-- Logs begin at Tue 2022-10-04 19:26:35 UTC, end at Tue 2022-10-04 21:41:53 UTC. -- Oct 04 20:02:18.711480 n-d-852085-12 systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 20:02:18.726268 n-d-852085-12 devstack@keystone.service[82427]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:02:18 2022] *** Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: nodename: n-d-852085-12 Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: machine: x86_64 Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: clock source: unix Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: pcre jit disabled Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: detected number of CPU cores: 4 Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: current working directory: / Oct 04 20:02:18.729475 n-d-852085-12 devstack@keystone.service[82427]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: your processes number limit is 47680 Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: your memory page size is 4096 bytes Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: detected max file descriptor number: 2048 Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: lock engine: pthread robust mutexes Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: thunder lock: enabled Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 20:02:18.730624 n-d-852085-12 devstack@keystone.service[82427]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:02:18.771971 n-d-852085-12 devstack@keystone.service[82427]: Python main interpreter initialized at 0x55e1929d49c0 Oct 04 20:02:18.771971 n-d-852085-12 devstack@keystone.service[82427]: python threads support enabled Oct 04 20:02:18.771971 n-d-852085-12 devstack@keystone.service[82427]: your server socket listen backlog is limited to 100 connections Oct 04 20:02:18.771971 n-d-852085-12 devstack@keystone.service[82427]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:02:18.772409 n-d-852085-12 devstack@keystone.service[82427]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:02:18.772521 n-d-852085-12 devstack@keystone.service[82427]: *** Operational MODE: preforking *** Oct 04 20:02:18.773979 n-d-852085-12 devstack@keystone.service[82427]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:02:18.773979 n-d-852085-12 devstack@keystone.service[82427]: spawned uWSGI master process (pid: 82427) Oct 04 20:02:18.773598 n-d-852085-12 systemd[1]: Started Devstack devstack@keystone.service. Oct 04 20:02:18.774414 n-d-852085-12 devstack@keystone.service[82427]: spawned uWSGI worker 1 (pid: 82439, cores: 1) Oct 04 20:02:18.774520 n-d-852085-12 devstack@keystone.service[82427]: spawned uWSGI worker 2 (pid: 82440, cores: 1) Oct 04 20:02:18.774739 n-d-852085-12 devstack@keystone.service[82427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:02:24.072180 n-d-852085-12 devstack@keystone.service[82440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:02:24.072180 n-d-852085-12 devstack@keystone.service[82440]: from cryptography.utils import int_from_bytes Oct 04 20:02:24.079606 n-d-852085-12 devstack@keystone.service[82440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:02:24.079606 n-d-852085-12 devstack@keystone.service[82440]: from cryptography.utils import int_from_bytes Oct 04 20:02:24.145613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:02:24.145888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:02:24.146122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] command line args: [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:02:24.146537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:02:24.146784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ================================================================================ {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:02:24.147117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] admin_token = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.147480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] config_dir = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.147745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.148038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] config_source = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.148314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] debug = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.148685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.149356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.149604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.149983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.150429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.150854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.151270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_config_append = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.151667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.151895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_dir = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.152193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_file = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.152556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.152928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.153299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.153675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.153950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.154221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.154590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.154978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.155351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.155702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.156054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.156406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.156769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.157121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.157501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.158081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.158289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] publish_errors = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.158602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.158891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.159095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.159440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.159728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.160029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] standard_threads = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.160310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.160603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.160867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.161185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] use_journal = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.161499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] use_json = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.161692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] use_stderr = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.161888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] use_syslog = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.162185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.162494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.162829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.163197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.163475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.163777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.164065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.164364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.164651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.164967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.165399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.165705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.165988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.166288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.166574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.166873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.167207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.167500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.167809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.168113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.168407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.168693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.168994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.169306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.169606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.169907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.170186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.170464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.170746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.171037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.171370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.171671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.171983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.172483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.172861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.173197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.173502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.173806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.174131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.174419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.174707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.175010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.175346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.175635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.175922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.176316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.176581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.176823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.177070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.177312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.177557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.177803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.178096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.178276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.179012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.181353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.183030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.183030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.183030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.183030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.183030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.184911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.185137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.185445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.185739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.186030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.186328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.186697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.187001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.187315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.187608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.187894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.188204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.188590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.188903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.189192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.189494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.189777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.190065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.190430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.190714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.191015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.191305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.191598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.191880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.192158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.192455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.192777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.193066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.193352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.193651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.194042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.194878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.195247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.195547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.195829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.external = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.196107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.196461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.196742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.197021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.password = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.197299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] auth.token = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.197584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.197869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.198162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.198446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.198742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.199035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.199348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.199634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.199933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.200230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.200563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.201071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.201405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.201694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.201992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.202293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.202582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.202929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.203412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.203620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.203905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.204194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.204499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.204787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.205069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.205393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.205688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.205966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.206277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.206571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.206871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.207171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.207496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.207776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.208073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.208359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.208651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.208952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.209233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.209517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.209897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.210173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.210457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.210756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.211053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.211394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.211735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.212020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.212346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.212645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.212948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.213251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.213549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.213868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.214153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.214436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.214713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.214996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.215322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.215611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.215899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.216184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.216481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.216757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.217112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.217512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.217890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.218382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.218945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.219321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.219692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.220036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.220407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.220755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.221139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.221505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.221925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.222289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.222583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.222878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.223193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.223575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.223974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.224317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.224659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.225007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.225387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.225734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.226143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.226481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.226914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.227308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.227657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.227994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.228330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.228667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.232949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.234167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.235817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.236177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.236483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.236792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.237105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.237426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.237746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.238055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.238376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.238696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.239000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.239348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.239660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.239974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.240282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] role.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.240872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] role.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.241709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.242029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.242346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.242666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.242981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.243334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.243653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.243998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.244319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.244625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.244957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.245263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.245603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.245922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.246546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.246882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.247245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.247579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.247901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.248229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.248542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.248871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.249198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.249511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.249824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.250133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.250438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.250763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.251217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.251551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.251860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.252165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.252529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.252836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.253142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.253457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.253764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.254098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.254413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.254721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.255036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.255385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.255731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.256043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.256365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.257217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.257543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.258013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.258435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.258745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.259069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.259433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.connection = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.259728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.260052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.260300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.260591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.260875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.261160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.261441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.261782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.262067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.262350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.262641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.262925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.263260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.263554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.263875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.264232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.264547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.264797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.264974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:02:24.295565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.295811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.296013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.305299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.334897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.335192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.395981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.456226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.456483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.642281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.642536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.642872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.643223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.643548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.643858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.680278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.680606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.680921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.681233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.681544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.681863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.682171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.695906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.715846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.716076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.716289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.716515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.716735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.716953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.717172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:24.734754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.734993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 20:02:24.735329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.735537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 20:02:24.735819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.736085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.736348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.736612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.746921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.747245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.747528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.747822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.755118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.758703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.758996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.759322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.759615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.759945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.760279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.760559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.760842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.761119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.761400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.761675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.785338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.786851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.787173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.792020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.792406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.792693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.799185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.799485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.805524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.805831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.806126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.806421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.806718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.807009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.807316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.807597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.824264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.824555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.828535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.831940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.834195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.837210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.840412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.843828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.844131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.844422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.844715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.845001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.845286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.861471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.862966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.862966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.862966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.870202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.871813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.873360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.873642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.875382 n-d-852085-12 devstack@keystone.service[82439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:02:24.875382 n-d-852085-12 devstack@keystone.service[82439]: from cryptography.utils import int_from_bytes Oct 04 20:02:24.876276 n-d-852085-12 devstack@keystone.service[82439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:02:24.876276 n-d-852085-12 devstack@keystone.service[82439]: from cryptography.utils import int_from_bytes Oct 04 20:02:24.876544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.876698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.876952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.877253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.877656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.889689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.891569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.891569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.891569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.891569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.891569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.892242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.907777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.910711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.914557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.917736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.920279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.920573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.921226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.927613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.928726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:02:24.929000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:02:24.931711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] command line args: [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ================================================================================ {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] admin_token = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] config_dir = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] config_source = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.931860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] debug = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.932903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.932903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.932903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.932903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.932903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.933517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.933652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.933796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.933949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_config_append = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.934080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.934224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.934356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.934489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_dir = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.934489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_file = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.934489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.934489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.935025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.935227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.935499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.935776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.936120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.936465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.936792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.937123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.937448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.937779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.938159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.938495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.938866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.939489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.939794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] publish_errors = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.940118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.940435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.940698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.941033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.941192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.941421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.941564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.941733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.941871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] standard_threads = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.942198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.942536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.942796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.943058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] use_journal = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.943380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] use_json = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.943643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] use_stderr = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.943915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] use_syslog = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.944283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:02:24.944635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.944964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.945315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.945674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.946028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.946361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.946703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.947031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.947424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.947766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.948117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.948445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.948783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.949110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.949415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:24.949415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.949779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.949970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.949970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.950325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.950512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.950718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.950905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.950905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.951286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.951473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.951662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.951866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.951866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.952220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.952406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.952406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.952774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.952972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.953158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.953325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:24.953495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.953495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.953933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.954277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.954622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.954963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.955348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.955711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.960372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.961759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.962777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.962777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.962777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.962777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.962777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.963465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.963618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.963962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.964299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.964633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.964955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.965306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.965635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.965962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.966287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.966653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.966980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.967338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.967679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.968029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.968392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.968724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.969068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.969407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.969745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.970075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.970404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.970741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.971070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.971429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.971775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.972104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.972443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.972773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.973129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.973488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.973822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.974148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.974497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.974827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.975211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.976115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.976461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.976794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.977122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.977450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.977779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.978226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.978497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.978823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.979179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.979496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.979827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.980165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.980505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.980833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.981177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.981528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.981856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.982186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.external = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.982508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.982897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.983274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.983598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.password = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.983922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] auth.token = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.984264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.984591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.984929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.985252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.985593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.985931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.986257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.986587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.986931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.987315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.987655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.987996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.988342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.988487 n-d-852085-12 devstack@keystone.service[82440]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1929d49c0 pid: 82440 (default app) Oct 04 20:02:24.988725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.989082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.989428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.989711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.990009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.990425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.991051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.991415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.991726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.992055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.992359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.992511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780b9-2286-4104-85a1-2d3a367f24cd None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:24.992656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780b9-2286-4104-85a1-2d3a367f24cd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:24.992796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.992936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780b9-2286-4104-85a1-2d3a367f24cd None None] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:24.993080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.993406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.993689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.994076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.994390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.994723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.995035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.995394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.995703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.996021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.996324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.996642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.996956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.997244 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Tue Oct 4 20:02:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:24.997410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.997708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.998127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.998540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.999307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.999460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:24.999816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.000745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.001149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.001532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.001966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.002339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.002760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.003190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.003808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.004186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.004511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.004832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.005153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.005493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.005890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.006353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.006761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.007061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.007432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.007741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.008349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.008730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.009096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.010426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.010426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.010426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.011012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.011252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.011560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.011940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.012324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.012699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.013137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.013579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.013999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.014322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.014600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.014897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.015298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.015633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.015972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.016516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.016918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.017321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.017663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.017970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.018503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.018794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.019233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.019617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.021069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.021069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.021069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.021778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.021778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.022662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.022967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.023371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.023805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.024187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.024588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.025009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.025358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.025627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.025877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.026167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.026592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.026888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.027218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.027463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.032733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.033218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.033449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.033870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.034294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] role.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.034725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] role.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.035127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.035558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.035891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.036209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.036522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.036840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.037165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.037481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.038593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.039005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.039474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.039910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.040260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.040576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.041264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.041688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.042105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.042464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.042855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.043346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.043706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.044126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.044549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.044969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.045371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.045793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.046131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.046442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.046997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.047288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.047631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.048058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.048462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.048852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.049167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.049486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.049779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.050220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.050654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.051061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.051524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.051948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.052267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.052567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.052865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.053226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.053725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.054224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.054627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.055059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.055506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.056267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.connection = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.056267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.056656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.057087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.057502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.057803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.058092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.058484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.058891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.059351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.059731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.060143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.060555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.061002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.061374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.061724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.062054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.062396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.062790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:02:25.063091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:02:25.099975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.100406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.101196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.114104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.136131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.136360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.181401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.218965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.219260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.359520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.359774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.359966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.360185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.360386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.360597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.374007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.374277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.374594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.374920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.375264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.375567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.375868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.385490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.393433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.393724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.394017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.394313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.394599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.394944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.395384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 20:02:25.407649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.407975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 20:02:25.408335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.408620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 20:02:25.408969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.409321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.409652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.410000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.420843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.421226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.421565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.421918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.429807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.433297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.433596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.433955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.434330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.434690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.435049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.435519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.435868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.436237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.436593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.436936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.462924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.464678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.465028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.469914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.470272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.470618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.477623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.477998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.482413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.482780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.483165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.483521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.483915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.486184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.486592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.487000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.504516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.504878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.510928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.514373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.515097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.519614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.523739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.527119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.527528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.527876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.528348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.528695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.529051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.545568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.545864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.546141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.546414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.553599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.555456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.557014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.557300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.560089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.560386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.560721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.561017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.561302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.573820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.576207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.591966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.595239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.598121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.600057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.601947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.602237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.602545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.609297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.610803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.613877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.614176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.614467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.614782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.623900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.627658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.627658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.631607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 20:02:25.633356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.633356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.633356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.633356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.635838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.636564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.636564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.636564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 20:02:25.670479 n-d-852085-12 devstack@keystone.service[82439]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e1929d49c0 pid: 82439 (default app) Oct 04 20:02:33.402279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:33.403036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:33.403036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:33.404192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:33.414314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:33.415421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:33.415421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:33.489395 n-d-852085-12 devstack@keystone.service[82439]: INFO dbcounter [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] Registered counter for database keystone Oct 04 20:02:33.514703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG oslo_db.sqlalchemy.engines [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:02:33.522509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writer thread running {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:02:33.752810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG passlib.handlers.bcrypt [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82439) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 20:02:33.753194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG passlib.handlers.bcrypt [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82439) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 20:02:33.812494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:33.814083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:33.949106 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1/3] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 20:02:34.410885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:34.482318 n-d-852085-12 devstack@keystone.service[82440]: INFO dbcounter [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] Registered counter for database keystone Oct 04 20:02:34.502166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG oslo_db.sqlalchemy.engines [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:02:34.509231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writer thread running {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:02:34.632740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaea6e6-6f24-4822-8dae-d383c16b4b57 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:34.637177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:34.637820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:34.638103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:34.638382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:34.647709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:34.700467 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 20:02:34.700817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94ead-aba8-46c2-a5c0-a27e41cda584 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:34.711738 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 4 20:02:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:02:34.718016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:34.745143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415addc8-1f61-41f6-aab6-2aabcb329e71 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:34.749707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:34.751030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:34.751344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:34.751625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] PATH_INFO: `/v3/projects/39207e776fb342b89ba6688e4c9f0eb3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:34.753224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] RBAC: Authorizing `identity:get_project(project_id=39207e776fb342b89ba6688e4c9f0eb3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:34.806708 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 20:02:34.807051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b3a02-2e54-480b-8b91-6cf098ffbedf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:34.811905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2/5] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 4 20:02:34 2022] GET /identity/v3/projects/39207e776fb342b89ba6688e4c9f0eb3 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:37.017503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326e9e4-c328-4af3-ab18-b968e8956ad4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:37.018023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326e9e4-c328-4af3-ab18-b968e8956ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:37.018023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326e9e4-c328-4af3-ab18-b968e8956ad4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:37.022337 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4/6] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:02:37.029242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:37.029821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:37.029821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:37.050996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:37.052634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:37.061231 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 20:02:37.330406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326e9e4-c328-4af3-ab18-b968e8956ad4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:37.342694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326e9e4-c328-4af3-ab18-b968e8956ad4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:37.347289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:37.347908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:37.348192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:37.348468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:37.357439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:37.359266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73051715-daba-4061-9c5a-7bdb676a0d5e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:37.369142 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 4 20:02:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:02:37.375089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:37.384384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93702d-1b97-4162-bd49-39359b1f1167 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:37.388884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:37.389525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:37.389809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:37.390089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:37.391448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:37.393309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda3f3-0174-4818-8ce4-c700958d50e6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:37.394883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4/9] 10.222.0.78 () {56 vars in 1198 bytes} [Tue Oct 4 20:02:37 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:39.669193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b877-cc16-4e1c-8872-67469cc08dfb None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:39.669782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b877-cc16-4e1c-8872-67469cc08dfb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:39.669782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b877-cc16-4e1c-8872-67469cc08dfb None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:39.671081 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:39.677056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:39.677563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:39.677638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:39.694520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2d8a-4991-4dc0-a549-7eeb54220796 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:39.694879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2d8a-4991-4dc0-a549-7eeb54220796 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:39.695265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2d8a-4991-4dc0-a549-7eeb54220796 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:39.696758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 7/11] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:02:39.697291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:39.698546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:39.703469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:39.703952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:39.704342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:39.752683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG passlib.handlers.bcrypt [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82440) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 20:02:39.753085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG passlib.handlers.bcrypt [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82440) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 20:02:39.793100 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 5/12] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:39.803106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:39.804800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:39.920558 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 8/13] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:02:40.058925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.084098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.168728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ec1f-d189-4f43-8aa8-616466b8fb44 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.206745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.207451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.207776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.207937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.208082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.225409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:02:40.234434 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:02:40.235655 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:02:40.236474 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 6/14] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:02:40.241791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.329002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.331758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cb000-01b4-4335-9a4a-a42027ab1f37 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.335302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.350603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b316d3-db63-425b-8cb2-61e5f1b2089f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.374146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.375067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.375356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.375631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.391278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.392129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.392529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.392918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.393797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:40.394185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.396062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:40.414975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 7/15] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:40.422087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.475717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.477180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:40.569246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806640c5-a120-45cf-a920-8fc10e3cb19c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.601440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:02:40.607240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.607457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.607990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.608267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.608540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.609761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.611221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.611375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:40.613039 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 8/17] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:40.619704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.637032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.747897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c716-4202-46e8-a46c-624249514d1e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.751451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6a837-7146-4224-953f-6c5e1a84a8c8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.784830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.785683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.785964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.786236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.788006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.788651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.788940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.789213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.790364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.791910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:40.793505 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 9/18] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:40.799479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.807003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.808555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:02:40.827736 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:02:40.829029 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:02:40.830368 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:02:40.830368 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:02:40.830368 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:02:40.830368 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 10/19] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:02:40.841530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:40.911292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.913519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:40.950964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b804c-f83a-4a80-902c-2392caeb4bca None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.973163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c0474-88ef-46c5-956e-90917d4e14ef None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:40.994792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:40.995505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:40.995782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:40.996056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:40.996821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.domain.id=default, user.id=555d4df795a04beda46e1d2e3837f96a) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:40.997131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:40.998739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd06111-0827-4232-9071-7ea17e205c8d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:41.007373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 10/20] 10.222.0.78 () {56 vars in 1322 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/role_assignments?user.id=555d4df795a04beda46e1d2e3837f96a&scope.domain.id=default&role.id=752f2c38dc7242cca4d4703d29369911 => generated 233 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:41.036442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:41.037592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:41.037935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:41.038360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:41.039641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:41.040192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:41.042977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921178f-dc03-4c14-9b22-6f006ee43a43 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:41.077159 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 11/21] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:43.970525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c8c4f-7b26-4e9d-a735-a917f9289a0e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:43.971295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c8c4f-7b26-4e9d-a735-a917f9289a0e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:43.971295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c8c4f-7b26-4e9d-a735-a917f9289a0e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:43.972708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 11/22] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:02:43.984378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124211c0-873a-4709-a54f-c74b0d9ac2d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:43.985209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124211c0-873a-4709-a54f-c74b0d9ac2d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:43.985209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124211c0-873a-4709-a54f-c74b0d9ac2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:44.016901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-124211c0-873a-4709-a54f-c74b0d9ac2d8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:44.018398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-124211c0-873a-4709-a54f-c74b0d9ac2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:44.176129 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 12/23] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:45.116623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e728-735d-49ca-bdd3-77891e7e5350 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.117396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e728-735d-49ca-bdd3-77891e7e5350 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.117777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e728-735d-49ca-bdd3-77891e7e5350 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.120338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 12/24] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:45.126934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.128364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.129171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.164771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:45.167276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:45.215412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e728-735d-49ca-bdd3-77891e7e5350 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:45.283796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:45.355336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 13/25] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:45.451472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e728-735d-49ca-bdd3-77891e7e5350 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:45.502287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:45.502938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.503256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.503653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.536730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6e4d0357-c7a6-4475-b6f6-ff006f9758a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:02:45.546692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:02:45.548115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:02:45.549373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 13/26] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:02:45.559281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:45.597712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ff8-dddb-45de-aa98-7e1f60c36862 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.598961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ff8-dddb-45de-aa98-7e1f60c36862 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.602784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ff8-dddb-45de-aa98-7e1f60c36862 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.607892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 14/27] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:45.630513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dd7bb-fae4-4330-86a8-b7ea48a0d8d1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.631563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dd7bb-fae4-4330-86a8-b7ea48a0d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.632055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dd7bb-fae4-4330-86a8-b7ea48a0d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.663584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:45.681252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-846dd7bb-fae4-4330-86a8-b7ea48a0d8d1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:45.683185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-846dd7bb-fae4-4330-86a8-b7ea48a0d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:45.849469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8145-6d83-447a-a85e-c487fb470791 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:45.952949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 15/28] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 20:02:45.956943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a68cd-0e74-4b27-971c-612a597457c7 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.962094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a68cd-0e74-4b27-971c-612a597457c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.964390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a68cd-0e74-4b27-971c-612a597457c7 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.967504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 16/29] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:45.978528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.980356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.981865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.989348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:45.995276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:45.996233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:45.997010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:45.998672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:46.000380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:46.003342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:46.040942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:46.043752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:46.046307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 14/30] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:46.047635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:46.184113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:46.314982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9e6ef-1c59-47e9-9c2a-e09bf6aa237d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:46.334056 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 17/31] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:46.335632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:46.398027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:46.399526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:46.400252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:46.401881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:46.403565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:46.406623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:46.529207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:46.639798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec881e97-5cce-44d5-83de-09cec6f33a9d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:46.738046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:46.739354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:46.739955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:46.741425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:46.748646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:46.751496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:46.755098 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 18/32] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:02:46 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:46.756940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:46.815587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 15/33] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 4 20:02:46 2022] POST /identity/v3/roles => generated 225 bytes in 769 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:46.817558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:47.050989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21937-75a9-4be7-aad3-5e3b90e0701d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:47.089339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:47.097458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c393-ecd9-4be3-a352-d3371305f214 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:47.116977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:47.127719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:47.129369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.129852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.130317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.153442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:47.156392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:47.185457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:47.186558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.187059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.187602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-587e80e4-36cd-4f53-b58a-8f3ba844b846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:02:47.189388 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:02:47.191011 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:02:47.192950 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:02:47.192950 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:02:47.192950 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:02:47.193777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:47.193908 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 19/34] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:02:47.194032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea168ba-768a-4e20-aa89-76d47532935e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:47.194620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8571f6f-0a1d-4ee8-b537-9a0b4a0c87bd None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.195026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8571f6f-0a1d-4ee8-b537-9a0b4a0c87bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.195541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8571f6f-0a1d-4ee8-b537-9a0b4a0c87bd None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.197966 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 20/35] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:47.199873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8571f6f-0a1d-4ee8-b537-9a0b4a0c87bd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:47.203763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 16/36] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:47.206357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5527a-a092-497e-8305-39b901899cd7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.206877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5527a-a092-497e-8305-39b901899cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.207467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5527a-a092-497e-8305-39b901899cd7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.211184 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 17/37] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:47.213280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5527a-a092-497e-8305-39b901899cd7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:47.391050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5527a-a092-497e-8305-39b901899cd7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:47.392117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8571f6f-0a1d-4ee8-b537-9a0b4a0c87bd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:47.453069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:47.454152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.454445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.456302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:47.456525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.456525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:47.456525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:47.456899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.456899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.456899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.457705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ce6db-020d-444d-a698-a64b6c0493df None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:47.458173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:47.462504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bb62d-eaea-421d-9213-0ff8e81725c2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:47.473095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 18/38] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:47.475365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17987-b278-460c-9111-5307184d844b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.475800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17987-b278-460c-9111-5307184d844b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.476219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b17987-b278-460c-9111-5307184d844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.496894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-02b17987-b278-460c-9111-5307184d844b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:47.498620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02b17987-b278-460c-9111-5307184d844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:47.526324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:47.584897 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 19/39] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:47.585895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b17987-b278-460c-9111-5307184d844b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:47.761356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b17987-b278-460c-9111-5307184d844b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:47.829406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:47.830449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.830907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.831412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] PATH_INFO: `/v3/domains/default/users/555d4df795a04beda46e1d2e3837f96a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.835745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=555d4df795a04beda46e1d2e3837f96a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:47.838313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:47.931011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 4 20:02:47 2022] POST /identity/v3/roles => generated 219 bytes in 727 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:47.931011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:47.931011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:47.931011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:47.960269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:47.962887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:47.989273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 20/41] 10.222.0.78 () {58 vars in 1361 bytes} [Tue Oct 4 20:02:47 2022] PUT /identity/v3/domains/default/users/555d4df795a04beda46e1d2e3837f96a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:02:47.998919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:48.060019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:48.072370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:48.141025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 22/42] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:48.142487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:48.196122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918428a-6f02-455d-9dae-25698452ce2d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:48.242086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:48.242739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:48.243027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:48.243345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:48.244066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:48.245625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:48.332616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298e7f-647f-44b7-92ae-fc0622f03634 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:48.376639 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 21/43] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:02:47 2022] POST /identity/v3/projects => generated 301 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:48.395430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:48.399172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:48.399172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:48.399172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:48.399172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:48.400357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:48.488916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 4 20:02:48 2022] POST /identity/v3/roles => generated 223 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:48.710528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:48.845877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:48.904751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e093-b2e6-4342-9956-4c223a03b703 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:48.957902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:48.959498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:48.959963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:48.960411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:48.962320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:48.964845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb8e6-567d-4a7c-97ad-d82c8f1c061b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:48.967767 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 22/45] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:48.976742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:49.040331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:49.156123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae769-5dd2-44a7-ad11-0331faf5e2fa None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:49.202258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:49.202989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:49.203379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:49.203726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:49.204514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:49.206204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb801086-25f6-4bc8-b8e7-432c19a4ad91 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:49.295881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:02:48 2022] POST /identity/v3/projects => generated 312 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:50.695633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af48fb-2306-452e-93bc-62fc94c311f2 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:50.696446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af48fb-2306-452e-93bc-62fc94c311f2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:50.696593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af48fb-2306-452e-93bc-62fc94c311f2 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:50.697987 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 23/47] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:50.704019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:50.704709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:50.704709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:50.727632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:50.728950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:50.820992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 25/48] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:51.089614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af48fb-2306-452e-93bc-62fc94c311f2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:51.217051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af48fb-2306-452e-93bc-62fc94c311f2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:51.258826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:51.259928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.260417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.260914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.267077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:51.282433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:02:51.294959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:02:51.295971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:02:51.296703 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:02:51.297439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 24/49] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:02:51.306523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:51.336229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:51.439083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba6811-4318-4d7c-95fd-ecc439b0d4e1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:51.483698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:51.484316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.484593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.484863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.485530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:51.485835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:51.487275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:51.496834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 26/50] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:51.502693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:51.620599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022097-02c0-4582-a079-497344a6d3ce None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:51.658431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:51.659075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.659400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.659682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.660848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:51.662394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c45e9-7e1c-40fa-ab21-d3fe6c5cf940 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:51.664224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 25/51] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:02:51 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:51.669842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:51.671458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291399-3b53-4d3a-b2c4-c78e0b0d4922 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.671836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291399-3b53-4d3a-b2c4-c78e0b0d4922 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.672201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20291399-3b53-4d3a-b2c4-c78e0b0d4922 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.673988 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 26/52] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:02:51.679861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.680154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.680438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.764977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:51.790070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73062a-fb57-45cb-bd34-b0b4d94c8b30 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:51.804791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:51.806326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:51.829463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:51.830115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.830410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.830689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.831891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:51.833383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:51.835599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 27/53] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:51.841510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:51.876182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:51.889636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 27/54] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:02:51.954552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995015b0-5c60-4af5-be67-4415c5ad0806 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:51.990627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:51.991530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:51.991813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:51.992086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:51.992824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.domain.id=default, user.id=555d4df795a04beda46e1d2e3837f96a) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:02:51.993133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:51.994737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:52.001344 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 28/55] 10.222.0.78 () {56 vars in 1322 bytes} [Tue Oct 4 20:02:51 2022] GET /identity/v3/role_assignments?user.id=555d4df795a04beda46e1d2e3837f96a&scope.domain.id=default&role.id=752f2c38dc7242cca4d4703d29369911 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:02:52.168326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:52.283453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbea2-0821-4c0e-92af-dfe488e6cd71 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:52.321386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:52.322026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:52.322310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:52.322590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:52.323757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:52.325239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dd046-9a69-4e9b-b676-802014dd21d8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:52.326823 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 28/56] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:52.332625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:52.346334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:52.445385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7903cf-8ef1-4fad-add1-cd453aa578bb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:52.483645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:52.484278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:52.484559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:52.484883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:52.485558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:52.487207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f688-a2f9-4ae6-84a2-ece07e6be8c1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:52.609538 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 29/57] 10.222.0.78 () {60 vars in 1140 bytes} [Tue Oct 4 20:02:52 2022] POST /identity/v3/projects => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:54.859923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc7cb-1e03-44b5-bb4a-07f8c6208356 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:54.860442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc7cb-1e03-44b5-bb4a-07f8c6208356 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:54.860527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc7cb-1e03-44b5-bb4a-07f8c6208356 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:54.861826 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 29/58] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:54.868315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:54.868782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:54.868866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:54.887883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:54.889086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:54.946184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:54.955850 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 30/59] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:55.223561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc7cb-1e03-44b5-bb4a-07f8c6208356 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:55.284479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:55.324405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc7cb-1e03-44b5-bb4a-07f8c6208356 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:55.356815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:55.357439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:55.357719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:55.358001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:55.359109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:55.360578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f5bf-7195-47d0-8967-9b28d0996a26 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:55.362131 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 30/60] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:02:55.368719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:02:55.468046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c792-399b-422a-8ee6-028d681def08 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:02:55.503716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:02:55.504239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:55.504518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:55.504790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:55.505488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:02:55.506943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8812f-21fb-41cb-b801-5f68bf61a378 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:02:55.659470 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 31/61] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:02:55 2022] POST /identity/v3/users => generated 275 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:02:59.290406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38573abe-97ab-443f-b390-136e4fa10585 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:59.291347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38573abe-97ab-443f-b390-136e4fa10585 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:59.291844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38573abe-97ab-443f-b390-136e4fa10585 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:59.293393 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 31/62] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:02:59.299342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf28b0-580c-4f86-b951-e88800306792 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:59.300201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf28b0-580c-4f86-b951-e88800306792 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:59.300642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf28b0-580c-4f86-b951-e88800306792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:59.328310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-addf28b0-580c-4f86-b951-e88800306792 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:59.329939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-addf28b0-580c-4f86-b951-e88800306792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:59.425943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:59.433106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6405-3f4f-4a74-9419-702b1daf1c1c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:59.434071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6405-3f4f-4a74-9419-702b1daf1c1c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:59.434845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6405-3f4f-4a74-9419-702b1daf1c1c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:59.438244 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 32/63] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:02:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:02:59.449944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:02:59.454883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:02:59.454883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:02:59.487913 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 32/64] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:02:59.496824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:02:59.499283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:02:59.625231 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 33/65] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:00.029571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf28b0-580c-4f86-b951-e88800306792 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:00.119675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:00.282890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf28b0-580c-4f86-b951-e88800306792 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:00.311176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:00.342115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:00.343461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.344724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.345182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.359995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-bde53b32-19e6-4eef-bfba-fb54c3428124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:00.366202 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:00.368426 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 33/66] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:00.370050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434875d-c5bb-4caa-9afe-d847fcf91f55 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.371712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434875d-c5bb-4caa-9afe-d847fcf91f55 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.371712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434875d-c5bb-4caa-9afe-d847fcf91f55 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.371712 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 34/67] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:00.377704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37b26-d93d-4aca-b9b7-6799b6df13bd None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.378229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37b26-d93d-4aca-b9b7-6799b6df13bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.378652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e37b26-d93d-4aca-b9b7-6799b6df13bd None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.380266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 35/68] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:00.381543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec747-37c0-41d3-b46f-ed5de3696785 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.382025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec747-37c0-41d3-b46f-ed5de3696785 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.382447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ec747-37c0-41d3-b46f-ed5de3696785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.394921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e60a4-9d45-44b4-b8f6-beab596d52b0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:00.405951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b11ec747-37c0-41d3-b46f-ed5de3696785 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:00.407597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b11ec747-37c0-41d3-b46f-ed5de3696785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:00.445602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:00.447987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:00.448765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.449155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.449531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.466402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:00.473232 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:00.475922 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:00.477544 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:00.481145 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:00.482943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:00.512630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:00.512630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.512630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.512630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.549520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:00.551560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:00.655699 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 37/71] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:00.657673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:00.657935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004fdda-fd40-4e13-a160-3553dcbe9885 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:00.707752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:00.736222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:00.737708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.738418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.739108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.741575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:00.742473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:00.745201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a6ca1-1dea-4d75-9d3b-f0b5c32477f4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:00.766132 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 35/72] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:00.770171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c84e8-e0de-42e9-b895-d6a98fab7f43 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.771021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c84e8-e0de-42e9-b895-d6a98fab7f43 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.771742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c84e8-e0de-42e9-b895-d6a98fab7f43 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.774646 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 36/73] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:00.776615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c84e8-e0de-42e9-b895-d6a98fab7f43 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:00.884122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:00.890993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e37693-bb31-4c42-b082-28127dacf762 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:00.965613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:00.967391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.968123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:00.968898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:00.971307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:00.972331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:00.976337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cec7-78eb-4abe-a06e-b4813dbe9e98 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:00.995500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c84e8-e0de-42e9-b895-d6a98fab7f43 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:00.996671 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 38/74] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:00.999199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:00.999685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.001670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.027123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:01.029213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:01.048537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.049207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.049639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.050043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.051808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:01.053658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:01.055500 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:00 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:01.056465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.126931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:01.136701 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 39/76] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:01.137550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.214657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc983-528c-4f31-8513-38a6bc28c392 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.277344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.278398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.278897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.279444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.281464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:01.281924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:01.284740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:01.291406 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 38/77] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:01.291406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.301043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccde7e-a540-42ae-9803-804aceefdb9c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.359380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.360497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.360992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.362036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.388660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:01.391341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:01.394457 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 40/78] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:01.394457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.464763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6336-f83e-48e9-b714-c1de56de9b94 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.493449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:01.521135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.522132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.522661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.523190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.532145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d29a2-651b-4365-a5fb-045a478dcbdf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.576351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.577073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.577387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.577671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.590794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:01.596094 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:01.597742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 41/79] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:01.600006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.617811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:01.630154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:01.635899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:01.741549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277b32-32c0-48d1-b7a9-180d0c09fe0e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.766718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 39/80] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:01.768470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.790638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.791648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.792118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.792582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.793583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:01.796407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:01.803591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:01.901737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 42/81] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:01 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:03:01.903663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:01.921557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51134b67-fb3c-44d5-9465-1e395f57e56e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:01.978119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:01.979370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:01.980408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:01.981148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:01.983700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.041054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af121e-eae5-4f79-8f55-905dda342d19 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.100251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.100931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.101236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.101532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.108798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.112443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.115769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:02.121830 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:02.122857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:02.124051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 43/82] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:02.124885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.147549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.283819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67160f-3915-4563-9511-fe3d9e5f482e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.290691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 40/83] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:02.290950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.329079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.345625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.347614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.347614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.347614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.348047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:02.348758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.349775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.366353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 44/84] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:02.368909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.467187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d62fb-a593-4e59-b004-3cd6f98a0daf None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.502118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.528820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.529511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.529858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.530193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.532591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.535440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.538363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 41/85] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:02.539771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.542063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e157a0-5f00-499c-9b41-3a6b2edbccbb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.593501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.594669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.595203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.595581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.596724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:02.597326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.600000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.617470 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 45/86] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:02.618986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.707464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.719364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a423ada-6fb4-435e-a2be-88f935203c97 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.785791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bf5d0-c123-4b61-b172-8b33b04b10cf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:02.787310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.788965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.789522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.790671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.792839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.796242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.799637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 42/87] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:02.801485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.832425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:02.833094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:02.833482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:02.834267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:02.836430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:02.837975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:02.840702 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 46/88] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:02.845487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:02.901105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:02.959853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450555-c4c5-418c-85fd-02e315bc0937 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:03.002422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:03.003440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:03.003876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:03.004300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:03.005786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=555d4df795a04beda46e1d2e3837f96a) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:03.006288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:03.008231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:03.018842 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 43/89] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/role_assignments?user.id=555d4df795a04beda46e1d2e3837f96a&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:03.024821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4999e8-69a8-4853-b2d4-4ec3bbe3fff3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:03.024993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:03.065662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:03.133690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:03.134414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:03.134704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:03.134982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:03.137474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:03.139016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:03.147537 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 47/90] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:02 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:03.148896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:03.304026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f1605-a1af-4690-ae04-6e9d289fd9ee None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:03.329725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a68f-7276-4b42-8c24-f20667c9c271 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:03.344828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:03.381501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:03.382445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:03.382780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:03.383095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:03.401580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:03.402846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:03.403538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:03.404766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:03.405453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:03.406009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:03.416906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:03.430740 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 44/91] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:03 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=85251621622246e79e839f870f6d411d => generated 259 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:03.432112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:03.453287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:03.478372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:03.480652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:03.783045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1e24b-87f0-46d5-a95b-9febc53b15bf None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:03.812966 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 48/92] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:03.824477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:03.881168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:03.881847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:03.882134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:03.882421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:03.996465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:04.031359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:04.034373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:04.047677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:04.074966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ca238-09cf-418e-b522-b367d5207daf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:04.155244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:04.155914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:04.156196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:04.156471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:04.158572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:04.160160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:04.162068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 49/93] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:03 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:04.171524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:04.249813 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 45/94] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:04.258781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:04.441000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:04.484418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c9b5b-edab-42e5-b9d0-ad973944a33b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:04.505871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed084-fe6e-4f5d-8195-8c44e411c34a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:04.590889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:04.591560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:04.591854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:04.592128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:04.592879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:04.593196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:04.594780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:04.607903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 50/95] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:04 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 259 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:04.614579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:04.615525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:04.616236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:04.616532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] PATH_INFO: `/v3/projects/a108e281162b4b89a4cacdc36d4eea4c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:04.624213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=a108e281162b4b89a4cacdc36d4eea4c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:04.625721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bec22-344d-4f03-8fe7-e9c9a5637dc9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:04.627594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 46/96] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:04 2022] GET /identity/v3/projects/a108e281162b4b89a4cacdc36d4eea4c => generated 312 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:04.634129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:04.664184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:04.812217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95e543-37eb-45f1-84cd-6664050a4d4e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:04.862831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:04.863553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:04.863840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:04.864121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:04.865011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=a108e281162b4b89a4cacdc36d4eea4c, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:04.865329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:04.867216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c707ce3-96c5-4674-a771-c743c2665985 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:04.883338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 51/97] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:04 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=a108e281162b4b89a4cacdc36d4eea4c&role.id=85251621622246e79e839f870f6d411d => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:05.330684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85207-f217-4da1-9035-c72671f45195 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:05.331293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85207-f217-4da1-9035-c72671f45195 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:05.331293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85207-f217-4da1-9035-c72671f45195 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:05.332864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 47/98] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:05.342770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384a7-e1f2-463a-8450-6bf58782b62c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:05.343325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384a7-e1f2-463a-8450-6bf58782b62c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:05.343829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384a7-e1f2-463a-8450-6bf58782b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:05.399020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-98d384a7-e1f2-463a-8450-6bf58782b62c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:05.401176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-98d384a7-e1f2-463a-8450-6bf58782b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:05.501141 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 52/99] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:06.115627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29202-4bcd-4e3b-913a-4105e184fb4c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:06.116254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29202-4bcd-4e3b-913a-4105e184fb4c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:06.116455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f29202-4bcd-4e3b-913a-4105e184fb4c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:06.118036 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 48/100] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:06.124032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:06.124639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:06.125133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:06.155829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:06.157473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:06.164691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:06.264332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 53/101] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 20:03:06.429164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29202-4bcd-4e3b-913a-4105e184fb4c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:06.681717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f29202-4bcd-4e3b-913a-4105e184fb4c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:06.765218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:06.766011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:06.766305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:06.766590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:06.788493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:06.794288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:06.796856 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:06.798723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 49/102] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:06.809704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:06.918452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:06.956229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:07.037942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b31afe-7ad7-4d1a-8842-f88533f8011e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:07.101182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:07.101826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:07.102101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:07.102435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:07.103125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:07.103541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:07.105791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608fb75-e619-4bad-a8ef-d3847effd723 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:07.116708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 54/103] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:07.118109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45811-76d1-441d-8794-889de1ab4dba None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:07.118966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45811-76d1-441d-8794-889de1ab4dba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:07.119284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45811-76d1-441d-8794-889de1ab4dba None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:07.121178 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 55/104] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:07.127370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:07.127735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:07.127978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:07.136275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:07.155779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:07.158579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:07.298954 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 56/105] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:07.300145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:07.361833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe281f9-4c99-4c6f-8ced-e1e7f11563dd None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:07.520035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:07.521325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:07.521325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:07.521781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:07.523356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:07.525136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:07.527378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 50/106] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:07.544461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:07.658689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a038be-a1df-4748-a074-4ea77215126d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:07.774721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:07.792701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:07.793391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:07.793676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:07.793958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] PATH_INFO: `/v3/users/6713910a5e2c45fe85517a913c06015e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:07.821832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] RBAC: Authorizing `identity:get_user(user_id=6713910a5e2c45fe85517a913c06015e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:07.823433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:07.825484 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 57/107] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:07 2022] GET /identity/v3/users/6713910a5e2c45fe85517a913c06015e => generated 289 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:07.835880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:07.870223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:07.959699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1fa57-46d5-4333-8450-c2f8b46eeab2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.039091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de737fc-f237-4acb-81b9-68fffe1285b9 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.104305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.105337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.106048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.106772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.108243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:08.115225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:08.125596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.126682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.127216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.127735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.235807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:08.258414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:08.261552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:08.270042 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 51/108] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:03:07 2022] POST /identity/v3/projects => generated 302 bytes in 726 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:03:08.271580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:08.456690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388e0c9-408e-4a96-99ea-646bef5c6925 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.480556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 58/109] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:08.487083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:08.525636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:08.537849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.539002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.541056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.541056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.576479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:08.589070 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:08.589982 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:08.590780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:08.595127 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 52/110] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:08.603588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:08.684188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:08.701587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73130c4-ace5-4e9c-ae5a-ffa6c8b68353 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.758666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.759543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.759829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.760597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.762129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:08.763966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f7ee4-00b4-4a63-ae40-afcdba258b2b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:08.766343 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 59/111] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:08 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:08.767771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00951-b9b4-4fea-9e2e-8fe261bb315b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.768085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00951-b9b4-4fea-9e2e-8fe261bb315b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.768371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d00951-b9b4-4fea-9e2e-8fe261bb315b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.770080 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 60/112] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:08.775744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d00951-b9b4-4fea-9e2e-8fe261bb315b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:08.798316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bef8-8c60-4b12-b2d6-b3725ad7f971 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.853149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.853781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.854108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.854431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.855163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:08.855498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:08.856943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35da74-c755-4290-9110-04cbc74b0604 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:08.867307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 53/113] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:08.868683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed5eb3-25b2-4182-98d6-8fda99e1bc2e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.869101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed5eb3-25b2-4182-98d6-8fda99e1bc2e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.869380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed5eb3-25b2-4182-98d6-8fda99e1bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.889688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5fed5eb3-25b2-4182-98d6-8fda99e1bc2e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:08.891226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5fed5eb3-25b2-4182-98d6-8fda99e1bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:08.927616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d00951-b9b4-4fea-9e2e-8fe261bb315b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:08.948532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:08.975980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 54/114] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:08.977604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced072fa-974f-456b-ab03-37bde50a4d86 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.978057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:08.978788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:08.979037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.979347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.980220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=6713910a5e2c45fe85517a913c06015e) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:08.980539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:08.982168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:08.987765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced072fa-974f-456b-ab03-37bde50a4d86 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:08.988180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced072fa-974f-456b-ab03-37bde50a4d86 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:08.989375 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 61/115] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:08 2022] GET /identity/v3/role_assignments?user.id=6713910a5e2c45fe85517a913c06015e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:08.990767 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 55/116] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:08.991337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:09.000656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.001352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.007799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.026081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:09.044338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:09.045578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:09.127434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794dd4-00b0-440b-9c01-21afd33ec3b0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:09.171035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:09.171827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.172211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.172491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.173841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:09.175445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:09.177208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 62/117] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:08 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:09.182024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 56/118] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:09.185375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:09.386352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:09.404786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33345b-61af-492f-913d-325ef32676ec None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:09.417315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:09.477870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:09.478567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.478844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.479173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.480761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:09.485051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:09.487858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 63/119] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:09 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:09.494319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:09.679016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2141856-64e7-4286-951a-0b770e3743e8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:09.725257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e9cb2-c2b8-4db9-bfd4-ba1a2fe9e87a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:09.726037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:09.726626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.726913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.727239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/users/555d4df795a04beda46e1d2e3837f96a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.729405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, user_id=555d4df795a04beda46e1d2e3837f96a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:09.731408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:09.758016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:09.797841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:09.799001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.799556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.800123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.822510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-57870adf-152a-4da6-a837-e474c71e3883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:09.832839 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:09.835706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:09.837242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 57/120] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:09.844576 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 64/121] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:09 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/users/555d4df795a04beda46e1d2e3837f96a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:09.846643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:09.846821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570190-4b8c-4ef9-8f57-a348958abdf1 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.847250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570190-4b8c-4ef9-8f57-a348958abdf1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.847713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570190-4b8c-4ef9-8f57-a348958abdf1 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.850517 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 58/122] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:09.860860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:09.862488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:09.863879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:09.905987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:09.926570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:09.928959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:10.138236 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 59/123] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:10.138978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:10.155250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855824f0-50d0-4284-80c0-7e74b6959957 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:10.266778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c324f1-0cd7-4413-b66d-53d91458a342 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:10.266778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:10.269608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:10.271115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:10.271999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:10.272788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:10.311930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:10.312196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:10.313631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:10.314462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:10.315260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:10.316795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:10.321276 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:10.322917 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:10.324438 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 65/124] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:10.326695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:10.330474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:10.330683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:10.362539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 60/125] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:10.373003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:10.635549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:10.710520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea51dee-fab7-4022-87a1-b76c83c1f48a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:10.721581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ca3a-8e63-4add-8dab-0f2224fa864f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:10.771995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:10.773211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:10.773661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:10.774113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:10.779025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:10.780692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:10.784705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 61/126] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:10 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:10.791970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:10.814889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:10.816063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:10.816580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:10.817086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:10.819929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:10.820498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:10.824044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:10.843127 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 66/127] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:10.844422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:10.879663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:11.042823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadee36-f671-4c5d-93e7-31ae39ac8fff None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.085352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.086801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.087098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.087405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.101066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:11.107602 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:11.109371 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 62/128] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:11.110964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:11.166611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46654-2afd-499c-8cc9-d84a4179049b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.239752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:11.252906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aed953-c86f-4f6b-b8e6-9fb6e5a66d9f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.289150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.289814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.292322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.292964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.299481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:11.301033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:11.302884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 67/129] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:10 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:11.303715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:11.344998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:11.350898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.352062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.352561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.353074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.357138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:11.360095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:11.366951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 63/130] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:11 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:11.374389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:11.530405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca7a0-77e7-4367-b839-ae8e67ce3cf8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.534898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5e4-568d-47d8-be94-8987997135e6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.567038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.567683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.567972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.568324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/users/05f0e63e9e434568841950a396b5e81e/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.570548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, user_id=05f0e63e9e434568841950a396b5e81e, role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:11.572065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:11.628685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.629706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.630265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.630803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.632060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:11.632662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:11.635463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:11.653659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 68/131] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:11.655177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:11.700923 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 64/132] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:11 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/users/05f0e63e9e434568841950a396b5e81e/roles/8a3388bd801d479ebdabb84cd8065882 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:03:11.715903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:11.763827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:11.805095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:11.871651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30766000-7ad2-49db-a725-e0dc014754ec None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.954918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:11.955982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:11.956451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:11.956919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:11.960473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:11.962454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9d75b-c9b2-401c-aace-ef580ffb20ad None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:11.963169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:11.966638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 69/133] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:11 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:11.978443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:12.056386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:12.057061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.057433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.057829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.060729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:12.062329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:12.068134 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 65/134] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:11 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:12.077437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:12.221785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3452df-80b8-4825-a831-b49d0acebfd0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:12.298498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:12.299229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.299514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.299790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/users/05f0e63e9e434568841950a396b5e81e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.301995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, user_id=05f0e63e9e434568841950a396b5e81e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:12.304759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:12.309577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:12.321154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeb7d3-13ce-43b0-be20-b1f80bd7fe16 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:12.361350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:12.362123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.362406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.362681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] PATH_INFO: `/v3/projects/a108e281162b4b89a4cacdc36d4eea4c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.364020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] RBAC: Authorizing `identity:get_project(project_id=a108e281162b4b89a4cacdc36d4eea4c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:12.365598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79508a71-8e74-44e3-b79e-748a09247829 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:12.368037 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 66/135] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:12 2022] GET /identity/v3/projects/a108e281162b4b89a4cacdc36d4eea4c => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:12.372484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290c03-09ee-4bf1-8d5a-7e5f92da9cde None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.372484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290c03-09ee-4bf1-8d5a-7e5f92da9cde None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.372484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290c03-09ee-4bf1-8d5a-7e5f92da9cde None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.372484 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 67/136] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:12.376998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.377343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.377576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.398209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:12.399599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:12.399932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:12.410881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 70/137] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:11 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/users/05f0e63e9e434568841950a396b5e81e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:03:12.411962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:12.510598 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 68/138] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:12.704578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1ff54-7db6-449f-ba7c-978fabea5a29 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:12.786502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:12.788178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:12.788941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:12.789682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] PATH_INFO: `/v3/projects/a108e281162b4b89a4cacdc36d4eea4c/users/05f0e63e9e434568841950a396b5e81e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:12.797602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a108e281162b4b89a4cacdc36d4eea4c, user_id=05f0e63e9e434568841950a396b5e81e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:12.800706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:12.921483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 71/139] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:12 2022] PUT /identity/v3/projects/a108e281162b4b89a4cacdc36d4eea4c/users/05f0e63e9e434568841950a396b5e81e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:03:12.981202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:13.105100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:13.123060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0ecb-6dc7-4f9d-846f-d2ae1400813e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:13.167017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:13.167804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.168158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.168538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.169880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:13.171501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad2782-b650-42cc-a1c6-92e87a85c55f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:13.173620 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 69/140] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:13.179945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:13.198930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd722f8-1cae-4de3-93b2-85b769658e7d None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.199396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd722f8-1cae-4de3-93b2-85b769658e7d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.199821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd722f8-1cae-4de3-93b2-85b769658e7d None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.201387 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 70/141] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:13.207373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.207783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.208465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.236204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:13.237440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:13.394196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:13.394923 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 71/142] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:13.482837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293dbe-996f-4b7f-a624-6398978701b1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:13.538123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:13.538772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.539050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.539351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.540051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:13.541621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7271f16-2d05-4f17-8840-bfb76babc1b4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:13.720145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:13.737404 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 72/143] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:13 2022] POST /identity/v3/users => generated 283 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:03:13.739931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2e0d-4ad2-4961-9d0b-e34c06fe0256 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.740466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2e0d-4ad2-4961-9d0b-e34c06fe0256 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.740940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d2e0d-4ad2-4961-9d0b-e34c06fe0256 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.743812 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 73/144] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:13.752217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:13.752570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:13.752920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:13.790989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:13.793608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:13.902894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:13.946349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00668bf5-e573-48da-a873-6722eb54ca7f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:13.974609 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 74/145] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:14.011003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:14.011733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:14.011990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:14.012318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:14.029304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:14.034519 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:14.035570 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:14.036980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 72/146] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:14.045601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:14.122940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:14.224791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f788eb-83f1-479a-bcd2-f696e00e2c7f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:14.313917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:14.314958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:14.315446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:14.315910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:14.317163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:14.317738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:14.320440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:14.341619 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 75/147] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:14.349418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:14.502982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53d8f-085e-4733-a827-365db0067f89 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:14.556815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:14.557981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:14.558518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:14.559090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] PATH_INFO: `/v3/users/6713910a5e2c45fe85517a913c06015e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:14.560810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=6713910a5e2c45fe85517a913c06015e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:14.562643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:14.564755 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 73/148] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:14 2022] GET /identity/v3/users/6713910a5e2c45fe85517a913c06015e => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:14.572111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:14.676936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:14.705757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:14.766411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecf04-8038-4710-b8ec-c2c32590d2a7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:14.779541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:14.858564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f08c-fb9c-44bd-90bf-3a2f382ef2b7 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:14.885362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:14.886454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:14.886922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:14.887424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:14.892471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:14.895359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:14.904714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:14.904907 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 76/149] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:14 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:14.905676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:14.905958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:14.906229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:14.912695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:14.926634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:14.933161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:14.934069 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:14.934861 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 74/150] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:14.942970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:15.101163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:15.210377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680c32-4ef7-427f-b256-5b0130a44091 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:15.293813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01930ab-0b49-4a5a-bb61-ebe445b45142 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:15.337103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:15.338126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.338610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.339086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:15.340086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:15.340606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:15.342425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:15.358564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 75/151] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:15.366404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:15.404669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:15.409275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.409901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.410436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/users/6713910a5e2c45fe85517a913c06015e/roles/4f2a6ebe135c4adbaca12bc3667dd6cf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:15.415760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, user_id=6713910a5e2c45fe85517a913c06015e, role_id=4f2a6ebe135c4adbaca12bc3667dd6cf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:15.419533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:15.516451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 77/152] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:14 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/users/6713910a5e2c45fe85517a913c06015e/roles/4f2a6ebe135c4adbaca12bc3667dd6cf => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:03:15.607028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9d62-45e3-4983-8297-87b0dee34ab0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:15.694179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:15.695273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.695764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.696243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] PATH_INFO: `/v3/users/555d4df795a04beda46e1d2e3837f96a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:15.704647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] RBAC: Authorizing `identity:get_user(user_id=555d4df795a04beda46e1d2e3837f96a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:15.707606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4329-9829-4135-8be1-29756ac3845c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:15.711549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 76/153] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:15 2022] GET /identity/v3/users/555d4df795a04beda46e1d2e3837f96a => generated 247 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:15.717548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:15.786547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:15.897665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4c0f-054d-4618-9a1d-8cc94e168e71 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:15.944248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:15.945281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.945850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.946295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:15.972655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f517a-16ce-4f09-af3e-c29b67780315 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.973142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f517a-16ce-4f09-af3e-c29b67780315 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.974268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f517a-16ce-4f09-af3e-c29b67780315 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:15.982717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 77/154] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:15.989344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:15.989799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:15.990245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:16.011655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:16.042743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:16.045810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:16.101498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:16.105582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:16.215364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:16.293384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 78/155] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:16.370243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 78/156] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:16.376954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:16.766969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f688732-6daa-48d5-af0b-dd6486b596a0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:16.877178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:16.904478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:16.905497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:16.905984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:16.906467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:16.908802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:16.912444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:16.916691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 79/157] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:16 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:16.923818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:17.150031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:17.157328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972b8d6-d1e6-4f67-8f31-787638982c47 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:17.220986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:17.221681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:17.222333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:17.222621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:17.223649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=555d4df795a04beda46e1d2e3837f96a) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:17.223970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:17.225495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dcf4f-9bd2-4a37-b480-640abd4babb6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:17.229465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:17.237801 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 79/158] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:16 2022] GET /identity/v3/role_assignments?user.id=555d4df795a04beda46e1d2e3837f96a&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:17.373387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9f69-6180-48b3-98a4-86ee45497961 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:17.373722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9f69-6180-48b3-98a4-86ee45497961 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:17.374201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9f69-6180-48b3-98a4-86ee45497961 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:17.375758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 80/159] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:17.392550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:17.392945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:17.393179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:17.423930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:17.425084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:17.542734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118421-50b5-4382-bd9e-f03c461cade8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:17.546102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 81/160] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:17.641611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:17.642704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:17.643213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:17.643696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:17.684177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:17.687245 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:17.689250 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:17.690979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 80/161] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 539 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:17.700654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:17.865573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4c51-b1ba-49f2-8148-a2a561dafda4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:17.906770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:17.918111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:17.918772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:17.922877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:17.922877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:17.922877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:17.922877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:17.922877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:17.936804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 82/162] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:17.943035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:18.029626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:18.080724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222075-fea0-4a68-b402-32368d575311 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:18.130620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:18.131373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:18.131657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:18.131936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:18.133364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:18.135106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:18.137055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:18.139468 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 81/163] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:17 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:18.145083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:18.399080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f802c4-5c45-48e9-b3cd-31c2503d877c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:18.463824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0edd-82ee-4b63-b94b-7a4b9d70d72f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:18.504821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:18.525257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:18.525920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:18.526210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:18.526522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:18.566043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:18.568394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:18.569123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:18.570198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:18.606088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:18.618754 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:18.620430 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:18.621948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:18.628770 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 83/164] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:18.636674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:18.776109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:18.777677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:18.793471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:18.933318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64d7ed-eb95-4f40-a97b-1d1de814a101 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:19.005944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:19.008217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.009679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.010518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.012446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:19.013301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:19.016675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:19.036752 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 84/165] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:19.045747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:19.076124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 82/166] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 931 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:03:19.083936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:19.187325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:19.362932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d6e1-7f28-4916-9999-ec0ae6330f83 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:19.383097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db015b-f96b-477d-9212-1a666e2679dd None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:19.407973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:19.475968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:19.476679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.477058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.477336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.478650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:19.480311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1659fa-124e-4e30-bf53-bfedac2b55f1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:19.482167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 83/167] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:19 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:19.483438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1c7-8bb4-4d7e-a4d5-55293918ee59 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.483718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1c7-8bb4-4d7e-a4d5-55293918ee59 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.483995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d1c7-8bb4-4d7e-a4d5-55293918ee59 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.485285 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 84/168] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:19.491513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.492298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.492298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.504386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:19.506015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.506583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.506951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.512494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:19.515186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:19.518311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 85/169] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:19 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:19.519756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:19.536550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:19.537969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:19.709217 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 85/170] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:19.710121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:19.760392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:19.765652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cace00-4fb7-45c8-9a01-aa2155afad67 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:19.835830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:19.837671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:19.840129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:19.841468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:19.844776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:19.846517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:19.850391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:19.879719 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 86/171] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:19 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:19.930940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa74fe-91ed-4cee-810b-ca5f82623dc9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:20.026690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:20.027602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:20.028067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:20.028516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:20.191797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:20.195084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:20.260395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:20.315011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:20.447549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:20.479396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 86/172] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:20.488557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:20.581832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d3a53-fb78-43e2-88e3-9e4f7325067c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:20.667538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:20.668647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:20.668995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:20.669420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:20.698899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:20.713824 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:20.714989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:20.715850 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:20.716511 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 87/173] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:20.727453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:20.866720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c68b79-f9d1-4f41-a2db-69e822611ff5 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:20.931121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbe9d-46ad-41d6-9b19-251f7860bf4a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:20.960031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:20.961766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:20.989802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:20.991020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:20.991855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:20.992011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:20.995687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:20.997399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc704f8-607f-46c8-865f-a720d0ad8736 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:21.002689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:21.003914 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 87/174] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:20 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:21.005146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.006105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.006884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.008467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:21.009266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:21.011226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb653a-4ef6-413d-945b-65432b76fcdd None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.012713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb653a-4ef6-413d-945b-65432b76fcdd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.013028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb653a-4ef6-413d-945b-65432b76fcdd None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.014137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8c45c-cfd2-4659-b2f9-84ef7c184830 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:21.017636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 88/175] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:21.018692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb653a-4ef6-413d-945b-65432b76fcdd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:21.035402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 88/176] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:21.045375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.046408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.047337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.084797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:21.086855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:21.208015 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 89/177] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:21.209913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:21.227661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb653a-4ef6-413d-945b-65432b76fcdd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:21.295727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:21.296803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.297465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.297955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.299373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:21.299896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:21.303503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cff2ff-8f78-4594-95ed-6937edc9ff0a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:21.316367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 89/178] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:21 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=85251621622246e79e839f870f6d411d => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:21.318639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20be5-e539-4706-a7f2-31d64c31342a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.319174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20be5-e539-4706-a7f2-31d64c31342a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.319652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20be5-e539-4706-a7f2-31d64c31342a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.322900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 90/179] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:21.330862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2804c23-ad73-4589-bedb-d1df4d582ba9 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.330862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2804c23-ad73-4589-bedb-d1df4d582ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.330862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2804c23-ad73-4589-bedb-d1df4d582ba9 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.330862 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 91/180] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:21.331676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d16fe-1749-4302-819b-53b6cd3f94a9 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.331676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d16fe-1749-4302-819b-53b6cd3f94a9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.332395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d16fe-1749-4302-819b-53b6cd3f94a9 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.337354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 92/181] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:21.337799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec35b7-5c85-465c-830a-633e328c8b50 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.338079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec35b7-5c85-465c-830a-633e328c8b50 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.338512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec35b7-5c85-465c-830a-633e328c8b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.372237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b1ec35b7-5c85-465c-830a-633e328c8b50 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:21.374310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1ec35b7-5c85-465c-830a-633e328c8b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:21.425721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:21.437771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f41d5-c71c-4f89-b3ec-cfd896aa75cc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:21.508638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:21.517717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:21.519384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.520217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.521291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] PATH_INFO: `/v3/users/05f0e63e9e434568841950a396b5e81e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.525185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=05f0e63e9e434568841950a396b5e81e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:21.526634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dda79-d013-43b4-9e7e-2d237edec9f5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:21.530002 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 90/182] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:21 2022] GET /identity/v3/users/05f0e63e9e434568841950a396b5e81e => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:21.531549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.533936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.534404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.539480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 93/183] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:21.541241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.541529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.541815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.569218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:21.571383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:21.576283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:21.577771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:21.674253 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 94/184] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:21.674916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:21.734525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 91/185] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:21.736576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:21.877449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed8d8-7b2e-4115-958b-bd327219262a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:21.901005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:21.929326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:21.930373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:21.930861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:21.931385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:21.939964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:21.947604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51a209-2191-496d-9682-6b0ff255ff88 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.009519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.010578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.011042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.011554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.017359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.018848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.029344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:22.038887 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:22.040264 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:22.041244 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:22.043288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 92/186] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:22.044338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.158012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387a7b-7927-4ce4-b350-8a38bd59c97f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.204468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.205553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.206049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.206537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.227689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:22.236927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:22.238121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:22.239082 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 93/187] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:22.240627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.254925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 95/188] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:22.256081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.269675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.281432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.393855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4004f-b4da-4905-9ff8-27a8a8e0d15a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.396337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f31a-6568-447b-866d-2c69dc5ce1f6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.446242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.447175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.447633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.447977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.448675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:22.448976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.449773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.450386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.450846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.451380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.452042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.460878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 96/189] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:22.463075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.471739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:22.480835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:22.482517 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:22.483680 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 94/190] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:22.484487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.580416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.591058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.605906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04551c2-8b47-4430-86bb-be8c0998a25e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.631248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6081d4-9f82-495b-be49-11a8495f27ee None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.656679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.657332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.657610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.658002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.659258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.660846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.662693 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 97/191] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:22.665418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.683701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.684338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.684624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.684893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.685648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:22.685945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.687650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.699259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 95/192] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:22.700660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.809507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d756-7138-4318-ae9e-50d6ca9455f0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.848981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.849633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.849919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.850193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] PATH_INFO: `/v3/projects/a108e281162b4b89a4cacdc36d4eea4c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.851590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] RBAC: Authorizing `identity:get_project(project_id=a108e281162b4b89a4cacdc36d4eea4c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.853070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.854781 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 98/193] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/projects/a108e281162b4b89a4cacdc36d4eea4c => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:22.855615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:22.881288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce603ff-1255-4c82-ac4f-9e0a1d48929f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:22.883226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.926765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:22.927555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:22.927967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:22.928308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:22.933211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:22.945921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:22.947575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:22.957238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 96/194] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:22.957238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.000512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f88e-11b7-4fb7-9134-8bc31016390a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.053882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.054609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.054790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.055078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.055787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:23.056196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.057601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.076698 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 99/195] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:23.076698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.102239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9783-c63d-4958-a5d1-85532c6bdcf7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.162969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.164067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.164559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.165058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.165665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:23.166524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.169546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.190443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b547b1-8258-45ed-be77-a61951489d5d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.229587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.230172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.230507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.230787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.232031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.233605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.235455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 100/196] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:23.236137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.314883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 97/197] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:22 2022] POST /identity/v3/users => generated 297 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:03:23.316509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.361340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73451a61-c351-4c34-a982-db4bf2574e79 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.414984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:23.425291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.426275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.426941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.427413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.428659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=a108e281162b4b89a4cacdc36d4eea4c, user.id=05f0e63e9e434568841950a396b5e81e) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:23.429190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.431752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.442502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 101/198] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/role_assignments?user.id=05f0e63e9e434568841950a396b5e81e&scope.project.id=a108e281162b4b89a4cacdc36d4eea4c&role.id=85251621622246e79e839f870f6d411d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:23.447732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.479576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:23.525651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2678-3fbd-4d42-98f6-2cc1d9c75c51 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.588531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.589491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.590102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.590609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.677454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843cb6b-1775-4d17-941a-93aeca375617 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.727563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.729834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.729834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.730218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] PATH_INFO: `/v3/users/6713910a5e2c45fe85517a913c06015e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:23.732493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] RBAC: Authorizing `identity:get_user(user_id=6713910a5e2c45fe85517a913c06015e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.734005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.736815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 102/199] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/users/6713910a5e2c45fe85517a913c06015e => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:23.737713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.743260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:23.748845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:23.844721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:23.875757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:23.916277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a86e-1a47-4532-8473-7f4bc2fe6d07 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:23.945127 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 98/200] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:23.946298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:23.980460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:23.981886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:23.982705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:23.984281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.131506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250f1bf-41b1-4168-ac13-c82789e15497 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:24.138850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.142523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.193178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:24.194162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:24.194643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:24.195097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.229732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:24.307928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:24.336541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.338546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.357149 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 103/201] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:24.363835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:24.483286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138f2f-7fa0-4030-8e1e-ca3dac23a658 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:24.524237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:24.524931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:24.525207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:24.525490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.526914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.528457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.530387 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 104/202] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:24.531225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:24.539288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 99/203] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:24.541921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:24.586196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:24.651638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3852-9481-4af0-89f1-7b083c45356f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:24.652241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:24.697289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:24.698244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:24.698725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:24.699226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.700722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.702498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.711186 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 105/204] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:24.711186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:24.780418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52b088-3e73-4667-9497-99720da248ef None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:24.841225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945208-6f40-47aa-9fe5-434529fdfd9b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:24.851501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:24.853102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:24.853915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:24.854729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.856560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=92820ff26db448cd827e1be739dfa5fc) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:24.857438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.859444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:24.861028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.873571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 100/205] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/role_assignments?user.id=92820ff26db448cd827e1be739dfa5fc&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:24.875694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:24.888605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:24.890168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:24.890668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:24.891185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:24.894528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:24.896789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:24.899087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 106/206] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:24.906219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:25.070543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0d1b4-d895-4634-bbb9-2ab09830d967 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:25.114632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37b9a-1e9b-42ab-83a0-59079417d334 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:25.155365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:25.167470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af9e82-391d-4215-b091-82292749d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:25.168167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9e82-391d-4215-b091-82292749d594 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:25.168503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9e82-391d-4215-b091-82292749d594 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:25.168781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9e82-391d-4215-b091-82292749d594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:25.171684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9e82-391d-4215-b091-82292749d594 None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, scope.project.id=d23a587c3520484596c285914dbbb738, user.id=6713910a5e2c45fe85517a913c06015e) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:25.171684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9e82-391d-4215-b091-82292749d594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:25.172443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9e82-391d-4215-b091-82292749d594 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:25.181207 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 107/207] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/role_assignments?user.id=6713910a5e2c45fe85517a913c06015e&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:25.213233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:25.214358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:25.214860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:25.215445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:25.216540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=92820ff26db448cd827e1be739dfa5fc) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:25.217170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:25.219295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799b36d-3397-4339-bf57-7965b0bccc86 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:25.232491 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 101/208] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:24 2022] GET /identity/v3/role_assignments?user.id=92820ff26db448cd827e1be739dfa5fc&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:26.247821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cd53-1749-4668-ad25-7457e140530b None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:26.248342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cd53-1749-4668-ad25-7457e140530b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:26.248342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81cd53-1749-4668-ad25-7457e140530b None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:26.249731 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 108/209] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:26.256086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1bbd-73c3-4473-81f9-fef26ac60e12 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:26.257046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1bbd-73c3-4473-81f9-fef26ac60e12 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:26.257534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1bbd-73c3-4473-81f9-fef26ac60e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:26.278179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-92dd1bbd-73c3-4473-81f9-fef26ac60e12 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:26.279925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-92dd1bbd-73c3-4473-81f9-fef26ac60e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:26.363328 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 102/210] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:26.484754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662a24-e18e-432c-a949-1c95ecebc18a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:26.485400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662a24-e18e-432c-a949-1c95ecebc18a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:26.485909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662a24-e18e-432c-a949-1c95ecebc18a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:26.487607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 109/211] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:26.494155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:26.494791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:26.495314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:26.514970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:26.516597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:26.598855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 103/212] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:26.670972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae662a24-e18e-432c-a949-1c95ecebc18a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:26.729330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:26.795351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae662a24-e18e-432c-a949-1c95ecebc18a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:26.833174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:26.833823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:26.834099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:26.834371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:26.835547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:26.837055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:26.838949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 110/213] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:26.844492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:26.892296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:26.969195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c15b7-1eb7-4a1a-bc2d-4850707824b6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:27.031447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:27.032522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.033013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.033500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.034706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:27.037599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:27.042634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:27.161053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 104/214] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:26 2022] POST /identity/v3/users => generated 297 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:03:27.212771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac5db-84d1-445e-acfb-e5f1fd7c9c9a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:27.232286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:27.260422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:27.261798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.262224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.262667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.278258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-07a314d5-2494-433b-95ae-ec73034f1e67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:27.283802 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:27.284901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:27.285968 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:27.288191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 111/215] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:27.296600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:27.426219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:27.433383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a75-fffd-4b36-af9c-5e02afe98734 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:27.493851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:27.494929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.495467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.495954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.497253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:27.497871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:27.500616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19af850-64cc-4e28-a3ed-d4e06f937697 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:27.518746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 105/216] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:27.520693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996225-456d-42df-a972-c97ac6615458 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.521028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996225-456d-42df-a972-c97ac6615458 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.521312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996225-456d-42df-a972-c97ac6615458 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.522765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 112/217] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:27.530395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996225-456d-42df-a972-c97ac6615458 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:27.532979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.533272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.533558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.556506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:27.557822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:27.658684 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 106/218] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:27.719643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996225-456d-42df-a972-c97ac6615458 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:27.768174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:27.768847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:27.769139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:27.769400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] PATH_INFO: `/v3/users/c28d2f8983c94f469bb1587dee6cfd75` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:27.791817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] RBAC: Authorizing `identity:get_user(user_id=c28d2f8983c94f469bb1587dee6cfd75)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:27.793535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:27.795889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 113/219] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:27 2022] GET /identity/v3/users/c28d2f8983c94f469bb1587dee6cfd75 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:27.805631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:27.973022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:27.975301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:27.999726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bfc12-f00f-423b-8ef8-190d93420d90 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:28.021237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:28.070226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:28.070974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.071283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.071552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.128448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3434e-3fd1-433a-ad49-6c45f45943f3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:28.165840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:28.167533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeb0df-c107-4344-aed4-9c59edb5189d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:28.179518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:28.180241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.181021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.181299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.198081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1c45b236-e428-4ddf-9590-e9b6672e92ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:28.205184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:28.206799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:28.209399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 114/220] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:28.213359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeec1f-a800-4374-9d4e-d113a098ffd1 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.213359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeec1f-a800-4374-9d4e-d113a098ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.213359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeec1f-a800-4374-9d4e-d113a098ffd1 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.216386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 115/221] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:28.217217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeec1f-a800-4374-9d4e-d113a098ffd1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:28.287805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:28.304534 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 107/222] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:28.306755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.307006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.307633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.337223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:28.339102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:28.367640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:28.387806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeec1f-a800-4374-9d4e-d113a098ffd1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:28.443468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:28.444668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.445253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.445855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.446779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:28.447338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:28.449315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:28.452598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 108/223] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:28.455047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:28.469973 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 116/224] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:28.480720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:28.739073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e204b-0828-41ed-a0df-af90abbebe0e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:28.752505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727950cc-e4a0-417b-96e7-8365db123083 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:28.819717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:28.853861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:28.855485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.856593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.859903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.865574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:28.871365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:28.876289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 117/225] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:28 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:28.885915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:28.892320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:28.893919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:28.894669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:28.895935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:28.904300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:28.907416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:28.911481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 109/226] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:28 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:28.918168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:28.935542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:29.096131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1177079-c173-4074-aa84-9464562e5c76 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:29.164422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:29.165936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:29.166644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:29.167391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:29.169727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:29.172703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:29.176460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 118/227] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:28 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:29.183175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:29.235896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cd0a4-e106-4cd6-8827-dae25aab061b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:29.304015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:29.305198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:29.306094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:29.306094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:29.307976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=c28d2f8983c94f469bb1587dee6cfd75) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:29.308579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:29.312494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:29.325994 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 110/228] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:28 2022] GET /identity/v3/role_assignments?user.id=c28d2f8983c94f469bb1587dee6cfd75&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=85251621622246e79e839f870f6d411d => generated 259 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:29.328435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:29.357865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:29.380227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f441-b683-4221-a3f6-550b5dab0109 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:29.444893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:29.449499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:29.450918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:29.451690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:29.452565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:29.474326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:29.486343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:29.488210 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:29.489660 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:29.494512 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 119/229] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:29.504293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:29.622843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f170-67a9-4ff5-b3f1-9bcbff234535 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:29.694005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:29.694897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:29.695212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:29.695489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/92820ff26db448cd827e1be739dfa5fc/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:29.697863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, user_id=92820ff26db448cd827e1be739dfa5fc, role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:29.699387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:29.731607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a509731-e790-4ca5-8f76-d2c710381990 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:29.799895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:29.801419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:29.802221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:29.802986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:29.804557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:29.805306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:29.808228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:29.818413 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 111/230] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:29 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/92820ff26db448cd827e1be739dfa5fc/roles/8a3388bd801d479ebdabb84cd8065882 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:03:29.829939 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 120/231] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:29.839932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:30.064182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8e8d-db5d-4054-9a87-b2894dc28d62 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:30.090414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:30.149214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:30.150285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.150780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.151294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.156556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:30.159618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:30.163875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 112/232] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:29 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:30.173277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:30.219821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:30.427768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c215f6-e8de-45ca-9b54-baf64b02495c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:30.499419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:30.501006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.501790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.502630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.505772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:30.508821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edbc39-376d-4d11-b95f-de85565dbd06 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:30.512986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 121/233] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:30 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:30.520408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:30.528864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d904-e181-42a3-b7b8-dc3766b67da4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.529301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d904-e181-42a3-b7b8-dc3766b67da4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.529460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d904-e181-42a3-b7b8-dc3766b67da4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.531248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 122/234] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:30.538275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e8b-1499-434c-828b-05139b82e5c0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.538735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e8b-1499-434c-828b-05139b82e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.539184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4e8b-1499-434c-828b-05139b82e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.583048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c84a4e8b-1499-434c-828b-05139b82e5c0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:30.583048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c84a4e8b-1499-434c-828b-05139b82e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:30.822772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 123/235] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:30.845301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623759f-fd74-496a-acba-436eb9604bc1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:30.883174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445460c-eb49-405f-8265-d6aba5c22f64 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.883696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445460c-eb49-405f-8265-d6aba5c22f64 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.884194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445460c-eb49-405f-8265-d6aba5c22f64 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.886878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 124/236] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:30.899212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.899212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.899212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.925034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:30.926185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:30.926749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:30.927256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/92820ff26db448cd827e1be739dfa5fc/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:30.932308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, user_id=92820ff26db448cd827e1be739dfa5fc, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:30.934969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:30.950953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:30.962376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:30.962376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:31.046867 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 113/237] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:30 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/92820ff26db448cd827e1be739dfa5fc/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:31.107998 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 125/238] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:31.403291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:31.484125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:31.659276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52177-88d5-4a2e-bec8-576b3ebc710c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:31.764846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:31.765929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:31.766485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:31.766971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:31.795033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:31.809370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:31.811101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:31.812807 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 114/239] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:31.825082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:31.826595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:32.032323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbfc61-bbf2-476b-8c78-e091fde45112 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:32.102968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:32.104534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:32.105323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:32.106240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:32.107953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:32.108836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:32.111920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:32.131504 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 126/240] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:32.156091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:32.162040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:32.169145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:32.193037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20638520-a776-41af-9813-4883ddabb4d2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:32.311282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:32.312357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:32.313047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:32.313376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:32.315536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:32.328569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:32.332747 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 115/241] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:32.342231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:32.412965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da23b2-3de9-461f-985a-063c6ec85df6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:32.479061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:32.480622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:32.481497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:32.482265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] PATH_INFO: `/v3/users/cf9c845d1fdd450c8dcbeecf14a45854` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:32.510294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9c845d1fdd450c8dcbeecf14a45854)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:32.513508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:32.516989 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 127/242] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:32 2022] GET /identity/v3/users/cf9c845d1fdd450c8dcbeecf14a45854 => generated 297 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:32.527172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:32.679031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7da2-c484-40e0-8692-265eb09e6b7f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:32.687771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:32.795183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31452-22bb-48e1-8637-4e129deb5854 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:32.815681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:32.816314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:32.817123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:32.817371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:32.818060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:32.819591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:32.857770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:32.859810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:32.859810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:32.859810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:32.945376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:32.946788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dfe8b-4463-4465-827c-cedd8534d1e0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:32.968119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 116/243] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:32 2022] POST /identity/v3/users => generated 293 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:03:33.031847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:33.070787 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 128/244] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:03:33.077014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:33.110317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63693-e6b3-4020-a91d-86879c1dcfa7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.111687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63693-e6b3-4020-a91d-86879c1dcfa7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.112517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63693-e6b3-4020-a91d-86879c1dcfa7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.116772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 129/245] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:33.117756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:33.127294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.127736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.130915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.174005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:33.184109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:33.297878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 130/246] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:33.368160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633f35e-37d6-4c5e-be10-3e63bb17394f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:33.446929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:33.448185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.448699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.449221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.451896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:33.454833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de03888-81cc-4f2f-a92b-9b244683660b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:33.459534 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 117/247] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:33 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:33.469465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:33.593555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:33.611777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5936d8-918b-459f-aa6a-456cf737c26b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:33.677235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:33.678179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.678613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.679049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.680351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=cf9c845d1fdd450c8dcbeecf14a45854) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:33.680848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:33.683377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb0c1f-486b-4a8f-95d2-b5bef3cbc41e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:33.694413 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 131/248] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:33 2022] GET /identity/v3/role_assignments?user.id=cf9c845d1fdd450c8dcbeecf14a45854&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:33.848758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d9380-45f1-452d-8b71-8ea8f4e22df2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.850322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d9380-45f1-452d-8b71-8ea8f4e22df2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.851182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d9380-45f1-452d-8b71-8ea8f4e22df2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.854223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 118/249] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:33.866962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:33.867783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:33.868123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:33.883628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d9380-45f1-452d-8b71-8ea8f4e22df2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:33.907880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:33.909951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:34.037211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 132/250] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:34.073439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:34.078104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d9380-45f1-452d-8b71-8ea8f4e22df2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:34.133109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:34.133689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:34.133965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:34.134235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:34.151968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:34.157289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:34.158664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:34.160008 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 119/251] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:34.169223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:34.290362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:34.311530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bde11-4382-48c3-a122-1c561a2769c3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:34.353720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:34.354373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:34.359742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:34.360001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:34.360809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:34.361134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:34.362804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:34.373551 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 133/252] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:34.382432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:34.535281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6d062-8768-40ae-9fbb-a4f54cfc2b65 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:34.590106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:34.591235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:34.591720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:34.592183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:34.596925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:34.599811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:34.602771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 120/253] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:34 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:34.611628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:34.770393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:34.775958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531e57-c3fa-4d77-85f9-cc58b2cdba8e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:34.842661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:34.843339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:34.843618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:34.843891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:34.846473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:34.869407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:34.962301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:34.969219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:35.165758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 134/254] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:35.174712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:35.236446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2179ba6-b4b1-4575-8e27-aae353c6e1f2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:35.285351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:35.322140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:35.323286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:35.324089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:35.324350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:35.346000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9b07c89a-4481-45ee-bd54-3ff524285e53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:35.356613 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:35.358376 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:35.360720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 121/255] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 589 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:35.362059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3291-4529-456f-bc8a-925679b04ca1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:35.362059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3291-4529-456f-bc8a-925679b04ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:35.362059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3291-4529-456f-bc8a-925679b04ca1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:35.365259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 122/256] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:35.367092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a3291-4529-456f-bc8a-925679b04ca1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:35.511074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9fa77-099c-45e6-b9e1-47e526bffe1c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:35.511991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:35.541842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a3291-4529-456f-bc8a-925679b04ca1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:35.585252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:35.585951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:35.586277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:35.586514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:35.587211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:35.587519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:35.589102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fda1c-5858-49d5-9960-7ebcf7c907f9 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:35.600521 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 123/257] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:35.602003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:35.602284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:35.602787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:35.625121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:35.626712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:35.704431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:35.705812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:35.706632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:35.707979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:35.712467 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 124/258] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:35.713637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:35.714390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:35.717242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:35.727846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 135/259] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:35 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:35.737959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:35.867551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:35.972918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3128866-4f7e-4564-92a3-bed083fdf695 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:36.088380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:36.089452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:36.089860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:36.090404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] PATH_INFO: `/v3/users/c28d2f8983c94f469bb1587dee6cfd75` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:36.096449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] RBAC: Authorizing `identity:get_user(user_id=c28d2f8983c94f469bb1587dee6cfd75)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:36.100647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:36.103921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 125/260] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:35 2022] GET /identity/v3/users/c28d2f8983c94f469bb1587dee6cfd75 => generated 297 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:36.110814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:36.202747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46a9a-50ca-47c1-a80b-f5f2e3010aaa None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:36.265593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:36.311785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:36.313261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:36.313748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:36.314251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:36.316774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=92820ff26db448cd827e1be739dfa5fc) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:36.317380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:36.320435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:36.339300 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 136/261] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:35 2022] GET /identity/v3/role_assignments?user.id=92820ff26db448cd827e1be739dfa5fc&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 608 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:36.340912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:36.445304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d1c6-a646-4abb-8faf-04e37d2ec872 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:36.592456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:36.593504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:36.593946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:36.594387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:36.596540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:36.600051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:36.603213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 126/262] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:36 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:36.612246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:36.643737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:36.663273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad0b4-7138-49d7-81b9-49ff80a822ff None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:36.789697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:36.790781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:36.791630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:36.792127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:36.837251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:36.856693 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:36.858406 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:03:36.860030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:36.864749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 137/263] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:36.874482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:36.905920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104304-6c5d-4919-a190-04a592c42d3d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:36.988946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:36.990683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:36.991675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:36.992368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/c28d2f8983c94f469bb1587dee6cfd75/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:37.001610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, user_id=c28d2f8983c94f469bb1587dee6cfd75, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:37.004644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:37.011632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:37.137372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0292-489d-4805-a5f7-d7464c5fcbf9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:37.139884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 127/264] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:36 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/c28d2f8983c94f469bb1587dee6cfd75/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:37.207902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:37.208928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:37.209419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:37.210847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:37.211127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:37.215216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:37.215216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:37.231468 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 138/265] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:37.243309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:37.428385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:37.510238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f95ec3-b30d-48db-bb77-8db3b063d85e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:37.573245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:37.573923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:37.574193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:37.574518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] PATH_INFO: `/v3/users/92820ff26db448cd827e1be739dfa5fc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:37.575798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] RBAC: Authorizing `identity:get_user(user_id=92820ff26db448cd827e1be739dfa5fc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:37.577327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de892-f0b0-4dc4-9443-dfdc1907a095 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:37.579336 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 128/266] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:37 2022] GET /identity/v3/users/92820ff26db448cd827e1be739dfa5fc => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:37.589093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:37.648365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97777c9-4bd1-43b3-b1cc-cb7a5b2a2a6d None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:37.648827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97777c9-4bd1-43b3-b1cc-cb7a5b2a2a6d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:37.649648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97777c9-4bd1-43b3-b1cc-cb7a5b2a2a6d None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:37.652773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 129/267] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:37.662368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b12e-da3c-4113-a4f9-0d79309abfe4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:37.663458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b12e-da3c-4113-a4f9-0d79309abfe4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:37.664172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b12e-da3c-4113-a4f9-0d79309abfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:37.705947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e174b12e-da3c-4113-a4f9-0d79309abfe4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:37.708523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e174b12e-da3c-4113-a4f9-0d79309abfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:37.823819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:37.833946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7209-6576-4653-82da-63bc8cb78328 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:37.875613 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 130/268] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:37.907498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:37.908149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:37.908477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:37.908763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.050830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:38.053535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:38.156403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593df8-3856-48b7-a15e-3cdc1a37dab3 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.156842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593df8-3856-48b7-a15e-3cdc1a37dab3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.157294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593df8-3856-48b7-a15e-3cdc1a37dab3 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.163860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 131/269] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:38.170940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.171370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.171628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.212762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:38.214831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:38.310735 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 139/270] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:38.311627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:38.312644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:38.330700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:38.350339 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 132/271] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:38.351819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:38.575327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79176c-e28a-4e73-b137-541a94f7f116 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:38.599746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4fdc-3aca-4eaf-b76c-1499c6cc0da2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:38.644372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:38.645622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.645941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.646284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.647550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:38.649113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d9de3-ce76-47d9-ba55-17cc6bff9dfe None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:38.650882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 133/272] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:38 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:38.652165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84881467-1a69-4305-9eea-e9ded0d3dc07 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.652450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84881467-1a69-4305-9eea-e9ded0d3dc07 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.652776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84881467-1a69-4305-9eea-e9ded0d3dc07 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.658371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 134/273] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:38.659628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84881467-1a69-4305-9eea-e9ded0d3dc07 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:38.686571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:38.687654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.687924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.688358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.702396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0491c296-249a-458d-82da-ea4c9ad1f804 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:38.710838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:38.711846 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:38.712639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:38.713310 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 140/274] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:38.724011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.724499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.725170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.756449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:38.758306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:38.769316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:38.826834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84881467-1a69-4305-9eea-e9ded0d3dc07 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:38.855396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:38.879318 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 141/275] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:38.879318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:38.890051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:38.892000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:38.892463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:38.892914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:38.895515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:38.898653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:38.901527 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 135/276] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:38.908616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.097479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7fcc-2f41-449a-b2d7-f21db0bc2115 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.100936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b103a5-2502-4c7d-b66e-c52ca034643f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.151358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:39.159784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.161550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.161831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.162104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.165064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=92820ff26db448cd827e1be739dfa5fc) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:39.165064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:39.165064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:39.169882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.171370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.171788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.172206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.173042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:39.173474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:39.175075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:39.181742 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 142/277] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:38 2022] GET /identity/v3/role_assignments?user.id=92820ff26db448cd827e1be739dfa5fc&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:39.183720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.191725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 136/278] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:39.205012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.328851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:39.428507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e329d-da6c-477e-ad8d-8e96dae7421a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.501663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.502568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.503074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.503595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.505179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:39.508039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:39.516759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26960-351f-43f6-a481-560b45f26f17 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.604923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.604923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.604923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.604923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] PATH_INFO: `/v3/users/cf9c845d1fdd450c8dcbeecf14a45854` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.614373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9c845d1fdd450c8dcbeecf14a45854)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:39.614373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:39.616186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 137/279] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:39 2022] GET /identity/v3/users/cf9c845d1fdd450c8dcbeecf14a45854 => generated 297 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:39.617897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.687171 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 143/280] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:03:39 2022] POST /identity/v3/users => generated 293 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:03:39.689065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.743731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:39.826920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc090f4-2127-4b72-9774-5cf773cc6ed7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.872103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24f82-6076-49b0-8f06-d612ba495a14 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:39.882943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.885812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.887375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.887710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.891021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:39.907694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:39.914899 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:39.916915 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:39.918574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 138/281] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:39.924020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:39.959572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:39.959572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:39.959572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:39.959572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:39.960179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:39.960179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:39.960179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 144/282] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:39 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:39.965578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:40.117183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b52f7-7e0b-447c-ad99-1da4dd17381c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:40.143056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:40.181007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:40.183300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.183437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.183555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88899-812c-4347-ac51-42d6c57cc60a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:40.183859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.185112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:40.186442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:40.190968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:40.208117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 139/283] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:40.216964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:40.247370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:40.248069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.248353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.248667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/cf9c845d1fdd450c8dcbeecf14a45854/roles/4f2a6ebe135c4adbaca12bc3667dd6cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.250866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, user_id=cf9c845d1fdd450c8dcbeecf14a45854, role_id=4f2a6ebe135c4adbaca12bc3667dd6cf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:40.252534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3485bdc-02cd-49e9-a851-69008f12a85e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:40.346558 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 145/284] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:03:39 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/users/cf9c845d1fdd450c8dcbeecf14a45854/roles/4f2a6ebe135c4adbaca12bc3667dd6cf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:40.431630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f2856-e625-443d-bdc9-94ccada4ef1d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:40.498894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55218-7242-4ad8-a87b-87292343cd46 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.499221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55218-7242-4ad8-a87b-87292343cd46 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.499540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef55218-7242-4ad8-a87b-87292343cd46 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.500927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 146/285] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:40.516702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.516990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.517343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:40.517519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.517960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.518544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.518903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] PATH_INFO: `/v3/users/fd492b8b3aa64550aaed6b983a6067c4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.546736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] RBAC: Authorizing `identity:get_user(user_id=fd492b8b3aa64550aaed6b983a6067c4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:40.549434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:40.553321 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 140/286] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:40 2022] GET /identity/v3/users/fd492b8b3aa64550aaed6b983a6067c4 => generated 293 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:40.562863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:40.573989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:40.576256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:40.692629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:40.742512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:40.777160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 147/287] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:40.903742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385fd2-bf30-4ffc-b1f1-a0ac5776bf6c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:40.978696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:40.980263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:40.981010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:40.981741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:40.983454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, user.id=fd492b8b3aa64550aaed6b983a6067c4, scope.system=all) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:40.984377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:40.987516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:41.003027 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 141/288] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 4 20:03:40 2022] GET /identity/v3/role_assignments?user.id=fd492b8b3aa64550aaed6b983a6067c4&scope.system=all&role.id=85251621622246e79e839f870f6d411d => generated 226 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:41.418491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:41.622166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82d81-dcde-41c2-a2a7-e624e32d0718 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:41.696497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:41.697588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:41.698065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:41.698530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:41.729559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:41.744287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:41.745997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:41.747746 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 148/289] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:41.760636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:41.970094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900d31-369d-4630-ab43-a509cf46528a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:41.973163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:42.036206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:42.037236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:42.037728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:42.038178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:42.039425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:42.039948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:42.042534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:42.058463 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 142/290] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:42.068333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:42.123520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:42.266665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcea3-c4b1-4718-ae25-54ec75b513c7 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:42.331760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:42.332893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:42.333377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:42.333874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] PATH_INFO: `/v3/users/c28d2f8983c94f469bb1587dee6cfd75` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:42.336005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] RBAC: Authorizing `identity:get_user(user_id=c28d2f8983c94f469bb1587dee6cfd75)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:42.338830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:42.342323 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 149/291] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:42 2022] GET /identity/v3/users/c28d2f8983c94f469bb1587dee6cfd75 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:42.351717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:42.632335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdcf07-6396-47f8-9de4-b71306cd63d6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:42.723788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:42.725251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:42.726002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:42.726730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:42.811943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:42.907703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:42.909745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:43.149503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 143/292] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:43.158371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:43.357340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a362-8d61-4bd8-8bf5-3964084a93ec None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:43.363772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:43.442257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:43.443171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:43.443594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:43.444048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:43.448478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:43.451640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f582e5-c422-4d60-9128-bab329fe6a79 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:43.455594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 150/293] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:43 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:43.466313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:43.657158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:43.770659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051b87a-b532-4d39-84e4-02c890cdfd99 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:43.833992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db07c-143c-44c7-a482-537a71d36b52 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:43.834930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db07c-143c-44c7-a482-537a71d36b52 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:43.835966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db07c-143c-44c7-a482-537a71d36b52 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:43.843254 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 151/294] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:43.843512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:43.843512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:43.843512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:43.843512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:43.844505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=c28d2f8983c94f469bb1587dee6cfd75) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:43.846026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:43.847764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9bb42-e553-4a07-8248-6b9124bb44ae None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:43.849224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfafe-49e8-4888-8232-54183663b2fb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:43.850021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfafe-49e8-4888-8232-54183663b2fb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:43.850777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dfafe-49e8-4888-8232-54183663b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:43.859730 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 144/295] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:43 2022] GET /identity/v3/role_assignments?user.id=c28d2f8983c94f469bb1587dee6cfd75&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=85251621622246e79e839f870f6d411d => generated 608 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:43.889398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e20dfafe-49e8-4888-8232-54183663b2fb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:43.891741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e20dfafe-49e8-4888-8232-54183663b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:44.062261 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 152/296] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:44.465206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64d20-8580-45f1-9f2a-64ef4b5f885e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:44.465664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64d20-8580-45f1-9f2a-64ef4b5f885e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:44.466116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64d20-8580-45f1-9f2a-64ef4b5f885e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:44.469136 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 145/297] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:44.476231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:44.477732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:44.478505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:44.513486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:44.516072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:44.518804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a6cb-e673-477c-8dab-862c6591f9ef None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:44.520109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a6cb-e673-477c-8dab-862c6591f9ef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:44.520816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a6cb-e673-477c-8dab-862c6591f9ef None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:44.523113 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 146/298] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:44.532921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:44.533407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:44.534538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:44.583527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:44.586178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:44.667756 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 153/299] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:44.668926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:44.704612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:44.712081 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 147/300] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:44.825411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c07527-43b1-438e-aeb2-4e0b5b5a9510 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:44.866833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:44.867518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:44.867841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:44.868190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:44.881060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:44.886112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:44.887842 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:44.889365 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 154/301] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:44.897355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.010171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.011557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.080664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538adf-5bca-423c-8e8f-6fc64c737806 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.137227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.137858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.138135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.138403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.139090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:45.139437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.140906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.144694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.151365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 148/302] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:45.152475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.170883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccb046-148b-4636-be9a-170ca039325f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.221499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.222324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.222722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.223220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.237039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:45.243996 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:45.245771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 155/303] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:45.248263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.317523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a39863-1006-4380-81a2-94ab70b00de5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.340712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.360660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.361384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.361657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.361938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.364117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.365584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48274c6-acbd-41c4-a836-9b684f23167b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.367948 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 149/304] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:45.368697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ec99-50b9-4fa2-ba65-f6bd592bb89f None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.368977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ec99-50b9-4fa2-ba65-f6bd592bb89f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.369260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ec99-50b9-4fa2-ba65-f6bd592bb89f None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.374728 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 150/305] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:45.374728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ec99-50b9-4fa2-ba65-f6bd592bb89f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.424869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8fa27-b929-4ed1-9603-dda99030b799 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.479534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.480314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.480453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.480726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] PATH_INFO: `/v3/users/7e23dd64c733487faa724577814dbebb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.499340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] RBAC: Authorizing `identity:get_user(user_id=7e23dd64c733487faa724577814dbebb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.501088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f107e-3aab-4baa-b96a-dd992056f600 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.503488 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 156/306] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/users/7e23dd64c733487faa724577814dbebb => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:45.505641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.505939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.506203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.514445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.529965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:45.531485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:45.556828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ec99-50b9-4fa2-ba65-f6bd592bb89f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.612237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.613015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.613388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.613740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.614753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] RBAC: Adding query filter params (name=reader) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:45.615282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.617238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.627318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 151/307] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:45.628382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.632574 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 157/308] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:45.634365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.697926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.765827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b36c-d173-445c-86df-73fb9f468bea None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.830511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.831833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.832393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.832950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.834242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.837667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.840012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20119819-d15d-4d2f-9d47-5d93d2aaf9f2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:45.897196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:45.904713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:45.905662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:45.906084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:45.906521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:45.907797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, user.id=7e23dd64c733487faa724577814dbebb, scope.system=all) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:45.908290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:45.911506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:45.920997 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 158/309] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/role_assignments?user.id=7e23dd64c733487faa724577814dbebb&scope.system=all&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:45.922166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:45.943923 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 152/310] 10.222.0.78 () {60 vars in 1134 bytes} [Tue Oct 4 20:03:45 2022] POST /identity/v3/groups => generated 229 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:03:46.016511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:46.114200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7841-aec5-4bc6-b283-5a5574abe343 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:46.177733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e541f-0120-4182-82d7-738caed0628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:46.178709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e541f-0120-4182-82d7-738caed0628e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:46.179445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e541f-0120-4182-82d7-738caed0628e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:46.180016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e541f-0120-4182-82d7-738caed0628e None admin] PATH_INFO: `/v3/users/cf9c845d1fdd450c8dcbeecf14a45854` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:46.181780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e541f-0120-4182-82d7-738caed0628e None admin] RBAC: Authorizing `identity:get_user(user_id=cf9c845d1fdd450c8dcbeecf14a45854)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:46.185252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e541f-0120-4182-82d7-738caed0628e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:46.187807 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 159/311] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:45 2022] GET /identity/v3/users/cf9c845d1fdd450c8dcbeecf14a45854 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:46.199211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e541f-0120-4182-82d7-738caed0628e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:46.248218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e0dd-9fb8-4e4f-8d9b-2ab582b48513 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:46.263386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:46.307987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:46.309586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:46.310356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:46.311123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:46.332262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:46.339796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:46.354810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:46.356809 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:46.358605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:46.362335 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 153/312] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:46.372870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:46.430292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e541f-0120-4182-82d7-738caed0628e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:46.519939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:46.522414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:46.523153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:46.523823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:46.588104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4b3a-9659-4f58-8d07-fececdc6e2bb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:46.659090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:46.660879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:46.661633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:46.662400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:46.663943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:46.664777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:46.667680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:46.695394 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 154/313] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:46.699337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:46.700089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:46.701955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:46.765175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:46.835998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:46.908155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f456758-8ff7-4666-83dc-238492a3465c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:46.914224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 160/314] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:03:46.923052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:46.957381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:46.958747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:46.959350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:46.959816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] PATH_INFO: `/v3/users/fd492b8b3aa64550aaed6b983a6067c4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:46.961695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] RBAC: Authorizing `identity:get_user(user_id=fd492b8b3aa64550aaed6b983a6067c4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:46.963658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:46.965873 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 155/315] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:46 2022] GET /identity/v3/users/fd492b8b3aa64550aaed6b983a6067c4 => generated 293 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:46.976445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:47.131761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8b5ca-0d80-485c-bcf9-d46f8b4ce266 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:47.207885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:47.210789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:47.212135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:47.212807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:47.213322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa59b6-ec35-4d7b-8cc2-358487aede38 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:47.213726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:47.216149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:47.220705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:47.224580 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 161/316] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:46 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:47.232435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:47.284218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:47.292177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:47.293643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:47.294428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:47.295176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] PATH_INFO: `/v3/system/users/fd492b8b3aa64550aaed6b983a6067c4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:47.297951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd492b8b3aa64550aaed6b983a6067c4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:47.301000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbf975-ba45-48c9-a66e-86ed58b3d6a6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:47.386539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c2cf5-7225-4039-ac01-c15080c10a1d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:47.419182 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 156/317] 10.222.0.78 () {58 vars in 1334 bytes} [Tue Oct 4 20:03:46 2022] PUT /identity/v3/system/users/fd492b8b3aa64550aaed6b983a6067c4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:47.444094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:47.445847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:47.446758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:47.447572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:47.449344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea, user.id=cf9c845d1fdd450c8dcbeecf14a45854) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:47.450381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:47.453442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16df799-5f4c-446c-9bec-bbea1cf1c4bc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:47.466549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 162/318] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:03:47 2022] GET /identity/v3/role_assignments?user.id=cf9c845d1fdd450c8dcbeecf14a45854&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:48.829398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee5-b48a-435e-a0d7-4ed1daf0d886 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:48.830085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee5-b48a-435e-a0d7-4ed1daf0d886 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:48.830374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97dee5-b48a-435e-a0d7-4ed1daf0d886 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:48.833431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 157/319] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:48.842190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:48.843038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:48.843217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:48.873880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:48.875928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:48.999471 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 163/320] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:49.273537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97dee5-b48a-435e-a0d7-4ed1daf0d886 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:49.480116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97dee5-b48a-435e-a0d7-4ed1daf0d886 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:49.550084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:49.551706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:49.552206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:49.552713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:49.572981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8337ee80-c1ab-4794-b837-4f524a796512 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:49.585658 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:49.586800 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:49.588170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 158/321] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:49.598494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:49.651911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:49.685705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f5b5-8b2e-43e0-9f1e-6788af7bf972 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:49.686198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f5b5-8b2e-43e0-9f1e-6788af7bf972 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:49.686697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f5b5-8b2e-43e0-9f1e-6788af7bf972 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:49.689249 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 159/322] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:49.698327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:49.699109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:49.699396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:49.733263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:49.735557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:49.781878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:49.782084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5e76-00f5-4dc6-a604-702309220f98 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:49.876221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:49.878093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:49.878518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:49.879113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:49.880451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:49.880938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:49.883475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:49.897696 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 160/323] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:49.900546 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 164/324] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:49.908885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:50.118957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34caf8-ecd6-455b-ab8a-91be13d5ac7c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:50.189331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:50.190356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.190822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.191851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] PATH_INFO: `/v3/users/7e23dd64c733487faa724577814dbebb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.194102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=7e23dd64c733487faa724577814dbebb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:50.196951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:50.200301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 161/325] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:49 2022] GET /identity/v3/users/7e23dd64c733487faa724577814dbebb => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:50.209726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:50.212529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:50.257654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:50.386698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:50.389638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aba6d4-fdc5-41a8-a8ed-b619432bb3a6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:50.403247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df835348-5e7b-47c0-9489-e379e85200ef None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:50.451275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:50.452274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.452771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.453262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] PATH_INFO: `/v3/system/users/7e23dd64c733487faa724577814dbebb/roles/4f2a6ebe135c4adbaca12bc3667dd6cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.455635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e23dd64c733487faa724577814dbebb, role_id=4f2a6ebe135c4adbaca12bc3667dd6cf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:50.457786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29679cac-8356-40ac-b1c6-9eae804699bf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:50.461352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:50.462306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.462758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.463228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.465285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:50.467978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:50.471171 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 162/326] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:03:50.478273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:50.534599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 165/327] 10.222.0.78 () {58 vars in 1334 bytes} [Tue Oct 4 20:03:50 2022] PUT /identity/v3/system/users/7e23dd64c733487faa724577814dbebb/roles/4f2a6ebe135c4adbaca12bc3667dd6cf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:03:50.647430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:50.667767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30264-a91a-4487-966d-b3da01cb3cfb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:50.739262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:50.740139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.740575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.740992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.742314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:50.744859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:50.842201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08772-6929-4c9c-8adc-1997f16cd090 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.842634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08772-6929-4c9c-8adc-1997f16cd090 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.842998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08772-6929-4c9c-8adc-1997f16cd090 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.844566 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 166/328] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:03:50.851819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:50.852256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:50.852866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:50.875379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:50.876658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:50.878093 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 163/329] 10.222.0.78 () {60 vars in 1134 bytes} [Tue Oct 4 20:03:50 2022] POST /identity/v3/groups => generated 226 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:03:50.990699 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 167/330] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:51.288757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:51.457329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5e98b-a487-43d1-9c7b-94e5e1366514 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:51.525729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:51.527041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:51.527707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:51.528255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:51.549409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:51.560034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:51.561758 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:51.563257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 164/331] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:51.570499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:51.764723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:51.802603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b035a-30a8-4cda-a67a-5aab92f9197d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:51.884058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:51.885120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:51.885618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:51.886100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:51.887367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] RBAC: Adding query filter params (name=member) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:51.887865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:51.890581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:51.910437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 168/332] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:51.919706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:51.945113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:52.071029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec3c48-b3eb-4afb-927d-ff361a152e04 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:52.122235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:52.123416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:52.123909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:52.124466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] PATH_INFO: `/v3/users/fd492b8b3aa64550aaed6b983a6067c4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:52.132403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] RBAC: Authorizing `identity:get_user(user_id=fd492b8b3aa64550aaed6b983a6067c4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:52.135376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8349e5-9c6d-42fe-b532-c68672b92a24 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:52.138436 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 165/333] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:51 2022] GET /identity/v3/users/fd492b8b3aa64550aaed6b983a6067c4 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:52.148804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:52.385924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee359f-fbf6-4780-ba2f-fe0d6d28ae9c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:52.457036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:52.458217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:52.458710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:52.459233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:52.460632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] RBAC: Adding query filter params (role.id=85251621622246e79e839f870f6d411d, user.id=fd492b8b3aa64550aaed6b983a6067c4, scope.system=all) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:52.461166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:52.463914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9937b2-dc36-41fa-9b2e-ba1e810c3d38 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:52.495541 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 169/334] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 4 20:03:52 2022] GET /identity/v3/role_assignments?user.id=fd492b8b3aa64550aaed6b983a6067c4&scope.system=all&role.id=85251621622246e79e839f870f6d411d => generated 510 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:54.625186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d7f3-a365-4866-8616-ff64569960b6 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:54.625916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d7f3-a365-4866-8616-ff64569960b6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:54.626520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d7f3-a365-4866-8616-ff64569960b6 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:54.629796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 166/335] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:54.638976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b6d7-afd5-4196-b7e6-4292a1d3a198 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:54.639508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b6d7-afd5-4196-b7e6-4292a1d3a198 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:54.639868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b6d7-afd5-4196-b7e6-4292a1d3a198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:54.657613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:54.687330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-14f2b6d7-afd5-4196-b7e6-4292a1d3a198 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:54.689362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-14f2b6d7-afd5-4196-b7e6-4292a1d3a198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:54.841438 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 170/336] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:55.445160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a8af-0c6d-41dd-870f-1ec552a4e909 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:55.446221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a8af-0c6d-41dd-870f-1ec552a4e909 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:55.446979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a8af-0c6d-41dd-870f-1ec552a4e909 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:55.450390 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 167/337] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:55.460932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:55.461849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:55.462659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:55.481786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a8af-0c6d-41dd-870f-1ec552a4e909 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:55.496324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:55.498343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:55.710608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 171/338] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:55.749486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:55.805952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a8af-0c6d-41dd-870f-1ec552a4e909 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:55.883428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:55.884546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:55.885046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:55.885532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:55.917493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0a2c3c97-801f-4679-ad24-b1075f9384cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:55.932268 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:55.933249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 20:03:55.934078 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:55.934675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 168/339] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:03:55.944866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:56.099639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:56.180902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d07b3-4580-4dc0-b9ca-e2fc29c80ca6 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.181388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d07b3-4580-4dc0-b9ca-e2fc29c80ca6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.181854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d07b3-4580-4dc0-b9ca-e2fc29c80ca6 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.191252 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 169/340] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:56.197679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.198120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.198563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.226827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e54db-5f46-4447-bb77-8a477626e035 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:56.230494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:56.231892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:56.356527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:56.357480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.357922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.358361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.359650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:56.360180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:56.363316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:56.384913 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 172/341] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:56.386975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:56.404858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 170/342] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:03:56.406101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:56.608207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:56.642584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735dba-d646-4992-84c7-a961dcdb3899 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:56.687188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:56.696777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:56.697468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.697754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.698329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.723949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376f5b2-0960-41b0-afe3-7b24491532db None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:56.726634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b9114139-3784-48b3-a834-a15c61c975c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:56.733149 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:56.734756 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:56.736218 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:03:56.742069 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 173/343] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:56.744375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15341-5b3a-4de7-aa6c-d3f65863b4ba None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.744854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15341-5b3a-4de7-aa6c-d3f65863b4ba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.745321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15341-5b3a-4de7-aa6c-d3f65863b4ba None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.747967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 174/344] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:56.750065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4ee5-12ea-452d-9ba9-32e90abe90b4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.750552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4ee5-12ea-452d-9ba9-32e90abe90b4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.751028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4ee5-12ea-452d-9ba9-32e90abe90b4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.762179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 175/345] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:56.763697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4ee5-12ea-452d-9ba9-32e90abe90b4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:56.789822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:56.790960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.792550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.792822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] PATH_INFO: `/v3/users/7e23dd64c733487faa724577814dbebb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.794152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] RBAC: Authorizing `identity:get_user(user_id=7e23dd64c733487faa724577814dbebb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:56.796335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402beca-655b-42d0-bfe0-48d1a9b4527e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:56.799179 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 171/346] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:03:56 2022] GET /identity/v3/users/7e23dd64c733487faa724577814dbebb => generated 293 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:56.801065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bbbb4-34e0-4639-9a6b-9bb17f7eab81 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.801377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bbbb4-34e0-4639-9a6b-9bb17f7eab81 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.801612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bbbb4-34e0-4639-9a6b-9bb17f7eab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:56.825417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ed6bbbb4-34e0-4639-9a6b-9bb17f7eab81 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:56.826923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ed6bbbb4-34e0-4639-9a6b-9bb17f7eab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:56.985927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 172/347] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:56.988629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:56.988842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:56.989297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.020179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4ee5-12ea-452d-9ba9-32e90abe90b4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:57.029486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:57.031500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:57.085067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:57.087997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:57.088869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:57.089601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.091074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] RBAC: Adding query filter params (name=member) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:57.091883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:57.094589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:57.113215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 176/348] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:57.115188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:57.162287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:57.180190 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 173/349] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:57.183085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:57.242180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:57.349890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f58a9-c54d-4258-9acc-edee984b4cca None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:57.394597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:57.395278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:57.395562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:57.395839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.396589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] RBAC: Adding query filter params (role.id=4f2a6ebe135c4adbaca12bc3667dd6cf, user.id=7e23dd64c733487faa724577814dbebb, scope.system=all) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:57.396896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:57.398593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:57.416186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488a769-38f4-468e-afd6-b53480f0bb2c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:57.431045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 177/350] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/role_assignments?user.id=7e23dd64c733487faa724577814dbebb&scope.system=all&role.id=4f2a6ebe135c4adbaca12bc3667dd6cf => generated 510 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:57.431962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:57.520939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:57.521542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:57.521817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:57.522145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.564110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:57.569581 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:57.570512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 174/351] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:57.572234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:57.586045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4495-717d-473b-80d1-4aac37feada0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:57.589910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:57.642562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:57.643243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:57.643534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:57.644369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.736205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:57.739174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:57.781816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:57.857289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c8fb-a53d-4078-a074-26ba0bdef1df None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:57.908376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 178/352] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:57.908900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:57.909970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:57.910325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:57.910512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:57.910660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:57.917966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:57.925185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:57.930522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:57.933982 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 175/353] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:57.934791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:58.076059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b8a9-d32d-4543-99c9-2c0b694967d4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.117440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceeb00-c6bc-42b1-9a1c-20ac09a0e2d9 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.140285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.141350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.141502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.142607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.142607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.144192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:58.144727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:58.146785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100acf2-3f70-48d0-8502-8b3bc665a69d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:58.162759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 179/354] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:58.164229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833317-a00f-48d5-8420-2be668abbe6d None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.164506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833317-a00f-48d5-8420-2be668abbe6d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.164782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833317-a00f-48d5-8420-2be668abbe6d None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.166313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 180/355] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:03:58.166955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833317-a00f-48d5-8420-2be668abbe6d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:58.180131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.181240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.181716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.182162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.199597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:03:58.205387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:03:58.206955 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:03:58.207814 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 176/356] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:03:58.208567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:58.289405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.367578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833317-a00f-48d5-8420-2be668abbe6d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.380921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a52f8-76b0-4664-983f-08b81acfa2fc None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.428366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.430394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.430394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.430394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.432462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:58.434533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:58.436645 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 181/357] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:58 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:58.437767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:58.442380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.443028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.443434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.443714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.444456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:58.444758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:58.446413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddf381-442b-42d0-8616-997e26e5b4c3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:58.461984 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 177/358] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:03:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:58.465185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.465185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.465185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.497053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:03:58.498999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:03:58.562176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.623746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193011-f63b-4274-8d0a-e78b87457663 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.634099 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 178/359] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:03:58.635685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:58.690691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.693037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.693037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.693037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.704264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.824861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:58.826481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:58.859203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83289ca8-e7f4-4a0b-9005-61e08f05907e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:58.924466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:58.925050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:58.925526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:58.926063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:58.927098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:03:58.927613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:58.929457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:58.947789 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 179/360] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:58.947789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.001843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.051399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 182/361] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:59.052911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.113626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.127796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c08b0-2b19-4ef9-be56-1976b3e46346 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:59.188589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:59.189148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:59.189493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:59.189787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:59.200961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:59.202540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:59.204463 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 180/362] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:03:58 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:59.205315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.240985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13baa6-a567-4cc5-a37e-edc7850b0e52 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:59.322316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:59.323846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:59.324345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:59.324839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:59.403635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.419220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28636cd0-deba-45d3-b0bd-1c70c7fc1637 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:59.480260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:59.482335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:59.499518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:59.501047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:59.501515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:59.502345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:59.540533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.639354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 183/363] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:59.640438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.648467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:59.651331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:59.770689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d5b8d-e23c-4990-9c02-ea10c0f19c9d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:59.812097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:03:59.812824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:03:59.813164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:03:59.813499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:03:59.814797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:03:59.816919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:03:59.819040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 184/364] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:03:59 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:03:59.820418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.825241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.834224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:59.844573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 181/365] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:03:59.852304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:03:59.986139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1819-196c-43ba-9b9f-79b4d67b2a6d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:03:59.994080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea221e9-bed3-40f2-af3b-d84c4a725bf2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.030483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.031516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.032004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.032502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.051503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:00.055693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.056723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.057212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.057697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.059055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=85251621622246e79e839f870f6d411d, scope.project.id=d23a587c3520484596c285914dbbb738) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:00.059638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.062441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:00.063541 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:00.064737 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:00.066171 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:00.066940 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 185/366] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:00.067845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.072864 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 182/367] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:03:59 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=85251621622246e79e839f870f6d411d => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.077045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.195801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:00.212048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:00.280341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b023-f914-45a7-b0c5-60b15f4efbb8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.298549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344ab0-5d01-4031-b884-05ee23d2515b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.343228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.344057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.344457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.344851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.346231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.348610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.350809 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 186/368] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.351847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.383257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.384511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.385122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.385625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.387819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.390477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.393365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 183/369] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.395483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.569644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b40b6-0ed2-482c-a49f-50c97af1fd63 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.616102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c171-5655-4b76-879c-edfa4c1da558 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.633995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:00.645989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.647078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.647616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.648106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.650488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.653518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.663299 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 187/370] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.663299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.670977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:00.687113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.687790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.688649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.688990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.689760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:00.690070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.692604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.712249 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 184/371] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.712249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.843968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c553-f0a5-4c06-9b35-434a4e298cc0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.874326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b213f4d-7a08-465f-b28d-d0cb19c44571 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:00.907476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.913837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.913837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.913837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.913837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:00.913837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.914730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.935177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 185/372] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.935177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:00.938278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:00.939001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:00.942298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:00.942298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:00.942298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:00.943024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:00.945436 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 188/373] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:00.946486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:01.042386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:01.083048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:01.122460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8855c2-19c3-4952-baf6-24d79588ae2b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:01.155615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2407f4-6cb1-462f-8b0f-6228f97c6937 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:01.173176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:01.173893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:01.174186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:01.174442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:01.176056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:01.178475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:01.180945 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 186/374] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:01.182016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:01.234126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:01.235985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:01.236914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:01.237804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:01.352954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25cc0a-f457-4f97-9db6-baa526e7f19b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:01.382695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:01.384203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:01.399737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:01.428625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:01.430261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:01.431071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:01.431971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:01.433791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=d23a587c3520484596c285914dbbb738) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:01.434676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:01.437785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:01.455982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 187/375] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:01 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:01.458683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:01.472104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:01.523584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 189/376] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:01.536326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:01.795974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5087e6-dd34-4c43-97f5-d476e56d5fad None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:01.813554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7241b-7201-4fc8-bea6-f55dae5289c9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:01.865547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:01.866870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:01.867416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:01.867910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:01.869339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=85251621622246e79e839f870f6d411d, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:01.869896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:01.872591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:01.884346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 188/377] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:01 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=85251621622246e79e839f870f6d411d => generated 260 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:01.894434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:01.895230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:01.895589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:01.895938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] PATH_INFO: `/v3/projects/39207e776fb342b89ba6688e4c9f0eb3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:01.897345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] RBAC: Authorizing `identity:get_project(project_id=39207e776fb342b89ba6688e4c9f0eb3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:01.899053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:01.901210 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 190/378] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:01 2022] GET /identity/v3/projects/39207e776fb342b89ba6688e4c9f0eb3 => generated 344 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:01.911623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:02.018045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:02.125612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b163e3c-428b-42de-a6f7-58fa50337ba1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:02.194999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:02.196266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:02.196758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:02.197232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] PATH_INFO: `/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:02.207048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] RBAC: Authorizing `identity:get_group(group_id=f3223c6c1e664aaa96d3b8ff0287c909)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:02.209894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ba55-3eae-444d-9a08-407f10b2cd4b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:02.213540 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 189/379] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:01 2022] GET /identity/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909 => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:02.224223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:02.322075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:02.475460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b2a0-c22f-4eea-8d35-e2fb8a4e0895 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:02.566430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:02.567837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:02.568435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:02.568989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:02.570795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] RBAC: Adding query filter params (group.id=f3223c6c1e664aaa96d3b8ff0287c909, role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=39207e776fb342b89ba6688e4c9f0eb3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:02.571440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:02.574803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bdb85-b7f7-4f4a-941d-c70066996ace None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:02.586339 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 191/380] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:02 2022] GET /identity/v3/role_assignments?group.id=f3223c6c1e664aaa96d3b8ff0287c909&scope.project.id=39207e776fb342b89ba6688e4c9f0eb3&role.id=752f2c38dc7242cca4d4703d29369911 => generated 260 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:03.686070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670539-e280-4405-9f45-cd2d0b2bdede None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:03.686602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670539-e280-4405-9f45-cd2d0b2bdede None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:03.687022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670539-e280-4405-9f45-cd2d0b2bdede None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:03.690149 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 190/381] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:03.699820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a4d2-3252-4bb9-99ab-42bd747c7240 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:03.700331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a4d2-3252-4bb9-99ab-42bd747c7240 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:03.700816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a4d2-3252-4bb9-99ab-42bd747c7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:03.753510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f0c3a4d2-3252-4bb9-99ab-42bd747c7240 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:03.755701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f0c3a4d2-3252-4bb9-99ab-42bd747c7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:03.872973 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 192/382] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:04.284541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f2c-6e7c-4511-afb9-d76bf8f1c7ed None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:04.285039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f2c-6e7c-4511-afb9-d76bf8f1c7ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:04.285531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f2c-6e7c-4511-afb9-d76bf8f1c7ed None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:04.288177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 191/383] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:04.294887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:04.295428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:04.295926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:04.321143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8f2c-6e7c-4511-afb9-d76bf8f1c7ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:04.358753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:04.360987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:04.425054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:04.548152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 193/384] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:04:04.644456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8f2c-6e7c-4511-afb9-d76bf8f1c7ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:04.684883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:04.740802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:04.742309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:04.742680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:04.743164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:04.776004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:04.786522 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:04.788307 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:04.790079 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 192/385] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:04.802661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:05.086025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9f254-57f9-46f0-ae85-19e3b6a500b9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:05.164793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:05.166526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:05.167294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:05.168246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:05.170692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] RBAC: Adding query filter params (name=member) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:05.171568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:05.179727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:05.203733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:05.205673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 194/386] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:05.215562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:05.294369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:05.465873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2ee41-0b0a-4593-aa9b-6f3552968b83 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:05.550985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab946ed5-9830-4d0e-97db-8686b75be588 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:05.592735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:05.593845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:05.594340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:05.594830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:05.617128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:05.627479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:05.629765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:05.631323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 193/387] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:04:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:05.642359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:05.674311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:05.676569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:05.677373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:05.678167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:05.680583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:05.683382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:05.688362 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 195/388] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:05 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:05.698876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:05.783763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:05.851308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:05.866371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3972784-e26b-435e-a748-fd39fa6b90cd None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:05.910232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:05.910888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:05.911188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:05.911485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:05.912697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:05.914437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:05.916872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 196/389] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:05 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:05.927502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:06.082886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb76c-b078-474f-9c57-ac53bbd23175 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:06.093934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f16fe-7202-44d3-a194-1aefdc329dd8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:06.140775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:06.141500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.141826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.142095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.142752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:06.143053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:06.145110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d1e55-4422-4825-88c0-4cc15bf04d55 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:06.155179 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 194/390] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:06.156602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead390-3d08-46e2-bce5-c3237e406f34 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.156941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead390-3d08-46e2-bce5-c3237e406f34 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.157209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead390-3d08-46e2-bce5-c3237e406f34 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.158825 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 195/391] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:06.164974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.165346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.165529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.168922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:06.170046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.170536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.171027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/groups/5ea2ca54367344db9300e20c53096e5c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.174706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, group_id=5ea2ca54367344db9300e20c53096e5c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:06.177501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8e43c-39e7-4f65-a66d-07185c046989 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:06.185928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:06.187308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:06.275255 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 196/392] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:06.277355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:06.322878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 197/393] 10.222.0.78 () {58 vars in 1442 bytes} [Tue Oct 4 20:04:05 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/groups/5ea2ca54367344db9300e20c53096e5c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:04:06.336570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:06.509948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6dead-492b-478e-adc9-584ee951ab36 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.510464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6dead-492b-478e-adc9-584ee951ab36 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.510910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6dead-492b-478e-adc9-584ee951ab36 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.519413 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 198/394] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:06.524542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b590-d68a-4906-a9d2-ecf867fa2992 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:06.529569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d907-e68a-4358-bb56-eaf44db0c17c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.530074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d907-e68a-4358-bb56-eaf44db0c17c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.530559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3d907-e68a-4358-bb56-eaf44db0c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.570188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d3f3d907-e68a-4358-bb56-eaf44db0c17c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:06.571592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d3f3d907-e68a-4358-bb56-eaf44db0c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:06.584759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:06.586349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:06.588108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.589003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.589743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.592266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:06.595502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a884bc-126e-4538-a64b-bf3746496c86 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:06.600199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 197/395] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:06 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:06.604902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e57f-00d0-483d-b977-71fce4c56b63 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.604902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e57f-00d0-483d-b977-71fce4c56b63 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.604902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e57f-00d0-483d-b977-71fce4c56b63 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.614333 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 198/396] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:06.616721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e57f-00d0-483d-b977-71fce4c56b63 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:06.676228 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 199/397] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:06.677646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.677977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.680542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.702877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:06.704568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:06.842264 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 200/398] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:06.843677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:06.852706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:06.883626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e57f-00d0-483d-b977-71fce4c56b63 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:06.992785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:06.993956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:06.994481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:06.994988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:06.997239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:07.000148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:07.012296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 199/399] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:06 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:07.016195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.019229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:07.049524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07e14-46a8-4b07-86ce-1b49ca878c62 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.093328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949289-e63f-4a32-b342-664619076844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.094418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949289-e63f-4a32-b342-664619076844 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.094892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949289-e63f-4a32-b342-664619076844 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.095403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949289-e63f-4a32-b342-664619076844 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.108857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae949289-e63f-4a32-b342-664619076844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ae949289-e63f-4a32-b342-664619076844 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:07.115057 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:07.116031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:07.117080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:07.120071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 201/400] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:04:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:07.121197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949289-e63f-4a32-b342-664619076844 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.211179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2d3d-35be-45f1-b4ee-c6d512958f9f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.249794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949289-e63f-4a32-b342-664619076844 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.277527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.278645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.279158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.279681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/groups/5ea2ca54367344db9300e20c53096e5c/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.283565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, group_id=5ea2ca54367344db9300e20c53096e5c, role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:07.286425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:07.294159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.295242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.295824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.296298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.300000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:07.315732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:07.325553 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:07.326668 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:07.327920 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 202/401] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:07.331613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.394810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 200/402] 10.222.0.78 () {58 vars in 1442 bytes} [Tue Oct 4 20:04:07 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/groups/5ea2ca54367344db9300e20c53096e5c/roles/8a3388bd801d479ebdabb84cd8065882 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:07.396899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.439174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:07.548064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71aba3-7891-4897-a5c9-1ddf7c8915d1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.622716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ed5b8-7275-4af3-b3c9-62baa5cca6a5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.624565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.625250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.625529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.625829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.626554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:07.626864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:07.631920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:07.647584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 203/403] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:07.653033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.699500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.700163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.700459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.700726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.701413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:07.701727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:07.703239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:07.713736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 201/404] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:07.714900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.743257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:07.797441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d71b49-8b55-449f-b08e-4765c76077af None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.830090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:07.842132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.842810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.843099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.843413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.854707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f194e-e636-437f-a222-32e367da12d5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:07.857839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:07.864953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:07.866030 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:07.867202 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:07.869636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 204/405] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:07.870696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:07.939546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:07.942806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:07.943255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:07.943580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:07.945792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:07.947965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:07.950806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 202/406] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:07.957795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.039486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956e03-dd7c-4423-9b4d-7925f0e24871 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.072903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:08.103117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.104112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.104421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.104698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] PATH_INFO: `/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.106142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] RBAC: Authorizing `identity:get_group(group_id=f3223c6c1e664aaa96d3b8ff0287c909)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.108185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.115407 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 205/407] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:08.119481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.142729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f34992-c4b0-4787-90ea-ca3f045c179c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.199594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.200669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.201176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.201657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.203540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:08.204140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.206362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.223521 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 203/408] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:08.224877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.243472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:08.326356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaf76e-4a2c-49b5-946b-453bf7c5bc64 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.398224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.399627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.400346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.401182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.403978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.407238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.417262 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 206/409] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:08 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:08.418503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.422622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673685-9fd0-4fbc-9888-46b7eb4a00a5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.494685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.496048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.496846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.497497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] PATH_INFO: `/v3/projects/39207e776fb342b89ba6688e4c9f0eb3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.500012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] RBAC: Authorizing `identity:get_project(project_id=39207e776fb342b89ba6688e4c9f0eb3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.503280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.507098 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 204/410] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:08 2022] GET /identity/v3/projects/39207e776fb342b89ba6688e4c9f0eb3 => generated 344 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:08.508879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.509647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:08.614850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff4baa-9f1e-465d-9898-40ed4c76058f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.687948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.689102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.689626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.690331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.692672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.695556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.703185 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 207/411] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:08 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:08.703185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.704794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:08.754800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b95b8-c652-4456-9175-345d988004d7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.832730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.834369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.835270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.835950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738/groups/5ea2ca54367344db9300e20c53096e5c/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.840466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] RBAC: Authorizing `identity:create_grant(project_id=d23a587c3520484596c285914dbbb738, group_id=5ea2ca54367344db9300e20c53096e5c, role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:08.843707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:08.916810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93b39-8a67-48d6-8762-7f319ce1389d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:08.942086 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 205/412] 10.222.0.78 () {58 vars in 1442 bytes} [Tue Oct 4 20:04:08 2022] PUT /identity/v3/projects/d23a587c3520484596c285914dbbb738/groups/5ea2ca54367344db9300e20c53096e5c/roles/8a3388bd801d479ebdabb84cd8065882 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:08.945292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:08.968253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:08.991315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:08.992803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:08.993313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:08.993810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] PATH_INFO: `/v3/projects/39207e776fb342b89ba6688e4c9f0eb3/groups/f3223c6c1e664aaa96d3b8ff0287c909/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:08.998132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] RBAC: Authorizing `identity:create_grant(project_id=39207e776fb342b89ba6688e4c9f0eb3, group_id=f3223c6c1e664aaa96d3b8ff0287c909, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:09.001247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:09.083367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 208/413] 10.222.0.78 () {58 vars in 1442 bytes} [Tue Oct 4 20:04:08 2022] PUT /identity/v3/projects/39207e776fb342b89ba6688e4c9f0eb3/groups/f3223c6c1e664aaa96d3b8ff0287c909/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:09.198547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c6e74-4df5-4cf5-aa11-639e1ac7234c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:09.276449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:09.278432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:09.279508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:09.280305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:09.283060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:09.287017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a315f8a-01ef-4c13-ae94-6396b1332f0e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:09.291113 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 206/414] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:08 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:09.305051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:09.513176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45479-0a77-468f-8072-6f93e6ef7768 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:09.584001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:09.585716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:09.586529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:09.587340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/groups/5ea2ca54367344db9300e20c53096e5c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:09.592023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f2cebf1be54a9eab5b3e85fd51bcea, group_id=5ea2ca54367344db9300e20c53096e5c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:09.594740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f039-7d96-4203-9f3f-95a5a8dd7b90 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:09.698942 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 209/415] 10.222.0.78 () {58 vars in 1442 bytes} [Tue Oct 4 20:04:09 2022] PUT /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea/groups/5ea2ca54367344db9300e20c53096e5c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:10.336310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737ea92-0dc5-419f-869c-424f9e4bed36 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:10.337869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737ea92-0dc5-419f-869c-424f9e4bed36 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:10.338643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737ea92-0dc5-419f-869c-424f9e4bed36 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:10.342055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 207/416] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:10.351044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b712e1-3fb0-4560-b06b-7bd57e14ea3d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:10.351876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b712e1-3fb0-4560-b06b-7bd57e14ea3d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:10.352010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b712e1-3fb0-4560-b06b-7bd57e14ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:10.389176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83b712e1-3fb0-4560-b06b-7bd57e14ea3d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:10.391259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83b712e1-3fb0-4560-b06b-7bd57e14ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:10.477018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:10.555354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 210/417] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:10.856985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec4d5-9706-46c2-a9e4-581e787ee409 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:10.857671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec4d5-9706-46c2-a9e4-581e787ee409 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:10.858283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ec4d5-9706-46c2-a9e4-581e787ee409 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:10.860299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 208/418] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:04:10.867276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:10.867890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:10.868369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:10.896227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:10.897841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:11.017164 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 211/419] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:04:11.256088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec4d5-9706-46c2-a9e4-581e787ee409 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:11.281793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:11.500350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ec4d5-9706-46c2-a9e4-581e787ee409 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:11.574201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:11.593105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:11.594157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:11.594655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:11.595128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:11.625504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:11.632647 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:11.633680 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:11.634580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:11.649070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 209/420] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:11.655966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:11.771914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:11.825573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520efa0d-c82c-4ae0-a5a8-2b0d5ea2198c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:11.858423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabcae-5605-49b7-8a76-be1f174b403f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:11.863712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:11.958224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:11.959356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:11.959885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:11.960363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:11.961824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:11.962536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:11.964657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:11.976093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:11.978325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:11.979485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:11.980159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:11.984542 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 210/421] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:04:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:12.001217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:12.015508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:12.024136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:12.025591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:12.026443 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:12.033556 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 212/422] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:12.043202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:12.351694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21589-d442-49b3-9261-fd5bcd10c987 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:12.359547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191f6e-7be3-4125-8c14-10b7e5bdf77d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:12.460776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:12.461902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:12.462593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:12.463084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:12.464532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:12.465680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:12.471192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:12.475566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:12.500553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 213/423] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:12.503781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:12.506085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:12.506945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:12.507809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:12.512855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:12.605508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:12.761442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:12.764282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc370f9-a25e-462a-a3dd-3eda8f774fcd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:12.833145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d5d4-aef6-45d5-a551-1c8ed1625341 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:12.898004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:12.898739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:12.899078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:12.899482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:12.976299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 211/424] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 975 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:12.978796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f76d-1623-45cc-a52f-f6edc573d2e3 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:12.979333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f76d-1623-45cc-a52f-f6edc573d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:12.979825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f76d-1623-45cc-a52f-f6edc573d2e3 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:12.982887 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 212/425] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:12.990538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186900-41be-449d-bc18-38ff826679b0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:12.990883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186900-41be-449d-bc18-38ff826679b0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:12.991263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08186900-41be-449d-bc18-38ff826679b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.021596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-08186900-41be-449d-bc18-38ff826679b0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:13.022705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:13.023738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-08186900-41be-449d-bc18-38ff826679b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:13.024404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0099-b333-420a-8eef-ebb3d3139496 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:13.060587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.072071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.161577 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 213/426] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:04:13.163458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08186900-41be-449d-bc18-38ff826679b0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.222895 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 214/427] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:13.224909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcbd8-a736-4a25-aab4-f6dec05ca61c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.225490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcbd8-a736-4a25-aab4-f6dec05ca61c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.225963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bcbd8-a736-4a25-aab4-f6dec05ca61c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.231988 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 215/428] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:13.233255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bcbd8-a736-4a25-aab4-f6dec05ca61c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.370882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08186900-41be-449d-bc18-38ff826679b0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:13.390716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bcbd8-a736-4a25-aab4-f6dec05ca61c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:13.435921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.448569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:13.449720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.450313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.450771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.452515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:13.454558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e277a1-77a6-434f-be9e-57c007411fa1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:13.454725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:13.456150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.456786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.457317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.458211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 214/429] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:13.459935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:13.460257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.460688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.461233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.463394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:13.470995 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 216/430] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:13.470995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.497583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:13.499201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:13.546101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.638148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 215/431] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:13.640071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.687822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488557f-1dd7-447f-a3b6-dead71a29974 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:13.756719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:13.757932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.758404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.758867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.761465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:13.764457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:13.767624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 217/432] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:13.777291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.788565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22586f61-3f33-450b-9746-b6b53f444a3b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:13.849500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:13.850658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:13.851164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:13.851622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:13.853626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:13.856523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:13.860255 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 216/433] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:13.867457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:13.905385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.938965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:13.994278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dcea-f592-4169-a8f5-fc7970ee98c7 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.073078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:14.074225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.074672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.075446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.095438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a77b8-79c8-4b70-b85d-9de236cad09f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.096027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:14.106045 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:14.107794 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:14.109429 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 218/434] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:14.110923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:14.164008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:14.165138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.165498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.165960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.167361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=85251621622246e79e839f870f6d411d, scope.project.id=d23a587c3520484596c285914dbbb738) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:14.167901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:14.170756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:14.181763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 217/435] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:13 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=85251621622246e79e839f870f6d411d => generated 611 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:14.183253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:14.319533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd3cb2-8cbc-4605-a95a-748e4b795962 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.341876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:14.358458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:14.362511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9224d7-d6ab-4949-a4f6-77359889a408 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.389423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:14.392266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.392266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.392266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.393019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:14.394094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:14.397159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f2578-c21f-4d5f-af17-04c35c55bdaf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:14.417760 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 219/436] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:14 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 611 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:14.417760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db51ba-5e57-44df-bb6c-2b8cc1f1c831 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.417760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db51ba-5e57-44df-bb6c-2b8cc1f1c831 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.417760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db51ba-5e57-44df-bb6c-2b8cc1f1c831 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.417760 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 220/437] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:14.420005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db51ba-5e57-44df-bb6c-2b8cc1f1c831 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:14.432105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:14.433909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.434122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.434468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.465321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-70a04035-ea20-4398-9954-a9e57a0024e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:14.480269 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:14.481349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:14.482140 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:14.483427 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 218/438] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:14.486195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.486680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.487183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.525831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:14.528320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:14.661488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db51ba-5e57-44df-bb6c-2b8cc1f1c831 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.667120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 219/439] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:14.668512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:14.730753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:14.732818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:14.733258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:14.733717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:14.734851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:14.735385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:14.739012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:14.757641 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 221/440] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:14.766717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:14.868472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:14.890284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:14.936776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd46ce-f651-4e87-bb61-459f9ac3f90a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:14.993597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb0a97-d512-4bd3-aa8b-8eb9ba2f9482 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.005402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.007592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.007592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.007789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.008838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:15.009381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.012102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.035228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 220/441] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:15.037102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.064723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.066213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.066643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.067063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.170168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.171770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.190195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f9e82-1a2f-4cd7-a9d2-b1a6b4863242 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.234103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.234871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.235572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.235572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.247456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.250972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.329938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.332603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.341154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 222/442] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:15.342628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.486488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0c92-b589-4e92-b9a0-b8cc456462fa None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.487241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 221/443] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:15.488131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.542471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.543348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.543707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.544046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.560338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:15.567081 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:15.568937 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 223/444] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:15.570511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.579773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.584879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.658381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceacd2-2830-4bab-bfe8-a9f7fbafa20e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.703696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.704396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.704608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.704881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] PATH_INFO: `/v3/projects/39207e776fb342b89ba6688e4c9f0eb3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.706655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] RBAC: Authorizing `identity:get_project(project_id=39207e776fb342b89ba6688e4c9f0eb3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.708160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.709836 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 222/445] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/projects/39207e776fb342b89ba6688e4c9f0eb3 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:15.710618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.747406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f8d4-7d8b-4b42-b94f-db043ceda8cb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.797906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.798714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.799087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.799577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] PATH_INFO: `/v3/projects/d23a587c3520484596c285914dbbb738` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.801022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] RBAC: Authorizing `identity:get_project(project_id=d23a587c3520484596c285914dbbb738)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.802618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.810111 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 224/446] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/projects/d23a587c3520484596c285914dbbb738 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:15.810111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.856049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0596da5-92bb-45ff-8d47-3e1aea99292a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:15.871660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.909455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:15.910282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:15.910765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:15.911299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:15.912528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:15.913051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:15.915693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:15.931837 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 223/447] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:15.933332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:15.947517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:15.988348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4b5b8-c4ce-42d2-8c61-86e89325a73c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:16.057345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:16.058330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:16.058812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:16.059332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] PATH_INFO: `/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:16.061429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] RBAC: Authorizing `identity:get_group(group_id=f3223c6c1e664aaa96d3b8ff0287c909)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:16.064258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:16.068039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 225/448] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/groups/f3223c6c1e664aaa96d3b8ff0287c909 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:16.069488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:16.112067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2256cd-b322-44e1-b659-e62809ef48b4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:16.176734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:16.177808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:16.178311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:16.178776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:16.180893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:16.183734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:16.186739 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 224/449] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:15 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:16.188225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:16.263658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30596e91-5f76-4537-80f9-e2b077cdb0de None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:16.269535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.335381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:16.336573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:16.336984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:16.337472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:16.361287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.385715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e5e0b-ab78-4b93-86fb-d36b979ec1a5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:16.451350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:16.452276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:16.452681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:16.453101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:16.454485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] RBAC: Adding query filter params (group.id=f3223c6c1e664aaa96d3b8ff0287c909, role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=39207e776fb342b89ba6688e4c9f0eb3) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:16.455035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:16.458465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:16.470274 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 225/450] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:16 2022] GET /identity/v3/role_assignments?group.id=f3223c6c1e664aaa96d3b8ff0287c909&scope.project.id=39207e776fb342b89ba6688e4c9f0eb3&role.id=752f2c38dc7242cca4d4703d29369911 => generated 611 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:16.471555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:16.485309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:16.488350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:16.704916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5455-93fa-4d8d-828c-455140a8749e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:16.712386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.719805 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 226/451] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:16.729691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:16.789553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:16.791113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:16.791944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:16.794077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:16.795562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=d23a587c3520484596c285914dbbb738) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:16.796094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:16.798837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:16.811709 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 226/452] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:16 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=d23a587c3520484596c285914dbbb738&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 611 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:16.824265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.943688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc22fa-6294-4f1d-84de-4dd8ee238b14 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:17.012603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:17.013693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:17.014178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:17.014666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] PATH_INFO: `/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:17.017067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] RBAC: Authorizing `identity:get_project(project_id=27f2cebf1be54a9eab5b3e85fd51bcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:17.020459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:17.023976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 227/453] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:04:16 2022] GET /identity/v3/projects/27f2cebf1be54a9eab5b3e85fd51bcea => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:17.033619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:17.240665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e73e-65f7-4802-96b1-35b16fb62ad8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:17.310689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:17.311846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:17.312336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:17.312826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] PATH_INFO: `/v3/groups/5ea2ca54367344db9300e20c53096e5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:17.315514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] RBAC: Authorizing `identity:get_group(group_id=5ea2ca54367344db9300e20c53096e5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:17.318401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9ed64-ef0b-4629-9308-9275cbbdb3e5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:17.321742 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 227/454] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 4 20:04:17 2022] GET /identity/v3/groups/5ea2ca54367344db9300e20c53096e5c => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:17.334098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:17.526212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eac53-280d-45b6-96e9-bb7b31aa7a81 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:17.540431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:17.567301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:17.568044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:17.568402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:17.569236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:17.569665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] RBAC: Adding query filter params (group.id=5ea2ca54367344db9300e20c53096e5c, role.id=85251621622246e79e839f870f6d411d, scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:17.570069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:17.571867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976bd5f-ae20-4481-b38e-bbdfc1bdd906 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:17.581848 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 228/455] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 4 20:04:17 2022] GET /identity/v3/role_assignments?group.id=5ea2ca54367344db9300e20c53096e5c&scope.project.id=27f2cebf1be54a9eab5b3e85fd51bcea&role.id=85251621622246e79e839f870f6d411d => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:22.444085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffd6ce-7e28-47d6-91c6-a7b445caa7bb None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:22.444659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffd6ce-7e28-47d6-91c6-a7b445caa7bb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:22.444959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffd6ce-7e28-47d6-91c6-a7b445caa7bb None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:22.447923 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 228/456] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:22.457339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20378-791c-478c-a396-e6b91468c452 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:22.458435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20378-791c-478c-a396-e6b91468c452 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:22.458981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20378-791c-478c-a396-e6b91468c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:22.485928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b7e20378-791c-478c-a396-e6b91468c452 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:22.487681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7e20378-791c-478c-a396-e6b91468c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:22.588287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 229/457] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:22.598362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37715-85f1-4e09-9754-327f343a7098 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:22.598858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37715-85f1-4e09-9754-327f343a7098 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:22.599367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37715-85f1-4e09-9754-327f343a7098 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:22.602254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 229/458] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:22.610826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937a55-ef02-4be7-bc21-840d70e4b2c2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:22.612044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937a55-ef02-4be7-bc21-840d70e4b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:22.612573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937a55-ef02-4be7-bc21-840d70e4b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:22.641966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2a937a55-ef02-4be7-bc21-840d70e4b2c2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:22.644127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2a937a55-ef02-4be7-bc21-840d70e4b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:22.766605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 230/459] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:04:23.018288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51a30-4d4d-402e-b9ec-e77348a276c2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.018707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51a30-4d4d-402e-b9ec-e77348a276c2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.019216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f51a30-4d4d-402e-b9ec-e77348a276c2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.022124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 230/460] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:23.030889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.032679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.032679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.068278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f51a30-4d4d-402e-b9ec-e77348a276c2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:23.075008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:23.080236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:23.167559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:23.203975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:23.271568 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 231/461] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:23.274917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:23.444851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f51a30-4d4d-402e-b9ec-e77348a276c2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:23.492782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db8d0-d93e-49e0-8cf5-673e2e9689e6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:23.518785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:23.520260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.520919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.521674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.530738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:23.531889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.532335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.532771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.542389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:23.544902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:23.546056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:23.546433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-9a4eea6c-d8ec-4fa8-bcde-fa4d709cdca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:23.562670 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:23.563696 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:23.564581 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:23.564581 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:23.564581 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:23.566783 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 232/462] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:23.568364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36e5c-b714-4dde-85e7-0098d6cb4ff7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.568861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36e5c-b714-4dde-85e7-0098d6cb4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.569301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36e5c-b714-4dde-85e7-0098d6cb4ff7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.571152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 233/463] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:23.577442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:23.579272 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:23.581539 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:23.581539 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:23.581539 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:23.587174 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 231/464] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 517 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:23.587547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.587845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:23.588120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.588120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.630675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:23.633515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:23.691221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:23.754326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:23.768641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75799327-4bea-4340-ad55-fa7225efce62 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:23.794917 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 234/465] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:23.796319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:23.812720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:23.813357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:23.813639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:23.813914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:23.814667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:23.814975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:23.816485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:23.837217 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 232/466] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:23.842955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:23.951294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cec21-3fe3-464f-8a1a-23807b7ca9ca None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:23.966668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6cf69-bc15-4584-9f48-7231ae32da55 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:24.002268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.003415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.003415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.003590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.004224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:24.004531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.006008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a430-95cd-40c5-8db8-c229e0618912 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.024624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 235/467] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:24.030587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069934-caa2-49da-8e24-02d321b79616 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.031579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069934-caa2-49da-8e24-02d321b79616 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.031579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069934-caa2-49da-8e24-02d321b79616 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.035260 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 236/468] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:24.035260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b069934-caa2-49da-8e24-02d321b79616 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:24.038680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.039872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.040382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.040885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.042188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.045258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.047195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:24.154970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b069934-caa2-49da-8e24-02d321b79616 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:24.171931 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 233/469] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:04:23 2022] POST /identity/v3/users => generated 248 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:04:24.172623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:24.178542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:24.245475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.246789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.248354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.249162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.281184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.285615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-81c1c9b5-bda8-4e5b-931d-28238b34684a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:24.307095 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:24.309170 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:24.311292 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:24.311292 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:24.311292 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:24.313765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 237/470] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:24.315350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.315639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.315915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.335738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7490e-42c1-400c-906b-4c32c11491e5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:24.337507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:24.338972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:24.400325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.401238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.401652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.402058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.403173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.405840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.416659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:24.436287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 238/471] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:24.437310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:24.528297 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 234/472] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:04:24 2022] POST /identity/v3/users => generated 246 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:04:24.529899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:24.707363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa608-a38e-44a6-8bba-4051f6d5b563 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:24.742821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:24.803254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.803943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.804281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.804565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.805379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:24.805691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.807237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.826154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 239/473] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:24.827178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:24.837168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78e3b0-3b66-4e55-b623-5e23b8a5fc5e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:24.903065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:24.903746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:24.904088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:24.904386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:24.923416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:24.927408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:24.928235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:24.958944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:24.960923 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:24.963666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:24.963666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:24.963666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:24.963666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 235/474] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:24.963666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:25.016578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c825-b60c-41c5-a557-2060583c6f96 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:25.056754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:25.057379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:25.057695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:25.058036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:25.058897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:25.060533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:25.102491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.sql.core [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 20:04:25.102491 n-d-852085-12 devstack@keystone.service[82440]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 20:04:25.102491 n-d-852085-12 devstack@keystone.service[82440]: [parameters: {'id': '4f9bd2a898664647937839860dd63032', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 20:04:25.102491 n-d-852085-12 devstack@keystone.service[82440]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82440) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 20:04:25.112100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b90cd2-a428-409a-bd4b-9a61b4b26698 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application result.read() Oct 04 20:04:25.121563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:04:25.123313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application yield resource Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise self.value Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application session.commit() Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:04:25.125092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:04:25.126797 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:04:25.139513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application result.read() Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:04:25.141433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [parameters: {'id': '4f9bd2a898664647937839860dd63032', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:25.143345 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 20:04:25.150771 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:25.152111 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 240/475] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 4 20:04:24 2022] POST /identity/v3/roles => generated 144 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:25.152111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:25.152300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:25.184755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:25.186201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:25.186982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:25.187814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:25.189490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:25.192592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:25.293420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17537c7a-fe74-4696-8453-731aaf28b827 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:25.313867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:25.331159 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 236/476] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:04:24 2022] POST /identity/v3/users => generated 248 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:04:25.332823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:25.367382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:25.369285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:25.369875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:25.370811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:25.372387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:25.373125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:25.376634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:25.411319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 241/477] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:25.417942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:25.606491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4736-8faa-4ad4-847f-3562d83534ba None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:25.646846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2a2a2-abc8-458e-9fa9-98fac7e81fb5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:25.662049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:25.663278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:25.663834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:25.664412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:25.665338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:25.667117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e6a3-0730-4895-a883-30b24f68426a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:25.727205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:25.728324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:25.729014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:25.729699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:25.753628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:25.764896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:25.766587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:25.768236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 237/478] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:25.778374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:25.791440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 242/479] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:04:25 2022] POST /identity/v3/users => generated 249 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:04:25.845628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:25.974996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1300a3-ec4a-493c-b8bf-540697633915 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:26.068916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:26.069555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:26.069835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:26.070111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:26.070809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:26.071112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:26.073013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abcdd-8a08-4786-a681-fe6428ac436e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:26.086397 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 238/480] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:28.085421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ce69-5c27-4a70-9906-0a498d0a35f2 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:28.086222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ce69-5c27-4a70-9906-0a498d0a35f2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:28.086504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052ce69-5c27-4a70-9906-0a498d0a35f2 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:28.089333 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 243/481] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:28.098467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:28.099273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:28.099273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:28.124987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:28.126256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:28.171540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a1d2-b170-49c2-9b9e-91cabc43be12 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:28.172007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a1d2-b170-49c2-9b9e-91cabc43be12 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:28.172505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a1d2-b170-49c2-9b9e-91cabc43be12 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:28.175477 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 244/482] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:28.181962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:28.182428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:28.182915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:28.221539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 239/483] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:28.227188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:28.227188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:28.254630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:28.313312 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 245/484] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:28.595232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:28.629620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:28.760318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8140e-e3a3-4188-9f4a-3c41a403319a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:28.816990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:28.817670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:28.817949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:28.818164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:28.818731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:28.833838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:28.843208 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:28.845028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:28.847298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 240/485] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:28.851082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.043637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:29.055382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e211f2a-c2f9-4bc4-b30b-074d7e2d9c5c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.090364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc003-9c6d-43d9-8ef4-3541c6491280 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.132777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.133531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.133677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.134021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.151299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fcd808c6-3edb-415e-bcc4-d6a5392eaf50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:29.156455 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:29.158261 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 246/486] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:29.161445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b286-c234-4e5b-8de0-ec2b72f44a1c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.164191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b286-c234-4e5b-8de0-ec2b72f44a1c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.164191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b286-c234-4e5b-8de0-ec2b72f44a1c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.171168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 247/487] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:29.171168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.171168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.171168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.171791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d07df-8351-4773-84be-98b031b25834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.171791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d07df-8351-4773-84be-98b031b25834 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.171791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d07df-8351-4773-84be-98b031b25834 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.171791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d07df-8351-4773-84be-98b031b25834 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.172937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d07df-8351-4773-84be-98b031b25834 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:29.179169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d07df-8351-4773-84be-98b031b25834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.179169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d07df-8351-4773-84be-98b031b25834 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:29.185209 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 241/488] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:29.186238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d07df-8351-4773-84be-98b031b25834 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.253792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:29.255783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:29.275064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:29.322098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d07df-8351-4773-84be-98b031b25834 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.337791 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 248/489] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:29.339095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.383014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.383665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.383996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.384271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.384964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:29.385263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.386840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:29.403657 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 242/490] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:29.412780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.416936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:29.484642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e874-a0af-4917-959f-b900221d9ba9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.554578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.556052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.556726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.557458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.565191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2bfa0-dcd7-43f5-9af5-e1231b3eb980 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.577802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.581470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:29.600970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:29.605258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.605844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.606158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.606436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:29.616031 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:29.618318 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:29.620007 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:29.620007 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:29.620007 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:29.620332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.621035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:29.623383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 249/491] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:29.637357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:29.641984 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:29.646053 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:29.651544 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:29.651544 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:29.651544 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:29.651544 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 243/492] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:29.652832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.753146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:29.817937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11042b-c044-4e8c-96f3-1390fcc77b36 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.885527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.886181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.886466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.886740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.887494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:29.887788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.889322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dfe3b-cbbd-4db7-a178-66357b16cedc None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:29.904611 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 244/493] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:29.905817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab682-4be1-4f51-83f2-03243b772e7d None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.906196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab682-4be1-4f51-83f2-03243b772e7d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.906420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab682-4be1-4f51-83f2-03243b772e7d None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.913738 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 245/494] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:29.915098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ab682-4be1-4f51-83f2-03243b772e7d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:29.927682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f3a-7357-4e4c-8259-48ee53893ff2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:29.990106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27222-894f-46a7-a070-344480febb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:29.991309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27222-894f-46a7-a070-344480febb1f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:29.992570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27222-894f-46a7-a070-344480febb1f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:29.992947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27222-894f-46a7-a070-344480febb1f None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:29.993971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27222-894f-46a7-a070-344480febb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:29.995206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27222-894f-46a7-a070-344480febb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:29.997086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c27222-894f-46a7-a070-344480febb1f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.023189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 250/495] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:30.023189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.023189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.023189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.045198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:30.046451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:30.095527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ab682-4be1-4f51-83f2-03243b772e7d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.122056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.128366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.144205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 251/496] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:30.144205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.172944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.174562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.175048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.175558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.189956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:30.192764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:30.217411 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:30.218767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:30.220204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 246/497] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:30.221146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.285979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692dcd0-ff37-4e33-a048-67f52182ddfd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.333761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.334409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.334692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.334972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.347112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-55fc265b-9085-48b3-99c7-18cfdf2d716f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:30.352078 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:30.353011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 252/498] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:30.354459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7167-648c-4d9a-a3e6-59f5722716b9 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.355899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7167-648c-4d9a-a3e6-59f5722716b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.355899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7167-648c-4d9a-a3e6-59f5722716b9 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.356529 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 253/499] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:30.357266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7167-648c-4d9a-a3e6-59f5722716b9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.415498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c849b-6b2e-47ff-a5ed-2ec1119fb23f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.437936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.465063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.466150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.466519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.467004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.481253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:30.483966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ce1745e6-0517-4046-a9e6-630af12716fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:30.500417 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:30.501508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 247/500] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.503789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.505058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.520893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7167-648c-4d9a-a3e6-59f5722716b9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.523672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:30.524950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:30.557325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.574764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.575607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.575895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.576167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.577030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:30.577342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:30.579050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.608432 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 248/501] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:30.609589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.631350 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 254/502] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:30.644560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.777748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093368e-7add-4f82-b38c-2ccdee86e525 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.813384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db52a7-de44-4867-bcac-f78f7df04a0c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:30.836096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.837043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.837993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.838405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.838681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.839731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:30.840040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:30.841852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.852596 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 249/503] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:30.853464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.895627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:30.896619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:30.896899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:30.897129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:30.903171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:30.915337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:30.918151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:30.935513 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:30.936640 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:30.937786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:30.937786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:30.937786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:30.937786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 255/504] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:30.937786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:30.989751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb26c7-bb95-44e3-ad05-7413badcc1b8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.036930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.037551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.037824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.038090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.038853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:31.039170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.040635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:31.058961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f9c7-b440-4309-9831-871c37c40288 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.092589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 250/505] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:31.093698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.104787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.105413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.105692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.105963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.147510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.222624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.224618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.225094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:31.245588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba2f5-af3a-416e-a6b1-2a0576eb10a3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.289016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.289661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.289969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.290306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.303576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.305320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:31.326904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:31.328120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:31.334298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:31.334298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:31.334298 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:31.334298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 251/506] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:31.334298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.357265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 256/507] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:31.358241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.456719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.496450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8e7a-81f4-4f35-bc51-27f73293589a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.516727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7183c-3666-42f8-9ad1-dfcf8d276be3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.542473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.543303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.543583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.543847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.552208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.557539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:31.562673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:31.565104 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:31.567267 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:31.568653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.568824 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 252/508] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:31.568965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.569146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.569288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.569288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.569288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:31.569288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.570448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:31.593649 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 257/509] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:31.594580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.740483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a56e8-ef6a-4f1b-8fa2-f0d6ff318771 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.772651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e832-a516-41ee-b99f-c33f602c5cee None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:31.807699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.808676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.809124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.811440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.811682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.840648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:31.846008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:31.846008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:31.846008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:31.846008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:31.846008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.847223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:31.870976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 258/510] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:31.872675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:31.908011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:31.911008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:31.912811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.057169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 253/511] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:32.057383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb8c05-294d-4e98-aa3c-5d208a687d1c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.057511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.103765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.104412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.104700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.104975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.120138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.121675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:32.144251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:32.145895 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:32.147100 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:32.147100 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:32.147100 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:32.152746 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 259/512] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:32.153720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.205899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.208908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.216432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201138-20b4-46b1-8099-40474e4b19c5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.280186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.280985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.281258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.281749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.283498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:32.284039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.286682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.302443 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 254/513] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:32.303976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.323039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e8e7-9680-44d4-8c35-67eb515cef61 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.371784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.372545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.372925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.373305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.374128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.376056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.484411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 260/514] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:04:32 2022] POST /identity/v3/users => generated 247 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:04:32.485792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.496378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b60b-46ea-492b-9a4a-34be06d55e9d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.551877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.552873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.553457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.553892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] PATH_INFO: `/v3/users/glance` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.570011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.572197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:32.607766 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:32.609292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:32.611289 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 255/515] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:32.612555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.656742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.707770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.734845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc6d2-7b5b-49f2-b200-3ebd3c0f6a4a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.812471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.813626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.814112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.814614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.837534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.838997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729cba7-942e-448e-98c4-16d28b16973c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:32.841254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:32.876021 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:32.878533 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:32.880401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:32.880401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:32.880401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:32.880401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 261/516] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:32.880857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:32.919509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:32.920640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:32.921117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:32.921610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:32.922851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:32.923437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:32.926158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:32.950941 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 256/517] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:32.953309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.098568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96bbee-cc21-4dba-9400-c5e41e6f3a28 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.154703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:33.170096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.172986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.174406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.175566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:33.193560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cba16b-910c-421e-8e00-4f177d33f161 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.201619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:33.206374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:33.210607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:33.243348 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:33.245172 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:33.248313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:33.248313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:33.248313 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:33.248313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 262/518] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:33.248313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.269807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.270904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.271415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.271846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:33.273260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:33.273819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:33.276679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:33.319991 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 257/519] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:33.323696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.461835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000606c8-cd2c-47fa-b8af-56103581f09f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.532058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.532818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a2e04-a4fb-41ea-83c9-6c3479767499 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.533116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.533634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.534101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:33.535339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:33.536176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:33.540229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:33.565810 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 263/520] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:33.567684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.619430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.620945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.621479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.621954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:33.635036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:33.637810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:33.641372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:33.662609 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:33.664532 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 258/521] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:33.667080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.684420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:33.787224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d2f7-4906-49cf-af2c-f65306d4da18 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.874494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.875651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.876588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.877661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:33.878943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:33.879573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:33.882292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:33.898385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea42ba-4525-47dc-83ac-6a3dededd039 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:33.915711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 264/522] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:33.915711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:33.971754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:33.973033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:33.973511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:33.974033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.100161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:34.107900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:34.112223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:34.171468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f1cb-6323-4b44-88a7-b29a322772cd None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:34.197342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:34.241525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:34.242753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:34.243220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:34.243661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.257186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:34.259667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:34.282819 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:34.284857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 265/523] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:34.287450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:34.328389 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 259/524] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:34.332066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:34.488212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07cac1-6a71-4528-b627-090b14404100 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:34.535512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:34.542930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ad3a2-37cb-42d7-9933-a8b5e19b0d65 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:34.558004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:34.558984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:34.559500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:34.559943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.561180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:34.561671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:34.564467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:34.600141 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 266/525] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:34.601755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:34.628117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:34.629228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:34.629667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:34.630151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.645041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:34.647904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:34.675075 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:34.676895 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:04:34.678922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:34.682974 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 260/526] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:34.684971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:34.690435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:34.825433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24a501-7afb-4dca-ab35-66372891cecb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:34.895909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039c87-9a14-41b4-b063-a8079585d00d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:34.899812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:34.901038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:34.901541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:34.902038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.903412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:34.903969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:34.906801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:34.937117 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 267/527] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:34.938569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:34.973847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:34.975074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:34.975604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:34.976095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:34.998221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:35.001043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:35.029109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:35.030940 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:35.034751 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:35.034751 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:35.034751 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:35.034751 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 261/528] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:35.034751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:35.064647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:35.145978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:35.162864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18c4a-8817-4d92-9a8e-a015f9493f27 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:35.234378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:35.236732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:35.236732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:35.237129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:35.238521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a554eb26060549b48a431c579659ff93) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:35.239063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:35.242396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:35.263187 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 268/529] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:34 2022] GET /identity/v3/role_assignments?user.id=a554eb26060549b48a431c579659ff93&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:35.263484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532abc3-8cc2-4d28-8bde-3d3fe696b8da None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:35.263662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:35.342982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:35.344297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:35.344883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:35.345527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:35.347407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:35.348190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:35.351362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:35.394243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 262/530] 10.222.0.78 () {56 vars in 1139 bytes} [Tue Oct 4 20:04:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:35.395827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:35.496743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23266a-afc8-4702-9d84-603557d6677f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:35.551449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:35.569199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:35.570242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:35.570717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:35.571513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:35.573149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:35.573149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:35.576020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:35.587427 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 269/531] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:35 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:35.589952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:35.640187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435647c-7ed4-43fe-8b46-4bafeb506da0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:35.646406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:35.721601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:35.723240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:35.724026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:35.724952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:35.727597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:35.728578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:35.732415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:35.764363 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 263/532] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:35.772973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:35.841193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4471b9f-7eaf-448e-9bbf-e3b190993283 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:35.930896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:35.933567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:35.934942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:35.935930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:36.165999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9cf75-a22b-4d2f-a83c-70ba2358f4e8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:36.165999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:36.165999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:36.165999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:36.166643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:36.166643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:36.166893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:36.167609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f2368-ee61-4fa4-97b7-5f63c46b7147 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:36.175444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:36.178441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ad3bd658-f902-4b66-86c3-6a4b1610dbdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:36.206323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:36.208462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:36.210174 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:36.214253 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 264/533] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:36.216951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b608a-7d78-46dc-a6b5-4e6e54a02786 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:36.217414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b608a-7d78-46dc-a6b5-4e6e54a02786 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:36.217870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b608a-7d78-46dc-a6b5-4e6e54a02786 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:36.224510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:36.226764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 265/534] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:36.232819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b608a-7d78-46dc-a6b5-4e6e54a02786 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:36.411120 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 270/535] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:36.414340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:36.415108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:36.415818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:36.450787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:36.453046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:36.463638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b608a-7d78-46dc-a6b5-4e6e54a02786 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:36.545774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:36.548215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:36.548911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:36.549517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:36.552049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:36.552816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:36.556937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:36.606905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 271/536] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:36.608778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:36.611682 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 266/537] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:36.617420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:36.786936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:36.788718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:36.941391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee1ab-949e-4d08-b54f-84581d702c93 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:37.006640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c88c-cd78-4149-826e-0caebbc3646b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:37.018058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:37.019165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:37.019664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:37.020148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:37.041442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:37.044385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:37.074994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:37.076666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:37.079079 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:37.079079 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:37.079079 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:37.079079 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 272/538] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:37.088116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:37.146250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:37.155680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:37.156244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:37.156730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:37.158318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=426a3d7b9b2248b6b22051224a4baa17) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:37.158845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:37.161771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:37.191549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 267/539] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:36 2022] GET /identity/v3/role_assignments?user.id=426a3d7b9b2248b6b22051224a4baa17&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:37.268828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:37.304236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ab9b-3b95-4735-b3b4-81f5b8e8ca55 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:37.307712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:37.382837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:37.383958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:37.384473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:37.384948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:37.386111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:37.386597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:37.389181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:37.413673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 273/540] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:37.428905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:37.625448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebe21-a1cb-4b32-82f6-a77fd266362f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:37.671333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:37.731029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143826c6-82fb-4b50-8cae-be7cdd93ea11 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:37.763701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:37.764854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:37.765509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:37.766001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:37.796477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:37.807496 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:37.809238 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:37.811795 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 268/541] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 542 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:37.817850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:37.817850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:37.817850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:37.817850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:37.819906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:37.839194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:37.842090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:37.867753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:37.870959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:37.874200 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 274/542] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:37.889843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:37.978800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:38.182309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539acd61-43a5-4e22-9943-06e3ad47e310 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:38.183985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee745-1e83-447b-aa76-0c6d2860df0d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:38.252603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:38.253559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:38.254010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:38.254460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:38.255682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:38.256181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:38.258844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:38.264097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:38.265114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:38.265599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:38.266081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:38.267967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:38.268501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:38.271628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:38.275643 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 269/543] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:38.286259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:38.303200 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 275/544] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:38.312983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:38.415521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:38.617583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:38.654371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c90a61-ea8e-49e5-8076-aca9416dbd92 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:38.680547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7b3f-477e-4dfa-94a7-5e8e59c213a9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:38.744100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:38.745206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:38.745712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:38.746194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:38.795604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:38.798515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:38.812732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:38.813568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:38.814548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:38.815019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:38.816356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=e67b4e16c695421890649a036fada64c) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:38.816882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:38.819090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:38.832124 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:38.834170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:38.835974 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:38.835974 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:38.835974 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:38.840826 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 270/545] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:38.842820 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 276/546] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:38 2022] GET /identity/v3/role_assignments?user.id=e67b4e16c695421890649a036fada64c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:38.851868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:39.049916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:39.084422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699809a-e430-46ce-9d4b-9d7cb68d32c6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:39.156646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:39.158729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:39.159549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:39.160334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:39.161919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:39.162679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:39.165651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:39.193296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 271/547] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:39.202418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:39.370671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314fb38-a8ce-4bab-9481-3d767f0232d9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:39.423078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:39.423931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:39.424212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:39.424484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:39.434359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:39.435890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:39.456978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:39.458574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:04:39.459774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:39.463658 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 277/548] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:04:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:39.464992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:39.729476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0f42-cc05-43a6-9c57-90002ee4504e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:39.827394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:39.828459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:39.828937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:39.829406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:39.830882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:39.831438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:39.834184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c0cf-4504-4ffe-b071-84d93570f891 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:39.886114 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 272/549] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:04:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:39.895456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:39.915877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:39.956127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94bf5-50a5-4211-84b3-2bf89e300603 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:39.956530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94bf5-50a5-4211-84b3-2bf89e300603 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:39.956896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94bf5-50a5-4211-84b3-2bf89e300603 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:39.959574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 273/550] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:39.974925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30520a-d75b-431b-88b5-70702e7ec2f7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:39.975408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30520a-d75b-431b-88b5-70702e7ec2f7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:39.975865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30520a-d75b-431b-88b5-70702e7ec2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:40.004537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:40.019530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fe30520a-d75b-431b-88b5-70702e7ec2f7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:40.021018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe30520a-d75b-431b-88b5-70702e7ec2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:40.161997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1614eb-a4ec-40fa-9254-31e67a90d020 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:40.221755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 274/551] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:04:40.232597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf0f9-5bdd-406b-812e-7c26cc7354e2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:40.233100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf0f9-5bdd-406b-812e-7c26cc7354e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:40.233697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caf0f9-5bdd-406b-812e-7c26cc7354e2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:40.239176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 275/552] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:40.245697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:40.246806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:40.247366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:40.247864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:40.257126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:40.257619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:40.258252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:40.320915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:40.323079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:40.509115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:40.512444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:40.530532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:40.543504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 276/553] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 20:04:40.777665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 278/554] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 883 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:40.786775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:40.905417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:40.945253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:41.058549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f967-30b8-4687-9761-d5c8ddc89f12 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.197974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.199062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.199575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.200063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.218031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:41.220975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:41.232261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7b3f3-85bc-48f7-8f4f-7454e253d76b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:41.248082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:41.249805 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:41.252123 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:41.252123 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:41.252123 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:41.252448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:41.254626 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 277/555] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:41.259514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:41.314753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.316334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.317022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.317790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.340687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:41.351279 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:41.353300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:41.354481 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:41.357000 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 279/556] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:41.357833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:41.461851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69920c-e863-464d-93ce-66a0b80b4f4b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.499082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:41.533551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.534650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.535175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.535653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.556178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:41.563677 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:41.565485 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:41.567152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:41.567832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22feb-a646-4e73-97b6-9f0eaccd389d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.567927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 278/557] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:41.567927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:41.631246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.631974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.632288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.632583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.633225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:41.633521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:41.634936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74edde4-734d-4b17-b775-9a0867282e81 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:41.652677 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 280/558] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:41.655189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d019e-da77-482b-aebb-ae67c06789ab None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.655189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d019e-da77-482b-aebb-ae67c06789ab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.655548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d019e-da77-482b-aebb-ae67c06789ab None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.658345 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 281/559] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:41.659663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d019e-da77-482b-aebb-ae67c06789ab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:41.703980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:41.777203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b57b6-3f7a-4e43-a919-3b6e757219ce None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.843962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.845044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.845570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.846019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d019e-da77-482b-aebb-ae67c06789ab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:41.846180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.847391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:41.847956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:41.850740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:41.867679 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 279/560] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:41.869237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:41.908779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:41.909692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.910188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.910531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.911353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:41.911714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:41.913443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87245-92a9-40d6-9c12-138f447e60a2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:41.936157 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 282/561] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:41.936157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:41.936157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:41.936157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:41.955536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:41.963359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:41.967411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:42.081585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f0a3a-3efe-4251-9802-48fc01d0d1e9 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:42.096600 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 283/562] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:42.097445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.129653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:42.172924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:42.173765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:42.174098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:42.174371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:42.185257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:42.188355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:42.207643 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:42.209363 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 280/563] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:42.212070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.297495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae40c6d-b4ea-4c95-868e-856561922486 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:42.362801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:42.363409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:42.363691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:42.364113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:42.385765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:42.389002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:42.412976 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:42.414545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:42.416355 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:42.416355 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:42.416355 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:42.420366 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 284/564] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:42.421494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.457915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:42.463882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5b39-888e-4bd6-8557-1cb92930300c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:42.548511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:42.549731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:42.550266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:42.550686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:42.573575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:42.576943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:42.597477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:42.613096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:42.615084 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:42.619987 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:42.619987 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:42.619987 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:42.623273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 281/565] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:42.625626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.659501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8959-9d67-4606-8d1d-3ac42ca39cf6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:42.729673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:42.730550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:42.730971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:42.731465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:42.732725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:42.733241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:42.735954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:42.767670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 285/566] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:42.767670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.804267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43f7c-0284-4820-a84a-04c1fb1bdb20 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:42.853526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:42.854552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:42.854953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:42.855447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:42.856335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:42.856780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:42.858592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:42.881532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 282/567] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:42.881532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:42.898251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:42.968468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6466af-bf2b-4a76-88a1-ff4097ac62ab None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.024714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d3f6f-c7b5-41df-ab43-6ebc64691de3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.030081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:43.042265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.043421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.043714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.043978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.065144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:43.073896 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:43.075710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:43.077285 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 286/568] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:43.079063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.083181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.083181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.083181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.083665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.084578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:43.085509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.088240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.111059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 283/569] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:43.119863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.228042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31f61-16df-49c8-a94a-63ea385a1579 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.255330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:43.281886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.282838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.283128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.283502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.284273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=18d4e38ee31a4ab3a21e998803226465) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:43.284587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.286174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.293341 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 287/570] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/role_assignments?user.id=18d4e38ee31a4ab3a21e998803226465&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:43.294692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.317962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a248b-b8b1-4b56-b678-2eb4a34c1a92 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.368674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.369615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.370066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.370487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.381799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.383839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:43.400374 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:43.402350 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 284/571] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:43.404437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.415829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:43.513829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d5ff0-876e-4e36-8ea8-9050e5714315 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.555933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25de1-1bb6-4725-889e-7b72d7615d83 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.586254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.587164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.587732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.588180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.589398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:43.590028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.595185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb23442-fc2f-4df9-aa9b-7703333d4c4e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.608862 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 288/572] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:43.611871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb999a-bd50-4e5e-9584-ed10f09d0c3a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.612438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb999a-bd50-4e5e-9584-ed10f09d0c3a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.613010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb999a-bd50-4e5e-9584-ed10f09d0c3a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.619252 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 289/573] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:43.619252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb999a-bd50-4e5e-9584-ed10f09d0c3a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.632680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:43.643656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.654142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.654142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.654142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.660749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.663425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:43.692310 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:43.694226 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:43.696215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 285/574] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:43.698076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:43.809793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb999a-bd50-4e5e-9584-ed10f09d0c3a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.839516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:43.872897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.873974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.874835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.874958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.876973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:43.877522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.879284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf5ae-b9ef-44f0-9e58-28da253ec88b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:43.880491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704542ab-1708-4bfb-93a5-b71765c2efe3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.925623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 290/575] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:43.925623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.925623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.925623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.934131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:43.934952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:43.935412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:43.935863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:43.951657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:43.953477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:43.956822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:43.959091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:43.973873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:43.982747 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:43.985938 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:43.985938 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:43.985938 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:43.985938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 286/576] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:43.985938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.052317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:44.119190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 291/577] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:44.119190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.161184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9fb3-1161-44c5-91dd-b6bea2c347bd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:44.227320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:44.228404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:44.228933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:44.229466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:44.230951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:44.231600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:44.234269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:44.268500 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 287/578] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:04:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:44.270138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.353095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050262-1b6a-4030-ab9e-3d51446e2b40 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:44.360666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:44.435188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:44.436849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:44.437549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:44.438189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:44.461474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:44.463088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:44.466611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:44.467163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857776-142f-41a7-842a-2ea95100f33c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:44.498385 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:44.500390 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:44.509465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:44.509465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:44.509465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:44.509465 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 292/579] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:44.509465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.545609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:44.546608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:44.547087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:44.547704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:44.548807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:44.549326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:44.551923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:44.578641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 288/580] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:44.578641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.747093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68e97-cff4-499f-8deb-1779e6947588 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:44.768096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d1c98-7eba-4464-82db-977e52d261b3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:44.808854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:44.810122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:44.810737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:44.811322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:44.830312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:44.832453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:44.838733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:44.839881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:44.840381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:44.840875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:44.842127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:44.843193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:44.845490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:44.858691 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:44.860877 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:44.862710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:44.862710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:44.862710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:44.863916 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 293/581] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:44.865537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.879567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 289/582] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:44.882199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:44.889479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:44.928833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:45.081372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73657c-7c50-4e3c-a8e2-b7d4b1f27220 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.097148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8498632-6643-47db-92b9-6032017afc6f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.153589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.154768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.155374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.155939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] PATH_INFO: `/v3/users/glance` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.170571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.171082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:45.171938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.172486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.173009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.174889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:45.195508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:45.198812 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:45.200910 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:45.202753 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:45.205333 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:45.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:45.212073 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:45.214623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 294/583] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:45.214623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.217373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 290/584] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:45.218991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.357955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:45.393159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:45.431675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d794-ff29-4e34-ad76-879a11295c0d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.449181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c9d64-6d65-408b-8a79-580dff61c3c4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.504615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.505709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.506215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.506707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.508003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:45.508558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:45.511036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:45.527390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.529187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.529969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.530755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.540943 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 295/585] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:45.541191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.545062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:45.548282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:45.570499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:45.572524 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:45.574481 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:45.575437 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 291/586] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:45.579422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.781212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d524-466a-4fd4-9b08-cfdcb97696d8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.802481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281498-4cd6-49a0-b26c-eb6126754623 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:45.839128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:45.854084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.855216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.855734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.856286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.858165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:45.858384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:45.861777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:45.873655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:45.874778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:45.875315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:45.875803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:45.877585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:45.878137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:45.880847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:45.900081 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 292/587] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:45.901619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.903632 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 296/588] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:45.905563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:45.909045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.121803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0639-bd20-4fd6-b073-03356efef8d1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.131451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64dd81-22d6-416d-9267-acf871d9d5b9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.187725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.188817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.189291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.189726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.202930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.206423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:46.208917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.211048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.211568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.212043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.213362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:46.213893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.216580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:46.228225 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:46.229975 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:46.231793 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 293/589] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:46.233838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:46.246656 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 297/590] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:46.248643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:46.351802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.361972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.449542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561f5c6-8d3e-4a89-aac1-28fd4a49a4f8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.469326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7c49-77f7-42f6-86af-bebb7d92bce9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.518556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.519750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.520241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.520707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.543296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.544796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.546150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.546360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:46.547055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.547809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.571844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.575053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:46.575313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:46.577027 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:46.586105 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:46.586105 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:46.586105 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:46.586105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 294/591] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:46.586105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:46.612637 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:46.614587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:46.616499 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:46.616499 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:46.616499 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:46.616499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 298/592] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:46.616499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:46.807266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946426-e9af-4cff-bd67-9da67cb74455 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.820524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.828210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ec0c3-776c-46ce-876d-79440acc1624 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:46.836869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.881592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.883278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.883741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.884205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.885509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:46.886038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.888687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:46.900065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:46.901514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:46.902204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:46.902906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a554eb26060549b48a431c579659ff93/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:46.914853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 295/593] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:46.916558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:46.938338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=a554eb26060549b48a431c579659ff93, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:46.942554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:47.035263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 299/594] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:04:46 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a554eb26060549b48a431c579659ff93/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:47.035263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:47.177054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a302eab-4482-451e-824d-f1867918adb3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:47.247296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:47.248388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.248864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.249365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.250650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:47.251770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:47.254616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:47.277007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b40ff-ebe6-4f8d-b524-4d2f1a1429f3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:47.278820 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 296/595] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:47.280473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:47.365974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:47.366304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.367867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.368462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.368981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.370250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:47.370804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:47.373578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1185220-ee8a-4e08-b31b-e2803acddc89 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:47.398921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 300/596] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:47.401309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574dc0-5437-4e99-bac7-39f9a75e2aa7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.401807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574dc0-5437-4e99-bac7-39f9a75e2aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.402291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574dc0-5437-4e99-bac7-39f9a75e2aa7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.410453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 301/597] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:47.410453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574dc0-5437-4e99-bac7-39f9a75e2aa7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:47.429525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.517476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606782-eeba-42cf-b882-aa08e293511d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:47.586207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:47.587751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.588254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.588730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.621822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=a0e5fa628b98463594d6066befb76468, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:47.626229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:47.636427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574dc0-5437-4e99-bac7-39f9a75e2aa7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:47.705495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:47.706596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.707086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.707626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.709171 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 297/598] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:04:47 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:47.710623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:47.730810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:47.734511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-97a017f8-2962-4164-bbf3-993b79468a7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:47.765727 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:47.767338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:04:47.768445 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:47.775788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 302/599] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:47.778172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:47.778662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:47.779197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:47.815212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:47.817474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:47.929476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.949828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.961511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 303/600] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:47.963244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:47.968328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8b5a-4ace-4a2e-861b-61da9468d708 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:48.044659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:48.046357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:48.047219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:48.048029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:48.062973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:48.066474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:48.093961 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:48.096236 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:48.097966 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:48.102292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 298/601] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:48.111713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:48.181297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147873d0-1cc6-4e13-b843-83d40db4f9de None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:48.250708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:48.252269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:48.252269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:48.252699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:48.254134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:48.254701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:48.257784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:48.294896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 304/602] 10.222.0.78 () {56 vars in 1139 bytes} [Tue Oct 4 20:04:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:48.303996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:48.323169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cf1d-0759-401d-9edb-ea90e407af9a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:48.434732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:48.436307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:48.446619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:48.447539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:48.449233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:48.450111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:48.453310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:48.499324 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 299/603] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:48.505760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:48.517544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:48.518442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:48.678332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d626e-9173-43b4-8aa2-fc0ffe4a14e4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:48.773525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:48.774618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:48.775619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:48.776119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:48.792060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56c303-fa53-4f2a-b05e-a840b5791dc5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:48.798470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:48.801279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:48.835675 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:48.837495 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:48.839662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:48.839662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:48.839662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:48.839662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 305/604] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 536 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:48.841796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:48.874100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:48.875595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:48.876812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:48.877284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/426a3d7b9b2248b6b22051224a4baa17/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:48.913057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=426a3d7b9b2248b6b22051224a4baa17, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:48.915892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:49.034512 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 300/605] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:04:48 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/426a3d7b9b2248b6b22051224a4baa17/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:04:49.036334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:49.062216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc22f3-150c-4c57-bf39-177b499ef0cc None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:49.084523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:49.147015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:49.148204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:49.148712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:49.149197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:49.196837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:49.208860 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:49.213043 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:49.215983 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 306/606] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:49.238738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:49.269393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:49.446098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958766d1-9dcb-457c-9888-5032e5fd6f6d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:49.524657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:49.525655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:49.526033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:49.526411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:49.527544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:49.527998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:49.530550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:49.556267 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 301/607] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:49.559234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492c13-520f-4611-8223-992f666a5188 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:49.572845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:49.631089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:49.632215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:49.632712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:49.633217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:49.634793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:49.635399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:49.638195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:49.657014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 307/608] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:49.668132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:49.786792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:49.912240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382afbd6-d523-4446-9604-db3280063a20 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:49.947706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:49.999318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:50.000628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:50.001966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:50.002881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:50.019947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:50.023192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:50.053205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:50.055871 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:50.057792 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:50.060069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 302/609] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:50.069881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:50.095604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b901-2a1e-4bac-b8fa-2e88c0fa8490 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:50.237333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:50.238448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:50.243889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:50.244386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:50.292536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:50.295445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:50.347673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:50.349587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:50.351439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:50.351439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:50.351439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:50.355108 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 308/610] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 688 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:50.365584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:50.396608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f6b3d-1a6b-4254-a6b3-62d1acc9f69d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:50.520646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:50.521717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:50.522201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:50.522697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:50.524118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:50.525084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:50.530540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:50.600458 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 303/611] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:50.605258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:50.622661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:50.660698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806544cd-2625-43c2-8d93-56ecc09d3694 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:50.696128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:50.771675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:50.772753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:50.773287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:50.773730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:50.774913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:50.779660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:50.782432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:50.831938 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 309/612] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:50.841121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:50.921764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad66f7-ebef-498f-b3de-36b873e9fc2a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:51.061412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:51.064411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:51.064931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:51.065415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/e67b4e16c695421890649a036fada64c/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:51.124366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=e67b4e16c695421890649a036fada64c, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:51.127864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:51.136905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb353-5c6e-4b2c-b459-689809f95eaf None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:51.219258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 304/613] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:04:50 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/e67b4e16c695421890649a036fada64c/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:51.234255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:51.235683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:51.236243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:51.236801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:51.261724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:51.264737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8b15e39c-da94-4abb-bdf5-83f6db6fae5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:51.295575 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:51.297461 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:51.301110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 310/614] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:04:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:04:51.313275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:51.506926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573148-2c46-4046-b09b-156a3adcc972 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:51.507370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573148-2c46-4046-b09b-156a3adcc972 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:51.507842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b573148-2c46-4046-b09b-156a3adcc972 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:51.510572 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 311/615] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:51.520686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:51.521139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:51.521651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:51.541512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:51.548259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:51.573273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c570c6-f961-453c-a29a-8592c22aa561 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:51.584353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:51.586031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:51.665663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:51.666971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:51.667524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:51.669213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:51.670638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:51.671872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:51.677803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:51.707955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 305/616] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:04:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:51.716660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:51.719813 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 312/617] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:51.988670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152798b8-e3c3-477d-b0e0-0cab2b60fa6a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:52.061838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:52.064731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.065239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.065761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.092700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:52.094813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:52.098097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:52.120946 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:52.122867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:52.124933 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:52.124933 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:52.124933 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:52.131171 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 306/618] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:52.134777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:52.234242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:52.405799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5142e7-11ad-4710-be8c-f5509f7bdd3b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:52.466132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:52.474005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:52.479794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871a8aa-390f-4147-9fce-d3828e2cd73c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:52.490991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0151b-9dc6-4d7f-a02e-ca50705e9398 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:52.494986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 313/619] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:52.496449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72663-1949-43fe-a5f4-2a59705de09d None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.496771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72663-1949-43fe-a5f4-2a59705de09d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.497066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72663-1949-43fe-a5f4-2a59705de09d None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.499924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 314/620] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:52.511438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.511913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.512373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.544812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:52.547635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:52.556590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:52.557635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.558065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.558492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.585254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:52.597760 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:52.599540 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:52.601149 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:52.606783 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 307/621] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:52.608867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:52.707540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 315/622] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:52.709537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:52.745954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:52.852671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478984b6-090a-456b-b843-1e5d65cf1606 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:52.897367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29e503-5293-4667-9df1-e12c5003a2cf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:52.926239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:52.927958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.928813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.929725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.943725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:52.944821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:52.948885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:52.980941 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:52.982695 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:52.985121 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:52.987252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:52.987543 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 308/623] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:52.987798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:52.987798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:52.987798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:52.987798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:52.987798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:52.995249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:52.995629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:53.026166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 316/624] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:53.035654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:53.356217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b118d3-2781-4354-856a-39ea24191ae3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:53.382611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9066fb4-bd0d-4977-ad25-f8f958e7590a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:53.410376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:53.461859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:53.463314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:53.464011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:53.464699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:53.466025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:53.466546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:53.468135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:53.469070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:53.469513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:53.470162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:53.470780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:53.491176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 309/625] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:04:53.492941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:53.502224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:53.505305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:53.537024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:53.539122 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:53.541188 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:53.541188 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:53.541188 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:53.542985 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 317/626] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:53.549075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:53.620307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:53.708777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc32086-7c50-44d6-a71e-6438b1e86cf8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:53.756801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499de95-6d5a-47ea-9d26-1264b8bcd3f3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:53.780843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:53.782266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:53.782956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:53.783480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:53.809493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:53.820157 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:53.821494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:53.822746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 310/627] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:53.824248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:53.832003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:53.832852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:53.833255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:53.833650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/18d4e38ee31a4ab3a21e998803226465/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:53.860570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=18d4e38ee31a4ab3a21e998803226465, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:53.862443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:53.899615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:54.085079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76861bd-9241-437f-a51f-2f5547b78594 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:54.174050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:54.175058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:54.175587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:54.176080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:54.178577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:54.179114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:54.181869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc1310-d48c-4b2d-b4f3-041a06b5251a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:54.205969 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 311/628] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:54.216011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a78f-d1a0-4e10-97d3-3a938ff768ee None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:54.216011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a78f-d1a0-4e10-97d3-3a938ff768ee None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:54.216011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a78f-d1a0-4e10-97d3-3a938ff768ee None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:54.216011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 312/629] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:54.216767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a78f-d1a0-4e10-97d3-3a938ff768ee None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:54.431585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a78f-d1a0-4e10-97d3-3a938ff768ee None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:54.468771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 318/630] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:04:53 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/18d4e38ee31a4ab3a21e998803226465/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:04:54.471109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:54.499830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:54.513327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:54.514913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:54.515457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:54.516289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:54.517701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:54.518259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:54.521338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776ad8-c03b-4fe6-a8b8-f701231fd34e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:54.547174 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 313/631] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:54.547174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:54.547174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:54.547174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:54.583941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:54.585952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:54.708504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:54.749835 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 314/632] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:54.751595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:54.751903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3066d-bf9d-4f80-85c1-cadab65eed22 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:54.837920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:54.837920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:54.837920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:54.837920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:54.863017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:54.865842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:54.894564 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:54.896159 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:04:54.897633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:54.899546 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 319/633] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:54.911306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:54.980086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:55.012889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fef3f9-fa51-4b01-bf88-368b38f031c8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:55.114783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:55.115937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.116398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.117129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.157252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:55.160123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:55.220033 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:55.221909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:55.224877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:55.224877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:55.224877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:55.227178 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 315/634] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:55.238465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:55.272617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4ab2-d9db-403c-b0dd-8b58ac86a02a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:55.397022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:55.398142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.398551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.399016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.400475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:55.400997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:55.403813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:55.446974 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 320/635] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:55.452964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:55.462794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:55.545577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038eb14-ad63-40f1-a517-b16dbbc56fc3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:55.619691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:55.621025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.621640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.622347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.624470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:55.624470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:55.627746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:55.644173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:55.660912 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 316/636] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:55.660912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:55.685529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d6e5-da39-46fd-801e-62962c854899 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:55.760697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:55.761795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.762290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.762781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.783637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-854d3159-f1d7-447d-85b2-a4f6b1cb3503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:55.790339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:55.792607 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:55.794209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 321/637] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:55.798237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b902b8-e426-49d4-a85b-bdf4889c4183 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.798237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b902b8-e426-49d4-a85b-bdf4889c4183 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.798237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b902b8-e426-49d4-a85b-bdf4889c4183 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.798237 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 322/638] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:55.799294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b902b8-e426-49d4-a85b-bdf4889c4183 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:55.873072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe364-c92f-484e-bcc0-4a8e3fd2b567 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:55.918551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:55.925016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:55.925910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:55.926347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:55.926790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:55.998760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b902b8-e426-49d4-a85b-bdf4889c4183 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:56.031425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:56.041637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.044566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.064646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:56.065610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.066092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.066592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.076887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.079046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b3b67000-3afe-4014-9bb2-8a326ff204cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:56.096044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:56.097975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 323/639] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:04:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.100799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.102161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.130377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:56.132462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:56.233363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 324/640] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:56.234802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.272868 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 317/641] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:56.274987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.369566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:56.470096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb38d-3bcb-4f2b-83e1-d3d45c4f0f91 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:56.507192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ca8f-2b88-45ee-9621-92f025950f8a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:56.513051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:56.553251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:56.555471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.556106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.556677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.558503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:56.559328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.562363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.580188 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 325/642] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:56.581779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.592580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:56.593544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.593989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.594480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.595751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:56.596276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.599123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.635981 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 318/643] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:56.637652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.801753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7b84c-8007-4402-949a-5763cd7708e3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:56.820903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01ac54-74d6-40df-8543-b5913a25e7d1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:56.826509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:56.854180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:56.854863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.855223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.855705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.870881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:56.871754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:56.872844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:56.873295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:56.876566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.878697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.888165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:56.889558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:56.903501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:56.905488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:56.907422 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:56.907422 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:56.907422 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:56.910257 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:56.919664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:56.922260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:56.922260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:56.922260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:56.922260 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 319/644] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:56.922802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 326/645] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:56.922978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.923126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:56.936202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:57.058401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5db62-42f8-4f1f-a867-ea985592c5eb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:57.086692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5de77-d9bd-4e00-a7c5-9c0eaf79b035 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:57.102976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:57.103975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:57.104384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:57.104711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:57.142561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:57.144068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:57.144593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:57.145326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:57.159612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:04:57.166164 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:57.167328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:04:57.168966 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:57.170187 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 327/646] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:57.171979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:57.229982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:57.234383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:57.237771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:57.258101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:57.368366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fe3cd-8112-4bed-a11d-bbdfdfbc20f1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:57.432869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 320/647] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:57.434039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:57.438922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:57.441106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:57.441106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:57.441426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:57.442319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:57.442800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:57.445480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:57.478352 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 328/648] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:57.478352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:57.614817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25597509-641c-4ccc-abf4-1e29cf8f5086 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:57.630849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:57.673586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:57.678571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:57.678817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:57.678817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:57.679067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:57.680632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:57.681420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:57.685097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:57.690886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b529-c95d-428c-90fc-07169f59f910 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:57.710707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 321/649] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:57.712357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:57.770973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:57.772222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:57.772729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:57.773204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:57.774552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:57.775078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:57.777818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:57.802999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 329/650] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:57.802999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:57.935534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0fc22-29d5-48be-834b-8784f174ccc7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.005031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.006376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.006866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.007365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.030433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.033832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.047306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c81ed-8144-482c-9a36-6936c89c8b33 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:58.062242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:58.064250 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:58.065971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:58.065971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:58.065971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:58.071642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 322/651] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:58.072953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.122969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.124156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.124628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.125109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.126006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:58.139547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.143179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:58.167972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:58.169743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:58.171518 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:58.178767 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 330/652] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:58.180440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.207277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:58.300210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c382e-5b0e-4209-b8aa-b0d6c7e20d1d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.367119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.368232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.368707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.369200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.383676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.386003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.390651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656fab2-2ee4-42a4-8469-a2b8c0f56cb9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:04:58.407508 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:58.409468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 323/653] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:58.411856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.457100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.458259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.458667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.459176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.478363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.481316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:04:58.508260 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:58.510363 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:04:58.512153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:04:58.512153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:04:58.512153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:04:58.512153 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 331/654] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:58.513671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.576517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:58.612812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c7e0a-483a-433c-ae83-a1a037b31d54 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.646040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:58.682252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.683326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.683789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.684279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.685526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:58.686067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.689509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b5a5-15c3-4282-bf1f-4887ac4af936 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.713165 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 324/655] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:58.715344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88cf1-0d8d-48cb-bd4a-b983fc4948a9 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.715830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88cf1-0d8d-48cb-bd4a-b983fc4948a9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.716295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d88cf1-0d8d-48cb-bd4a-b983fc4948a9 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.718821 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 325/656] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:04:58.720604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88cf1-0d8d-48cb-bd4a-b983fc4948a9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.733216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85895e-aadf-4663-a3de-70b5f29775e5 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.798324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.799343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.799839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.800325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.801604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:58.802140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.805020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:58.827541 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 332/657] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:58.829133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:58.926332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d88cf1-0d8d-48cb-bd4a-b983fc4948a9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:58.991115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:58.992348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:58.992801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:58.993276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:58.994617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:58.995181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:58.998038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:59.015793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:59.029146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682384e-d2c2-4951-89e0-33f494e2ec14 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:59.034644 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 326/658] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:59.036310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:59.079487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:59.100175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:59.101346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.101861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.102359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.103664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:59.104161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:59.106946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aca3b-c8e8-4a00-8d2e-b01ea1dff630 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:59.131258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 333/659] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:59.133501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.134007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.134471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.168110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:04:59.170254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:04:59.246811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5525f2-709f-47d2-a16e-ad153f3d37e5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:59.303382 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 334/660] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:04:59.304929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:59.315587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:59.316664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.317146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.317625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.333036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:59.335878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:04:59.358595 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:04:59.360477 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 327/661] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:04:59.362233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:59.479912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:59.535488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc141b-efde-4733-9af5-a8a10b3079ac None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:59.562237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a9fb-bb2f-4047-b980-e8442cfdb45b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:59.564775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:59.614684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:59.615846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.616352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.617097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.618629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a554eb26060549b48a431c579659ff93) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:04:59.619200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:59.622306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:59.633323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:59.634449 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 335/662] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:04:59 2022] GET /identity/v3/role_assignments?user.id=a554eb26060549b48a431c579659ff93&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:04:59.635408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.635739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:04:59.636691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.637489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.828374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:59.832092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:04:59.887677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0feb-4317-4dc7-bf48-43122d3b5558 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:04:59.957309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:59.971737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:04:59.972816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:04:59.973314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:04:59.973801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:04:59.989325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:04:59.992701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:00.017726 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:00.019686 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:00.021554 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 336/663] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:04:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:00.022787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.051402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 328/664] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:00.052728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.102403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:00.249285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8a40-ce81-41f9-aa22-66e3f3e8ccd8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:00.263744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb581e2-7516-40dd-a829-32b6c945772e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:00.321550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:00.322794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:00.323430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:00.324023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:00.325451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:00.326107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:00.329269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:00.336644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:00.337856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:00.338442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:00.339024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:00.363887 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 337/665] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:00.363887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.373876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:00.385365 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:00.387400 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:00.389188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:00.396183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 329/666] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:00.396183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.435525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:00.576532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:00.588588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ef9cd-90cb-4787-b3ec-4dc1b9b911f9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:00.619922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1d01-6fb7-4b5a-aff3-628323797fde None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:00.669733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:00.671301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:00.672004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:00.673157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:00.675289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:00.678378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:00.679275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:00.698874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:00.700903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:00.700903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:00.701212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:00.726524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 338/667] 10.222.0.78 () {56 vars in 1139 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:00.726524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.729569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:00.732486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:00.764552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:00.767382 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:00.769489 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:00.769489 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:00.769489 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:00.771212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 330/668] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:00.772979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:00.921510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:00.939105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c9460-24a5-4433-84a7-e27392e99588 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:00.992866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734233-5ded-4f80-b9f7-52e45e39afa3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:01.013941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:01.014994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:01.022964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:01.023809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:01.025306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:01.026061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:01.032687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:01.051191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 339/669] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:01.051191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:01.085447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:01.086517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:01.086996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:01.087513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:01.088962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:01.089480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:01.092347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:01.098391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:01.119838 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 331/670] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:01.121854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:01.309556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2909-c22f-4089-8d0d-b3817196a28d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:01.361941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a74621-9ba5-4670-943b-d8cc3ad26030 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:01.394212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:01.396017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:01.396878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:01.397639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:01.428888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:01.439115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:01.445143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:01.445143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:01.445143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:01.445143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:01.445143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:01.445854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:01.474605 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 332/671] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:01.476218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:01.566218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:01.569668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:01.618123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:01.738243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05d6-fcc5-428d-8e15-070bf250c2dd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:01.815344 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 340/672] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:01.817472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:01.820467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:01.821697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:01.822184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:01.822739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:01.852081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:01.856081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:01.893326 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:01.895006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:01.896906 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:01.896906 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:01.896906 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:01.903928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 333/673] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:01.904404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.017314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.050770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5faf04-90d4-4f23-bf11-78d24a56e39e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.097270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.129348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec5d5-a6b0-440d-9f25-e348ae433a01 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.133601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.136479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.137033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.137457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.152029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.155293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:02.179189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:02.181162 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:02.183239 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:02.191294 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 341/674] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:02.191294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.222358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.224140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.225046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.225840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.249439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.253479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:02.285422 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:02.287371 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:02.289168 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:02.289168 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:02.289168 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:02.293227 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 334/675] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:02.295437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.405270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6f3b1-923f-4c82-a5a7-69822893bef9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.475921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.477353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.477544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.478046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.479329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:02.479873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.482874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:02.509093 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 342/676] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:02.509526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.518334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.525019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940030b7-26f6-42a9-9051-99e8b28b3460 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.601463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.603015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.603902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.604694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.606435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:02.607564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:02.609111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.612521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:02.647457 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 335/677] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:02.649674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.750140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4d9d-c800-4371-bd22-e9e143e83021 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.827550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.829266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.829677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.830153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.831460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:02.832006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.834668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:02.855763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 343/678] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:02.857238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:02.878132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1d95-a632-4a96-ba30-77c2c4c6cec6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:02.957102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:02.958897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:02.959883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:02.960680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:02.978256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:02.981673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:03.007120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:03.009006 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:03.010816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:03.021037 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 336/679] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:03.023779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:03.061731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:03.064197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:03.069542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a7b3-c6f0-4f81-ba69-510ac11680e2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.137446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:03.138443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:03.138929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:03.139427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:03.140651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=426a3d7b9b2248b6b22051224a4baa17) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:03.141167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:03.144121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:03.163541 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 344/680] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:02 2022] GET /identity/v3/role_assignments?user.id=426a3d7b9b2248b6b22051224a4baa17&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:03.165096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:03.230677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88780f-ddb5-4916-b162-96f2cf2b4fbc None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.298430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:03.300378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:03.301730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:03.306283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:03.331658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:03.336949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:03.379035 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:03.380817 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:03.382163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:03.386282 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 337/681] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:03.396258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:03.470575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5633d-24e9-4d48-8ae9-76b808874787 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.529253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:03.539667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:03.541247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:03.546884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:03.546884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:03.546884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:03.546884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:03.546884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:03.582966 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 345/682] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:05:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:03.583290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996a016-2ccb-4957-a950-3fa76f549e82 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.585626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:03.634055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:03.667886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:03.669473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:03.670486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:03.672092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:03.673471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:03.674368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:03.678976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:03.708998 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 338/683] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:03.717850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:03.804089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e669d-df1f-4cbf-9047-a2572b4f9207 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.855013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:03.856259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:03.856748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:03.857181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:03.929582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518620b1-ef1c-4ebe-b6c7-df5f4cad97aa None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:03.990893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:03.994433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:04.004002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:04.005234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:04.005705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:04.006280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:04.007621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=e67b4e16c695421890649a036fada64c) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:04.008117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:04.015258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaacf2-70a6-4e57-95f5-498acfbc03ab None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:04.021738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:04.029143 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 339/684] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:03 2022] GET /identity/v3/role_assignments?user.id=e67b4e16c695421890649a036fada64c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:04.033412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd888-40f8-4c0d-9cc1-b37317781d85 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:04.044523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd888-40f8-4c0d-9cc1-b37317781d85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:04.044523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd888-40f8-4c0d-9cc1-b37317781d85 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:04.044523 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 340/685] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:04.045772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:04.048053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c734-5496-423e-9bda-9c2566863607 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:04.049029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c734-5496-423e-9bda-9c2566863607 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:04.049799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c734-5496-423e-9bda-9c2566863607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:04.093317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6749c734-5496-423e-9bda-9c2566863607 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:04.095598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6749c734-5496-423e-9bda-9c2566863607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:04.297316 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 346/686] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:05:04.304048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:04.442264 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 341/687] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:04.512207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166b0ec-12ab-4974-a0d9-0f70f231c020 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:04.554214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:04.581338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:04.590300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:04.590300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:04.590300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:04.612382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:04.614934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:04.642953 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:04.644789 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:04.646466 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:04.646466 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:04.646466 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:04.646466 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 347/688] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:04.652711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c734-5496-423e-9bda-9c2566863607 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:04.942843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c734-5496-423e-9bda-9c2566863607 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:05.006075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:05.015592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:05.019727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.019727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.019727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.019727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:05.019727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:05.022046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:05.040660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 342/689] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:05.049040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:05.108532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:05.318624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542747b8-da8a-4dc7-8f4d-b54323010722 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:05.388956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c5d-9b9a-4d91-8ca5-0859902ea0a8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:05.401852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:05.403169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.403704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.404203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.419292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:05.422191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-885a47c8-9f3c-4bea-a960-b327959634fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:05.439048 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:05.440774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:05.442814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:05.446155 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 348/690] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:05.448548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809364b-8378-4971-be93-c337af4afb5e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.449265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809364b-8378-4971-be93-c337af4afb5e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.449769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809364b-8378-4971-be93-c337af4afb5e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.459186 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 349/691] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:05.459186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809364b-8378-4971-be93-c337af4afb5e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:05.475337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:05.477855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.478605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.479284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.480746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:05.485522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2d77ee98-e345-4d6e-9eec-716e8cb36e90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:05.512158 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:05.514403 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:05.516723 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:05.519076 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 343/692] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 4 20:05:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:05.525071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.526083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.526939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.534250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:05.560889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:05.563606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:05.669835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:05.676128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809364b-8378-4971-be93-c337af4afb5e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:05.704553 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 344/693] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:05.707823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:05.739624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:05.740514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:05.740961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:05.741449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:05.743046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:05.743624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:05.746440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:05.805616 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 350/694] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:05.816967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:06.004680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:06.020733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913b7f-5aef-44ef-bc70-81d92aa19ca1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:06.098438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:06.100395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2a322-4137-47a4-a454-8b156f26d8ad None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:06.103816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:06.104342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:06.104835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:06.106389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=18d4e38ee31a4ab3a21e998803226465) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:06.106943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:06.109760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:06.138034 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 351/695] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:05 2022] GET /identity/v3/role_assignments?user.id=18d4e38ee31a4ab3a21e998803226465&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:06.202297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:06.204265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:06.204924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:06.205600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:06.207110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:06.207951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:06.211078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:06.225192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 345/696] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:06.235128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:06.311869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:06.455445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad756d-1f2a-4372-a4fa-fd2d1bac6dbb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:06.499024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:06.527460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:06.528835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:06.529303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:06.529760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:06.530932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:06.531469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:06.534580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:06.547011 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 352/697] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:06.643875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d62fc-8a89-4a2c-ab74-1335353a000a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:06.709083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:06.710135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:06.710589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:06.711050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:06.737055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:06.747832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:06.749664 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:06.751765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 346/698] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:06.761927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:06.832943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:07.029789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897188-b3d9-47f6-ab93-b490151c02a0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:07.118425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:07.120121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:07.121210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:07.122032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:07.123759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:07.124672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:07.128391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:07.151440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 353/699] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:07.160844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:07.426757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc140-4550-43cd-a3d1-2f5bce4f480a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:07.451342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:07.520445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:07.521537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:07.521998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:07.522487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:07.543841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:07.546588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ae0a8a69-6e57-4ced-beee-9963a6b43827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:07.579188 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:07.580972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:07.582654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:07.582654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:07.582654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:07.582654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 347/700] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:07.590436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:07.717309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcba56-7526-4401-a34a-264491655f37 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:07.718221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcba56-7526-4401-a34a-264491655f37 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:07.719002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcba56-7526-4401-a34a-264491655f37 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:07.721603 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 348/701] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:07.730934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:07.731427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:07.731864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:07.788133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:07.790370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:07.819742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:07.858049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399a9a-9b3e-4e14-af73-a6baca2e1c18 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:07.952536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 349/702] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:07.967933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:07.969095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:07.970095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:07.970593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:07.971902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:07.972428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:07.975065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:07.999630 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 354/703] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:08.009325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:08.231804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:08.259218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d94bc7-637a-4127-8da0-fa48bfd89867 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:08.348658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:08.349848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:08.350294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:08.350781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:08.367179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:08.369952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:08.392981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:08.394767 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:08.397070 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:08.403164 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 350/704] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:08.405522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:08.522679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:08.652361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9575fc-1297-497d-ae26-4ecab4a3d63a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:08.735753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:08.737273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:08.738125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:08.738839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:08.740593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:08.741514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:08.744945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:08.778891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:08.788739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 355/705] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:08.799228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:08.896789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a24dd-a92a-41ee-b554-f926ff5a9fcd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:08.983027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:08.984157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:08.984977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:08.985442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.012726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:09.017528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:09.052768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81e269-1bbe-4786-9b4c-b0673bc8f91c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2b860550-d28d-4d62-9a87-2d680619ac45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:09.055288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:09.057313 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:09.058995 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:09.058995 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:09.058995 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:09.058995 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 351/706] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 536 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:09.067178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5c7e-c3d4-41f8-814f-357670ffd582 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.067178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5c7e-c3d4-41f8-814f-357670ffd582 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.067178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5c7e-c3d4-41f8-814f-357670ffd582 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.070021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 352/707] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:09.071703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5c7e-c3d4-41f8-814f-357670ffd582 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:09.079559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:09.149341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:09.151054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.151953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.152740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.304125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:09.306333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:09.309444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:09.310742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5c7e-c3d4-41f8-814f-357670ffd582 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:09.398940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:09.403025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.403854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.404595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.408736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:09.408736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:09.410143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccfc63-99f7-4d6f-8d59-882ef7ec6e23 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:09.437194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 353/708] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:09.440406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.441226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.442203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.481931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:09.485289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:09.543844 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 356/709] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:09.545613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:09.620089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:09.638938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 354/710] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:09.640611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:09.826000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:09.838708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03b8f-e550-49b5-a980-bca2046218f4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:09.864361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3c133-3658-4fc4-9447-267585a72b93 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:09.938864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:09.940296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.941611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.942287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.964491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:09.967790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:09.987241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:09.988484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:09.989068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:09.989635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:09.991011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:09.994065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:10.001635 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:10.003370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:10.005009 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:10.005009 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:10.005009 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:10.008246 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 355/711] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:10.027729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:10.123027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:10.169055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 357/712] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:05:09 2022] POST /identity/v3/users => generated 254 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:10.246895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce631f8-a8d5-41b7-80d6-a49b1f2f2329 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:10.293897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:10.328020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:10.331471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:10.332243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:10.332984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:10.334379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:10.335215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:10.338015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:10.363561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 356/713] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:10.373102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:10.553854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f726-02d2-4321-a307-49a7301bb87b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:10.637939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:10.639111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:10.639685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:10.640195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] PATH_INFO: `/v3/services/network` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:10.645223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:10.645223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:10.667403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:10.669177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:10.670749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 358/714] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:10 2022] GET /identity/v3/services/network => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:10.690237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:10.714421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3666f-6bac-4965-b100-922a666d14b2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:10.720670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:10.734858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:10.813985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:10.814262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:10.814496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:10.814956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:10.831916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:10.834759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:10.862597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:10.864355 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:10.865971 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 357/715] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 493 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:10.875689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:10.958978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0ad5-3ffb-4ea5-be4a-b18456e67f4d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:11.089292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:11.090346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.090850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.091373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.092534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] RBAC: Adding query filter params (name=network) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:11.093073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:11.103921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:11.131432 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 359/716] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:11.140818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:11.168518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3c1a3-f761-4afe-9f0e-f9066d185322 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:11.242293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:11.243292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.243730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.244161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.245344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:11.245833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:11.248470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea732745-9aee-48a8-ac30-776e6ecce329 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:11.270958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 358/717] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:11.273265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77118a9-c8c1-458b-a858-098e7bf46dfa None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.273743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77118a9-c8c1-458b-a858-098e7bf46dfa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.274220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77118a9-c8c1-458b-a858-098e7bf46dfa None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.277356 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 359/718] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:11.279515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02088df-a2bb-4eb2-be31-745ff1b58b39 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.279988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02088df-a2bb-4eb2-be31-745ff1b58b39 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.280463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02088df-a2bb-4eb2-be31-745ff1b58b39 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.289679 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 360/719] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:11.289679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02088df-a2bb-4eb2-be31-745ff1b58b39 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:11.321370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:11.353065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:11.382476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2213-5672-4584-b8be-44384425ae04 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:11.446094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02088df-a2bb-4eb2-be31-745ff1b58b39 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:11.456409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:11.457316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.457751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.458167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.459396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] RBAC: Adding query filter params (type=network) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:11.459908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:11.462617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9b79-09d3-4794-a1d6-24b5abf10660 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:11.471788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 360/720] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:11.473820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.474236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.474729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.507074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:11.509035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:11.521218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:11.522628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.523321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.524819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.526384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:11.527121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:11.531332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9283-713a-4770-affc-b19bfb49b43d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:11.543360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 361/721] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:11 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:11.545888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:11.546705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:11.547430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:11.600186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:11.603283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:11.747993 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 361/722] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:11.827415 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 362/723] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:12.380103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:12.393392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:12.454296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:12.602128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:12.678516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2c306-6c1d-4783-8fcf-65fb3f44162e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:12.801069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1814e3-b1d4-493e-bbda-0ff86dfc35ec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:12.833362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:12.834433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:12.834928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:12.835439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:12.881779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:12.892104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:12.893178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:12.893655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:12.894135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:12.895428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:12.898123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:12.904702 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:12.906611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:12.910307 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:12.912760 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 362/724] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 533 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:12.922786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:13.058738 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 363/725] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:05:12 2022] POST /identity/v3/services => generated 251 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:05:13.168793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d18bcf-e44f-4684-bbf0-2fb72cb3505b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:13.292596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:13.294238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:13.295069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:13.295931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:13.297494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:13.298289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:13.301401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:13.307774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:13.332491 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 363/726] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:13.343359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:13.546093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:13.608857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c1f0-dcb8-4a02-bfaf-3ba5b10ec063 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:13.682668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:13.684342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:13.685093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:13.685826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:13.709565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:13.712505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:13.743649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:13.745503 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:13.747292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:13.747292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:13.747292 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:13.747292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 364/727] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:13.760843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:13.990580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72a01-5175-4294-9f73-d53576f20730 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:14.058763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:14.059802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:14.060295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:14.060787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:14.061976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:14.062558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:14.065327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:14.089521 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 364/728] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:14.098924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:14.397993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331f8b-f4ae-4090-9e03-1516e9ed0853 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:14.475900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:14.492786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:14.494435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:14.495233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:14.495935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] PATH_INFO: `/v3/users/swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:14.513153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:14.516529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:14.551032 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:14.553674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:14.555659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 365/729] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:14.565016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:14.702815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:14.820560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482f76-4784-48f9-8707-7b996085ba5f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:14.915101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:14.916199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:14.916681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:14.917161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:14.918633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:14.919226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:14.922108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec47a7-8f3a-473f-9730-95d1530bed44 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:14.973891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 365/730] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:05:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:14.982903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:15.005841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a09-0b3b-449f-856c-06c4def0b465 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:15.006309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a09-0b3b-449f-856c-06c4def0b465 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:15.007878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a09-0b3b-449f-856c-06c4def0b465 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:15.010880 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 366/731] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:15.022659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:15.023178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:15.023710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:15.094989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:15.097212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:15.266631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdb318-ad68-4246-b561-7d68618eddea None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:15.352786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 367/732] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:15.385449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:15.386540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:15.386981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:15.387453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:15.543609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:15.569412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:15.572240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:15.829906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 366/733] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 848 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:15.838891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:15.881726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:15.993902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:16.192452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da810ed-890b-45ba-bcbb-13cd706633bc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:16.195453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:16.213240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b972a7-9215-498b-b41b-ec6e27ad0692 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:16.276769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:16.277887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.278376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.278880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.286519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:16.287714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.288219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.288721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.300320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:16.303212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:16.310879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-57c2385e-ac1e-4962-869b-fa3db085c8c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:16.321795 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:16.323652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:16.325459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:16.332888 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 367/734] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:16.335447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af23ca-ee78-4272-a6ba-83aef8595778 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.335970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af23ca-ee78-4272-a6ba-83aef8595778 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.336490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af23ca-ee78-4272-a6ba-83aef8595778 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-47459ac7-60c2-474e-bf57-3fa24845e3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:16.338606 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:16.340450 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:16.342167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:16.342167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:16.342167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:16.342501 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 368/735] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:16.343382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825f18e-2864-4e6d-96e1-a7d3010296bf None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.343540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825f18e-2864-4e6d-96e1-a7d3010296bf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.347089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825f18e-2864-4e6d-96e1-a7d3010296bf None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.347748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 369/737] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:16.348069 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 368/737] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:16.349457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825f18e-2864-4e6d-96e1-a7d3010296bf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:16.350386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.350898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.351419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.383623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:16.385773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:16.523119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 369/738] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:16.524995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:16.582566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825f18e-2864-4e6d-96e1-a7d3010296bf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:16.587986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:16.680743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:16.682470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.682470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.682892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.684341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:16.688681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:16.696405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526749-5496-4275-99ff-1872ebc62f37 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:16.723174 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 370/739] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:16.723174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.723174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.723174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.761630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:16.764092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:16.783083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:16.800317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54649253-2d27-4ce8-beec-abb0842e0368 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:16.872776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:16.875790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:16.877264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:16.878011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:16.879872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:16.880642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:16.883248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:16.915755 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 370/740] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:16.915755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:16.928897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 371/741] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:05:16.930853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.161659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993fe2-3b12-4e1d-a83e-c3507c128f87 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.164310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:17.201584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d930c-dc5e-469b-b8b0-7922c7493789 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.241615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.243552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.244263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.245099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.260158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:17.263241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:17.282313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.283449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.284150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.284826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:17.288854 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:17.290882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:17.292768 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:17.296537 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 372/742] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:17.298727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.304514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:17.310144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:17.313637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:17.348828 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:17.350650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:17.353790 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:17.353790 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:17.353790 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:17.353790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 371/743] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:17.354705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.544844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4274e8-eab3-4c87-99d0-caac3be9c262 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.591981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aaa4-c4ec-4ca1-8b1c-a4983b182b06 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.617636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.618751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.619294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.619786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.641582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:17.652835 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:17.654318 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 373/744] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:17.657324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.685677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.686678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.687344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.687828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.689111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:17.689644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:17.692475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:17.708046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:17.719072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 372/745] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:17.725806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.802559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:17.882699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740f4f-5b07-49db-a67f-09b28f091102 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.923838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789ac3-b731-4f94-8948-c171a61594dc None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:17.955834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.957034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.957606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.958202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.959529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:17.960158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:17.962913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:17.985894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:17.986665 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 374/746] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:17.986836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:17.991231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:17.991231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:17.991631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:17.991780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:17.991780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:18.128025 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 373/747] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:05:17 2022] POST /identity/v3/services => generated 240 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:18.130534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:18.199374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3cd7-b0ff-4691-9ed0-ba29e57269d4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:18.226047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:18.251530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:18.283057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:18.284178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.284732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.285254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.286280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:18.286736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:18.289287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934b777-1307-40ed-89ce-a0b5dab9307b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:18.309653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046b40-979a-4501-ae63-51073ee5f643 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:18.311768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 375/748] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:18.315682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d171-9e5c-44a9-a25e-c1015ac83385 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.316165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d171-9e5c-44a9-a25e-c1015ac83385 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.316740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d171-9e5c-44a9-a25e-c1015ac83385 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.319712 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 376/749] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:18.321210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d171-9e5c-44a9-a25e-c1015ac83385 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:18.379920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:18.381300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.381988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.382641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.384229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=18d4e38ee31a4ab3a21e998803226465) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:18.384911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:18.387385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:18.398240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 374/750] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:18 2022] GET /identity/v3/role_assignments?user.id=18d4e38ee31a4ab3a21e998803226465&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:18.399851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:18.545059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d171-9e5c-44a9-a25e-c1015ac83385 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:18.621830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:18.622988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.624014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.624467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.641465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8d393-51fb-4dec-87b3-986b6b173f30 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:18.642192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:18.645284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6f4d1a7a-2644-4695-864d-fcb37827de1a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:18.674441 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:18.676360 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:18.678288 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:18.687177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 377/751] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:05:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:18.687177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.687177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.687177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.697585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:18.720321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:18.721871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:18.722089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:18.722982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:18.725745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:18.727538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:18.755869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:18.760473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:18.795012 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:18.796935 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:18.798657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:18.798657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:18.798657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:18.803279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 375/752] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:18.806288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:18.811797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:18.882222 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 378/753] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:18.884179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:19.090766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9866db-8174-4d83-a3ba-2aa28f509024 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:19.098844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ed453-1720-4bf6-98a5-da9208782a1a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:19.169532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:19.170854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:19.171533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:19.172671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:19.174581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:19.176066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:19.178997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:19.207591 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 379/754] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:19.217262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:19.265460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:19.266484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:19.266946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:19.267493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:19.268831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:19.269342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:19.272065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:19.320311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:19.334902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 376/755] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:05:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:19.345411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:19.478417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db05ee5-14a5-455d-a161-da1ed1f0bc72 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:19.511596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:19.554920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:19.556524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:19.557270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:19.557958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:19.572368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:19.575588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:19.608783 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:19.610943 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:19.613181 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:19.617451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 380/756] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:05:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:19.619129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:19.673639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedda9-9f22-4615-be88-ab29a4511a59 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:19.747391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:19.748677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:19.749175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:19.749891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:19.809853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:19.831025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb821f-b9c4-44cf-b053-c1d89dc1be18 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:19.894007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:19.897426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:19.919730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:19.922952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:19.923714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:19.924239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:19.925407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:19.929034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:19.949774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:19.951839 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:19.954068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 381/757] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 4 20:05:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:19.955949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:19.970101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:20.139735 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 377/758] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:05:20.143009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:20.185833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1934f-2d64-4767-b011-1fabd8794dff None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:20.269522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:20.271878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:20.272379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:20.272874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:20.274339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:20.274864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:20.277783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:20.320438 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 382/759] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:05:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:20.322499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:20.358416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:20.381979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6097-dc8e-428c-af0a-a2bcccb770df None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:20.458811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:20.471398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:20.473006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:20.473823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:20.474564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:20.476474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:20.477344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:20.481561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:20.491629 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 378/760] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:20.494461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:20.571979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5681cb-0047-434e-b517-9c5e3a1121e4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:20.651496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:20.652424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:20.652859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:20.653316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:20.675063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:20.677822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:20.709674 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:20.711663 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:20.713487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:20.713487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:20.713487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:20.719120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 383/761] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:20.721135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:20.725883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef82fb-a76f-4406-8d66-77a0d92aa0e3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:20.800121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:20.801439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:20.802050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:20.802663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:20.826312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:20.829469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:20.852775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:20.867951 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:20.869796 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:20.871447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:20.871447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:20.871447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:20.874890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 379/762] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:20.876799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:20.940004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1f18-2ae1-4387-9b0b-343bec56184a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:20.999540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:21.009140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.014015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.014015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.014015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.014015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:21.014015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.017321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:21.035935 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 384/763] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:21.037591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:21.119893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209af5d-1032-4b31-9296-943cce607cfd None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:21.201696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.204062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.204603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.205074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.206348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:21.206871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.210591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:21.239264 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 380/764] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:21.240987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:21.265047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35788-38c8-4fec-b697-ff21699b8151 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:21.332441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:21.350254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.352141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.352636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.353123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.354349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:21.354891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.359492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:21.391306 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 385/765] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:21.393100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:21.507114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2a10f-0187-4a60-8bf8-cf176503c95f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:21.531518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:21.597673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.599352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.601385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.602246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.605269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] RBAC: Adding query filter params (interface=public, service_id=d7d7fb3749c245eaa7b7ded9d0aea421, region_id=RegionOne) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:21.606670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.609858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:21.628863 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 381/766] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:05:21 2022] GET /identity/v3/endpoints?service_id=d7d7fb3749c245eaa7b7ded9d0aea421&interface=public®ion_id=RegionOne => generated 194 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:21.630978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:21.651804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7f47-7f10-4a2f-be2c-5a1905da1051 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:21.735658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.736828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.737617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.738255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.753227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.756156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:21.781154 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:21.783042 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:21.785329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:21.791081 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 386/767] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:21.792906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:21.892104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be7c7-ecdb-45f4-83a4-87635bdaef04 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:21.904383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:21.972860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:21.974469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:21.975398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:21.976142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:21.994965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:21.999260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:22.021958 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:22.023697 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:22.025545 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:22.026741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164802a-82a7-4c02-b472-d84145ab40d6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:22.030586 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 382/768] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:22.033631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:22.113485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:22.123891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:22.134542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.134542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.134542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.134542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:22.134542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:22.142893 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 387/769] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:05:21 2022] GET /identity/v3/services => generated 772 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:22.144621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:22.311300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180d67-8e68-40da-9019-f988f64f1b6f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:22.364784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98481cdf-8dcd-4176-beb3-ffe01e0bbfee None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:22.392502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:22.402560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:22.410176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.410176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.410176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.410176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:22.410176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:22.411326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e97f0-7134-4e4c-ac1a-8dcbab7efdf1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:22.436457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:22.437647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.438074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.438576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.439830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:22.440319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:22.442910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f411f1-1a69-4987-a467-75e5bc2f61c3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:22.444490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 383/770] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:22.447244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53087-44bc-405c-b717-9a8f491e3ed0 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.448190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53087-44bc-405c-b717-9a8f491e3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.448955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53087-44bc-405c-b717-9a8f491e3ed0 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.452182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 384/771] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:22.454707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06710e-5065-4347-8678-b84dba7b65e2 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.455608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06710e-5065-4347-8678-b84dba7b65e2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.456390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06710e-5065-4347-8678-b84dba7b65e2 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.461228 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 385/772] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:22.461228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06710e-5065-4347-8678-b84dba7b65e2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:22.470736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 388/773] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:22.473178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ccb-897e-460b-a3d7-9a11ac2b9d54 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.473693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ccb-897e-460b-a3d7-9a11ac2b9d54 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.474187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ccb-897e-460b-a3d7-9a11ac2b9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.511112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e6336ccb-897e-460b-a3d7-9a11ac2b9d54 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:22.513360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6336ccb-897e-460b-a3d7-9a11ac2b9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:22.641670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:22.661557 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 389/774] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:22.661557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.661557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.661557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.669735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06710e-5065-4347-8678-b84dba7b65e2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:22.698088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:22.701716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:22.744471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:22.745876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:22.746611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:22.747439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:22.749335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=92b7edc1a506407db3cd691bfabf169c) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:22.750032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:22.752672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:22.770782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 386/775] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:22 2022] GET /identity/v3/role_assignments?user.id=92b7edc1a506407db3cd691bfabf169c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:22.770782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:22.940533 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 390/776] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:23.048808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b6ddf-4171-44dc-ba89-6c76523bbc99 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:23.118298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:23.120050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:23.120763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:23.121407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:23.125997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=a0e5fa628b98463594d6066befb76468, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:23.129240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:23.228830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 387/777] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:05:22 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:05:23.267955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:23.341270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:23.513596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848b7f-a276-4c04-bf76-83778e196f42 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:23.533503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:23.585268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:23.597429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a149a1-be21-4670-8135-401481e301aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:23.602468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a149a1-be21-4670-8135-401481e301aa None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:23.602468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a149a1-be21-4670-8135-401481e301aa None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:23.602468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a149a1-be21-4670-8135-401481e301aa None admin] PATH_INFO: `/v3/services/network` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:23.602468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a149a1-be21-4670-8135-401481e301aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:23.603600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a149a1-be21-4670-8135-401481e301aa None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-21a149a1-be21-4670-8135-401481e301aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:23.622427 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:23.624501 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:23.626877 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:23.630392 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 391/778] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:23 2022] GET /identity/v3/services/network => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:23.636070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a149a1-be21-4670-8135-401481e301aa None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:23.874441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:23.888434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8a3e-5201-4f7a-9b68-4523ba9752ac None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:23.896732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a149a1-be21-4670-8135-401481e301aa None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:23.986878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:23.987974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:23.988441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:23.988897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:24.019407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:24.020428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:24.020934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:24.021369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:24.022554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] RBAC: Adding query filter params (name=network) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:24.023075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:24.025828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:24.029755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:24.040867 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:24.042743 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:24.044206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 388/779] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:24.050926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 392/780] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:24.054353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:24.064957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:24.301203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:24.412021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf06fa-2030-49a1-91e1-360634604af2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:24.413290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac465f-b4f9-4594-88b9-2aa36633f455 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:24.496719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:24.497794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:24.501605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:24.502213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:24.503496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] RBAC: Adding query filter params (type=network) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:24.504040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:24.506637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:24.530263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 393/781] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:24.540600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:24.548284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:24.549427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:24.549929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:24.550427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:24.551740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:24.552216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:24.554846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:24.585738 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 389/782] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:24.600853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:24.638078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:24.870169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff3aa-1c7b-44c1-ade2-d910aa73a70a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:24.937018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d6bc2-ce4f-4d8f-b5a5-65e41c7b4d10 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:24.956427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:24.958066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:24.958907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:24.959744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:24.961460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] RBAC: Adding query filter params (interface=public, service_id=e058a62a82434c5f88aba6b6a440fb23, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:24.962365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:24.973409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:25.003121 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 394/783] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:05:24 2022] GET /identity/v3/endpoints?service_id=e058a62a82434c5f88aba6b6a440fb23&interface=public®ion_id=RegionOne => generated 194 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:25.005129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:25.006236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:25.006730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:25.007250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:25.012567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:25.022324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:25.031519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:25.035102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:25.065183 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:25.067024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:25.068803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:25.068803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:25.068803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:25.072681 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 390/784] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:25.093942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:25.243858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:25.287091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799d31d-532f-4adf-a6fc-75ac5e39fbf8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:25.363646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b69fd-305f-43a4-bd4f-7771796854f2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:25.397550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:25.398283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:25.398630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:25.398933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:25.399782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:25.401423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:25.418718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 395/785] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:05:25 2022] GET /identity/v3/services => generated 772 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:25.453398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:25.454483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:25.454987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:25.455464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:25.456735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:25.457235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:25.459567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:25.491365 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 391/786] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:25.495902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:25.739430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172b5b2-102d-4a33-9987-46977432b02a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:25.827078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:25.828808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:25.829597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:25.830369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:25.851859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:25.854877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:25.882354 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:25.884242 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:25.886056 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 396/787] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:25.895958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:25.991632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:26.105989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007e7a-5cdf-4aa4-8b6a-3192c7492193 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:26.189441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:26.190493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:26.190962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:26.191500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:26.192866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:26.193417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:26.196180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:26.246036 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 392/788] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:05:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:26.255709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:26.314312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:26.542808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66b6e5-b2e6-423b-a7a3-9040be5a29ff None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:26.638311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:26.640621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:26.641411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:26.642145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:26.670784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:26.674527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9cb4894d-2bfe-4fb9-b91f-0ff0e728f760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:26.722778 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:26.724536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:26.726156 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:26.726156 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:26.726156 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:26.731175 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 397/789] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:26.745612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:26.973522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d8ee-b94b-4421-a405-9dbb5246af02 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:26.974020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d8ee-b94b-4421-a405-9dbb5246af02 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:26.974460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d8ee-b94b-4421-a405-9dbb5246af02 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:26.977517 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 398/790] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:26.986746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467376e-af84-400c-be12-0339c3807a3f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:26.987251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467376e-af84-400c-be12-0339c3807a3f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:26.987758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467376e-af84-400c-be12-0339c3807a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.031924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d00679-f6b7-4845-8b0a-ef7090973a8a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:27.045246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5467376e-af84-400c-be12-0339c3807a3f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:27.048413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5467376e-af84-400c-be12-0339c3807a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:27.051685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:27.091957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:27.092896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.094077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.094511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.096938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:27.097449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:27.099723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:27.135203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 393/791] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:27.141108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:27.243807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:27.274038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 399/792] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:27.380475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b7f8-29d6-4782-a768-7444d70474db None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.381401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b7f8-29d6-4782-a768-7444d70474db None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.382062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721b7f8-29d6-4782-a768-7444d70474db None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.389539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 400/793] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:27.398238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7cfd3-630d-4adc-b36e-2cf519d3f6d3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.398675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7cfd3-630d-4adc-b36e-2cf519d3f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.399179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7cfd3-630d-4adc-b36e-2cf519d3f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.453736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a1a-4521-4572-af41-12198b1f6126 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:27.456166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-abf7cfd3-630d-4adc-b36e-2cf519d3f6d3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:27.458220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-abf7cfd3-630d-4adc-b36e-2cf519d3f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:27.524773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:27.525764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.526260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.526744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.540904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:27.543815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:27.569783 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:27.571574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:27.573179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 394/794] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:27.587780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:27.691864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:27.729540 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 401/795] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:27.731884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5251bf-110e-43db-8a50-efa5ea3ddaa4 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.732324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5251bf-110e-43db-8a50-efa5ea3ddaa4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.732750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5251bf-110e-43db-8a50-efa5ea3ddaa4 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.735469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 402/796] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:27.757407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.758485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.759122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.796160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:27.799910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:27.904570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b0e0c-29f0-4573-bfab-d8a18f13b1ec None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:27.971366 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 403/797] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:27.972977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:27.977313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:27.978881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:27.979798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:27.980301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:27.981376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:27.981912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:27.985479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:28.019186 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 395/798] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:28.026223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:28.140063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:28.306457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a305e9f-fb58-409d-b13e-2fe58473cd4a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:28.363765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:28.394858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:28.395946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff36d1-4e1a-42b0-a81f-23306cbba8ef None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:28.396387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:28.397224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:28.397720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:28.398828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:28.401339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:28.419447 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:28.421418 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:28.428968 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 404/799] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 4 20:05:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:28.430530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:28.488616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:28.490197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:28.491032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:28.492434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/18d4e38ee31a4ab3a21e998803226465/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:28.496454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=18d4e38ee31a4ab3a21e998803226465, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:28.500514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:28.610838 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 396/800] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:05:28 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/18d4e38ee31a4ab3a21e998803226465/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:05:28.613520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:28.647232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954533d-f8ff-44e6-ae74-a497ec19a8ca None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:28.694934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:28.734650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:28.738309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:28.738799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:28.739329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:28.762370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:28.773096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:28.775047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:28.777619 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:28.783662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 405/801] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:28.785315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:28.879166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d05-a8d1-48c6-92af-ba05b3e8eb98 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:28.956348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:28.957461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:28.957964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:28.958453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:28.959980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:28.960311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:28.962972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:28.974487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 397/802] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:28.974746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.005760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.020792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9832598-5dce-429e-94af-1c6f0f6e0b62 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:29.090134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:29.090874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:29.091435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:29.091918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:29.113619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:29.125334 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:29.127261 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 406/803] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:29.130659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.204654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa57620-9479-4914-9b96-6f22494a708f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:29.214610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.283801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:29.284633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:29.285114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:29.285580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:29.286827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:29.287377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:29.290266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:29.307837 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 398/804] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:05:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:29.309323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.351826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c35aa0-6e38-4c9d-b389-5f55601c5afd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:29.430339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164f94-34be-4661-abce-d7d729833311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:29.431409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164f94-34be-4661-abce-d7d729833311 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:29.431847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164f94-34be-4661-abce-d7d729833311 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:29.432272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164f94-34be-4661-abce-d7d729833311 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:29.433368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67164f94-34be-4661-abce-d7d729833311 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:29.433832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67164f94-34be-4661-abce-d7d729833311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:29.436297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67164f94-34be-4661-abce-d7d729833311 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:29.452197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 407/805] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 4 20:05:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:29.452197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164f94-34be-4661-abce-d7d729833311 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.511932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.562950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e903845-1e41-40e3-b48b-fa305845c320 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:29.652763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:29.654348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:29.655236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:29.656869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:29.659604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:29.660986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:29.664354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:29.683871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164f94-34be-4661-abce-d7d729833311 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:29.685284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:29.694740 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 399/806] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:29.699605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.776242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:29.777258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:29.777742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:29.778210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:29.799125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:29.802029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:29.832036 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:29.833944 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:29.836672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:29.836672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:29.836672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:29.836672 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 408/807] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:29.836672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:29.969547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53952c3-c5df-4f25-b367-eea373331587 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:30.030104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:30.031442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.031878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.032353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.033211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:30.035179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:30.042987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:30.052104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fa6f6-fc3f-4750-b2ff-1b580be6dfce None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:30.121271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:30.122456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.123177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.123681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.147736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:30.150595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:30.171202 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 400/808] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:05:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:30.171202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d83c68ab-565a-4782-a9a3-168fc0e45c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:30.191504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:30.193405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:30.195645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:30.195645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:30.195645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:30.195645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 409/809] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:30.198531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbbcf6-92c9-4984-8256-f0d31435d90d None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.199099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbbcf6-92c9-4984-8256-f0d31435d90d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.199620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbbcf6-92c9-4984-8256-f0d31435d90d None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.204160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 410/810] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:30.205862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbbcf6-92c9-4984-8256-f0d31435d90d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:30.229141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:30.480820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbbcf6-92c9-4984-8256-f0d31435d90d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:30.569992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:30.571651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.572482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.573342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.574851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:30.575735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:30.579377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49e443-234c-411b-aed5-74be5f5395fc None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:30.604659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 411/811] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:30.607416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.608281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.609095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.627113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a601cd-66df-42ae-a839-4280c6cf2e29 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:30.644131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:30.646833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:30.709213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:30.710730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:30.711518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:30.712236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:30.713969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:30.714942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:30.718162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:30.743480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 401/812] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:30.745595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:30.787812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:30.807469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 412/813] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:30.809568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:30.906496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:31.080429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfdfac-39fa-44d9-938f-db2d0a611ea6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.160020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b9412-b1d5-4ce6-a68a-937de40f8e0b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.184592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.185743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.186233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.186828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:31.210954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:31.213856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:31.252508 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:31.254236 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:31.256803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 402/814] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:05:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:31.268946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:31.281276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.282302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.282772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.283256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:31.298584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:31.301464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:31.325771 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:31.328183 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:31.330972 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 413/815] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:05:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 520 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:31.338431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:31.492576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:31.545048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7190ec2-f0e2-4939-9646-50db93db5e74 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.558539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212960d-c66d-4785-82c0-dc5c42565d12 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.571964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:31.626678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.628168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.629675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.630603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:31.632755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:31.633599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:31.636999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:31.650772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.651887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.652367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.652865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:31.654805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:31.655387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:31.658890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:31.679599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 403/816] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:05:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:31.681209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:31.706849 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 414/817] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:05:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:31.708820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:31.899793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b2d21-95ce-434a-ba9e-dd9ef68d6e51 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.912128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451fa98-f766-49f1-bc3c-e752101500c3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:31.939941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:31.978139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.979603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.980547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.981200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] PATH_INFO: `/v3/services/network` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:31.982944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:31.987120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:31.990355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:31.991815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:31.992651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:31.993250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:32.007216 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:32.009517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 20:05:32.011612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:32.022516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 404/818] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:31 2022] GET /identity/v3/services/network => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:32.022516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.091770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:32.138376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.141085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.254717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6d62-5bac-412f-a440-263b076f5efc None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:32.336183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:32.337862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.338695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.339526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.339708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 415/819] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:05:32.341179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.361394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.364193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.374691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:32.398157 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:32.400329 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:32.402085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:32.402085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:32.402085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:32.406064 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 405/820] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:32.408319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.563023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b9ff-2dbd-4458-a01d-e7e6974ba807 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:32.621294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:32.629933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:32.630887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.637961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.637961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.637961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] RBAC: Adding query filter params (name=network) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:32.637961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.637961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.643999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 416/821] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:32.643999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.654040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29217-7654-4daa-9c97-83136aa981fa None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:32.709147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:32.710193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.710652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.711164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.725323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.726996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6f50b929-d8aa-475b-939e-0bec3472477f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:32.746339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:32.748215 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:32.750589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:32.750589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:32.750589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:32.755080 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 406/822] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:32.756997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730f270-7e9a-4e10-981f-2a4ca458ec20 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.757429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730f270-7e9a-4e10-981f-2a4ca458ec20 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.757853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730f270-7e9a-4e10-981f-2a4ca458ec20 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.760055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 407/823] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:32.760732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730f270-7e9a-4e10-981f-2a4ca458ec20 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.813406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:32.866170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272b3f5-da65-46a7-a52f-10b642fd24ed None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:32.896547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730f270-7e9a-4e10-981f-2a4ca458ec20 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:32.932726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:32.933853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.934351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.934846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.936119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:32.937199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.939923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddb16f-266f-4789-a78e-ce07544d12ba None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.941904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:32.942929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.943461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.943942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:32.945091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:32.945616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:32.947548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:32.964617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 408/824] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:32.964617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:32.969623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:32.972549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 417/825] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:32.981444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:32.981854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:32.988285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:33.014325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:33.017296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:33.158387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df5fb5-3e26-49dd-b1fe-10626f3313f6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:33.161713 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 418/826] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:33.163156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:33.239423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688295-1530-4521-a577-a413a355aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:33.240484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688295-1530-4521-a577-a413a355aac0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:33.241005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688295-1530-4521-a577-a413a355aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:33.241485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688295-1530-4521-a577-a413a355aac0 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:33.242999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688295-1530-4521-a577-a413a355aac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:33.243589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688295-1530-4521-a577-a413a355aac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:33.246312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688295-1530-4521-a577-a413a355aac0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:33.272782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 409/827] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:33.274448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688295-1530-4521-a577-a413a355aac0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:33.324567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:33.408042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab600a-a625-45bf-8836-423250c7d740 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:33.437489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:33.487878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:33.489123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:33.489543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:33.490048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:33.491784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:33.494812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:33.541799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688295-1530-4521-a577-a413a355aac0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:33.621325 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 419/828] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:05:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:33.624764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:33.642138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057e72-e270-477f-847c-5834376e41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:33.643283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057e72-e270-477f-847c-5834376e41df None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:33.643878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057e72-e270-477f-847c-5834376e41df None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:33.644432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057e72-e270-477f-847c-5834376e41df None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:33.664993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057e72-e270-477f-847c-5834376e41df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:33.669813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05057e72-e270-477f-847c-5834376e41df None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-05057e72-e270-477f-847c-5834376e41df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:33.705654 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:33.707583 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 410/829] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:33.710287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057e72-e270-477f-847c-5834376e41df None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:33.906014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3ea-26f6-4edf-83c9-33928997b576 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:33.921242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057e72-e270-477f-847c-5834376e41df None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:33.956916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:33.959259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:33.996162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:33.997654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:33.998248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:33.998766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.005038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.006820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.007902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.008757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.018599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.021797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.045857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:34.050192 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:34.054509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 420/830] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:34.056554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:34.064977 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:34.067112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:05:34.068986 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:34.075831 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 411/831] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:34.084783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.254609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355aa22-666e-442c-b5e0-2f5ef726dffb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:34.264897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b80405-f6b5-4989-ab0c-1bf5f6ef1cb8 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:34.300940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.301654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.301909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.302414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.303840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:34.304448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.307228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.324655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.325725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.326220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.326702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.328670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:34.329211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.331303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ecc8-8f92-42cf-82fe-c15996b8c055 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.341895 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 421/832] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:34.341895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.355575 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 412/833] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:34.358062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487240df-f96c-4b24-8d3b-2caa3ee61217 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.358682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487240df-f96c-4b24-8d3b-2caa3ee61217 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.359074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487240df-f96c-4b24-8d3b-2caa3ee61217 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.364201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 413/834] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:34.364201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487240df-f96c-4b24-8d3b-2caa3ee61217 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.421869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:34.447949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:34.535979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40128-01fe-4316-9b99-0fcdaadcae09 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:34.565219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487240df-f96c-4b24-8d3b-2caa3ee61217 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:34.602303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.603387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.603831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.604322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.605612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:34.606152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.609384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.632960 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 422/835] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:34.634492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.647333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.648495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.649003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.649507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/92b7edc1a506407db3cd691bfabf169c/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.682183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=92b7edc1a506407db3cd691bfabf169c, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.685099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881eb103-ffbf-4cc1-b705-e1142a2e6167 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.784905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 414/836] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:05:34 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/92b7edc1a506407db3cd691bfabf169c/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:05:34.787113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.787533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.787967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.822495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:34.824729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:34.833892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:34.840280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536010-faa2-46ad-a2a1-4d5547a17f38 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:34.909430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:34.910382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:34.910791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:34.911225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:34.931234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:34.933774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:34.962484 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:34.964560 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:34.967657 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:34.967657 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:34.967657 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:34.967657 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 423/837] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:34.967657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:34.988243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 415/838] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:34.988243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:35.035409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:35.192828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d10d2-2e92-41e9-9f1b-a6bcc48fc5e0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:35.221378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bd697-73e2-4155-a0f2-2f0b99a736b8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:35.260677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:35.261730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:35.262184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:35.262634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:35.264037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:35.264739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:35.267970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:35.279832 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 424/839] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:35.292303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:35.293288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:35.293720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:35.294148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:35.295313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:35.295791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:35.298284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:35.321998 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 416/840] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:35.332378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:35.375827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:35.550502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c73ff-811b-40cc-88ae-6988f4aa7380 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:35.552949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:35.616790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:35.618056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:35.618504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:35.618971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:35.633807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:35.636456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:35.657212 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:35.658996 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:35.660882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 425/841] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:05:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:35.671806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:35.727350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:35.764498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe639f5-acf1-4d28-be89-2523988a3ec6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:35.833643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:35.834739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:35.835261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:35.836367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:35.836818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:35.839514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:35.856932 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:35.858770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:35.860378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 417/842] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:35.866275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:35.869522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:35.936442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510912d-7f80-4e04-a820-14a15789fff5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:36.022287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:36.024307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:36.026745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:36.027697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:36.029326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:36.030148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:36.033601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:36.082642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 426/843] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 4 20:05:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:36.084824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:36.103805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f821b-123d-4557-ae9c-5b3c6242b813 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:36.186842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:36.188695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:36.189603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:36.190415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:36.192169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:36.193537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:36.196363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:36.215909 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 418/844] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:36.221805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:36.245661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:36.313166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1e0fa-9f1d-40fd-a456-cd66f0ab4b13 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:36.384509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:36.384509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:36.384925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:36.385403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:36.391317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:36.464892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b7256-c102-49c5-8afc-6aaaf4c1656a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:36.528864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:36.532165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:36.547619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:36.549966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:36.550823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:36.551614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:36.553109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:36.554689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:36.558352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:36.570590 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 419/845] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:36.780103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 427/846] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:05:36.790979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:36.944450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:37.003401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc3d1-88b2-4b22-b7bd-17cccd769704 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:37.073762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:37.074881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:37.075426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:37.075919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:37.099674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:37.102487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:37.135403 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:37.137167 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:37.138872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:37.138872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:37.138872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:37.138872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 420/847] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:37.149748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:37.220452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:37.362510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252622e-04e6-40f9-8862-9822c4494fc2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:37.438495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:37.439639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:37.440139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:37.440637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:37.441882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:37.442436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:37.445225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:37.471121 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 428/848] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:37.481028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:37.697525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625fcc-7678-48ad-b99a-e4e22f13857b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:37.765207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:37.766248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:37.766747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:37.767276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:37.771172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:37.785737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:37.788838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:37.813793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:37.816673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:37.818110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 421/849] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:37.829655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:38.025670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:38.039332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2722-2492-43a3-8126-657356d87bfe None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:38.110348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:38.111449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.111940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.112428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.113755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:38.114302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:38.116890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a705a02-eaf8-403c-9629-84377a8eae55 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:38.143532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 429/850] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:38.153342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:38.360881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2414-7cc6-49be-874e-732200cf81e3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:38.430819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:38.431898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.432379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.432844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.434195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=18d4e38ee31a4ab3a21e998803226465) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:38.434749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:38.437561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16939f-f57a-4d66-9143-69bdfc0dbe0e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:38.449628 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 422/851] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:38 2022] GET /identity/v3/role_assignments?user.id=18d4e38ee31a4ab3a21e998803226465&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:38.814600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcf63-7d79-4576-8f14-54020ab6fc66 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.815109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcf63-7d79-4576-8f14-54020ab6fc66 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.815670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bcf63-7d79-4576-8f14-54020ab6fc66 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.818898 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 430/852] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:38.829628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.830401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.830722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.864343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:38.866503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:38.943790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd5a8-387c-4083-8d5a-bf66325c532e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.944695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd5a8-387c-4083-8d5a-bf66325c532e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.944695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd5a8-387c-4083-8d5a-bf66325c532e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.946170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 431/853] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:38.953882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:38.954354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:38.954611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:38.958197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:38.992918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:38.994695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 423/854] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:38.995099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:39.123810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 432/855] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:05:39.406744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:39.607771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7213d-44a7-473a-b90c-4677bd82723b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:39.616955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:39.692948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:39.694487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:39.695050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:39.695570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:39.722943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:39.735194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:39.736814 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:05:39.738178 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:39.744439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 424/856] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:39.746346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:39.818011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:39.842968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:39.852486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c63c0e-7520-4d7e-b2c3-22b58a681e54 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:39.931707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:39.933611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:39.934444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:39.935271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:39.937001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:39.940490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:39.960260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:39.963038 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:39.964997 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:39.970219 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 433/857] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 4 20:05:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:39.979740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:39.993917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd202-7c10-4aa4-a9a6-17bc2a7268e4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:40.066730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:40.067903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.068404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.069242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.070505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:40.071056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:40.073786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:40.091506 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 425/858] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:40.104917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:40.229513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4457da-57f7-492e-8309-b4b4c39b01d3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:40.302193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:40.303364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.303882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.304351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.305558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:40.306101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:40.309496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:40.315562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.319527 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 434/859] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:40.322558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db10dd-0f47-41dc-ab1f-1e22d9b17a93 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:40.329337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:40.361272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.401120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:40.402455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.403090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.403748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.430292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:40.433892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2964366b-ca7a-4d6a-91ce-4d8460e72444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:40.465462 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:40.468136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:40.470028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:40.470028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:40.470028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:40.470028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 426/860] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:40.470593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db6240-65a6-4497-930a-1b5ba5919e59 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.471099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db6240-65a6-4497-930a-1b5ba5919e59 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.471640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db6240-65a6-4497-930a-1b5ba5919e59 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.475217 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 427/861] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:40.479690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db6240-65a6-4497-930a-1b5ba5919e59 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:40.558738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f263c0-de5c-453c-ae06-4fbdc14597d6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:40.649067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:40.650204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.650729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.651302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.652641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:40.653197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:40.656339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d2b4-03a1-45b9-b091-1dd62ac6d259 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:40.674124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 435/862] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:40.674124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.674124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.674124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.713454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db6240-65a6-4497-930a-1b5ba5919e59 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:40.713731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:40.715617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:40.786450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:40.787560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:40.788031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:40.788489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:40.790861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:40.791688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:40.794571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:40.826231 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 428/863] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:40.831457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:40.866217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:40.890359 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 436/864] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:41.061045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2ae2-84c2-40c7-84b4-4ab725fbec5c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:41.134941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:41.136162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:41.136653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:41.137128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:41.153105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:41.156034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:41.182153 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:41.184060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:41.185978 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 429/865] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:05:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:41.194990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:41.211867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:41.412462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a056-1163-4629-82d5-f7c9469f8b41 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:41.449489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:41.485538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:41.486556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:41.487033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:41.487561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:41.488891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:41.489454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:41.492531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:41.527940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 437/866] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:05:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:41.539015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:41.629290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:41.704718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:41.713191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6ad2c-8361-460a-bbce-34e692698622 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:41.793518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:41.795069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:41.795685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:41.796156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:41.797354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:41.799492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888935f-17ad-4d2e-be40-d3c0ddc2655a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:41.799877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:41.877427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:41.878512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:41.878990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:41.879524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:41.919717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 430/867] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:05:41 2022] POST /identity/v3/services => generated 251 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:05:42.035532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:42.038965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54cfaa-a943-4c4c-9a91-299dfb9dc5ee None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:42.181101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:42.259955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 438/868] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:05:42.270450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:42.279746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9608e-9e4a-4de7-b8b1-27566e2f0b3b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:42.281171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9608e-9e4a-4de7-b8b1-27566e2f0b3b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:42.281954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9608e-9e4a-4de7-b8b1-27566e2f0b3b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:42.284778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 439/869] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:42.295924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:42.297189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:42.297887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:42.334836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:42.336940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:42.493113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6bec8-3284-4ee3-bd40-a620563a4dc0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:42.503218 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 440/870] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:05:42.555432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:42.571004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:42.572124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:42.572586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:42.573079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:42.595404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:42.597879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:42.629118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:42.630942 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:42.633169 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:42.633169 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:42.633169 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:42.633169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 431/871] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:42.643964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:42.841851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:42.854892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e48f4-f0d7-4723-af9c-2ede22285687 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:42.926282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:42.927370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:42.927862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:42.928339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:42.929525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:42.930058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:42.932711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:42.955961 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 441/872] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:42.965080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.066036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.169062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7428c5-7a66-4d7e-9fec-f280c8e89f55 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.237559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:43.239053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:43.239796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:43.240509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:43.255230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:43.258487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:43.282295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77fb4b-2a2d-47a4-8cc0-5b4b76bdb433 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:43.284054 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:43.285963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:43.288072 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:43.291760 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 432/873] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:43.302084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.371023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:43.372222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:43.372725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:43.373244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:43.375334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:43.378236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:43.397618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:43.399797 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:43.401756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:43.403673 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:43.415546 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 442/874] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:43.431764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.461619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:43.523328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf0982-a391-4584-9c49-20dd32fac57e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.606082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:43.607344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:43.607936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:43.609070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:43.610885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:43.611547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:43.614622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:43.642055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 433/875] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:43.648600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1967e-7f7b-42b0-9106-e89753a89538 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.652844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.724765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:43.725812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:43.726301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:43.726755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:43.727979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:43.728542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:43.731097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:43.747694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 443/876] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:05:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:43.751718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:43.872730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:43.878741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beca9b-e3fe-47a7-826a-d46cd8aac17b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.927443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:43.959993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:43.961085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:43.961621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:43.962208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:43.963771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=92b7edc1a506407db3cd691bfabf169c) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:43.964468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:43.968083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20fb15-b6ea-44b7-9a83-d45bd52ae974 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:43.969385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945fe6-0ae7-49bd-9457-03558e46babf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:43.980700 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 434/877] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:43 2022] GET /identity/v3/role_assignments?user.id=92b7edc1a506407db3cd691bfabf169c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:44.042435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:44.043896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:44.044625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:44.045332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:44.046829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:44.047629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:44.050546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f4c3-9931-4f44-9915-575798cc14b2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:44.060784 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 444/878] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:05:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:44.473539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476687-9f82-42a0-8575-5c3f9adc20b8 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:44.474012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476687-9f82-42a0-8575-5c3f9adc20b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:44.474544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476687-9f82-42a0-8575-5c3f9adc20b8 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:44.477480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 435/879] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:44.487013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf02f-c72c-475d-9e29-1ab12a445edb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:44.488121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf02f-c72c-475d-9e29-1ab12a445edb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:44.488121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf02f-c72c-475d-9e29-1ab12a445edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:44.520811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b0caf02f-c72c-475d-9e29-1ab12a445edb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:44.522942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b0caf02f-c72c-475d-9e29-1ab12a445edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:44.667406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 445/880] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:45.162515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33476687-9f82-42a0-8575-5c3f9adc20b8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:45.376357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33476687-9f82-42a0-8575-5c3f9adc20b8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:45.446758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:45.447762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:45.448267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:45.448772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:45.449976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:45.453217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d976-65d2-404d-8674-dda80d4baee7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:45.545918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 436/881] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:05:45 2022] POST /identity/v3/services => generated 269 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:46.133461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b119d4-d691-43a7-b301-bb4711a1b383 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:46.134160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b119d4-d691-43a7-b301-bb4711a1b383 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:46.134385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b119d4-d691-43a7-b301-bb4711a1b383 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:46.137340 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 446/882] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:46.147283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:46.147775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:46.148271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:46.182307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:46.184659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:46.224013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:46.340075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 437/883] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:46.869213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b119d4-d691-43a7-b301-bb4711a1b383 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:47.045559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:47.094472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b119d4-d691-43a7-b301-bb4711a1b383 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:47.166434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:47.167556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:47.168243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:47.168924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:47.170181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:47.173183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:47.192026 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:47.194166 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:47.196113 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:47.200541 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 447/884] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:47.211013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:47.412445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c49de-aa9a-4cf4-8366-25857777fb29 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:47.481721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825576-f215-430c-9103-082505d4935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:47.483907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825576-f215-430c-9103-082505d4935d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:47.484744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825576-f215-430c-9103-082505d4935d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:47.485518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825576-f215-430c-9103-082505d4935d None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:47.486956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e825576-f215-430c-9103-082505d4935d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:47.487757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e825576-f215-430c-9103-082505d4935d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:47.490596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e825576-f215-430c-9103-082505d4935d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:47.501106 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 438/885] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:47.511499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:47.738191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdc30e-13b3-4ab2-93b9-c46d877ee41e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:47.809921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:47.810951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:47.811493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:47.811964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:47.813144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:47.813672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:47.816360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82146a-92a5-42df-8fc9-e94f7dd01671 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:47.826881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 448/886] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:47.837306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825576-f215-430c-9103-082505d4935d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:47.873153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:47.913647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db980ff-d84e-4eec-b787-3cde5230b19f None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:47.914144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db980ff-d84e-4eec-b787-3cde5230b19f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:47.914635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db980ff-d84e-4eec-b787-3cde5230b19f None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:47.923345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 449/887] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:47.927081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb318-f80e-4311-84b8-d86ed9ec56aa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:47.927599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb318-f80e-4311-84b8-d86ed9ec56aa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:47.928487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb318-f80e-4311-84b8-d86ed9ec56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:47.941253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:47.962238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e90bb318-f80e-4311-84b8-d86ed9ec56aa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:47.964371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e90bb318-f80e-4311-84b8-d86ed9ec56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:48.041456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825576-f215-430c-9103-082505d4935d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:48.110265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:48.111387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:48.111890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:48.112568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:48.113982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] RBAC: Adding query filter params (interface=public, service_id=a7e8cef1ebfc440aa8757eaed3b4cc64, region_id=RegionOne) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:48.114543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:48.115618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 450/888] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:48.117455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:48.118062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104422b-79e3-417a-98b9-bf03e4cae6c4 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:48.118558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104422b-79e3-417a-98b9-bf03e4cae6c4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:48.119062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104422b-79e3-417a-98b9-bf03e4cae6c4 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:48.121899 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 451/889] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:48.135205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 439/890] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:05:47 2022] GET /identity/v3/endpoints?service_id=a7e8cef1ebfc440aa8757eaed3b4cc64&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:48.135535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:48.135535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:48.135535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:48.147234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:48.165260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:48.167518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:48.319667 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 452/891] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:05:48.353624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:48.378750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d394659-5f1f-4659-befb-1282a9af6f98 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:48.459966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:48.461755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:48.462618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:48.463453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:48.464994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:48.468706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:48.482277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 440/892] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:05:48 2022] GET /identity/v3/services => generated 1268 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:05:48.595524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:48.724761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:48.804159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3ea9-5804-4b06-ab26-aacf922efb14 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:48.846678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:48.876982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:48.878365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:48.878974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:48.879464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:48.898989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:48.909180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:48.910327 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:05:48.911971 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:48.916288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 453/893] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:05:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:48.926948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:49.067401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c9c9-1e85-4ce6-8abd-d07e54659c4f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:49.137241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b73ba-2acc-4316-99c8-e60100db1c94 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:49.141169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:49.143615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.144383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.145118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.146517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:49.149346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f43ec1-61c5-4fd4-b8e8-de6fd6bb94d3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:49.177629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:49.192469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:49.193405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.193811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.194238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.195060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:49.195531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:49.197136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:49.219243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 454/894] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:49.223067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:49.270938 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 441/895] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:05:48 2022] POST /identity/v3/services => generated 241 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:49.455562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdafe-3114-4124-9450-492ac1371f18 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:49.485880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d6b1-707d-4107-9dcc-a051d16b9849 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.487516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d6b1-707d-4107-9dcc-a051d16b9849 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.488314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d6b1-707d-4107-9dcc-a051d16b9849 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.492493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 442/896] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:49.502280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.502774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.503249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.511324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:49.531324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:49.534395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:49.539720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:49.540472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.540837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.541108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.563075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:49.565313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:49.593450 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:49.595249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:49.597025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:49.597025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:49.597025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:49.600895 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 455/897] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:49.609245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:49.660597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:49.694535 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 443/898] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:05:49.791083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c12f4-1b1c-481c-883b-1fa65846dd66 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:49.848696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:49.849781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:49.850413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:49.851472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:49.852502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:49.853060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:49.855324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:49.886828 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 456/899] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:49.889916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.059815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c50f-89d6-4951-b9cb-d9bec9ced96f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:50.112002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:50.115669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:50.116630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:50.116950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:50.117481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:50.118444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.129349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:50.131008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:50.153991 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:50.156465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:50.159831 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 444/900] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:05:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:50.166959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.346122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2adb0-fc4a-4c65-aee3-e8948de397ff None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:50.378827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2653403-5e4c-4af9-8505-572c44bd72f3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:50.407686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:50.421544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:50.424378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:50.425014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:50.425658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:50.427118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:50.430765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:50.444696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:50.446224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:50.446987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:50.447710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:50.449352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:50.450185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:50.452666 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:50.454769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:50.456849 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:50.459875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:50.467834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 457/901] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 4 20:05:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:50.471847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.507230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 445/902] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:05:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:50.518591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.628801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:50.746922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2461-98cf-41a5-9bec-6c03be10b2e0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:50.751733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b742-6273-499d-883d-88b4a02c020f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:50.830608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:50.831797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:50.832317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:50.832755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:50.834010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:50.834557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:50.836239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:50.837145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:50.837968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:50.839295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:50.840106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:50.848013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 458/903] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:50.857406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:50.909187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:51.009549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.012526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.075555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b301-ee7f-48fc-a16e-e76eb6df7b0d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:51.116145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:51.163321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:51.164878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:51.165711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:51.167528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:51.169061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:51.169926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.175020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.189811 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 459/904] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:51.201193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:51.231298 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 446/905] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:05:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:05:51.240194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:51.415844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:51.434476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1afe5-1278-47c8-8b97-5e979665654f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:51.456101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872289d6-de3c-4e4b-beda-a7898ec61202 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:51.518398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:51.519562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:51.520262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:51.520861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:51.522269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] RBAC: Adding query filter params (interface=public, service_id=e44c330fcc0d46b29852ae6b5a2443f4, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:51.522834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.526887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.535356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:51.537680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:51.538606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:51.539536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:51.544604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 460/906] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:05:51 2022] GET /identity/v3/endpoints?service_id=e44c330fcc0d46b29852ae6b5a2443f4&interface=public®ion_id=RegionOne => generated 194 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:51.549339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:51.565339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.568407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:51.608388 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:51.610284 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:51.612132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:51.612132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:51.612132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:51.622171 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 447/907] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:51.625458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:51.631832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:51.826546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf309c-368f-4f7e-8991-b33e5a41d35c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:51.872321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538c35-d19d-4fae-9c53-3e17daaf601a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:51.904026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:51.906524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:51.907449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:51.908403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:51.909886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.913023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.927000 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 461/908] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:05:51 2022] GET /identity/v3/services => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:05:51.957574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:51.959288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:51.960141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:51.961115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:51.962687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:51.963595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:51.966595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a945-b40d-41d1-ae15-f85d080d70a7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:51.999350 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 448/909] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:52.006236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:52.043897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:52.239996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db797-6ce6-46a3-b6a1-3f261dfcf873 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:52.314479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:52.315688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:52.316186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:52.316680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:52.329160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d912-ece3-4432-a5ff-2bc1a9821947 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:52.329667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d912-ece3-4432-a5ff-2bc1a9821947 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:52.330148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d912-ece3-4432-a5ff-2bc1a9821947 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:52.331377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:52.333235 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 449/910] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:52.334543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:52.343428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:52.343910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:52.344403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:05:52.360185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:52.362096 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:05:52.364034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:52.371176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 462/911] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:52.373276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:52.383730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:52.385639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:52.534124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:52.543448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:52.560990 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 450/912] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:52.608863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60e591-32a8-4946-a6d1-c2d2d7942dcf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:52.688210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:52.688970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:52.689474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:52.689969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:52.691442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:52.691993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:52.694845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca407bc3-34fd-4bdc-bdf5-a1ec6850df68 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:52.727387 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 463/913] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:52.733233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:52.965575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfe81-1a3f-4e8f-ad52-006f218293c1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:53.043221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:53.045104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:53.045652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:53.046154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:53.047720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] RBAC: Adding query filter params (role.id=8900019413f7421f86282a8b0d82e700, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=92b7edc1a506407db3cd691bfabf169c) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:53.048278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:53.051298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:53.057616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e827-0932-4188-88f9-4ace9ee3512c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:53.058998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e827-0932-4188-88f9-4ace9ee3512c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:53.059597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5e827-0932-4188-88f9-4ace9ee3512c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:53.063847 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 464/914] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:53.064133 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 451/915] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:05:52 2022] GET /identity/v3/role_assignments?user.id=92b7edc1a506407db3cd691bfabf169c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=8900019413f7421f86282a8b0d82e700 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:53.073892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:53.074361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:53.074778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:53.112582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:53.113556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:53.115988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:53.254036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:53.303295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 465/916] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:53.365519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17785-2558-44b5-aeb8-716f646590d3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:53.439368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:53.440481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:53.440987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:53.441548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:53.442692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:53.445359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:53.464501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:53.469034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:53.472086 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 452/917] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:53.480083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:53.615602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:53.698714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2a66-196c-42b4-8ecc-65fffc758491 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:53.771570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:53.772650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:53.773153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:53.773646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:53.774860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:53.775438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:53.777988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:53.791681 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 466/918] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:53.798852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:53.812239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:54.024556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4a13-35d5-456d-82f9-5be65aaaf58f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:54.033856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8c65-9542-4f21-b0de-a3e3b30865fc None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:54.088067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:54.091037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:54.109939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:54.111448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:54.111958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:54.113325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:54.114778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:54.118640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:54.121890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:54.124365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:54.125679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:54.126412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:54.128453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:54.129263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:54.132178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:54.140981 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:54.157164 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:05:54.158864 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:54.160603 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 453/919] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 4 20:05:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:54.160769 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 467/920] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:54.160935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:54.161092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:54.385049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd4c5-8aca-417d-91e2-2f5b03bdcb68 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:54.390598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2fdd2-fa80-4b79-8428-d089c8f249dc None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:54.461382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:54.463252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:54.463987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:54.464649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:54.464821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:54.465893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:54.466398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:54.466679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:54.466859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:54.468191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:54.468671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:54.471320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:54.471679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:54.483006 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 468/921] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:05:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:54.496843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:54.620318 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 454/922] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:05:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:05:54.626776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:54.742977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30606f4e-7a8f-4c9b-971e-82d705e684a6 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:54.830949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:54.832184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:54.832693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:54.833152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:54.834374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:54.834924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:54.837741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:54.855341 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 469/923] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:05:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:05:54.859860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:54.953076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:55.073354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3071-d09b-4b0f-a598-f54bb0d276ac None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:55.145524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:55.146584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:55.147064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:55.147591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:55.148943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] RBAC: Adding query filter params (interface=public, service_id=979d8d1dadf748019862c2d8355c631d, region_id=RegionOne) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:55.149502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:55.152174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afee3aa-3736-4c3a-9693-491ca4acdc12 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:55.163892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 455/924] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:05:54 2022] GET /identity/v3/endpoints?service_id=979d8d1dadf748019862c2d8355c631d&interface=public®ion_id=RegionOne => generated 194 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:55.173235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:55.388665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b614-a13b-47d7-b0fb-9a0c6cbca5f2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:55.423436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:55.458533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:55.459628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:55.460131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:55.460744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:55.461885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:55.465355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89035a49-8f60-45c7-bebd-214b92cb46a3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:55.479184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 470/925] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:05:55 2022] GET /identity/v3/services => generated 1497 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:05:55.936444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3871-7872-43ce-a825-c965ce0376ad None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:55.937181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3871-7872-43ce-a825-c965ce0376ad None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:55.937686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a3871-7872-43ce-a825-c965ce0376ad None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:55.940823 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 456/926] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:55.950591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:55.951948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:55.952463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:55.982219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:55.984431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:56.121962 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 471/927] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:56.632252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3871-7872-43ce-a825-c965ce0376ad None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:56.849719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a3871-7872-43ce-a825-c965ce0376ad None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:56.854706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:56.920825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:56.921846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:56.922334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:56.922815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:56.923904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:56.926614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-41b702f6-3e94-425a-a5ac-16edcd46d205 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:56.945085 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:56.946529 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:56.947836 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 457/928] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 4 20:05:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:56.958571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:57.184381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a84a-3b15-41c7-a1fe-295c27e83cfa None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:57.184880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a84a-3b15-41c7-a1fe-295c27e83cfa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:57.185164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634a84a-3b15-41c7-a1fe-295c27e83cfa None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:57.187929 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 458/929] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:57.188177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475f11a-8bd6-4f9b-9138-a4c88e8e460c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:57.196673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:57.197599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:57.198339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:57.212635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:57.231524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:57.233639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:57.264366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:57.265955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:57.266743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:57.267718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:57.269468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:57.271992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:57.275203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:57.288128 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 472/930] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:57.298194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:57.369375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 459/931] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:57.496260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83997-4249-42e4-9f28-9789044a6b37 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:57.563503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:57.564475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:57.564893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:57.565316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:57.566476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:57.566988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:57.569692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:57.580875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 473/932] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:05:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:57.590295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:57.820535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:57.828562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7a440-c293-408f-9ad4-607dd2bc7794 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:57.891739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:57.900982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:57.902756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:57.903603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:57.904966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:57.906531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:57.909597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:57.977176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:58.035511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 460/933] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:05:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:05:58.105688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65ebc-c620-4c37-a3c9-8dba93e7d816 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:58.192630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:58.194430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:58.195371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:58.196171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:58.220654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:05:58.232205 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:58.234141 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:05:58.235909 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:58.241050 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 474/934] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:05:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:58.252863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:58.473312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f7dfd-b4d6-478a-acdc-ae953aca2fb2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:58.547993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:58.549349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:58.550020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:58.550678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:58.552108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:58.552850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:58.555374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d504eb-3f5f-476e-bb87-4acd2a99ba6b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:58.572505 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 461/935] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:05:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:58.583384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:58.788878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:58.793384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96f66-d536-49ef-9ccd-b86e41c3a1d8 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:58.793878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96f66-d536-49ef-9ccd-b86e41c3a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:58.794384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96f66-d536-49ef-9ccd-b86e41c3a1d8 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:58.802911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00e1d-5922-48b1-bab4-0f8920b16dd5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:58.803382 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 462/936] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:05:58.806674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:58.807167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:58.807837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:58.838755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:58.840897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:05:58.863609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:58.880457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:58.881577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:58.882054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:58.882849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:58.906935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:58.909744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:05:58.940618 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:58.942811 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:05:58.945180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:05:58.945180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:05:58.945180 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:58.945180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 475/937] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:58.953289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:59.004550 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 463/938] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:05:59.172678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f069e-e05d-4d86-b3e4-555e44d0afed None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:59.245496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:59.246517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.247006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.247511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.249261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:59.249872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:59.252626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:59.278434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 476/939] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:59.288145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:59.505135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaeea2-bc47-42b8-a564-d4c103101b9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:59.531783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:59.549875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:59.583209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:59.584375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.584887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.585386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.602238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:59.605460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0d59c627-81e4-45fc-bf10-bd945ca87650 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:05:59.630714 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:05:59.632674 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:05:59.634523 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:05:59.641246 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 464/940] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:05:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:05:59.644167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4eb7-4d28-4973-99ba-248a7384f8ab None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.644635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4eb7-4d28-4973-99ba-248a7384f8ab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.645123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4eb7-4d28-4973-99ba-248a7384f8ab None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.648470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 465/941] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:05:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:05:59.649947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4eb7-4d28-4973-99ba-248a7384f8ab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:59.669866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:05:59.750480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32789b-bcf8-494a-9107-2c91f36063e7 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:59.823504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:59.824570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.825061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.825558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.827380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:59.830159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:59.835068 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.common [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 20:05:59.868786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4eb7-4d28-4973-99ba-248a7384f8ab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:05:59.902651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.sql.core [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 20:05:59.902651 n-d-852085-12 devstack@keystone.service[82439]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:05:59.902651 n-d-852085-12 devstack@keystone.service[82439]: [parameters: {'id': 'b0db388e83584fb29d3318f25f1bba8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 20:05:59.902651 n-d-852085-12 devstack@keystone.service[82439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 20:05:59.938874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:05:59.939982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.940471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d7ef5024-4683-4c54-b3ea-6e9d52f31998 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b0db388e83584fb29d3318f25f1bba8e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b0db388e83584fb29d3318f25f1bba8e. Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:05:59.940763 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 20:05:59.942715 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application yield resource Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise self.value Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application session.commit() Oct 04 20:05:59.945339 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:05:59.947683 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 20:05:59.950370 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:05:59.954689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [parameters: {'id': 'b0db388e83584fb29d3318f25f1bba8e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:59.957397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:05:59.962324 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b0db388e83584fb29d3318f25f1bba8e. Oct 04 20:05:59.967672 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:05:59.969482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.969482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:05:59.969482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:05:59.970188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 477/942] 10.222.0.78 () {60 vars in 1140 bytes} [Tue Oct 4 20:05:59 2022] POST /identity/v3/projects => generated 262 bytes in 413 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:05:59.970188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:05:59.972355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:05:59.972610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:05:59.972610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:05:59.982835 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 466/943] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:05:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:05:59.982835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:05:59.983563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:05:59.983829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:00.075816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:00.096354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:00.123473 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 478/944] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:05:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:00.123473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:00.141202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571df301-9142-44ab-aae3-c2b84269256f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:00.209857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:00.210931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:00.211476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:00.211961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:00.225671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:00.228468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:00.252478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:00.254463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:00.264587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 467/945] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:00.268153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:00.361267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4cb8-7f5e-4b12-bca6-378687a7d8fc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:00.446103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:00.448870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:00.449796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:00.451481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:00.478389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:00.483509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:00.485282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a68f3-5ee2-4973-a77e-f7aaa59b25e7 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:00.518738 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:00.520927 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:00.523059 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:00.523059 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:00.523059 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:00.523059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 479/946] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:00.528167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:00.548876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:00.574458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:00.576612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:00.577527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:00.578331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:00.579984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:00.580861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:00.584005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:00.629373 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 468/947] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:00.637454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:00.664237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:00.776565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77abaf-9611-4da6-b39f-c1e337cf2279 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:00.848953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:00.850038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:00.850492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:00.850975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:00.852204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:00.852745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:00.855582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:00.866365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e732-f7ba-4937-a633-19031c8f9424 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:00.894139 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 480/948] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:00.898996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:00.944942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:00.946069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:00.949048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:00.949048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:00.949048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:00.953424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:00.972563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:00.976308 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:00.979547 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:00.982650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 469/949] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:00.987626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:01.115028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:01.132780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028edcff-14ee-4c1e-bb93-7f2db86b35d8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.137605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:01.221489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:01.221489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:01.221489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:01.221489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:01.235237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:01.236069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27682e-ba05-4e05-9476-c50414304cb4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.238087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:01.269826 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:01.272556 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:01.274614 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 481/950] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:01.284045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:01.324660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:01.325951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:01.327027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:01.327794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:01.329115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:01.329845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:01.332451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:01.342876 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 470/951] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:01.352369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:01.524224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2346-27b0-4ab0-946b-e52fa59d3a25 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.583346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4f7e-d6c8-4121-80a9-70fb730f52ba None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.609389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:01.610480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:01.610974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:01.611498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:01.612854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:01.614358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:01.617882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:01.620370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:01.647689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 482/952] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:01.659089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:01.680679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:01.683219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:01.683219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:01.683219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:01.684089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:01.685838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:01.688846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:01.707281 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 471/953] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:01.709754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:01.723837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:01.909400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da39bc-1ba6-4845-93b7-056712af6ee5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.957527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fed5e-df5b-4bb0-8d26-b276b0f5692b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:01.986080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:01.988251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:01.988251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:01.988975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/92b7edc1a506407db3cd691bfabf169c/roles/8900019413f7421f86282a8b0d82e700` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:01.993600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=92b7edc1a506407db3cd691bfabf169c, role_id=8900019413f7421f86282a8b0d82e700)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:01.996714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6573d-6811-4dcc-ba81-d3d560ca73f1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:02.034112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:02.035186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:02.035692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:02.036177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:02.037446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:02.040055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:02.110534 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 483/954] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:06:01 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/92b7edc1a506407db3cd691bfabf169c/roles/8900019413f7421f86282a8b0d82e700 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:06:02.112368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef0f-9a6a-4c1e-886e-90df2757ea37 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:02.112824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef0f-9a6a-4c1e-886e-90df2757ea37 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:02.113240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ef0f-9a6a-4c1e-886e-90df2757ea37 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:02.115329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 484/955] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:02.122176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:02.122757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:02.135485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:02.147819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:02.149427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:02.170847 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 472/956] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:06:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:06:02.311040 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 485/957] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:02.833950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:02.903370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:03.047852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ac5c1-dc6c-42b8-baeb-c33656801aec None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:03.117239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:03.118832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:03.119679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:03.120468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:03.121922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:03.125466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:03.143870 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:03.145855 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:03.147548 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:03.153230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 473/958] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:03.163491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:03.187581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:03.371027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d33c5-ac50-4779-9416-a3c68342ed7e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:03.442527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:03.444142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:03.444934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:03.445689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:03.447156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] RBAC: Adding query filter params (name=compute) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:03.447980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:03.451432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bdfbd-de2d-4c20-bef4-20478361339b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:03.462280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 486/959] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:03.472628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:03.674233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:03.691174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e71f-1289-4075-852e-5f3db00870c3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:03.756532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:03.757275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:03.757554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:03.757827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:03.758483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:03.758954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:03.760642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71a80-a3b5-4f5f-9d4c-9dcfae27c996 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:03.767991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 474/960] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:04.925274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052eafb-b238-4b4c-a38e-12ce70f19e15 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:04.926925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052eafb-b238-4b4c-a38e-12ce70f19e15 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:04.927746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052eafb-b238-4b4c-a38e-12ce70f19e15 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:04.931270 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 487/961] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:04.940976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417bb9-4c64-4972-9f43-e25b19b44719 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:04.942520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417bb9-4c64-4972-9f43-e25b19b44719 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:04.943372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417bb9-4c64-4972-9f43-e25b19b44719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:04.978364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-30417bb9-4c64-4972-9f43-e25b19b44719 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:04.981336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-30417bb9-4c64-4972-9f43-e25b19b44719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:05.110965 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 475/962] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:05.645761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052eafb-b238-4b4c-a38e-12ce70f19e15 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:05.680716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c11f2-791c-41f2-9f7e-5e0fc4d9b892 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:05.681305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c11f2-791c-41f2-9f7e-5e0fc4d9b892 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:05.682225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c11f2-791c-41f2-9f7e-5e0fc4d9b892 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:05.684569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 476/963] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:05.692447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b67d-7476-44ee-a010-1b1eb14d4857 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:05.692757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b67d-7476-44ee-a010-1b1eb14d4857 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:05.693116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b67d-7476-44ee-a010-1b1eb14d4857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:05.715917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9006b67d-7476-44ee-a010-1b1eb14d4857 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:05.719256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9006b67d-7476-44ee-a010-1b1eb14d4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:05.825398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:05.848123 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 477/964] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:05.849617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27efb-e0be-4bc8-8a74-ebdf5549fb22 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:05.850055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27efb-e0be-4bc8-8a74-ebdf5549fb22 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:05.850467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27efb-e0be-4bc8-8a74-ebdf5549fb22 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:05.858398 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 478/965] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:05.861788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:05.862287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:05.862785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:05.893169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052eafb-b238-4b4c-a38e-12ce70f19e15 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:05.896357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:05.900473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:05.933085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:05.969132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:05.971404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:05.972247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:05.973042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:05.974866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:05.978206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:06.052646 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 479/966] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:06.241390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.sql.core [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 20:06:06.241390 n-d-852085-12 devstack@keystone.service[82439]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 20:06:06.241390 n-d-852085-12 devstack@keystone.service[82439]: [parameters: {'user_id': 'ae08d0ed72a94602b3fcabab4bd86212', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 20:06:06.241390 n-d-852085-12 devstack@keystone.service[82439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:06:06.255386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:06:06.256845 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application yield resource Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise self.value Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application session.commit() Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:06:06.258415 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:06:06.261728 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:06:06.265764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:06:06.270421 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ae08d0ed72a94602b3fcabab4bd86212', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:06.275030 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 20:06:06.286574 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.292505 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 488/967] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 4 20:06:05 2022] POST /identity/v3/users => generated 160 bytes in 639 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:06.294065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:06.344442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:06.494072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403c6c9-c14e-42de-9a56-56a75702d31b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:06.556015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e771-6980-4435-8d4e-63ddcc654005 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:06.560573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:06.561514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:06.562065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:06.562540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:06.577821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:06.580254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:06:06.602360 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:06.609092 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 480/968] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:06:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:06.610118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:06.628473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:06.637106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:06.642363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:06.642363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:06.642363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:06.646226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:06.665807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:06.676468 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:06.682356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 489/969] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:06:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:06.684442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:06.811777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8ee3f-2464-4e28-bdba-182ebc3bd7df None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:06.877159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:06.878368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:06.878936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:06.879544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:06.880798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:06.883818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:06.884755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6d22-9427-43ef-85cb-62893785174f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:06.905247 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:06.907644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:06.917984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 481/970] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:06:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:06.919905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:06.962230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:06.967128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.059180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 490/971] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 4 20:06:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:07.059180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.147764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:07.160588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a59f53-5d94-4611-9740-a5b21d196051 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:07.207638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:07.245380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:07.246633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.247029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.247661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.248691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:07.249170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:07.250766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.266141 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 482/972] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:06:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:07.275402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.336704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeccc08-5896-4248-a377-f13a799ced40 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:07.410418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:07.411493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.411971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.413000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.413000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:07.413411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:07.414975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.422935 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 491/973] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:07.429131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.492725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769fc04-6196-44cb-bb6d-b5173657f008 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:07.542529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:07.543575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.544018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.544477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.550046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:07.564529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:07.566961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-793ad1b0-ef6a-4c7b-8ce5-ef328879f777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:07.590574 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:07.592551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:07.594931 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:07.594931 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:07.594931 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:07.594931 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 483/974] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:07.595594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92702b-28f6-421c-a8bf-a092ae97d086 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.595756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92702b-28f6-421c-a8bf-a092ae97d086 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.596096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92702b-28f6-421c-a8bf-a092ae97d086 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.597549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 484/975] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:07.603815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92702b-28f6-421c-a8bf-a092ae97d086 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.615096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e087-3baf-49d4-b224-eb5df6b56e98 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:07.641627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:07.664822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:07.665578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.666053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.667038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.668602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:07.670033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:07.672770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fa4d9-2f4e-4d8f-adaa-d3eed899e193 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.685598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 492/976] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:07.687846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.688337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.688765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.715344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:07.717178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:07.791840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92702b-28f6-421c-a8bf-a092ae97d086 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:07.833636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 493/977] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:07.835268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.857198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:07.858285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:07.858800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:07.859328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:07.860552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:07.861160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:07.864465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:07.894631 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 485/978] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:07.897005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:07.967840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:08.007995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936a53b-1958-41a9-aa1c-3e996a523d99 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.031797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:08.064540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebaf2a-e3ff-49dc-a73b-faff2ff84a87 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.066949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.068058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.068572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.069052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.070410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] RBAC: Adding query filter params (interface=admin, service_id=979d8d1dadf748019862c2d8355c631d, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:08.070963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.073261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:08.090069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 494/979] 10.222.0.78 () {56 vars in 1249 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/endpoints?service_id=979d8d1dadf748019862c2d8355c631d&interface=admin®ion_id=RegionOne => generated 193 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:08.091888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:08.125817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.126479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.126882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.127287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.137643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.139878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:06:08.156402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:08.158892 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:08.160673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 486/980] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:06:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:08.164339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:08.278825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95ae3-79c9-4b67-ad8d-a60c37386acd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.326440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb8f7d-4c98-4104-8966-9ef39a796749 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.326720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.327575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.328067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.328639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.329755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.332235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:08.343539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 495/981] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:06:08 2022] GET /identity/v3/services => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:06:08.343829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:08.345787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:08.398009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.399265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.399869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.400456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.401990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:08.402945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.406201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:08.427049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:08.454532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 487/982] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 4 20:06:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:08.456857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:08.531564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a20b6e-d3f1-4107-9066-34f67ee6fd35 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.602448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.603563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.604045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.604559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.605757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.608916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:08.620112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c0914-63a9-4c59-ab6c-39550619f89f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:08.666681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:08.667335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:08.667612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:08.667879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:08.702098 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 496/983] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:06:08 2022] POST /identity/v3/services => generated 242 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:06:08.725977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:08.800246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:08.802675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:09.007967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 488/984] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:06:09.018078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:09.215460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:09.236655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b0ec-1b7d-4e24-ab98-3189d1c78053 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:09.372855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:09.374393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:09.375191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:09.375902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:09.395891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:09.399207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:09.429386 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:09.430525 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:09.432837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:09.432837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:09.432837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:09.433530 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 497/985] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:09.443082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:09.573406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:09.646521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb737b8-9c03-4f40-9796-9a0395d6992f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:09.715870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:09.716932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:09.717434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:09.717932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:09.719210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:09.719641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:09.721180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:09.736828 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 489/986] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:09.743919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:09.945942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7fdd8-c3c6-41e7-a13e-b2a3a283f79a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:09.999658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:10.000861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:10.001373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:10.001855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:10.015411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:10.018191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:10.038615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:10.047578 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:10.049234 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 498/987] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:10.050112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:10.218236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8acf1-172f-453b-bc92-37721f8e63a1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:10.260077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:10.285026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:10.286134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:10.286729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:10.287286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:10.288676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:10.289220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:10.292315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aa60-c136-4ac7-8c6b-954a3a990055 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:10.327223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 490/988] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:10.333955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:10.349888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:10.520523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cae7e-b3d8-41ad-bc0b-ba93ae41d327 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:10.563003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:10.563753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:10.564019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:10.564397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:10.565788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] RBAC: Adding query filter params (role.id=8900019413f7421f86282a8b0d82e700, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=92b7edc1a506407db3cd691bfabf169c) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:10.566348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:10.569319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aed6c6-82a9-450d-80c3-60d99119984e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:10.581213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 499/989] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:10 2022] GET /identity/v3/role_assignments?user.id=92b7edc1a506407db3cd691bfabf169c&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=8900019413f7421f86282a8b0d82e700 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:11.227420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2def-ec15-49ce-82a0-996d6abee793 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:11.228013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2def-ec15-49ce-82a0-996d6abee793 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:11.228412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2def-ec15-49ce-82a0-996d6abee793 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:11.230843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 491/990] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:11.239818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f700be-9d3d-4364-be0e-7b9fc5545b1d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:11.240428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f700be-9d3d-4364-be0e-7b9fc5545b1d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:11.240733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f700be-9d3d-4364-be0e-7b9fc5545b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:11.266339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-01f700be-9d3d-4364-be0e-7b9fc5545b1d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:11.267605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-01f700be-9d3d-4364-be0e-7b9fc5545b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:11.395183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 500/991] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:11.725782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2def-ec15-49ce-82a0-996d6abee793 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:11.734103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfb99-4567-4aec-8b4f-44df835093f0 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:11.734378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfb99-4567-4aec-8b4f-44df835093f0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:11.734722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bfb99-4567-4aec-8b4f-44df835093f0 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:11.736596 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 501/992] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:11.742937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:11.743267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:11.743546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:11.751349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:11.768971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:11.770262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:11.873266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 502/993] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:11.916015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2def-ec15-49ce-82a0-996d6abee793 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:11.986409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833fea0-e655-4714-8919-089e948092bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:11.987856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fea0-e655-4714-8919-089e948092bb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:11.988579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fea0-e655-4714-8919-089e948092bb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:11.989270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fea0-e655-4714-8919-089e948092bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:11.990505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833fea0-e655-4714-8919-089e948092bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:11.993497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833fea0-e655-4714-8919-089e948092bb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4833fea0-e655-4714-8919-089e948092bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:12.010780 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:12.013373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 20:06:12.015123 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.019320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 492/994] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 4 20:06:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:12.029025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.217966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53932c-401b-4bd4-8239-34a5372b6244 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.248494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833fea0-e655-4714-8919-089e948092bb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.278499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:12.286672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.287685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.288152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.288670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.289708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:12.290288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.292716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.301889 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 503/995] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:12.313719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.346811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:12.445143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833fea0-e655-4714-8919-089e948092bb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.473811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917025c-1338-46fc-8cc9-32184e7af62e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.509634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.510534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.510985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.511380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.512149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.515287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:12.530808 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:12.532857 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:12.534590 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 493/996] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:12.543196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.543463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.543463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.544032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.544381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.545409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:12.545880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.549307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.565979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 504/997] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 4 20:06:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:12.570142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.681995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:12.736002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a4f7-afd1-40e8-a367-1954f63168af None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.743358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823f98e-d739-4d98-a33a-9c92d1d09a67 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.764126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:12.793059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.793919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.794282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.794625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.795395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:12.795763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.796149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.797359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.797640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.798313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.798987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.800524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.803181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:12.810685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 494/998] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:12.811882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:12.916149 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 505/999] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:06:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:06:12.937264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0060470-ee0b-4523-a842-5851a5eab890 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:12.992370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:12.993230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:12.993656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:12.994060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:12.994898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:12.995386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:12.997032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:13.008808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 495/1000] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:13.010061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:13.213186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6756c8-04b6-4994-abc5-e803c2693d31 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:13.248345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:13.269528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:13.270312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:13.270719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:13.271121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:13.272049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] RBAC: Adding query filter params (interface=public, service_id=4125f076cff94f0993bcbe4620d25802, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:13.272484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:13.274034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96385521-d0da-4548-8490-1ac2e52a81bf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:13.280561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 506/1001] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:06:13 2022] GET /identity/v3/endpoints?service_id=4125f076cff94f0993bcbe4620d25802&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:13.287285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:13.338350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:13.414391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d876af-96a3-4202-9ae3-3299a71f7467 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:13.454592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:13.455459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:13.455923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:13.456380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:13.457150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:13.458739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5b691-8261-43c9-8e70-246712bd5371 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:13.466668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 496/1002] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:06:13 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:06:14.131493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62659-bb57-45ff-bb35-aad6422820d3 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:14.132002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62659-bb57-45ff-bb35-aad6422820d3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:14.132506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62659-bb57-45ff-bb35-aad6422820d3 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:14.135572 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 507/1003] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:14.145030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:14.145545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:14.146099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:14.180307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:14.182546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:14.347387 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 497/1004] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:14 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:14.865629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62659-bb57-45ff-bb35-aad6422820d3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:15.074023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62659-bb57-45ff-bb35-aad6422820d3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:15.146375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:15.147434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:15.147869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:15.148298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] PATH_INFO: `/v3/services/image` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:15.149286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:15.151708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:15.168068 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:15.170794 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:15.172654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 508/1005] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 4 20:06:14 2022] GET /identity/v3/services/image => generated 86 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:15.181236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:15.245306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:15.386295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788747d-c4dc-422d-ba04-7d869b122c49 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:15.454082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:15.455000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:15.455511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:15.456005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:15.457181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] RBAC: Adding query filter params (name=image) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:15.457731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:15.460386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0673b-2d61-4146-9933-c12b1fa52ef1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:15.477775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 498/1006] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:15.479971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:15.583532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:15.692094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16987-1c72-4e5c-8c52-9ab8e4c90364 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:15.760995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:15.762020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:15.763092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:15.763626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:15.764810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] RBAC: Adding query filter params (type=image) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:15.765368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:15.768056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05d08c-6e21-43ac-9ba0-89cfc649a070 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:15.783194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 509/1007] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:16.595356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e59-7da9-4c2b-a7c9-04607f3e9523 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:16.595356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e59-7da9-4c2b-a7c9-04607f3e9523 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:16.595356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6e59-7da9-4c2b-a7c9-04607f3e9523 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:16.596785 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 499/1008] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:16.606983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5baf-e65e-463b-83ca-a4c219868de4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:16.607865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5baf-e65e-463b-83ca-a4c219868de4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:16.608008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5baf-e65e-463b-83ca-a4c219868de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:16.642127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7b5d5baf-e65e-463b-83ca-a4c219868de4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:16.644367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b5d5baf-e65e-463b-83ca-a4c219868de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:16.779204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 510/1009] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:16 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:17.012371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48a8a-2b04-4363-bb0f-085af7404130 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:17.013436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48a8a-2b04-4363-bb0f-085af7404130 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:17.013885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c48a8a-2b04-4363-bb0f-085af7404130 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:17.016464 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 500/1010] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:17.025949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:17.026533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:17.027095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:17.058790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:17.061224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:17.123624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:17.172245 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 511/1011] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:17.224113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48a8a-2b04-4363-bb0f-085af7404130 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:17.389923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:17.403922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c48a8a-2b04-4363-bb0f-085af7404130 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:17.478318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:17.479485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:17.479983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:17.480447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:17.482803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:17.485722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:17.489230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 501/1012] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:17.498891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:17.610445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:17.693387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e32f-34c7-45f8-8f84-4e3ebc1d3b99 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:17.765963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:17.766913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:17.767388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:17.767813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:17.769196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:17.771839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:17.799921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684709-536d-4cdf-ae81-b84bc74fe848 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:17.872766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:17.873788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:17.874243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:17.874703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:17.875776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:17.878321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:17.895551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:17.897591 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:17.904666 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 502/1013] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:17.908394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:17.956190 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 512/1014] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:06:17 2022] POST /identity/v3/projects => generated 311 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:06:17.971917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:18.126956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e288df4-1aa6-4e28-8635-f841518ef4cb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:18.205412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:18.207169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:18.208033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:18.208804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:18.210431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:18.211491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:18.214689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:18.232074 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 503/1015] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:18.241038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:18.305729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:18.481172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25469f88-2011-4e7b-96f0-6d89c2f2f012 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:18.554267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:18.555518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:18.556104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:18.556716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:18.558054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:18.558669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:18.562066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ad19-bcbf-4cc9-99d5-846d6e6105c5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:18.579340 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 513/1016] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 4 20:06:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:18.585205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:18.802503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:18.821857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7bf7-09cb-4f78-b8fd-672fc6a9cd0b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:18.895379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:18.896468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:18.896963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:18.897449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:18.898766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:18.901561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425b43-11af-44a7-aaec-98be5a608927 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:19.003606 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 504/1017] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:06:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:06:19.134511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8154d9-448d-446b-9259-d57958b59b58 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:19.135427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8154d9-448d-446b-9259-d57958b59b58 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:19.135427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8154d9-448d-446b-9259-d57958b59b58 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:19.137998 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 514/1018] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:19.146944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce988d-f9b2-4724-ac66-054e88fb9be4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:19.147477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce988d-f9b2-4724-ac66-054e88fb9be4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:19.148163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce988d-f9b2-4724-ac66-054e88fb9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:19.184839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a0ce988d-f9b2-4724-ac66-054e88fb9be4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:19.187266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a0ce988d-f9b2-4724-ac66-054e88fb9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:19.343927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 505/1019] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:19.691878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8154d9-448d-446b-9259-d57958b59b58 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:19.855165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:19.879809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8154d9-448d-446b-9259-d57958b59b58 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:19.946422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:19.947377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:19.947847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:19.948320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:19.950386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:19.952782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d55aa-b3ad-4a70-b5b1-cccb7cdaf3b0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:20.095990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 515/1020] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:06:19 2022] POST /identity/v3/services => generated 242 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:06:21.704509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a17c-bab8-4200-afc2-90a1b3906f87 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:21.705279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a17c-bab8-4200-afc2-90a1b3906f87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:21.705652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a17c-bab8-4200-afc2-90a1b3906f87 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:21.708390 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 506/1021] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:21.717856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e64f-ccbd-4633-a0b3-2a5bbf38baf2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:21.718701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e64f-ccbd-4633-a0b3-2a5bbf38baf2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:21.718852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e64f-ccbd-4633-a0b3-2a5bbf38baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:21.745670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b0f6e64f-ccbd-4633-a0b3-2a5bbf38baf2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:21.747324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b0f6e64f-ccbd-4633-a0b3-2a5bbf38baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:21.882368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 516/1022] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:22.347589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a17c-bab8-4200-afc2-90a1b3906f87 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:22.407693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eac5da-db2a-4a00-a4a5-66db2cbf9138 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:22.408194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eac5da-db2a-4a00-a4a5-66db2cbf9138 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:22.408687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eac5da-db2a-4a00-a4a5-66db2cbf9138 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:22.411515 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 517/1023] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:22.422578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:22.423045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:22.423588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:22.466370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:22.468087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:22.525650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:22.585038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a17c-bab8-4200-afc2-90a1b3906f87 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:22.607771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 518/1024] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:22.657530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:22.658585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:22.659076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:22.659600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:22.661816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:22.664734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:22.671194 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 507/1025] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:22.680057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:22.688670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:22.899535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf125d9-0216-4b7b-9e85-51ffa1238191 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:22.972140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198e466-bea5-4981-925c-a433927a482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:22.973058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e466-bea5-4981-925c-a433927a482b None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:22.973498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e466-bea5-4981-925c-a433927a482b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:22.973874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198e466-bea5-4981-925c-a433927a482b None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:22.975074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198e466-bea5-4981-925c-a433927a482b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:22.977460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198e466-bea5-4981-925c-a433927a482b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:23.108713 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 519/1026] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:06:22 2022] POST /identity/v3/users => generated 285 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:06:23.124586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:23.354698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d198-ea27-4e49-bbf4-edc45058fe7c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:23.424854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:23.425742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:23.426130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:23.426465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:23.448088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-91825716-6e24-4833-a71e-b38cb7d23d92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:23.457929 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:23.459963 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:23.461773 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 508/1027] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:06:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:23.470846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198e466-bea5-4981-925c-a433927a482b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:23.601303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:23.628467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d3cf-9b29-4ca4-9380-b343d2257958 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:23.628900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d3cf-9b29-4ca4-9380-b343d2257958 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:23.629376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d3cf-9b29-4ca4-9380-b343d2257958 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:23.632725 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 509/1028] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:23.641633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:23.642094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:23.642574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:23.652159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:23.667818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:23.669441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:23.690055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198e466-bea5-4981-925c-a433927a482b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:23.743612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:23.744396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:23.744834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:23.745143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:23.746823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:23.747217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:23.748887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:23.764525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 520/1029] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:06:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:23.772604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:23.808500 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 510/1030] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:23.945393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402893d-7d3f-4677-b90f-1dab1b6d2697 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:23.981233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:24.002661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.003848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.004167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.004423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.024823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:24.029521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:24.056741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:24.058651 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:24.068596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:24.068596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:24.068596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:24.068596 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 521/1031] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:24.071659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.228656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.290548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3a8f-24c6-40de-acbb-e63664458741 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.359544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:24.369655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.373755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.373755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.373755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.373755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:24.373755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:24.375779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:24.407571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 511/1032] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:24.409304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.430277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc0f2-fa1b-437f-b3f6-255c2ae5f25f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.494490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.495424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.496984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.496984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] PATH_INFO: `/v3/services/image` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.497942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:24.500053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:24.516596 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:24.518779 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:24.521444 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 522/1033] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/services/image => generated 86 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:24.526446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.601894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:24.617037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6d183-6e89-4ae6-9b54-364a76b6f20e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.688909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.689971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.690466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.690968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.704828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61008bf6-634c-49f0-bcb8-d46cdd34faeb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.707080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:24.710297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:06:24.732251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:24.734011 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:24.735859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 512/1034] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:24.742206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.781828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.782840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.783121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.783485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.784658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] RBAC: Adding query filter params (name=image) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:24.785047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:24.787113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:24.801188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 523/1035] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:24.802144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:24.839185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:24.918871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aef5e-61cf-4fcf-8c4e-f9a8f21d1c4c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.981232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e3688-d1c7-4016-9aff-b555c0f78fba None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:24.984835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:24.994069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:24.995107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:24.995642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:24.996220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:24.998521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:24.999168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.003027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.042033 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 513/1036] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:25.052894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:25.055450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:25.056245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:25.056662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:25.057090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:25.058101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:25.058661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.060915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.067729 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 524/1037] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:25.079870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:25.244240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720dba-ba0a-4725-91f6-7c960cc3f3cb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:25.254932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6396e-dcde-456d-a055-9be60aa4c8b3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:25.265189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:25.303196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:25.304469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:25.304469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:25.304469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:25.309610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:25.309610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:25.309925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:25.310340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:25.311936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] RBAC: Adding query filter params (interface=public, service_id=0951d6d345e4405ca06f2052599d1a80, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:25.312342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.315039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.330184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 525/1038] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:06:25 2022] GET /identity/v3/endpoints?service_id=0951d6d345e4405ca06f2052599d1a80&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:25.331741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:25.384281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:25.396124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.397642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.495825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ea8a-9eb7-4b4e-b21d-6e9f67daf702 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:25.552291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:25.552925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:25.553286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:25.553461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:25.554285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.555924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.564766 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 526/1039] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:06:25 2022] GET /identity/v3/services => generated 1957 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:06:25.584858 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 514/1040] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:06:25.594503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:25.787019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:25.800575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc745b-b991-42ba-ae7c-d284a0df638e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:25.868717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:25.869814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:25.870302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:25.870787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:25.890503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:25.893316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:25.927592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:25.929402 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:25.931092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:25.931092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:25.931092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:25.931092 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 527/1041] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:25.941230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:25.963439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:26.121354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6d6b-b11a-46d6-9d22-95ae84a8f3b3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:26.185873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:26.186914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.187439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.187823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.188750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:26.189300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:26.191734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc233c3e-1341-422d-b92f-aeab5b62285b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:26.212103 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 515/1042] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:26.219476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:26.414636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27881-f774-4d45-8a3d-b8cb08d3031f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:26.461580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2c38-badd-4ee8-bf83-683a4fa64c07 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.462412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2c38-badd-4ee8-bf83-683a4fa64c07 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.462550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2c38-badd-4ee8-bf83-683a4fa64c07 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.465886 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 516/1043] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:26.466891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:26.467590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.467978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.468153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.475584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.476092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.476620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.478308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:26.480919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:26.499387 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:26.507308 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:26.508317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 528/1044] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:26.508836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:26.508836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:26.509328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:26.525355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:26.620165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:26.626438 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 517/1045] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:26.688399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb35-0b81-4704-adb7-33720b228624 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:26.738299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:26.738926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.739290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.739567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.740208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:26.740501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:26.742261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:26.765199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 529/1046] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:26.767486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:26.893247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232a2b4-1707-49c0-a90a-bf768ba8a953 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:26.949145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:26.950382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:26.950794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:26.951236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:26.952123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] RBAC: Adding query filter params (role.id=8900019413f7421f86282a8b0d82e700, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:26.952620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:26.954227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:26.967245 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 518/1047] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:26 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=8900019413f7421f86282a8b0d82e700 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:27.008996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:27.093002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:27.156581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054ab0-d54d-4d54-9bd2-217fa71cd20d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:27.227970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:27.229007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:27.229173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:27.229475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:27.250763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:27.261676 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:27.263901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:27.265862 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 530/1048] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:27.274500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:27.363020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:27.418189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f5fc-9a18-445b-9100-785018d71148 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:27.482493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:27.483529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:27.483529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:27.483805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:27.484628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:27.485049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:27.486991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:27.499607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 519/1049] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:27.509503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:27.721514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f6cc-3f2d-45a5-93d1-db8a2ce84173 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:27.768239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:27.779721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:27.780522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:27.786730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:27.786730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] PATH_INFO: `/v3/users/ccd9404813a949608a82c1e6beedf6e3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:27.798427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] RBAC: Authorizing `identity:get_user(user_id=ccd9404813a949608a82c1e6beedf6e3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:27.800204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:27.807322 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 531/1050] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:27 2022] GET /identity/v3/users/ccd9404813a949608a82c1e6beedf6e3 => generated 285 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:27.809249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:27.936011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd613f-95d7-43cf-9fe0-f6fe5735b131 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:27.976296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:27.988314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:27.988998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:27.989278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:27.989532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:28.100854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:28.103613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:28.303603 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 520/1051] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:06:28.305439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:28.472586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65f1e4-f4d8-4081-aade-199ebbaca0df None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:28.529233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:28.530164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:28.530444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:28.530738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:28.532003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:28.533485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacc53-35ad-42dc-bdda-30c42b700de4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:28.539207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 532/1052] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:28 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:28.544413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:28.601223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:28.739094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6caa6-4345-4ab8-be7e-e2f8f08f184d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:28.798464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:28.799458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:28.799965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:28.800462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:28.801597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=08577537fd444ef4945df52a6038e314, user.id=ccd9404813a949608a82c1e6beedf6e3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:28.802149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:28.804957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84333a-23ae-4bec-970c-a3e6141d5118 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:28.820085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 521/1053] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:28 2022] GET /identity/v3/role_assignments?user.id=ccd9404813a949608a82c1e6beedf6e3&scope.project.id=08577537fd444ef4945df52a6038e314&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:29.036868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5f03-e5fb-4b8f-b7e8-472ef8ea6c3c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:29.037243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5f03-e5fb-4b8f-b7e8-472ef8ea6c3c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:29.037520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5f03-e5fb-4b8f-b7e8-472ef8ea6c3c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:29.039641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 533/1054] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:29.048907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:29.049412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:29.049821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:29.077502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:29.079557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:29.231187 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 522/1055] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:29.727702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b5f03-e5fb-4b8f-b7e8-472ef8ea6c3c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:29.840053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:29.936375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b5f03-e5fb-4b8f-b7e8-472ef8ea6c3c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:29.988446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:29.989539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:29.990149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:29.990735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] PATH_INFO: `/v3/services/image` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:29.992228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:29.994500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c1d43364-a802-4612-932b-1ce404d1d4ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:30.005536 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:30.007543 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 20:06:30.009316 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:30.015543 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 534/1056] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 4 20:06:29 2022] GET /identity/v3/services/image => generated 86 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:30.016940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:30.047660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:30.155550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0855-4799-4cf9-9e01-eab80f26022a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:30.193981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de748d-51ed-42af-aeda-955bd08635b1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:30.194366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de748d-51ed-42af-aeda-955bd08635b1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:30.194700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de748d-51ed-42af-aeda-955bd08635b1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:30.197030 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 535/1057] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:30.205152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:30.205566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:30.205984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:30.214532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:30.215710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:30.216294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:30.216891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:30.217802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] RBAC: Adding query filter params (name=image) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:30.218321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:30.220798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:30.227960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 523/1058] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:30.235327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:30.237868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:30.239810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:30.364670 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 536/1059] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:30.383112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:30.411424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00b55-68ba-4302-8300-df64bf54bff4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:30.473090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:30.473835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:30.474250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:30.474659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:30.475542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] RBAC: Adding query filter params (type=image) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:30.475979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:30.477563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:30.484996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 524/1060] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:30.494319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:30.591084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:30.704224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260e0d-fa93-4d5f-9420-ee80383afde4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:30.759834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:30.774073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:30.775951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:30.776380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:30.776798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:30.778180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:30.780238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:30.923175 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 537/1061] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:06:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:06:30.936544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ce885-c5f2-44e1-ae31-1bba033dcbdb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:31.017522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:31.018524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:31.018934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:31.019402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:31.033724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:31.039189 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:31.041068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:31.044741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 525/1062] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:06:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:31.050827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:31.255830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc8ee-f19b-4f9d-a63c-2e542d4b9e42 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:31.258991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:31.328883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:31.329918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:31.330431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:31.330908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:31.332207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:31.332716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:31.335312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:31.352955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 538/1063] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:06:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:31.362844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:31.370529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:31.569447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4263e-efeb-4e14-9015-9d876ae2fed3 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:31.637053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:31.637991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:31.638461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:31.638942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:31.661043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:31.663804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:31.694650 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:31.696644 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:31.704815 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:31.704815 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:31.704815 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:31.704815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 526/1064] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:31.710588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:31.921628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14d3a5-300e-4c11-9037-35f2b810af7b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:31.968043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:31.969005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:31.969421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:31.969846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:31.970653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:31.971103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:31.972707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:31.988855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 539/1065] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:31.994684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:32.063908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:32.120022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfadf-a064-473b-898c-f796107951c1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:32.165019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:32.165875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.166301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.166711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.177318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:32.179001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e510e279-3b1c-4d31-863b-8a394bd6a089 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:06:32.192621 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:32.194516 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:32.201156 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 527/1066] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:06:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:32.203879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:32.235779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:32.327247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08749-6474-44fa-8a0d-916d2590fae6 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.327702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08749-6474-44fa-8a0d-916d2590fae6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.328141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08749-6474-44fa-8a0d-916d2590fae6 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.329771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 528/1067] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:32.335606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce939eaf-876d-4952-bafe-86fc4c5c2e60 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:32.336396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.336700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.336993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.368633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:32.371402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:32.385161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:32.385849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.386132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.386976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.387878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:32.388223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:32.390008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:32.413876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 540/1068] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:06:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:32.421081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:32.515325 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 529/1069] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:32.554309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:32.588051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06abf-7454-45ac-b95d-80f335786dc8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:32.644977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:32.646086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.646566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.647026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.668031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:32.670670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:32.703213 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:32.711964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:32.713810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:32.713810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:32.713810 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:32.713810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 541/1070] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:32.719280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:32.817312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:32.900362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107de6-befe-4da2-b0d9-c03adb109e18 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:32.944687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:32.945341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:32.945623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:32.945894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:32.946653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:32.946959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:32.949241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:32.972263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 530/1071] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:32.981413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.038500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.122812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6305-3035-4660-a4ad-6103c1d855c5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.190408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.191584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.192074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.192576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.196286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:33.206598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:33.209419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6219313-cb53-4568-94ad-47c5c2b47309 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.209971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:33.219364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:33.234178 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:33.236582 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:33.238082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:33.243391 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 542/1072] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:33.247652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.259341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.260182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.260600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.261060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.276519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:33.282517 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:33.284464 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:33.286106 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 531/1073] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:33.294004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.459782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7fc63-c6bb-4068-8fb6-465e243d0fd8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.485016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34791d3-fb3b-4972-bd24-c16948971de9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.525331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.526377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.526910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.527442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.528779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:33.529331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:33.532166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:33.553097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.554205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.554701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.555259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.556464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:33.556982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:33.566545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 543/1074] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:33.566801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:33.567825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.584094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 532/1075] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:33.593766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.657519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:33.684530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:33.773264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26924e-e147-47b0-b87c-02a691c2e9b2 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.807791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bd9e-704f-4311-8246-789ee2d83fae None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:33.840278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.841455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.841935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.842410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/8900019413f7421f86282a8b0d82e700` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.846209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=a0e5fa628b98463594d6066befb76468, role_id=8900019413f7421f86282a8b0d82e700)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:33.848862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29039da-b509-4b6e-be34-dca5b1323b8e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:33.878709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:33.880004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:33.880508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:33.880996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] PATH_INFO: `/v3/users/ccd9404813a949608a82c1e6beedf6e3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:33.883284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd9404813a949608a82c1e6beedf6e3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:33.886025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:33.889925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 533/1076] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:33 2022] GET /identity/v3/users/ccd9404813a949608a82c1e6beedf6e3 => generated 285 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:33.899525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:33.930716 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 544/1077] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:06:33 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/a0e5fa628b98463594d6066befb76468/roles/8900019413f7421f86282a8b0d82e700 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:06:34.108717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:34.121060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b231605-6923-4062-ae17-fb2ba2694cf6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:34.143368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c18d-b55c-4edc-b811-d3b0fdfb4491 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:34.144186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c18d-b55c-4edc-b811-d3b0fdfb4491 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:34.144372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c18d-b55c-4edc-b811-d3b0fdfb4491 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:34.146859 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 545/1078] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:34.156785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:34.157273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:34.157756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:34.189688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:34.192301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:34.197075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:34.198313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:34.199375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:34.199865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:34.202084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:34.204529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:34.209070 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 534/1079] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:33 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:34.220386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:34.343064 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 546/1080] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:34.427272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16daeb-37a4-4575-8b93-eafd9df757a9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:34.495939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:34.497206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:34.497742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:34.498322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314/users/ccd9404813a949608a82c1e6beedf6e3/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:34.502168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] RBAC: Authorizing `identity:create_grant(project_id=08577537fd444ef4945df52a6038e314, user_id=ccd9404813a949608a82c1e6beedf6e3, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:34.505237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:34.614073 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 535/1081] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:06:34 2022] PUT /identity/v3/projects/08577537fd444ef4945df52a6038e314/users/ccd9404813a949608a82c1e6beedf6e3/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:06:34.785903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:34.869235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:34.949871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b39ad-0cc1-4a82-999e-4cdee239856d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:34.999619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:35.000627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:35.001120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:35.001608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:35.134261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:35.138378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:35.226903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:35.342525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 547/1082] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:06:35.354297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:35.406775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:35.512519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044e419-2b3c-46a1-be73-80b0b99045bb None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:35.571091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:35.572166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:35.572629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:35.573116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:35.587288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:35.589717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0fffb493-50e2-44e5-887e-2a8b027cc5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:35.621306 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:35.629300 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:35.630416 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:35.630416 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:35.630416 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:35.630416 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 536/1083] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:35.630759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:35.828786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604395ec-c2b3-43d4-aeb1-7cad8e809ca1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:35.894727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:35.895948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:35.896441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:35.896935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:35.898193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:35.898716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:35.901256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb524-4bb8-4459-8440-fd5e88574c78 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:35.925259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 548/1084] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:36.857366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8e5e-baf0-4c46-ad55-45294c027da4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:36.857939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8e5e-baf0-4c46-ad55-45294c027da4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:36.858331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8e5e-baf0-4c46-ad55-45294c027da4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:36.860250 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 537/1085] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:36.867568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95196b-0d1b-4554-8524-05aa6002ea5d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:36.868362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95196b-0d1b-4554-8524-05aa6002ea5d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:36.868550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95196b-0d1b-4554-8524-05aa6002ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:36.881288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:36.901200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cc95196b-0d1b-4554-8524-05aa6002ea5d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:36.903270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cc95196b-0d1b-4554-8524-05aa6002ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:37.031409 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 549/1086] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:37.313267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8e5e-baf0-4c46-ad55-45294c027da4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:37.412613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:37.441823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8e5e-baf0-4c46-ad55-45294c027da4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:37.447870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81063-ca44-4738-880d-22a5062c08e4 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:37.447870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81063-ca44-4738-880d-22a5062c08e4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:37.448571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81063-ca44-4738-880d-22a5062c08e4 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:37.450903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 550/1087] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:37.459861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:37.460150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:37.460432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:37.492169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:37.494178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:37.497022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:37.498108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:37.498750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:37.500052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:37.516981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:37.523058 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:37.524829 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:37.526378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 538/1088] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 4 20:06:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:37.535158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:37.597553 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 551/1089] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:37.719042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086b9ed-09df-4097-b895-a1f590b0dd20 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:37.770093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:37.770824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:37.771204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:37.771551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:37.772322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:37.772693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:37.774169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:37.777746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:37.785756 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 539/1090] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:06:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:37.793737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:37.883713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:37.924583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:37.944362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e23d4c-4751-4f04-a3fc-19e0a5458dca None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:37.995939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:37.997054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:37.997549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:37.998032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.017098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.019777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:38.046504 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:38.048621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:38.050638 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:38.050638 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:38.050638 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:38.050638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 552/1091] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:38.058081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.095291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb6ab-4743-4f1a-a785-28e25ede343c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.165871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.166666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.167195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.168070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.181329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:06:38.186612 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:38.188770 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:06:38.191323 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:06:38.193582 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 540/1092] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:38.194648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.223539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7504a-bee2-447e-89b8-1b7e0441d326 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.244915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:38.267837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.268484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.268829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.269126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.269889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:38.270286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.272104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.283903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:38.289885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 553/1093] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:38.297020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.338521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239732-6c5f-4e83-9bf2-6de99bfc2217 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.382012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.382629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.382911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.383203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.383891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:38.384194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.385650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.396807 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 541/1094] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:38.404364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.476302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0c7d-558d-4fef-a5d3-4fb3f25f3d1e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.543812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.544900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.545402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.545884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.560401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.563252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:06:38.587916 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:38.589789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:38.591047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 554/1095] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:06:38.592535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2bb1-b73d-4f86-8a12-2d05b060675c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.600182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.623763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:38.650973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.652701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.653266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.653739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] PATH_INFO: `/v3/users/ccd9404813a949608a82c1e6beedf6e3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.655997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd9404813a949608a82c1e6beedf6e3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.659417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.668624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 542/1096] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/users/ccd9404813a949608a82c1e6beedf6e3 => generated 285 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:38.670600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:38.670826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.789996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a7ff-bb87-4287-a6db-de32ba701105 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.841265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.842012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.842300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.842732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:38.844052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:38.844476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:38.846216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:38.866730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c32e4-3192-41d8-b8f6-121e849c5a68 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:38.870831 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 555/1097] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:38.877958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:38.925544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:38.926407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:38.926568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:38.926759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.022664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:39.027318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:39.036742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d173e-6e0b-40ec-8a3a-6a4b0e8365c0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:39.041359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.041576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.089811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:39.090925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:39.091481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:39.091974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.206781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.208789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.212794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 543/1098] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:06:39.221649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:39.336667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:39.347992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:39.352644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a1d3b-2b87-47db-872f-345dca112b6d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:39.359734 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 556/1099] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:06:39.369631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:39.408517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:39.409374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:39.409831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:39.410278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.412248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.414441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.416372 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 544/1100] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:39 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:39.424180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:39.535209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5be9e-3119-4f36-9c4d-d9d974d62666 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:39.572182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a631f-046e-49b2-8f4d-5965b587f86a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:39.600227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:39.600789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:39.601070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:39.601343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.616374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.620732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.620920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:39.620920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:39.621090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:39.621265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.622028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=08577537fd444ef4945df52a6038e314, user.id=ccd9404813a949608a82c1e6beedf6e3) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:39.622334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.623834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.631811 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 545/1101] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:39 2022] GET /identity/v3/role_assignments?user.id=ccd9404813a949608a82c1e6beedf6e3&scope.project.id=08577537fd444ef4945df52a6038e314&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:06:39.654512 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:39.655879 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:06:39.656948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:06:39.656948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:06:39.656948 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:39.656948 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 557/1102] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:39.665619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:39.706581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:39.837213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8714b-99b7-41eb-87e6-f97c2e728cfc None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:39.911495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:39.911495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:39.911495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:39.911495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:39.912136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:39.912136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:39.913121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:39.929003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 546/1103] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:39.935895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:40.008037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:40.081525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c7775-b1f5-4a4f-ae74-4c61f6885d06 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:40.139656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:40.140410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:40.140868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:40.141297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:40.152336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:40.153903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:06:40.166837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:06:40.167937 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:06:40.168910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 558/1104] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:06:40.176080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:40.267732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:40.289464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6295da-bfb1-426a-82ae-d1d89bf9fc11 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:40.333236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:40.333935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:40.334309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:40.334651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:40.335474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:40.335841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:40.337376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee080b-f510-46ad-87e1-4f2d1e52a26c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:40.350440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 547/1105] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:40.356877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:40.475020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f71-ebcf-447a-b4d6-ec0450a505f0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:40.483605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:40.514725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:40.515374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:40.515739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:40.516398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:40.517426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] RBAC: Adding query filter params (role.id=8900019413f7421f86282a8b0d82e700, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=a0e5fa628b98463594d6066befb76468) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:40.517767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:40.519824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77e6d-3692-4c55-ac08-f6335747953f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:40.526707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 559/1106] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:40 2022] GET /identity/v3/role_assignments?user.id=a0e5fa628b98463594d6066befb76468&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=8900019413f7421f86282a8b0d82e700 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:42.145754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991910-8e59-496b-a4b0-3372cbe28d71 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:42.146323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991910-8e59-496b-a4b0-3372cbe28d71 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:42.146323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76991910-8e59-496b-a4b0-3372cbe28d71 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:42.147961 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 548/1107] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:42.154746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:42.155403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:42.155403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:42.174943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:42.176206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:42.249623 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 560/1108] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:42.531396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76991910-8e59-496b-a4b0-3372cbe28d71 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:42.658226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76991910-8e59-496b-a4b0-3372cbe28d71 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:42.717838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:42.718872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:42.719557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:42.720023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:42.721935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:42.724536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e166a-4d31-47f8-ac65-69c5fba75f81 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:42.727749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 549/1109] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:42.734175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:42.844826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:42.848012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f918e-1a38-4de8-87b0-c45c4f99cdbf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:42.887231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:42.887849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:42.888123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:42.888390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:42.889056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:42.890505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7d38-bccf-49b1-9e4b-054c34e8243b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:42.998550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 561/1110] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:06:42 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:06:45.309637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06332-5227-4814-b38e-6dd2aaac3c28 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:45.310666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06332-5227-4814-b38e-6dd2aaac3c28 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:45.310666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06332-5227-4814-b38e-6dd2aaac3c28 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:45.311830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 550/1111] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:45.319217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:45.319836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:45.320216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:45.356470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:45.358733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:45.465058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 562/1112] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:45.753167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a06332-5227-4814-b38e-6dd2aaac3c28 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:45.766097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:45.886784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a06332-5227-4814-b38e-6dd2aaac3c28 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:45.925483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:45.926120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:45.926401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:45.926673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] PATH_INFO: `/v3/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:45.928174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] RBAC: Authorizing `identity:get_role(role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:45.929633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:45.930890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 551/1113] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:45 2022] GET /identity/v3/roles/8a3388bd801d479ebdabb84cd8065882 => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:45.937404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:46.040220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:46.057271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f6775-a025-4b4b-b45d-3c64c325fd69 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:46.098681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:46.099359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:46.099639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:46.099904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] PATH_INFO: `/v3/users/457333ed96b44818a31f891e38b7fe4d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:46.114859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] RBAC: Authorizing `identity:get_user(user_id=457333ed96b44818a31f891e38b7fe4d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:46.116639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:46.118383 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 563/1114] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:45 2022] GET /identity/v3/users/457333ed96b44818a31f891e38b7fe4d => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:46.128184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:46.251903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:46.277725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc035-bbe9-4c0e-9461-c8a7585f7cb5 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:46.331111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:46.331904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:46.332209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:46.332512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:46.429065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:46.430546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:46.511700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:46.540794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 552/1115] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:06:46.547168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:46.654133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091d9a-54c9-4c42-b309-fee9d7069003 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:46.694487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:46.695126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:46.695424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:46.695736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:46.696807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:46.698285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4cc75-40c3-4c24-8cc7-f61480c7ff00 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:46.699985 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 564/1116] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:46 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:46.708232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:46.813087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e2295-b3d4-4555-b730-ab93c89edee4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:46.848164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:46.848779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:46.849058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:46.849331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:46.850072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=08577537fd444ef4945df52a6038e314, user.id=457333ed96b44818a31f891e38b7fe4d) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:46.850374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:46.851873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f1b37-b34a-409c-b8b4-31445e4eb3e0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:46.859343 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 553/1117] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:46 2022] GET /identity/v3/role_assignments?user.id=457333ed96b44818a31f891e38b7fe4d&scope.project.id=08577537fd444ef4945df52a6038e314&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:49.137356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c40-d5ff-44b8-af33-61181e13745a None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:49.138190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c40-d5ff-44b8-af33-61181e13745a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:49.138190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c40-d5ff-44b8-af33-61181e13745a None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:49.139327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 565/1118] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:49.145373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:49.145925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:49.145925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:49.166783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:49.168037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:49.227971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:49.264984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 554/1119] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:49.536568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326c40-d5ff-44b8-af33-61181e13745a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:49.561112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:49.671907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326c40-d5ff-44b8-af33-61181e13745a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:49.715425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:49.716086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:49.716364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:49.716642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] PATH_INFO: `/v3/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:49.718180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] RBAC: Authorizing `identity:get_role(role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:49.719653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:49.721083 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 566/1120] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:49 2022] GET /identity/v3/roles/8a3388bd801d479ebdabb84cd8065882 => generated 223 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:49.728322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:49.898133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca16f9-1bf9-4c8a-975a-755726cb890c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:49.937475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:49.938111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:49.938391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:49.938663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] PATH_INFO: `/v3/users/457333ed96b44818a31f891e38b7fe4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:49.939878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=457333ed96b44818a31f891e38b7fe4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:49.941334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:49.942968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 555/1121] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:49 2022] GET /identity/v3/users/457333ed96b44818a31f891e38b7fe4d => generated 286 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:49.950240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:50.048416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:50.070724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc7d4-a4df-4ce7-829e-dd25826486d0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:50.111662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:50.112432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:50.112821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:50.113181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:50.114510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:50.116275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abbe6-7692-480a-8159-32dd702a20eb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:50.117972 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 567/1122] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:49 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:50.124987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:50.169942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:50.240124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92b363-471a-4c7b-94ec-6e78a6cfcdb9 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:50.281338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:50.282064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:50.282386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:50.282706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314/users/457333ed96b44818a31f891e38b7fe4d/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:50.285104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] RBAC: Authorizing `identity:create_grant(project_id=08577537fd444ef4945df52a6038e314, user_id=457333ed96b44818a31f891e38b7fe4d, role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:50.286619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad619a-9722-43f6-b6ad-24eccbf8ca9d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:50.361216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 556/1123] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:06:50 2022] PUT /identity/v3/projects/08577537fd444ef4945df52a6038e314/users/457333ed96b44818a31f891e38b7fe4d/roles/8a3388bd801d479ebdabb84cd8065882 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:06:53.071716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6055-b2cb-42ad-bce6-21e2622e945a None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:53.073115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6055-b2cb-42ad-bce6-21e2622e945a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:53.073115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6055-b2cb-42ad-bce6-21e2622e945a None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:53.074342 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 568/1124] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:06:53.080641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:53.081204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:53.081204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:53.109681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:53.111841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:53.214654 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 557/1125] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:06:53.493985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6055-b2cb-42ad-bce6-21e2622e945a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:53.633223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6055-b2cb-42ad-bce6-21e2622e945a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:53.670734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41575630-c038-46d7-b246-03385e66895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:53.671398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41575630-c038-46d7-b246-03385e66895a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:53.671677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41575630-c038-46d7-b246-03385e66895a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:53.671946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41575630-c038-46d7-b246-03385e66895a None admin] PATH_INFO: `/v3/roles/8a3388bd801d479ebdabb84cd8065882` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:53.673397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41575630-c038-46d7-b246-03385e66895a None admin] RBAC: Authorizing `identity:get_role(role_id=8a3388bd801d479ebdabb84cd8065882)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:53.674826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41575630-c038-46d7-b246-03385e66895a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:53.676398 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 569/1126] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:53 2022] GET /identity/v3/roles/8a3388bd801d479ebdabb84cd8065882 => generated 223 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:53.682476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:53.714467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:53.795984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056071d-a9a8-4131-bc3d-84c0368f6f9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:53.833764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:53.834406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:53.834684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:53.834959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] PATH_INFO: `/v3/users/457333ed96b44818a31f891e38b7fe4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:53.836205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] RBAC: Authorizing `identity:get_user(user_id=457333ed96b44818a31f891e38b7fe4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:53.837660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:53.839343 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 558/1127] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:06:53 2022] GET /identity/v3/users/457333ed96b44818a31f891e38b7fe4d => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:53.846017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41575630-c038-46d7-b246-03385e66895a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:53.873584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:53.989256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41575630-c038-46d7-b246-03385e66895a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:54.059570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:54.060522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:54.061027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:54.061521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:54.163668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:54.165156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:54.185764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:54.282617 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 570/1128] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:06:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:06:54.289679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:54.459176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:54.470074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9884-8879-44e4-bc43-108648ee6506 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:54.532047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:54.533134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:54.533640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:54.534131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] PATH_INFO: `/v3/projects/08577537fd444ef4945df52a6038e314` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:54.536226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] RBAC: Authorizing `identity:get_project(project_id=08577537fd444ef4945df52a6038e314)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:54.538980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162f5d4-b4ca-4c0f-8ce6-4fb23f788979 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:54.542667 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 559/1129] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:06:54 2022] GET /identity/v3/projects/08577537fd444ef4945df52a6038e314 => generated 311 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:54.552573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:54.703674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997cf-fc5e-4287-99b8-afa978d67f83 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:54.725518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:54.757496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:54.758452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:54.758899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:54.759380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:54.760649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] RBAC: Adding query filter params (role.id=8a3388bd801d479ebdabb84cd8065882, scope.project.id=08577537fd444ef4945df52a6038e314, user.id=457333ed96b44818a31f891e38b7fe4d) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:06:54.761223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:54.764766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e775-bfa9-4cc6-800c-d1f3c69aa456 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:54.776093 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 571/1130] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:06:54 2022] GET /identity/v3/role_assignments?user.id=457333ed96b44818a31f891e38b7fe4d&scope.project.id=08577537fd444ef4945df52a6038e314&role.id=8a3388bd801d479ebdabb84cd8065882 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:06:57.312159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded382b-32cd-4512-b76f-6ac926438ba0 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:57.312997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded382b-32cd-4512-b76f-6ac926438ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:57.312997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded382b-32cd-4512-b76f-6ac926438ba0 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:57.314432 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 560/1131] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:06:57.322958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:57.323676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:57.323913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:57.351813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:06:57.353221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:06:57.434396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 572/1132] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:06:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:06:57.721119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded382b-32cd-4512-b76f-6ac926438ba0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:57.849742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded382b-32cd-4512-b76f-6ac926438ba0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:57.892140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:57.892800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:57.893073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:57.893384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:57.894597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:57.896199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929ee43-5aab-4610-9445-55779ebc8f56 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:57.897893 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 561/1133] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:06:57.904997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:06:58.072929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0a51c-e403-40e6-85ac-7219086c92d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:06:58.087187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:58.116608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:06:58.117323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:06:58.117640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:06:58.117953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:06:58.118666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:06:58.120195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de40b-0576-4a92-a830-5a1f8f64cff4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:06:58.205491 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 573/1134] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:06:57 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:07:00.816373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd324ee-744f-4484-972f-bbb47690dca4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:00.817175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd324ee-744f-4484-972f-bbb47690dca4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:00.817175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd324ee-744f-4484-972f-bbb47690dca4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:00.818240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 562/1135] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:07:00.826136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:00.826721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:00.827073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:00.858284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:00.860382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:00.976314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 574/1136] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:01.251580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd324ee-744f-4484-972f-bbb47690dca4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:01.310926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:01.424248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd324ee-744f-4484-972f-bbb47690dca4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:01.465158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:01.465876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:01.466198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:01.466512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:01.467827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:01.469429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2828108-90f7-48bc-81a5-b691534e225e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:01.471101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 563/1137] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:01.477310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:01.579961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:01.589436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f7162-76bc-40f2-a2e9-c960a1449da9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:01.631378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:01.632078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:01.632407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:01.632729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:01.633445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:01.635529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73725a-667f-44d0-a1a9-04ff36bc62e1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:01.717954 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 575/1138] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:07:01 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:07:04.058076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290294b-7efd-4940-bf5e-3e5c8faaa660 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:04.058684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290294b-7efd-4940-bf5e-3e5c8faaa660 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:04.058978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290294b-7efd-4940-bf5e-3e5c8faaa660 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:04.061559 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 564/1139] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:04.071193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:04.072485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:04.072685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:04.103624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:04.105756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:04.227918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 576/1140] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:04.513764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290294b-7efd-4940-bf5e-3e5c8faaa660 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:04.656616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:04.661077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290294b-7efd-4940-bf5e-3e5c8faaa660 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:04.702989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:04.704099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:04.704599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:04.705085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:04.724824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:04.735179 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:04.737719 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:04.738657 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 565/1141] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:07:04.747901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:04.837035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:04.862813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486385e-bbe1-4bf2-bb9f-4481d910e8ac None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:04.904828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:04.905543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:04.905862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:04.906175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:04.906946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:04.907349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:04.908839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:04.920127 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 577/1142] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:04.930217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:05.061136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c989c-8735-460c-bcbe-672e85e897da None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:05.101709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:05.102401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:05.102800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:05.103201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] PATH_INFO: `/v3/users/98038020564e402d906d6e2ebcdc3351` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:05.119720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] RBAC: Authorizing `identity:get_user(user_id=98038020564e402d906d6e2ebcdc3351)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:05.121392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:05.123401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 566/1143] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:04 2022] GET /identity/v3/users/98038020564e402d906d6e2ebcdc3351 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:05.133504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:05.317481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5094e2-8a09-4460-a53f-90861f05fd43 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:05.382318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:05.383318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:05.383815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:05.384836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:05.401836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:05.470648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:05.472343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:05.597581 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 578/1144] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:07:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:07:05.604701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:05.641895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:05.754509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081f59c-fe15-4d58-9b47-d201e650c212 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:05.796542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:05.797310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:05.797697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:05.798063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] PATH_INFO: `/v3/projects/d2a29764d427447aace57fc0c0a9e1f6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:05.799482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a29764d427447aace57fc0c0a9e1f6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:05.801134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447d969-abb3-4e06-9bbe-54660986f380 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:05.803032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 567/1145] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:05 2022] GET /identity/v3/projects/d2a29764d427447aace57fc0c0a9e1f6 => generated 311 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:05.813357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:05.897377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:06.015336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb49b8-3427-4810-a12b-abe5e29d1661 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:06.061781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:06.062497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:06.062823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:06.063192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:06.064130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=d2a29764d427447aace57fc0c0a9e1f6, user.id=98038020564e402d906d6e2ebcdc3351) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:06.064527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:06.066294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9af922-7714-48ad-83b2-38b3ee1d1767 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:06.073843 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 579/1146] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:07:05 2022] GET /identity/v3/role_assignments?user.id=98038020564e402d906d6e2ebcdc3351&scope.project.id=d2a29764d427447aace57fc0c0a9e1f6&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:08.457382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3438a-8e17-466e-96d8-a8ffda8602c1 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:08.458174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3438a-8e17-466e-96d8-a8ffda8602c1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:08.458174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3438a-8e17-466e-96d8-a8ffda8602c1 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:08.459396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 568/1147] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:08.467243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:08.468107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:08.468267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:08.493433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:08.494785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:08.606733 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 580/1148] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:09.087449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3438a-8e17-466e-96d8-a8ffda8602c1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:09.226404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:09.252375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3438a-8e17-466e-96d8-a8ffda8602c1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:09.311085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:09.312310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:09.313263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:09.313739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:09.331994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:09.340465 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:09.341721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:09.342774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 569/1149] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:07:09.350121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:09.389896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:09.499923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e389ad-8bd8-4a69-9992-27eb9aa7262c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:09.567055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:09.568141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:09.568628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:09.569118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:09.570372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:09.570910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:09.574273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:09.591039 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 581/1150] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:07:09.600596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:09.728344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093989f-0093-47f5-b493-bde0e1fea0af None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:09.787856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:09.788940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:09.789438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:09.789931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] PATH_INFO: `/v3/users/98038020564e402d906d6e2ebcdc3351` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:09.792257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] RBAC: Authorizing `identity:get_user(user_id=98038020564e402d906d6e2ebcdc3351)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:09.794924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:09.797808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 570/1151] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:09 2022] GET /identity/v3/users/98038020564e402d906d6e2ebcdc3351 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:09.808533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:09.942932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:09.950769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b151-c093-4d08-8ee9-ed23dbd94f68 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:09.996733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:09.997437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:09.997815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:09.998141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] PATH_INFO: `/v3/projects/d2a29764d427447aace57fc0c0a9e1f6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:09.999423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a29764d427447aace57fc0c0a9e1f6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:10.000934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d02fe-3ae8-4fae-b114-b24f85dda341 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:10.002698 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 582/1152] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:09 2022] GET /identity/v3/projects/d2a29764d427447aace57fc0c0a9e1f6 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:10.011817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:10.030141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:10.129870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62644-fac8-4d21-92b3-d9cc036c7201 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:10.167856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:10.168528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:10.168810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:10.169082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] PATH_INFO: `/v3/projects/d2a29764d427447aace57fc0c0a9e1f6/users/98038020564e402d906d6e2ebcdc3351/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:10.171062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a29764d427447aace57fc0c0a9e1f6, user_id=98038020564e402d906d6e2ebcdc3351, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:10.172547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7d06-8cbc-4fbc-a8c5-dd04386127ec None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:10.295352 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 571/1153] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:07:10 2022] PUT /identity/v3/projects/d2a29764d427447aace57fc0c0a9e1f6/users/98038020564e402d906d6e2ebcdc3351/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:07:12.699937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be20d-f2e5-418d-a4e5-68c9c080e4f2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:12.700749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be20d-f2e5-418d-a4e5-68c9c080e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:12.700749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3be20d-f2e5-418d-a4e5-68c9c080e4f2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:12.701949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 583/1154] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:07:12.707935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:12.708657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:12.708657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:12.729212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:12.730498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:12.846315 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 572/1155] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:07:13.379359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3be20d-f2e5-418d-a4e5-68c9c080e4f2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:13.501057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3be20d-f2e5-418d-a4e5-68c9c080e4f2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:13.542556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:13.543391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:13.543767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:13.544129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:13.556703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:13.561762 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:13.563873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:07:13.565495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 584/1156] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:07:13.574039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:13.577474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:13.697824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e90e08-a02c-40ca-a20e-7b7b2a0378ac None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:13.740297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:13.741498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:13.741991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:13.742441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:13.743643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:13.744186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:13.746780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:13.762513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 573/1157] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:13.768589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:13.800525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:13.928476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237d80-5250-4f06-af99-3175b3f93529 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:13.988380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:13.989334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:13.989766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:13.990203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] PATH_INFO: `/v3/users/98038020564e402d906d6e2ebcdc3351` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:13.992460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] RBAC: Authorizing `identity:get_user(user_id=98038020564e402d906d6e2ebcdc3351)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:13.995739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:13.998728 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 585/1158] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:13 2022] GET /identity/v3/users/98038020564e402d906d6e2ebcdc3351 => generated 286 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:07:14.005214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:14.079795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:14.119444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ad023-d86d-4b9c-8206-dd488a4cdf81 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:14.182128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:14.183199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:14.183686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:14.184172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:14.307715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:14.310418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:14.404687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:14.447893 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 574/1159] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:07:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:07:14.457861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:14.573893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:14.587383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3fe1-f5e1-4a12-90ab-bd29243e1a3f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:14.640800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:14.641907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:14.642389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:14.642863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] PATH_INFO: `/v3/projects/d2a29764d427447aace57fc0c0a9e1f6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:14.645222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a29764d427447aace57fc0c0a9e1f6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:14.648333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb55da-919f-4e89-b31b-c1bc7f5a0c12 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:14.652630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 586/1160] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:14 2022] GET /identity/v3/projects/d2a29764d427447aace57fc0c0a9e1f6 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:07:14.660636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:14.785337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42c17-de82-420b-a722-8d8e89e2fb20 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:14.822831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:14.823475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:14.823751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:14.824073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:14.824756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=d2a29764d427447aace57fc0c0a9e1f6, user.id=98038020564e402d906d6e2ebcdc3351) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:14.825060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:14.826503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fce20-68d4-40ab-812e-ea2a430e1818 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:14.833204 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 575/1161] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:07:14 2022] GET /identity/v3/role_assignments?user.id=98038020564e402d906d6e2ebcdc3351&scope.project.id=d2a29764d427447aace57fc0c0a9e1f6&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:17.653431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636e1e-e2f4-4d08-9e44-daec5926aa8b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:17.654290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636e1e-e2f4-4d08-9e44-daec5926aa8b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:17.654290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636e1e-e2f4-4d08-9e44-daec5926aa8b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:17.655627 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 587/1162] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:17.665487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:17.666080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:17.666443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:17.697079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:17.699182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:17.743964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:17.822829 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 576/1163] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:18.102196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636e1e-e2f4-4d08-9e44-daec5926aa8b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:18.229811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636e1e-e2f4-4d08-9e44-daec5926aa8b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:18.272938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:18.273587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:18.273939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:18.274698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:18.307177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:18.358181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:18.359673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:18.479417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 588/1164] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:07:18.486515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:18.649604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe18f-1dab-4f9e-ab67-dea9077371ec None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:18.691668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:18.692506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:18.692629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:18.692844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:18.701365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:18.703100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f3694d98-74d8-4b16-8628-97a27111c165 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:18.715822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:18.718288 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:18.720342 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 577/1165] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:07:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:07:18.723486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:18.796738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:18.847716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28554828-07e6-472f-b120-ce7b3dcb3534 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:18.914128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:18.915409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:18.915758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:18.916162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:18.917024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:18.917426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:18.919241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce333-f508-4a0d-9ddd-2344f3829932 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:18.928665 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 589/1166] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 4 20:07:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:21.277042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4a56-31c1-4d95-95a5-aab4f2f8717f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:21.277640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4a56-31c1-4d95-95a5-aab4f2f8717f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:21.277987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4a56-31c1-4d95-95a5-aab4f2f8717f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:21.280524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 578/1167] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:21.289142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77717-2172-4c1e-ad0e-8aedf72e5c21 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:21.290455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77717-2172-4c1e-ad0e-8aedf72e5c21 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:21.290612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77717-2172-4c1e-ad0e-8aedf72e5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:21.313093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d0e77717-2172-4c1e-ad0e-8aedf72e5c21 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:21.314549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0e77717-2172-4c1e-ad0e-8aedf72e5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:21.398266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 590/1168] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:21.724662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d4a56-31c1-4d95-95a5-aab4f2f8717f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:21.758087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:21.894039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d4a56-31c1-4d95-95a5-aab4f2f8717f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:21.962374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:21.963063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:21.963590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:21.964084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:21.965330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:21.968068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18047-681b-4edc-b255-7110cd14b158 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:22.081993 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 579/1169] 10.222.0.78 () {60 vars in 1138 bytes} [Tue Oct 4 20:07:21 2022] POST /identity/v3/domains => generated 267 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:07:24.440667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb62b-7fb6-4875-8f86-60dfd118d97b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:24.441358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb62b-7fb6-4875-8f86-60dfd118d97b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:24.441669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb62b-7fb6-4875-8f86-60dfd118d97b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:24.444250 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 591/1170] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:24.453873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:24.454448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:24.454855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:24.486546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:24.488607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:24.607746 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 580/1171] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:25.122742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbb62b-7fb6-4875-8f86-60dfd118d97b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:25.224036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:25.292356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbb62b-7fb6-4875-8f86-60dfd118d97b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:25.335450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:25.336654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:25.336929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:25.337203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] PATH_INFO: `/v3/domains/f8a207c44fbf427db99603d40177182f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:25.349316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8a207c44fbf427db99603d40177182f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:25.350812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521de32-3b93-48e6-8981-e9504d6a317a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:25.353186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 592/1172] 10.222.0.78 () {56 vars in 1183 bytes} [Tue Oct 4 20:07:25 2022] GET /identity/v3/domains/f8a207c44fbf427db99603d40177182f => generated 267 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:25.359889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:25.375834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:25.479743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c424f-2884-4627-8f91-cea5688059e6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:25.538728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:25.540422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:25.540855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:25.541255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:25.542359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:25.544972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22c5f-bbf1-427a-b771-56cecd1c5c38 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:25.653811 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 581/1173] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:07:25 2022] POST /identity/v3/projects => generated 361 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:07:28.078303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf9a2-3b2f-483f-b323-c6cb4c10a2d2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:28.079126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf9a2-3b2f-483f-b323-c6cb4c10a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:28.079126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf9a2-3b2f-483f-b323-c6cb4c10a2d2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:28.080385 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 593/1174] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:07:28.086389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:28.087073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:28.087073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:28.107124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:28.108468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:28.172751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:28.186443 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 582/1175] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:07:28.686816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abf9a2-3b2f-483f-b323-c6cb4c10a2d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:28.816513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abf9a2-3b2f-483f-b323-c6cb4c10a2d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:28.837556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:28.860507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:28.861153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:28.861430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:28.861707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] PATH_INFO: `/v3/domains/f8a207c44fbf427db99603d40177182f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:28.862974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8a207c44fbf427db99603d40177182f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:28.864468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a40f4-e4ae-44ec-8728-01e72dcaaa78 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:28.866392 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 594/1176] 10.222.0.78 () {56 vars in 1183 bytes} [Tue Oct 4 20:07:28 2022] GET /identity/v3/domains/f8a207c44fbf427db99603d40177182f => generated 267 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:28.873028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:28.981578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde715ed-a7e8-4a53-b847-b69a15559bf5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:29.018322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:29.019006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:29.019361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:29.019734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:29.020467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:29.022013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078aa2e-8352-4cb4-8cb2-35e7232c4933 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:29.164376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 583/1177] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:07:28 2022] POST /identity/v3/users => generated 311 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:07:31.585867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb445a-e96a-4154-a27d-e79398d220c2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:31.586472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb445a-e96a-4154-a27d-e79398d220c2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:31.586824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb445a-e96a-4154-a27d-e79398d220c2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:31.589438 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 595/1178] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:31.595783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:31.596550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:31.596550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:31.616997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:31.618367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:31.675809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:31.702859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 584/1179] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:07:31.984772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb445a-e96a-4154-a27d-e79398d220c2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:32.118662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb445a-e96a-4154-a27d-e79398d220c2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:32.178341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:32.179473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:32.179975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:32.180447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:32.199344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:32.208732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:32.210990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:07:32.220947 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 596/1180] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:07:32.221978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:32.399007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388735e9-1cea-42c2-9b75-5c3f41eda7dd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:32.450124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:32.450733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:32.451012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:32.451319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:32.452022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:32.452332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:32.453758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:32.466009 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 585/1181] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:32.473600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:32.525495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:32.616568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fec22-7648-4b3e-bc48-5988acd731f0 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:32.665173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:32.665733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:32.666009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:32.666281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] PATH_INFO: `/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:32.690630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] RBAC: Authorizing `identity:get_user(user_id=9c7571c9f4f84293adccc0fcfcce0c6f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:32.692229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:32.694050 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 597/1182] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:32 2022] GET /identity/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:07:32.700883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:32.756687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:32.839968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a46e-47d2-46e9-badb-8d2cd0316fd1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:32.885840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:32.886496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:32.886784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:32.887058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:32.974304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:32.975745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:33.027916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:33.104547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 586/1183] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:07:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:07:33.112098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:33.296355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:33.300088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445a24-b86d-46a9-97d4-41ed7899ba63 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:33.344763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:33.345415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:33.345689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:33.345962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] PATH_INFO: `/v3/projects/597a1786f7854207b0888266f5d847b4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:33.347244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] RBAC: Authorizing `identity:get_project(project_id=597a1786f7854207b0888266f5d847b4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:33.348705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491db5a-e0ed-46dc-ae50-f35cc6e9d101 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:33.350547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 598/1184] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:33 2022] GET /identity/v3/projects/597a1786f7854207b0888266f5d847b4 => generated 361 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:33.356960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:33.474093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf648-bfe6-4ba6-b39b-1db25aa62b55 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:33.515294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:33.515941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:33.516197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:33.516467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:33.517217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=597a1786f7854207b0888266f5d847b4, user.id=9c7571c9f4f84293adccc0fcfcce0c6f) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:33.517520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:33.518997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175c76-7cce-4709-8076-eefedc1700c5 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:33.525688 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 587/1185] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:07:33 2022] GET /identity/v3/role_assignments?user.id=9c7571c9f4f84293adccc0fcfcce0c6f&scope.project.id=597a1786f7854207b0888266f5d847b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:35.738548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810376f-c711-4772-87b8-03074e1e4161 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:35.739131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810376f-c711-4772-87b8-03074e1e4161 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:35.739131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810376f-c711-4772-87b8-03074e1e4161 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:35.740782 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 599/1186] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:35.750532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:35.751537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:35.751822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:35.760029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:35.773386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:35.774801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:35.847522 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 588/1187] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:36.126269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810376f-c711-4772-87b8-03074e1e4161 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:36.253445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810376f-c711-4772-87b8-03074e1e4161 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:36.293666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:36.294305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:36.294581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:36.294850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:36.307628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:36.312479 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:36.314499 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:07:36.316378 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 600/1188] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:07:36.324501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:36.497600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6d010-d4da-4271-b0cb-a29dc39bd334 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:36.538241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:36.538639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:36.538967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:36.539458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:36.540096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:36.540452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:36.542055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:36.543880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:36.552631 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 589/1189] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:36.560209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:36.600468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:36.692434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6801b-0165-4965-b05b-4fe2fafdd496 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:36.730769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:36.731458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:36.731737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:36.732011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] PATH_INFO: `/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:36.733320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] RBAC: Authorizing `identity:get_user(user_id=9c7571c9f4f84293adccc0fcfcce0c6f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:36.734865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:36.736636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 601/1190] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:36 2022] GET /identity/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:36.743181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:36.860540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f627-f59f-4d89-bc12-d7f5618f75c4 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:36.900224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:36.900880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:36.901162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:36.901436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] PATH_INFO: `/v3/projects/597a1786f7854207b0888266f5d847b4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:36.902685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] RBAC: Authorizing `identity:get_project(project_id=597a1786f7854207b0888266f5d847b4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:36.904184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4586d47-e2a2-4f5c-8905-4afc5f8e29da None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:36.905956 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 590/1191] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:36 2022] GET /identity/v3/projects/597a1786f7854207b0888266f5d847b4 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:07:36.912192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:37.027177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:37.036381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811f28b-6dfa-4f26-8f60-534031623caf None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:37.082569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:37.083753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:37.084262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:37.084764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] PATH_INFO: `/v3/projects/597a1786f7854207b0888266f5d847b4/users/9c7571c9f4f84293adccc0fcfcce0c6f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:37.088516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=597a1786f7854207b0888266f5d847b4, user_id=9c7571c9f4f84293adccc0fcfcce0c6f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:37.091343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34119-09be-4cea-b481-9459b351b8e3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:37.151110 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 602/1192] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:07:36 2022] PUT /identity/v3/projects/597a1786f7854207b0888266f5d847b4/users/9c7571c9f4f84293adccc0fcfcce0c6f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:07:39.393535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619afb9-2694-4deb-91bf-a6352f57951e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:39.394331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619afb9-2694-4deb-91bf-a6352f57951e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:39.394331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619afb9-2694-4deb-91bf-a6352f57951e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:39.395478 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 591/1193] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:07:39.403480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:39.404258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:39.404460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:39.434648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:07:39.436731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:07:39.556724 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 603/1194] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:07:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:07:40.037799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619afb9-2694-4deb-91bf-a6352f57951e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:40.145213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:40.225004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619afb9-2694-4deb-91bf-a6352f57951e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:40.270421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:40.271184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:40.271512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:40.271837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:40.284674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:07:40.290488 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:07:40.292590 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:07:40.293673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 592/1195] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:07:40.302761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:40.420161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:40.436690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb8e8d-4553-49ad-95c8-00d347039b11 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:40.483270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:40.484121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:40.484593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:40.485032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:40.485902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:40.486368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:40.488079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:40.500726 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 604/1196] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:40.508599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:40.690991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d526-14ca-4654-9f76-6fce9a39645e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:40.718450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:40.731085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:40.732006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:40.732410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:40.732767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] PATH_INFO: `/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:40.734128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] RBAC: Authorizing `identity:get_user(user_id=9c7571c9f4f84293adccc0fcfcce0c6f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:40.735852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:40.737755 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 593/1197] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 4 20:07:40 2022] GET /identity/v3/users/9c7571c9f4f84293adccc0fcfcce0c6f => generated 311 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:40.745552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:40.894866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a73de1-d3ca-40ce-8e05-8e0ffee08e13 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:40.962096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daad144-efae-4466-9703-2b5683139411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:40.962610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad144-efae-4466-9703-2b5683139411 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:40.962894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad144-efae-4466-9703-2b5683139411 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:40.963190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daad144-efae-4466-9703-2b5683139411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:40.984269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:41.071779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daad144-efae-4466-9703-2b5683139411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:41.074537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daad144-efae-4466-9703-2b5683139411 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:41.243228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 605/1198] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:07:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:07:41.253148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:41.410244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd584-948a-48f8-a5c2-e9a322b3d120 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:41.452120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:41.452766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:41.453042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:41.453316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] PATH_INFO: `/v3/projects/597a1786f7854207b0888266f5d847b4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:41.454526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] RBAC: Authorizing `identity:get_project(project_id=597a1786f7854207b0888266f5d847b4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:41.456022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d9792-a8a3-4f75-9294-7bf3e6a458bd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:41.457702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 594/1199] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 4 20:07:41 2022] GET /identity/v3/projects/597a1786f7854207b0888266f5d847b4 => generated 361 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:41.464867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daad144-efae-4466-9703-2b5683139411 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:07:41.518695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:41.583756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daad144-efae-4466-9703-2b5683139411 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:07:41.622999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:07:41.623672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:07:41.623954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:07:41.624227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:07:41.624962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=597a1786f7854207b0888266f5d847b4, user.id=9c7571c9f4f84293adccc0fcfcce0c6f) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:07:41.625325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:07:41.626810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c77e7-f461-4c67-b0d4-59e9884bddf7 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:07:41.634248 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 606/1200] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:07:41 2022] GET /identity/v3/role_assignments?user.id=9c7571c9f4f84293adccc0fcfcce0c6f&scope.project.id=597a1786f7854207b0888266f5d847b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:07:51.447593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=70 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:51.630489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=44 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:07.244409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743214f2-8274-4c4f-995d-24e672eefe80 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:07.245039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743214f2-8274-4c4f-995d-24e672eefe80 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:07.245039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743214f2-8274-4c4f-995d-24e672eefe80 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:07.246265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 595/1201] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:07.252147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab237bc-190c-4758-b730-c79205486632 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:07.252603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab237bc-190c-4758-b730-c79205486632 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:07.252707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab237bc-190c-4758-b730-c79205486632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:07.273603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0ab237bc-190c-4758-b730-c79205486632 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:07.274844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0ab237bc-190c-4758-b730-c79205486632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:07.349051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 607/1202] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:09:07.628078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743214f2-8274-4c4f-995d-24e672eefe80 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:07.742007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743214f2-8274-4c4f-995d-24e672eefe80 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:07.779114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:07.779778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:07.780059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:07.780335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:07.791646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:07.793116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:07.808521 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:07.810396 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:07.811625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:07.811625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:07.811625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:07.811625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 596/1203] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:09:07.816486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab237bc-190c-4758-b730-c79205486632 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:07.929531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab237bc-190c-4758-b730-c79205486632 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:07.964349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:07.971000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:07.971678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:07.971953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:07.972226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:07.972906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:07.973208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:07.974636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5f35-d89c-4346-930f-06c05cfa7efc None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:07.989104 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 608/1204] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:07.995408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:08.053733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:08.106318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170f1a9-ad11-4588-b852-ef5275a6f87f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:08.149027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:08.149640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:08.149920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:08.150192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:08.150860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:08.152340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144eccd-4957-46d8-a607-61b8facd4a00 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:08.404644 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 597/1205] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 4 20:09:07 2022] POST /identity/v3/users => generated 251 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:09:10.714393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc361-11f8-41f5-8ca1-3fdd604cc337 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:10.715021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc361-11f8-41f5-8ca1-3fdd604cc337 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:10.715021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc361-11f8-41f5-8ca1-3fdd604cc337 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:10.716378 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 609/1206] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:10.722546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:10.723045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:10.723183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:10.744917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:10.746330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:10.816486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 598/1207] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:09:11.089947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc361-11f8-41f5-8ca1-3fdd604cc337 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:11.199347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc361-11f8-41f5-8ca1-3fdd604cc337 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:11.243811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:11.244488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:11.244766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:11.245037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:11.256794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:11.261605 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:11.263260 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:11.264133 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 610/1208] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:11.268898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:11.309282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:11.371795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05d329-4171-42de-876a-7cc1c9fb4110 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:11.407278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:11.408387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:11.408666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:11.408938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:11.409613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:11.409912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:11.411375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:11.420543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 599/1209] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:11.427243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:11.484931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:11.543472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2401-8f46-4459-89c3-0d0303808cdd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:11.578751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:11.579437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:11.579717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:11.579990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:11.590656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:11.592159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:11.607678 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:11.609616 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:11.612020 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:11.612020 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:11.612020 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:11.612020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 611/1210] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:11.615987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:11.723286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:11.726345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985a15-a204-4b09-b9f3-28fb51422665 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:11.761677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:11.762296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:11.762578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:11.762847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:11.763531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:11.763833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:11.765256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:11.778055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 600/1211] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:11.784753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:11.912071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108bead-76cc-4564-8fbc-0ca12742e977 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:11.914938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:11.968343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:11.968908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:11.969189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:11.969460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:11.978402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:11.979918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:11.993457 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:11.994741 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:11.996329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 612/1212] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:12.001121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:12.111570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654fdac-9a08-4120-927c-aed0449aa39f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:12.150400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:12.151017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:12.151332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:12.151607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:12.152345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:12.152649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:12.154089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:12.173115 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 601/1213] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:12.179004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:12.286371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9681-0e99-4ca4-92aa-38353c6c48f3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:12.325827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:12.326472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:12.326786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:12.327072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:12.365353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:12.408552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:12.410612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:12.521651 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 613/1214] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:09:12.528590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:12.561971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:12.699961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf9a47-f8ed-4298-b30d-037527187c6c None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:12.752595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:12.753476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:12.753738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:12.754012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:12.765438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:12.766879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:12.782501 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:12.783781 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:12.785875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:12.785875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:12.785875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:12.785875 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 602/1215] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:12.789697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:12.858250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:12.904328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190163-c924-4354-b9fb-eb906d47f933 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:12.955746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:12.956700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:12.957202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:12.957698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:12.958954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:12.959580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:12.962233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:12.979706 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 614/1216] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:12.985602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:13.062516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:13.097129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dbbd8-f9cc-443e-9d74-c975063c6417 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:13.148213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195be00-646a-400e-935a-39710d203f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:13.148213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195be00-646a-400e-935a-39710d203f74 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:13.148213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195be00-646a-400e-935a-39710d203f74 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:13.148213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195be00-646a-400e-935a-39710d203f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:13.148888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195be00-646a-400e-935a-39710d203f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:13.148888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195be00-646a-400e-935a-39710d203f74 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1195be00-646a-400e-935a-39710d203f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:13.154765 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:13.155914 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:13.157326 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 603/1217] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:13.162161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:13.275348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f317-f47f-4a2a-9692-7e5ee8a1df85 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:13.298934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:13.310963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:13.311611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3c8a4-bde6-49af-ae7f-6a9224186a91 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:13.365854 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 615/1218] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:09:13.366454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195be00-646a-400e-935a-39710d203f74 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:13.448107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195be00-646a-400e-935a-39710d203f74 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:13.467162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:13.473418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:13.474062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:13.474339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:13.474607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:13.475414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=618992172e2c4fc89d9f0be304dfe510) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:13.475783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:13.477365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abda33-1986-4d85-b394-1eae2165cb05 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:13.483348 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 604/1219] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:09:13 2022] GET /identity/v3/role_assignments?user.id=618992172e2c4fc89d9f0be304dfe510&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:15.740423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7718-a4dc-4ba3-ae3b-d3b81c396d5e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:15.741095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7718-a4dc-4ba3-ae3b-d3b81c396d5e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:15.741095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7718-a4dc-4ba3-ae3b-d3b81c396d5e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:15.742387 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 616/1220] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:15.748761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:15.749352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:15.749352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:15.769426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:15.770629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:15.862741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 605/1221] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:09:16.143914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7718-a4dc-4ba3-ae3b-d3b81c396d5e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:16.248771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7718-a4dc-4ba3-ae3b-d3b81c396d5e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:16.284653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:16.285285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:16.285566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:16.285841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:16.296277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:16.301564 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:16.314483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:16.315559 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 617/1222] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:16.316417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:16.409241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e15dc7-dba5-4818-8e3f-3cee7c57f3b1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:16.433630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:16.444532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:16.445150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:16.445435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:16.445703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:16.446371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:16.446671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:16.448082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:16.457152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 606/1223] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:16.463033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:16.512453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:16.580250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74f20-0929-408f-a8ae-ab8194fdd84d None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:16.627253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:16.627891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:16.628162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:16.628430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:16.639086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:16.640589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:16.656022 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:16.663645 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:16.664764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:16.664764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:16.664764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:16.664764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 618/1224] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:16.665073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:16.771436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4ed1-0c1b-437d-8be9-57656ebe70f6 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:16.807238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:16.807848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:16.808130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:16.808405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:16.809057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:16.809358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:16.810798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:16.822666 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 607/1225] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:16.828797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:16.926602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:16.933592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ce8-de3f-41f5-8645-4a2452c18e74 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:16.968745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97762152-920d-41f0-9768-28a26a233267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:16.969380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97762152-920d-41f0-9768-28a26a233267 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:16.969711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97762152-920d-41f0-9768-28a26a233267 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:16.969932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97762152-920d-41f0-9768-28a26a233267 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:16.977745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97762152-920d-41f0-9768-28a26a233267 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:16.979257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97762152-920d-41f0-9768-28a26a233267 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-97762152-920d-41f0-9768-28a26a233267 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:16.993169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:16.994332 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:16.995561 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:16.999060 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 619/1226] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:17.000144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:17.051411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:17.107760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f5941-4dfb-4e0e-92b8-0828213dbb87 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:17.146573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:17.147312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:17.154496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:17.154496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:17.154496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:17.154496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:17.154496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:17.168086 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 608/1227] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:09:17.180306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97762152-920d-41f0-9768-28a26a233267 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:17.296849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97762152-920d-41f0-9768-28a26a233267 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:17.336610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:17.337324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:17.337606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:17.337878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:17.350250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:17.351788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:17.368787 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:17.370549 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:17.372713 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:17.372713 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:17.372713 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:17.372713 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 620/1228] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:17.377364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:17.490281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3f09-5757-458a-a93d-244978538e61 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:17.492789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:17.525865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:17.526486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:17.526765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:17.527035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:17.527801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:17.528106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:17.529488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:17.541666 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 609/1229] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:17.550823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:17.566903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:17.691216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdab50-9cfb-4217-b3a0-1e2af6faa4eb None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:17.731880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:17.732697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:17.733107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:17.733496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:17.742814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:17.744326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:17.757139 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:17.758459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:17.759659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 621/1230] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:17.764883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:17.886577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ecadc-36c3-463b-8236-f4d5a6bd67b0 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:17.929794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:17.930439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:17.930732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:17.931009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:17.931753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:17.932056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:17.933600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f9420-b22c-400d-8a73-5b1fa7778e02 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:17.947678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 610/1231] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:17.954062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:18.027219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:18.076684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a42b97-5c92-4feb-a332-329abe8aa687 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:18.113006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:18.113679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:18.114205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:18.114467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/618992172e2c4fc89d9f0be304dfe510/roles/b90e300834cf43b78caf5b158782d71e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:18.133262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=618992172e2c4fc89d9f0be304dfe510, role_id=b90e300834cf43b78caf5b158782d71e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:18.134806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d0074-914d-4875-993d-8246b0b9944b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:18.249484 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 622/1232] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:09:17 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/618992172e2c4fc89d9f0be304dfe510/roles/b90e300834cf43b78caf5b158782d71e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:09:20.479396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc245-99e4-4832-baee-b4d8ad369a4a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:20.480241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc245-99e4-4832-baee-b4d8ad369a4a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:20.480241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc245-99e4-4832-baee-b4d8ad369a4a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:20.481595 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 611/1233] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:20.487639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:20.488108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:20.488269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:20.507511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:20.508814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:20.587620 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 623/1234] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:09:20.856542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc245-99e4-4832-baee-b4d8ad369a4a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:20.884095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:20.963184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc245-99e4-4832-baee-b4d8ad369a4a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.002100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.002783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.003117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.003520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.013993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:21.018822 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:21.019946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:21.021136 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 612/1235] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 4 20:09:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:21.026176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:21.074999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:21.130265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55053f0-4557-4547-a4fc-e0f1e2751bbd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.164682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.165286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.165559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.165828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.166485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:21.166780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:21.168262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:21.177055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 624/1236] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:21.183061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:21.271154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:21.288838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a0f5-d21f-4b96-a759-9ad098d2a092 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.322004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.322630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.322903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.323194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.334375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:21.335904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:21.351289 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:21.352601 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:21.354090 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:21.354090 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:21.354090 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:21.354090 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 613/1237] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:21.358387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:21.469707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474a053-1c3e-467e-96b1-abe309c8e0d9 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.480377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:21.510133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.510831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.511004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.511312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.511952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:21.512250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:21.513619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:21.526627 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 625/1238] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:21.532923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:21.655158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9409fbf-ba96-45f7-89bd-e8d4277388c1 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.707566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.708646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.709144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.709643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.714485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:21.727032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:21.727959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:21.742013 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:21.743349 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:21.744875 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 614/1239] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:21.749407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:21.853886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848044c-6528-46c9-bb6b-c40af60f5840 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:21.891011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:21.892243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:21.892525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:21.892829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:21.893582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:21.893888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:21.895367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:21.913636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 626/1240] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:21.919715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:22.024486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47056-3872-4b22-a156-044071a3c1fa None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:22.061345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:22.061981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:22.062262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:22.062538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:22.138802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:22.145665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:22.147129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:22.264065 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 615/1241] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:09:22.270659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:22.301028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:22.381170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76244-305e-4bd3-97be-277dde6a036a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:22.418624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:22.419327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:22.419609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:22.419890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:22.430255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:22.431797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:22.447175 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:22.448367 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:22.449389 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:22.449389 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:22.449389 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:22.449389 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 627/1242] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:22.455680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:22.557753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:22.564819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdded6-109f-4b37-bf0c-d88607a479f5 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:22.601144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:22.601783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:22.602063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:22.602334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:22.602990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:22.603329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:22.604865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:22.616994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 616/1243] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:22.623004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:22.711058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:22.733868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c353b5e-c898-4610-afe2-e4aa9d5559f3 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:22.771716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:22.772351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:22.772654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:22.772926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:22.780478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:22.781962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:22.793994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:22.797970 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:22.799074 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 628/1244] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:22.801403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:22.913795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195480-0a1e-4f19-ad18-68d9ac68aa2f None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:22.949509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:22.950149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:22.950433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:22.950707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:22.951437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:22.951747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:22.953199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e22df8-5ab7-4927-861a-3947d2d12ad3 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:22.968110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 617/1245] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:22.974960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:23.082952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030fd4e-8b72-4868-9ba4-62150e0702ac None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:23.120346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:23.120957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:23.121245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:23.121540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:23.122304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] RBAC: Adding query filter params (role.id=b90e300834cf43b78caf5b158782d71e, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=618992172e2c4fc89d9f0be304dfe510) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:23.122718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:23.124278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d8b0-bc70-46db-9692-1d9442442dd6 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:23.130785 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 629/1246] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:09:22 2022] GET /identity/v3/role_assignments?user.id=618992172e2c4fc89d9f0be304dfe510&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=b90e300834cf43b78caf5b158782d71e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:25.397257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3e07-3c53-4363-a0d7-0c991b9066d3 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:25.397791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3e07-3c53-4363-a0d7-0c991b9066d3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:25.397981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e3e07-3c53-4363-a0d7-0c991b9066d3 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:25.399319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 618/1247] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:25.405076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:25.405540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:25.405681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:25.414498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:25.427421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:25.428661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:25.508219 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 630/1248] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:25.787671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e3e07-3c53-4363-a0d7-0c991b9066d3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:25.809855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:25.907338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e3e07-3c53-4363-a0d7-0c991b9066d3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:25.946719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:25.947309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:25.947591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:25.947871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:25.963298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:25.968098 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:25.969338 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:25.970584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 619/1249] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:25.975645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:26.091972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65a431-7725-4ffc-b072-9e789d98c05b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:26.133273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:26.144728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:26.146109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:26.146530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:26.147108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:26.147825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:26.148125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:26.149505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:26.158513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 631/1250] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:09:26.167378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:26.255277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:26.280259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca970a-e3c5-43a6-ac45-856ae74c25ff None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:26.316826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:26.317459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:26.317739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:26.318038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:26.329016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:26.330567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:26.345809 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:26.349734 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:26.351792 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:26.351792 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:26.351792 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:26.351792 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 620/1251] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:26.355405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:26.470293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293dbd-fb51-453a-be6a-0e8ef26558ef None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:26.507196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:26.507748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:26.508170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:26.508458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:26.509122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:26.509429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:26.510835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:26.524053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 632/1252] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:26.531008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:26.648684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515471f5-0042-4f45-acf3-75efe03c6813 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:26.681941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:26.689959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:26.690596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:26.690876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:26.691176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:26.700059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:26.703282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:26.714568 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:26.716023 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:26.717312 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:26.719846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 621/1253] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:26.723336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:26.799817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:26.847765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a463b3-bc2a-4198-be7a-def6c8452d7b None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:26.884997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:26.885614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:26.886192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:26.886192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:26.886923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:26.887230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:26.888723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:26.913057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 633/1254] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:26.919098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:27.042054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1530-91d3-40cd-9a8d-afe5b4ae4de2 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:27.085139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:27.085755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:27.086032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:27.086302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:27.156293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:27.170338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:27.171861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:27.287788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 622/1255] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:09:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 20:09:27.295269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:27.428829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b739d3-fdb4-4c9d-8729-445b75861b69 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:27.443451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:27.474579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:27.475327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:27.475514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:27.475779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:27.487649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:27.489497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:27.505840 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:27.509931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:27.511191 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:27.511191 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:27.511191 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:27.511191 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 634/1256] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:27.513391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:27.631083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:27.645630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36470-a7f3-4530-98e1-bf6ddea1c52b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:27.683997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:27.684543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:27.684825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:27.685099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:27.685752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:27.686056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:27.687529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:27.700343 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 623/1257] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:27.706193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:27.827313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc201aaf-ee5b-43c1-8bb3-3a7b3a08a2cd None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:27.865532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:27.866167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:27.866446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:27.866720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:27.873819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:27.875848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:27.888275 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:27.890040 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:27.893048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 635/1258] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:27.898766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:28.020512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e6da7-6e4e-41da-99d9-f47a2ae61c55 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:28.055650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:28.069834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9abe6-6a78-422a-8468-59b29de63a7c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:28.073075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 624/1259] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:28.080185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:28.118486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:28.210905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de555f6-384e-4e89-a0cf-6e1f6757502a None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:28.251448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:28.252130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:28.252409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:28.252680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:28.253422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=618992172e2c4fc89d9f0be304dfe510) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:28.253731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:28.255211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd47c-9188-4915-8672-df26e66b35df None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:28.261123 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 636/1260] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:09:28 2022] GET /identity/v3/role_assignments?user.id=618992172e2c4fc89d9f0be304dfe510&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:30.467582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bff36-0a36-413e-b521-b8b2b75f4ee4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:30.468177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bff36-0a36-413e-b521-b8b2b75f4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:30.468177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bff36-0a36-413e-b521-b8b2b75f4ee4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:30.470029 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 625/1261] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:30.475807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:30.476320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:30.476449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:30.498574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:30.499837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:30.575103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 637/1262] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 20:09:30.846916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bff36-0a36-413e-b521-b8b2b75f4ee4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:30.858605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:30.951482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bff36-0a36-413e-b521-b8b2b75f4ee4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:30.987571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:30.988201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:30.988475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:30.988995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:30.999350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:31.005062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:31.009799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:31.010873 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 626/1263] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:31.012555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.032331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:31.117404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5d39-269d-4e69-a73a-642ab2fb4d15 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:31.153383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:31.154072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:31.158260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:31.158260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:31.158260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:31.158260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:31.158260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:31.166506 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 638/1264] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:31.172619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.241525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:31.278109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555aeb9-5e22-4623-b28f-fd262eb6c811 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:31.313037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:31.313673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:31.313947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:31.314217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:31.326135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:31.330093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:31.344698 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:31.346018 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:31.347441 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:31.347441 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:31.347441 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:31.347441 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 627/1265] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:31.352219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.438817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:31.463430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801d74-7518-4e44-a208-085d97984f7e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:31.500677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:31.501364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:31.501564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:31.501956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:31.502485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:31.503094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:31.504199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:31.516807 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 639/1266] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:31.522727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.632659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c118-e81d-4acc-a55b-410cbed7ae3b None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:31.654274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:31.668024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:31.668665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:31.668947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:31.669220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:31.677264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:31.678747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:31.691398 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:31.692566 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:31.693774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 628/1267] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:31.699621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.804347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc9379-29a6-4dc8-bf21-6eed7e0f4d5e None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:31.842785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:31.843444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:31.843810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:31.844063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:31.844816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:31.845122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:31.846622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:31.857500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:31.866290 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 640/1268] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:31.872366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:31.980775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0c2a-0dde-4d38-9550-71e7ff558871 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:32.019833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:32.020918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:32.021400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:32.021881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:32.035292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:32.036749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:32.051755 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:32.059251 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:32.060526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:32.060526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:32.060526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:32.060526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 629/1269] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:32.060832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:32.168370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70215718-bf01-4a2a-af6a-d0a865a6fd2f None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:32.213245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:32.213924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:32.214203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:32.214473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:32.215291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:32.215663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:32.217107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:32.230192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 641/1270] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:32.236986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:32.275575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:32.357187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8cce-b7d9-4b12-9005-4c39c0e29f80 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:32.394078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:32.394717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:32.395002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:32.395313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:32.402348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:32.403932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:32.417080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:32.418223 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:32.419321 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 630/1271] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:32.424443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:32.508102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:32.552746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56e03-62b5-448a-bffa-11c133a4d2f1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:32.599974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:32.600579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:32.600854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:32.601125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:32.601814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:32.602115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:32.603672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70a76e-18d0-4f44-a08c-f8064871b970 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:32.617349 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 642/1272] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:32.624870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:32.724316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:32.735417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a350f-a49f-426e-ae1b-2cd98f0e0311 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:32.775079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:32.775755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:32.776018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:32.776298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] PATH_INFO: `/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/618992172e2c4fc89d9f0be304dfe510/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:32.778527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e548a82d7ba413bb8f774858cfcd2b4, user_id=618992172e2c4fc89d9f0be304dfe510, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:32.780142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7ff8a-555a-4a90-a1b6-d82ccf62a0a7 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:32.980498 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 631/1273] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 4 20:09:32 2022] PUT /identity/v3/projects/5e548a82d7ba413bb8f774858cfcd2b4/users/618992172e2c4fc89d9f0be304dfe510/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:09:35.210147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c175e3-061b-4296-9c77-662021523a38 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:35.211027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c175e3-061b-4296-9c77-662021523a38 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:35.211027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c175e3-061b-4296-9c77-662021523a38 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:35.212565 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 643/1274] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:35.218010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:35.218454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:35.218592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:35.237373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:35.238837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:35.314459 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 632/1275] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:35.589364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c175e3-061b-4296-9c77-662021523a38 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:35.693070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c175e3-061b-4296-9c77-662021523a38 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:35.711473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:35.727975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:35.728602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:35.728878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:35.729148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:35.740337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 20:09:35.745167 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:35.746252 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:35.747652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 644/1276] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 4 20:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:35.753211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:35.837985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:35.855437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f1faa-22d6-42cc-8eab-104e784d244a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:35.889699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:35.890301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:35.894612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:35.894612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:35.894612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:35.894612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:35.894612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:35.901388 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 633/1277] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 4 20:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:35.907458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:36.011505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506e25-d4e1-431f-9c67-2d94dc511cc4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:36.045557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:36.046186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:36.046465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:36.047264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:36.057450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:36.058906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:36.076615 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:36.084293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:36.085256 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:36.085256 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:36.085256 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:36.085256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 645/1278] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:36.085500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:36.191752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f850c3d-fbda-4a0a-8793-c3c4e8a20c2d None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:36.226189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:36.227084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:36.227084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:36.227341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:36.227994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:36.228353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:36.229735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:36.242963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 634/1279] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:36.248966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:36.281540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:36.353227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23ee7-522c-41c2-b1f9-3a0336e1401c None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:36.388306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:36.388956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:36.389232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:36.389591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:36.398465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:36.400011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:09:36.413820 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:36.415115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:36.416120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 646/1280] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:36.421061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:36.446711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:36.526314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26f190-1e19-49b0-931b-c398265ffb4e None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:36.580977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:36.582030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:36.582768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:36.583540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:36.585006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:36.585593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:36.588865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:36.622772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 635/1281] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 4 20:09:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:36.629714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:36.729186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:36.739734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f3767-ee6f-4a33-a0d2-0cea438b4bc8 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:36.774780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:36.775421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:36.775696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:36.775965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:36.850069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:36.851694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:36.950298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:36.959936 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 647/1282] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 4 20:09:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 20:09:36.966076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:37.032421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:37.075170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34bcb0-be8b-439b-a53a-240b579e2bdf None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:37.127122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:37.128259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:37.128752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:37.129370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:37.148888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:37.151710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:09:37.170531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:37.173373 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 20:09:37.174633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:09:37.174633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 20:09:37.174633 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:37.174633 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 636/1283] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:37.179494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:37.318163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422751e-30af-401f-9ba5-df0c270ca1d4 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:37.372591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:37.373235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:37.373512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:37.373769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:37.374443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:37.374760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:37.376237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:37.396913 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 648/1284] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 4 20:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:37.403040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:37.528160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd386ee2-bcea-464f-9014-63b5e160c34a None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:37.548205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:37.576322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:37.577190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:37.577709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:37.578258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:37.590029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:37.592159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 20:09:37.606876 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:37.608226 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:09:37.609971 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 637/1285] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 4 20:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:37.614784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:37.677260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:37.736027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809a6-9463-427a-af4d-6a39018366f5 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:37.773854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:37.774595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:37.774815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:37.775017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:37.775737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:37.776038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:37.777473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f822aa-07bd-43ee-82ec-40592568f5f9 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:37.790281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 649/1286] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 4 20:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:37.797723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:37.905657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2715b4-0992-491e-be8e-e71f1e36cd76 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:37.940618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:37.941224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:37.941497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:37.941766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:37.942489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] RBAC: Adding query filter params (role.id=752f2c38dc7242cca4d4703d29369911, scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4, user.id=618992172e2c4fc89d9f0be304dfe510) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:37.942793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:37.944339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff43871-dba5-442c-a00f-7e87ff4e33fe None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:37.950096 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 638/1287] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 4 20:09:37 2022] GET /identity/v3/role_assignments?user.id=618992172e2c4fc89d9f0be304dfe510&scope.project.id=5e548a82d7ba413bb8f774858cfcd2b4&role.id=752f2c38dc7242cca4d4703d29369911 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:40.166430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c522d-f7eb-4539-9b36-e2c3d67a5070 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:40.167044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c522d-f7eb-4539-9b36-e2c3d67a5070 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:40.167044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c522d-f7eb-4539-9b36-e2c3d67a5070 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:40.168393 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 650/1288] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:09:40.175752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:40.176345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:40.176345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:40.195874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:40.197095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:40.230942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:40.271602 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 639/1289] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:40.544307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c522d-f7eb-4539-9b36-e2c3d67a5070 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:40.695978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c522d-f7eb-4539-9b36-e2c3d67a5070 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:40.719065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:40.749555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:40.750230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:40.750503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:40.750771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:40.751416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:40.753045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:40.763173 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:40.765239 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:40.766866 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 651/1290] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:09:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:40.776677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:40.930852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92699f-d796-46d1-921b-2e1708e76608 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:40.993943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:40.994707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:40.995124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:40.995482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:40.995981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:40.996287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:40.997684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c116ad-9c20-45f0-8063-02603c205e99 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:41.004242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 640/1291] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 4 20:09:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:41.010469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:41.184302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b8ddd-e1da-4adf-abe9-301c5e1fdef1 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:41.222346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:41.223095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:41.223488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:41.223822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:41.224651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:41.225102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:41.226825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b67b31-2728-48b8-bcc1-6eab5ac82c30 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:41.233466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 652/1292] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 4 20:09:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:09:43.875359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871feef-0c2d-4402-9a73-63899005064b None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:43.875927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871feef-0c2d-4402-9a73-63899005064b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:43.875927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871feef-0c2d-4402-9a73-63899005064b None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:43.877383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 641/1293] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:09:43.886691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d6d5-d377-4df7-a343-fd1c566cb8e3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:43.887302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d6d5-d377-4df7-a343-fd1c566cb8e3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:43.887691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d6d5-d377-4df7-a343-fd1c566cb8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:43.919729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1246d6d5-d377-4df7-a343-fd1c566cb8e3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:43.921850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1246d6d5-d377-4df7-a343-fd1c566cb8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:43.975115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:44.032046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 653/1294] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:44.309191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871feef-0c2d-4402-9a73-63899005064b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:44.361543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:44.487937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871feef-0c2d-4402-9a73-63899005064b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:44.532466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:44.533148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:44.533495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:44.533807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:44.534665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:44.536312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f444d-b06d-4bb1-9ee0-258b07a096dd None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:44.716841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 642/1295] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 4 20:09:44 2022] POST /identity/v3/services => generated 246 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:09:47.030877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085856-0e4c-4135-9019-113d597af28c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:47.031426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085856-0e4c-4135-9019-113d597af28c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:47.031426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085856-0e4c-4135-9019-113d597af28c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:47.032744 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 654/1296] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:47.038934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:47.039569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:47.039569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:47.059118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:47.060357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:47.169005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 643/1297] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:47.444060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6085856-0e4c-4135-9019-113d597af28c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:47.592065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6085856-0e4c-4135-9019-113d597af28c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:47.635565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:47.636245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:47.636521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:47.636792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:47.637482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:47.639163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:47.649600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:47.651057 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:47.652405 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 655/1298] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:09:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:47.658145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:47.683886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:47.786797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97bfb-5e93-417d-832f-7de057f77f18 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:47.828031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:47.828655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:47.828935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:47.829207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:47.829851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:47.830153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:47.831707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:47.837537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 644/1299] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 4 20:09:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:47.844039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:47.885740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:47.958511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2438629-d197-4796-bf7e-f6c62bab1491 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:47.994932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:47.995764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:47.996116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:47.996441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:47.997200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] RBAC: Adding query filter params (interface=public, service_id=defbd57ec800479a926b6d7f95a265cf, region_id=RegionOne) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:47.997554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:47.999056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01975c-d9c9-46f3-acb3-40e48e4d810f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:48.005744 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 656/1300] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 4 20:09:47 2022] GET /identity/v3/endpoints?service_id=defbd57ec800479a926b6d7f95a265cf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:48.011732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:48.101180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:48.120761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715dfea-15ad-44be-a593-3ed2c9f87607 None admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:48.161785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:48.162410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:48.162689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:48.162962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:48.163628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:48.165030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e16f1-ec7f-4315-a32d-32d863ef322c None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:48.173433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 645/1301] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 4 20:09:48 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:09:50.383919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892049d-adc6-47ea-9ce4-fd61883e5587 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:50.384803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892049d-adc6-47ea-9ce4-fd61883e5587 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:50.384803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892049d-adc6-47ea-9ce4-fd61883e5587 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:50.385808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 657/1302] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:09:50.391708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:50.392138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:50.392254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:50.410508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:09:50.411745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:09:50.489880 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 646/1303] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:09:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 20:09:50.764484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892049d-adc6-47ea-9ce4-fd61883e5587 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:50.862379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:50.869814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892049d-adc6-47ea-9ce4-fd61883e5587 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:50.905331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:50.905961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:50.906239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:50.906605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:50.907216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:50.908578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:09:50.917281 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:09:50.918488 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:09:50.919588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 658/1304] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 4 20:09:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:09:50.925161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:51.006774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:09:51.029298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe164-fce0-4f2f-846c-77b3dce2b8ea None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:51.064975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:51.065584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:51.065859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:51.066129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:51.066759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] RBAC: Adding query filter params (name=placement) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:09:51.067064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:51.068451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70897ca9-2e5e-4751-88db-59133e5a419a None admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:51.073684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 647/1305] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 4 20:09:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:09:51.079682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:09:51.183071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d304-7826-45f0-83a6-598919d29926 None admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:09:51.219114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:09:51.219757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:09:51.220072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:09:51.220343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:09:51.221029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:09:51.222394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493338a-3969-4c97-b880-88501d5fb20f None admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:09:51.360625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 659/1306] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:09:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:10:01.319328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=30 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:01.354789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:19.016486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875601-837d-4677-8b2d-5aee4e08ba63 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:19.017286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875601-837d-4677-8b2d-5aee4e08ba63 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:19.017286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875601-837d-4677-8b2d-5aee4e08ba63 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:19.024798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1006bc-f061-4857-8b42-4ad9ced9e87d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:19.025601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1006bc-f061-4857-8b42-4ad9ced9e87d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:19.025601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1006bc-f061-4857-8b42-4ad9ced9e87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:19.030564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 648/1307] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:19 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:19.167985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8c1006bc-f061-4857-8b42-4ad9ced9e87d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:19.169222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c1006bc-f061-4857-8b42-4ad9ced9e87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:19.289767 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 660/1308] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:19:19.684380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:19.684776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:19.685199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:19.688363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 649/1309] 10.222.0.78 () {54 vars in 964 bytes} [Tue Oct 4 20:19:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:19.699975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ac72-f8ac-4d6d-bd18-67ebdc7dc3e3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:19.701424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ac72-f8ac-4d6d-bd18-67ebdc7dc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:19.702027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ac72-f8ac-4d6d-bd18-67ebdc7dc3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:19.833133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5396ac72-f8ac-4d6d-bd18-67ebdc7dc3e3 None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:19.834386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5396ac72-f8ac-4d6d-bd18-67ebdc7dc3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:19.867907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:19.948773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 661/1310] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 4 20:19:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:19:19.957965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:19.959795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:20.113487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29192f48-f65d-498a-846c-4ce7a39b36da None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:20.220196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:20.221421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:20.221890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:20.222404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:20.225331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:20.292845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:20.369420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:20.371174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ba6ee-9999-41bd-8b56-3ba823f5c0ce service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:20.393434 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 650/1311] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:23.177239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab33c6-0dc2-4f3a-a3ab-dfb49271842b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:23.177683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab33c6-0dc2-4f3a-a3ab-dfb49271842b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:23.177778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab33c6-0dc2-4f3a-a3ab-dfb49271842b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:23.179589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 662/1312] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:23.187913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358366-1144-4fe6-bb7c-8b3920a8f9be None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:23.188446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358366-1144-4fe6-bb7c-8b3920a8f9be None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:23.188838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76358366-1144-4fe6-bb7c-8b3920a8f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:23.300476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-76358366-1144-4fe6-bb7c-8b3920a8f9be None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:23.302126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76358366-1144-4fe6-bb7c-8b3920a8f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:23.439384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 651/1313] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:23.737040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:23.737321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:23.737600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:23.738952 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 663/1314] 10.222.0.78 () {54 vars in 964 bytes} [Tue Oct 4 20:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:23.745821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375667-f5e0-4d96-89c6-c80e475645a7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:23.746105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375667-f5e0-4d96-89c6-c80e475645a7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:23.746381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375667-f5e0-4d96-89c6-c80e475645a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:23.758889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:23.830008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dc375667-f5e0-4d96-89c6-c80e475645a7 None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:23.831530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc375667-f5e0-4d96-89c6-c80e475645a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:23.920351 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 652/1315] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 4 20:19:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:23.930731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:23.932416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:24.056734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b0ad3-003a-497b-9d40-e08387465c26 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:24.142295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:24.144813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:24.145487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:24.145759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:24.146025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:24.147718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:24.283457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:24.284941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca042f-bb6c-4074-b7bf-37b0f6356b23 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:24.309744 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 664/1316] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:27.559687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:27.560258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:27.560258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:27.561690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 653/1317] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:27.567539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0825b61-3253-4f2f-a1e8-55f2fe9e36c8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:27.568073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0825b61-3253-4f2f-a1e8-55f2fe9e36c8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:27.568073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0825b61-3253-4f2f-a1e8-55f2fe9e36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:27.646271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f0825b61-3253-4f2f-a1e8-55f2fe9e36c8 None None] MFA Rules not processed for user `05f0e63e9e434568841950a396b5e81e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:27.647568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0825b61-3253-4f2f-a1e8-55f2fe9e36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:27.716709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:27.765454 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 665/1318] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:28.052986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:28.054568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:28.184461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759d59-d936-4544-9523-67352bd6c582 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:28.187845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:28.283347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:28.283968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:28.284242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:28.284507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:28.286176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:28.468877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:28.470333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1146ff-073c-47d6-ac2c-0e7a75b4c312 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:28.491964 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 654/1319] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:31.684371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:31.685024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:31.685269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:31.686723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 666/1320] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:31.692824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4369f1-16d3-42f0-8fcf-1a174d81c3e6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:31.693430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4369f1-16d3-42f0-8fcf-1a174d81c3e6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:31.693430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4369f1-16d3-42f0-8fcf-1a174d81c3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:31.749580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:31.782799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7e4369f1-16d3-42f0-8fcf-1a174d81c3e6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:31.784097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e4369f1-16d3-42f0-8fcf-1a174d81c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:31.907197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 655/1321] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:32.205875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:32.207648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:32.331378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df949f-b505-4ee6-9ced-249146e3b4d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:32.422178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:32.422793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:32.423069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:32.423375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:32.425032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:32.434584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:32.571471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:32.572943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031e4a-ae23-4ebb-b231-6d3a4f7b9927 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:32.592018 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 667/1322] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:19:37.575775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345922f-5180-4184-aa49-cf250849a40a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:37.576311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345922f-5180-4184-aa49-cf250849a40a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:37.576511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345922f-5180-4184-aa49-cf250849a40a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:37.577940 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 656/1323] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:37.584346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d04f-31d6-4a71-99c4-09008d0fd60c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:37.585073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d04f-31d6-4a71-99c4-09008d0fd60c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:37.585073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d04f-31d6-4a71-99c4-09008d0fd60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:37.669575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6684d04f-31d6-4a71-99c4-09008d0fd60c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:37.670911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6684d04f-31d6-4a71-99c4-09008d0fd60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:37.749300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:37.819203 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 668/1324] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:38.103485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345922f-5180-4184-aa49-cf250849a40a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:38.105081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d345922f-5180-4184-aa49-cf250849a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:38.263206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345922f-5180-4184-aa49-cf250849a40a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:38.289830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:38.372344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:38.372876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:38.373165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:38.373428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:38.375100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:38.501817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:38.503500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9fe35-a167-4025-95d3-700a65ab0c79 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:38.524802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 657/1325] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:41.300122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:41.300703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:41.300703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:41.302187 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 669/1326] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:41.312140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e7c16-40ab-422a-8272-ff45510c2353 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:41.312785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e7c16-40ab-422a-8272-ff45510c2353 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:41.313086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e7c16-40ab-422a-8272-ff45510c2353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:41.392549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:41.418436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-088e7c16-40ab-422a-8272-ff45510c2353 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:41.420848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-088e7c16-40ab-422a-8272-ff45510c2353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:41.566751 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 658/1327] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:41.858283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:41.859913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:41.971959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fbf9e-5920-49ba-b423-46845814b01c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:42.058614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:42.059278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:42.059554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:42.059820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:42.061576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:42.084316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:42.206679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:42.208209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813eb54-2a44-4c3b-8931-29019e54e6c6 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:42.230170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 670/1328] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:44.525730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:44.526315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:44.526315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:44.527669 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 659/1329] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:44.533471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca5439-8fdf-4f3a-b556-0e0b2e49e338 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:44.533968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca5439-8fdf-4f3a-b556-0e0b2e49e338 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:44.534159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca5439-8fdf-4f3a-b556-0e0b2e49e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:44.629392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-79ca5439-8fdf-4f3a-b556-0e0b2e49e338 None None] MFA Rules not processed for user `05f0e63e9e434568841950a396b5e81e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:44.630573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79ca5439-8fdf-4f3a-b556-0e0b2e49e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:44.705137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:44.742120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 671/1330] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:45.033205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:45.034769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:45.152834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1606f-9a97-419a-8253-001239e8a973 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:45.197263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:45.245149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:45.245149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:45.245149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:45.245944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:45.247947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:45.387911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:45.389473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162abe7-bbd4-40a3-8e86-ea214ec1363c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:45.410400 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 660/1331] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:48.695323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:48.695904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:48.695904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:48.697203 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 672/1332] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:48.702864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476056-3ef5-4423-b6a7-344c97eafaf6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:48.703368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476056-3ef5-4423-b6a7-344c97eafaf6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:48.703479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476056-3ef5-4423-b6a7-344c97eafaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:48.771939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:48.775321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c3476056-3ef5-4423-b6a7-344c97eafaf6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:48.776595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c3476056-3ef5-4423-b6a7-344c97eafaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:48.881932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 661/1333] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:49.171785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:49.173353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:49.290239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0657919-4f1c-4449-98e4-2299187eae31 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:49.381233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:49.381873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:49.382145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:49.382415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:49.384158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:49.427845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:49.540292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:49.542115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9759b-801d-43ac-9afc-8e711322b6fb service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:49.562503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 673/1334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:19:51.823419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:51.823953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:51.823953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:51.825293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 662/1335] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:51.830667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc0aa-e104-4b42-939c-72c8d9281715 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:51.831112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc0aa-e104-4b42-939c-72c8d9281715 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:51.831268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc0aa-e104-4b42-939c-72c8d9281715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:51.899888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7b1cc0aa-e104-4b42-939c-72c8d9281715 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:51.901128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b1cc0aa-e104-4b42-939c-72c8d9281715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:51.981055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:52.006890 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 674/1336] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:19:52.290305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:52.291909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:52.407782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e6b1-d184-4493-89a5-e9be32d7bd12 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:52.441929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:52.498049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:52.498668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:52.498969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:52.499265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:52.500981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:52.624077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:52.625516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84b8ec-b03f-423f-938e-451f7db02611 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:52.644906 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 663/1337] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:19:55.533581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:55.534109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:55.534109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:55.535661 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 675/1338] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:19:55.542262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296850-92a0-4e31-a942-cfb8c4dfe44b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:55.542770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296850-92a0-4e31-a942-cfb8c4dfe44b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:55.542881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296850-92a0-4e31-a942-cfb8c4dfe44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:55.631911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f4296850-92a0-4e31-a942-cfb8c4dfe44b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:19:55.633157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4296850-92a0-4e31-a942-cfb8c4dfe44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:55.642283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:55.754582 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 664/1339] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:19:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:19:56.082075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:19:56.085760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:56.217255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cf97a-6e1a-475d-81d6-ae8c5aedbaf1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:19:56.298503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:19:56.299229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:19:56.299508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:19:56.299781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:19:56.301444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:19:56.352927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:56.453398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:19:56.454883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8b045-82f1-4258-8727-6581bb96d661 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:19:56.481357 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 676/1340] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:19:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:20:02.056951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:02.057502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:02.058118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:02.060890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 665/1341] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:02.069656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6330-d71c-4045-bbb1-8f38232be6e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:02.070213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6330-d71c-4045-bbb1-8f38232be6e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:02.070213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6330-d71c-4045-bbb1-8f38232be6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:02.169315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6f7c6330-d71c-4045-bbb1-8f38232be6e9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:02.170467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f7c6330-d71c-4045-bbb1-8f38232be6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:02.287835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:02.310086 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 677/1342] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:02.615090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:02.616904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:02.753916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d611c-b9b8-468f-bfb2-f95611406697 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:02.820936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:02.885539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:02.886458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:02.886943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:02.887451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:02.889825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:03.070342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:03.072763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3c608-ee33-4826-a628-c39a74da08bb service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:03.098808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 666/1343] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:20:07.027587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:07.028427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:07.028427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:07.030601 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 678/1344] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:07.040139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d84-2391-49c6-b8df-1fc5cd64806a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:07.040936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d84-2391-49c6-b8df-1fc5cd64806a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:07.040936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54d84-2391-49c6-b8df-1fc5cd64806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:07.163803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c0d54d84-2391-49c6-b8df-1fc5cd64806a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:07.165604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c0d54d84-2391-49c6-b8df-1fc5cd64806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:07.189349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:07.340554 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 667/1345] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:07.738118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:07.741346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:07.970832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dd230-a48c-4257-84a1-c5bb5568f1e1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:08.103311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:08.104354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:08.104765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:08.105160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:08.107354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:08.176885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:08.284614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:08.286711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1e86-ea96-40d9-85f0-ff0205309c3f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:08.315386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 679/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:20:14.951442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:14.951442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:14.952796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:14.954323 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 668/1347] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:14.968415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efe8-ed33-4ef0-9316-85409be592c5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:14.969439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efe8-ed33-4ef0-9316-85409be592c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:14.969439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efe8-ed33-4ef0-9316-85409be592c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:15.113182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bb96efe8-ed33-4ef0-9316-85409be592c5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:15.116121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bb96efe8-ed33-4ef0-9316-85409be592c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:15.341670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:15.346013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 680/1348] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:15.743826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:15.746627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:15.976589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1447a-934d-4c26-bc7e-47d8a0a8e15e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:16.082045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:16.138442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:16.139613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:16.140146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:16.140647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:16.143956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:16.371484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:16.374524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49520f2-029d-4edc-bca5-deafd6f979d7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:16.414045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 669/1349] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:20:23.936291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71cb62-6707-4881-9cd8-9fe6da036753 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:23.939018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71cb62-6707-4881-9cd8-9fe6da036753 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:23.939018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71cb62-6707-4881-9cd8-9fe6da036753 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:23.942497 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 681/1350] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:20:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:23.948373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe516d9-ebda-478c-8c1a-34c46c1737fb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:23.949052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe516d9-ebda-478c-8c1a-34c46c1737fb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:23.949354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe516d9-ebda-478c-8c1a-34c46c1737fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:24.161744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dbe516d9-ebda-478c-8c1a-34c46c1737fb None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:24.163183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dbe516d9-ebda-478c-8c1a-34c46c1737fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:24.199262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:24.339128 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 670/1351] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:20:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:29.229741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5263f-534b-411a-922b-e6acb84bb48c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:29.230311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5263f-534b-411a-922b-e6acb84bb48c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:29.230877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5263f-534b-411a-922b-e6acb84bb48c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:29.234278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 682/1352] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:20:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:29.240346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add27-0e43-44bd-b72d-a22e98a44238 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:29.240346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add27-0e43-44bd-b72d-a22e98a44238 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:29.241198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add27-0e43-44bd-b72d-a22e98a44238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:29.372943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-689add27-0e43-44bd-b72d-a22e98a44238 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:29.374458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-689add27-0e43-44bd-b72d-a22e98a44238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:29.476149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:29.526807 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 671/1353] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:20:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:31.790108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6e0f-4c28-4f08-bee8-b37192acd5cb None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:31.791473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6e0f-4c28-4f08-bee8-b37192acd5cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:31.791866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6e0f-4c28-4f08-bee8-b37192acd5cb None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:31.793665 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 683/1354] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:31.803934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572930-cd87-4789-bf6f-9e043eb73895 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:31.804597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572930-cd87-4789-bf6f-9e043eb73895 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:31.804895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572930-cd87-4789-bf6f-9e043eb73895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:31.958300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c6572930-cd87-4789-bf6f-9e043eb73895 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:31.959850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c6572930-cd87-4789-bf6f-9e043eb73895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:32.129602 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 672/1355] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:20:36.356229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33de2-90e3-41e0-85db-a7c101a44f95 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:36.356937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33de2-90e3-41e0-85db-a7c101a44f95 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:36.356937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33de2-90e3-41e0-85db-a7c101a44f95 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:36.358154 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 684/1356] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:36.364992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ad4-9798-46c9-be80-8728967be777 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:36.365746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ad4-9798-46c9-be80-8728967be777 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:36.365746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ad4-9798-46c9-be80-8728967be777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:36.417505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:36.493097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f6c14ad4-9798-46c9-be80-8728967be777 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:36.495056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f6c14ad4-9798-46c9-be80-8728967be777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:36.702929 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 673/1357] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:37.099004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:37.100915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:37.101957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:37.105922 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 685/1358] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:20:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:37.121429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51f14-fb15-418c-b786-8ebdd33dd0f0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:37.121901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51f14-fb15-418c-b786-8ebdd33dd0f0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:37.122303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51f14-fb15-418c-b786-8ebdd33dd0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:37.275573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d4c51f14-fb15-418c-b786-8ebdd33dd0f0 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:37.277604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4c51f14-fb15-418c-b786-8ebdd33dd0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:37.376818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:37.518734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 674/1359] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:20:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:20:37.528927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:37.532639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:37.952657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c8400-b2ca-4902-bc04-095e9477b673 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:38.090927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:38.163153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:38.164129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:38.164503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:38.164874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:38.167177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:38.305905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:38.308165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ff0a-1b5a-412e-a561-156c5b4ea97f service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:38.341568 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 686/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:20:41.769968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:41.770812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:41.770960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:41.774314 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 675/1361] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:41.782833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c456-37b5-405b-bcf7-bde38896ab5b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:41.783783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c456-37b5-405b-bcf7-bde38896ab5b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:41.784361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c456-37b5-405b-bcf7-bde38896ab5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:41.921263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3269c456-37b5-405b-bcf7-bde38896ab5b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:41.923392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3269c456-37b5-405b-bcf7-bde38896ab5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:41.975488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:42.070903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 687/1362] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:42.611989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:42.616571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:42.951629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2725-eaa9-4ecd-b737-4d076d3e8763 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:42.972162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:43.191087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:43.191087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:43.191087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:43.191087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:43.192560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:43.323384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:43.327058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135a19-7f92-478f-b360-e9119bee3c75 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:43.361977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 676/1363] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:20:47.470051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4280b-1770-4980-88ce-12af8c9940fb None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:47.470663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4280b-1770-4980-88ce-12af8c9940fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:47.470663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4280b-1770-4980-88ce-12af8c9940fb None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:47.472479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 688/1364] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:47.479029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137db6-1348-4070-91d9-9c647d6c7511 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:47.481956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137db6-1348-4070-91d9-9c647d6c7511 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:47.485021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137db6-1348-4070-91d9-9c647d6c7511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:47.555317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:47.637665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-49137db6-1348-4070-91d9-9c647d6c7511 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:47.638958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-49137db6-1348-4070-91d9-9c647d6c7511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:47.809370 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 677/1365] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:48.150338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:48.151944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:48.152535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:48.154914 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 689/1366] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:48.166897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e453b-cec5-4240-a6f2-982e642d1185 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:48.167394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e453b-cec5-4240-a6f2-982e642d1185 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:48.167854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e453b-cec5-4240-a6f2-982e642d1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:48.380817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c15e453b-cec5-4240-a6f2-982e642d1185 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:48.382528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c15e453b-cec5-4240-a6f2-982e642d1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:48.464036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:48.633527 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 678/1367] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:20:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:48.649215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:48.652113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:49.019383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a6b3d-40c5-4676-b8ae-083d51bf0523 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:49.064519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:49.266750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:49.268689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:49.269511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:49.270203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:49.273850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:49.529624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:49.533059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71dda-e97b-4918-979e-9f05c968e7a8 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:49.563726 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 690/1368] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:20:52.772407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:52.773309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:52.773773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:52.781278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 679/1369] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:52.783107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcee9e-6a68-4286-8220-cd6135853675 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:52.784611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcee9e-6a68-4286-8220-cd6135853675 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:52.785042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcee9e-6a68-4286-8220-cd6135853675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:52.833263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:52.892052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bddcee9e-6a68-4286-8220-cd6135853675 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:52.896697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bddcee9e-6a68-4286-8220-cd6135853675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:53.091214 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 691/1370] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:53.423017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:53.428874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:53.569205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400c67-c722-4e06-bfb4-781d5099e894 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:53.569619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400c67-c722-4e06-bfb4-781d5099e894 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:53.570213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400c67-c722-4e06-bfb4-781d5099e894 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:53.575948 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 692/1371] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:20:53.580205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44151-deea-471d-a1c6-16cb22a6a397 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:53.580620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44151-deea-471d-a1c6-16cb22a6a397 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:53.587651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44151-deea-471d-a1c6-16cb22a6a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:53.788145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:53.804584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ceff-5e5a-4db2-b1e6-e4af274ead42 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:53.804751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1de44151-deea-471d-a1c6-16cb22a6a397 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:53.806561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1de44151-deea-471d-a1c6-16cb22a6a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:53.949357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:54.031388 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 693/1372] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:20:54.104291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:54.106749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:54.108202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:54.108862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:54.111661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:54.283257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:54.285828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8b5be-bc08-4532-82ef-07f5ea38cbde service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:54.306603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:54.311703 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 680/1373] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 893 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:20:54.648202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:54.648202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:54.648202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:54.651618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 694/1374] 10.222.0.78 () {54 vars in 963 bytes} [Tue Oct 4 20:20:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:54.659292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929fb2-1058-48db-999b-465bb92af1f6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:54.660125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929fb2-1058-48db-999b-465bb92af1f6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:54.660125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929fb2-1058-48db-999b-465bb92af1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:54.832993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-44929fb2-1058-48db-999b-465bb92af1f6 None None] MFA Rules not processed for user `a554eb26060549b48a431c579659ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:54.835505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-44929fb2-1058-48db-999b-465bb92af1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:54.966379 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 681/1375] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 4 20:20:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:20:54.975994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:54.977864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:55.196474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93398-f252-4503-842f-02a9639c2b1a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:55.333825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:55.335254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:55.335842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:55.336331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:55.339110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:55.353498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:55.526469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:55.529542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6add57-a442-40df-8dc9-c525e39d6667 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:55.571034 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 695/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:20:57.537979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:57.538870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:57.538870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:57.541415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 682/1377] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:20:57.550710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1d5a-656b-4268-8938-38aaadff9e93 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:57.551540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1d5a-656b-4268-8938-38aaadff9e93 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:57.551672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1d5a-656b-4268-8938-38aaadff9e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:57.699195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f89c1d5a-656b-4268-8938-38aaadff9e93 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:20:57.702129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f89c1d5a-656b-4268-8938-38aaadff9e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:57.829726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:57.892978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 696/1378] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:20:58.332457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:20:58.334713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:58.497192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:58.582495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85c5a6-af15-4318-baeb-aa8215b6def3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:20:58.811385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:20:58.812294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:20:58.812763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:20:58.813113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:20:58.815037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:20:58.922659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:59.009313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:20:59.013629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef6eb7-3b48-447a-8796-13f8f490bac9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:20:59.054282 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 683/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:01.802748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:01.803603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:01.803603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:01.804720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 697/1380] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:21:01.810675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17cb9-5f3e-4de3-8dca-49088bd6fc85 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:01.811688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17cb9-5f3e-4de3-8dca-49088bd6fc85 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:01.812196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c17cb9-5f3e-4de3-8dca-49088bd6fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:01.919203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83c17cb9-5f3e-4de3-8dca-49088bd6fc85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:01.923289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83c17cb9-5f3e-4de3-8dca-49088bd6fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:02.099779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 684/1381] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:02.465959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:02.468255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:02.732836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cb56-ba5f-4667-96eb-b7b79777f1af None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:02.802509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:02.903164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:02.904225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:02.904225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:02.904692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:02.906686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:03.083829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:03.085781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd1d7e-70e7-4f1e-a070-009652c5b4ec service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:03.120456 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 698/1382] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:06.054546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:06.055470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:06.055645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:06.058194 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 685/1383] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:06.068025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03ca78-6ce8-4661-8d1e-0de7b21d8c53 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:06.069395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03ca78-6ce8-4661-8d1e-0de7b21d8c53 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:06.069830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03ca78-6ce8-4661-8d1e-0de7b21d8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:06.195486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6c03ca78-6ce8-4661-8d1e-0de7b21d8c53 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:06.196999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c03ca78-6ce8-4661-8d1e-0de7b21d8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:06.201790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:06.425705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 699/1384] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:06.771459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:06.773419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:06.821781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:07.009300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507996-652d-48c9-89d0-f6afe8882406 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:07.172012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:07.183715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:07.184732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:07.185078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:07.185536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:07.187637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:07.366573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:07.368457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fb092-d865-445d-8497-8d8d443a5b48 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:07.404665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 686/1385] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:10.206784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:10.207417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:10.207893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:10.211085 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 700/1386] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:10.217503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca0f9-dfe3-43ca-993b-e5681f30913a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:10.218488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca0f9-dfe3-43ca-993b-e5681f30913a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:10.218488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca0f9-dfe3-43ca-993b-e5681f30913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:10.321323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-877ca0f9-dfe3-43ca-993b-e5681f30913a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:10.322613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-877ca0f9-dfe3-43ca-993b-e5681f30913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:10.412176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:10.461804 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 687/1387] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:10.770681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:10.773144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:11.020347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:11.062692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1128d-4147-4458-885d-80b1beadfc5b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:11.259611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:11.260940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:11.261414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:11.261901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:11.265196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:11.455591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:11.457514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19c356-e1cf-4a5c-8897-e0d56eaa77fc service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:11.463293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:11.481089 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 701/1388] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:14.642692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:14.643507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:14.643733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:14.646499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 688/1389] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:14.656465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc308-5e94-4d79-9b4e-d8ca02f33dc0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:14.657384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc308-5e94-4d79-9b4e-d8ca02f33dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:14.657384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc308-5e94-4d79-9b4e-d8ca02f33dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:14.760538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e97dc308-5e94-4d79-9b4e-d8ca02f33dc0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:14.762239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e97dc308-5e94-4d79-9b4e-d8ca02f33dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:14.915160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 702/1390] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:15.266902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:15.269888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:15.547111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13e83-27b5-48b6-a12a-23e04723069f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:15.637264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:15.755828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:15.757021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:15.757570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:15.758063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:15.761258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:15.933806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:15.936917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f97a7-d464-4716-92b3-87c10a3e59ca service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:15.975311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 689/1391] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:16.310713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59666d-413f-44e9-b0b6-e12ddf33bf56 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:16.311583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59666d-413f-44e9-b0b6-e12ddf33bf56 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:16.311583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59666d-413f-44e9-b0b6-e12ddf33bf56 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:16.312755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 703/1392] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:16.319473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749e37-ef97-4e25-8505-07ddf4820688 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:16.319839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749e37-ef97-4e25-8505-07ddf4820688 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:16.320184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749e37-ef97-4e25-8505-07ddf4820688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:16.431876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-42749e37-ef97-4e25-8505-07ddf4820688 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:16.434117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42749e37-ef97-4e25-8505-07ddf4820688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:16.449023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:16.623444 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 690/1393] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:21:17.041113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:17.041538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:17.041912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:17.043556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 704/1394] 10.222.0.78 () {54 vars in 962 bytes} [Tue Oct 4 20:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:17.050583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202432c-641b-443e-9fb8-b8c0208a45db None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:17.051499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202432c-641b-443e-9fb8-b8c0208a45db None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:17.051499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202432c-641b-443e-9fb8-b8c0208a45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:17.167498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3202432c-641b-443e-9fb8-b8c0208a45db None None] MFA Rules not processed for user `426a3d7b9b2248b6b22051224a4baa17`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:17.169293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3202432c-641b-443e-9fb8-b8c0208a45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:17.323991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 691/1395] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 4 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:21:17.341315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:17.344017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:17.462959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:17.530367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb4f8d-4ad4-402f-a0ab-901ea0ab2ad1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:17.665482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:17.666631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:17.667226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:17.667698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:17.670015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:17.894954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:17.896701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c8c10-fb7f-4203-9afe-deb420224fa8 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:17.917952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:17.921912 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 705/1396] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:21:19.287212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:19.287709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:19.287877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:19.289441 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 692/1397] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:19.296028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9265ee2-01e6-4540-b9a6-4081584020c1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:19.296868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9265ee2-01e6-4540-b9a6-4081584020c1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:19.296868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9265ee2-01e6-4540-b9a6-4081584020c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:19.421611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d9265ee2-01e6-4540-b9a6-4081584020c1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:19.423089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9265ee2-01e6-4540-b9a6-4081584020c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:19.574072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 706/1398] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:19.924072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:19.925679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:19.929205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:20.121386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06c3e-4056-4653-b3a2-8e08fd6b8378 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:20.121386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06c3e-4056-4653-b3a2-8e08fd6b8378 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:20.121973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06c3e-4056-4653-b3a2-8e08fd6b8378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:20.229387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9eb7-76ba-47d0-81dc-e0c4af1ebcfc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:20.243349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8de06c3e-4056-4653-b3a2-8e08fd6b8378 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:20.245436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8de06c3e-4056-4653-b3a2-8e08fd6b8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:20.303249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:20.369655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:20.399355 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 707/1399] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:20.439118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:20.440281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:20.440913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:20.441411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:20.444931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:20.477471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbdef7-9ad3-4120-9e18-74840166a211 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:20.477812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbdef7-9ad3-4120-9e18-74840166a211 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:20.478210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbdef7-9ad3-4120-9e18-74840166a211 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:20.480949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 708/1400] 10.222.0.78 () {54 vars in 943 bytes} [Tue Oct 4 20:21:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:21:20.490338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c02b0-a76c-4705-a1b8-f6215996872e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:20.491355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c02b0-a76c-4705-a1b8-f6215996872e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:20.492254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c02b0-a76c-4705-a1b8-f6215996872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:20.612256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:20.614341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:20.617174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-628c02b0-a76c-4705-a1b8-f6215996872e None None] MFA Rules not processed for user `18d4e38ee31a4ab3a21e998803226465`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:20.618638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-628c02b0-a76c-4705-a1b8-f6215996872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:20.644018 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 693/1401] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:20.782852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 709/1402] 10.222.0.78 () {58 vars in 1040 bytes} [Tue Oct 4 20:21:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:21:20.794971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:20.796564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:20.922605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5926d-97f1-44ab-9071-a1be5dbb4a15 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:20.927364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:21.091455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:21.095664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:21.095664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:21.095664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:21.095664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:21.254284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:21.259712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b172-de39-4c5d-9d53-3990e41d2340 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:21.269521 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 694/1403] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:21:24.264802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:24.265613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:24.267575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:24.270563 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 710/1404] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:21:24.281338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11784-73fb-49e0-808d-dd07da81937e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:24.282197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11784-73fb-49e0-808d-dd07da81937e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:24.282839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11784-73fb-49e0-808d-dd07da81937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:24.369995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:24.415715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d5c11784-73fb-49e0-808d-dd07da81937e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:24.417369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5c11784-73fb-49e0-808d-dd07da81937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:24.577833 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 695/1405] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:25.092269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:25.095229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:25.100469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:25.448465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd74e5-a205-44b3-9842-7eba483c354d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:25.630003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:25.718175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:25.719177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:25.719708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:25.720183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:25.723582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:25.909502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:25.911623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31483b-f72e-440c-97ed-355eb5ea6211 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:25.943013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 711/1406] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:29.233435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:29.234543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:29.234543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:29.237908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 696/1407] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:21:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:29.249093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e99d3-f85d-4dce-b706-81d8d4a1f658 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:29.249093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e99d3-f85d-4dce-b706-81d8d4a1f658 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:29.249093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e99d3-f85d-4dce-b706-81d8d4a1f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:29.379880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5b4e99d3-f85d-4dce-b706-81d8d4a1f658 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:29.381445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b4e99d3-f85d-4dce-b706-81d8d4a1f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:29.459276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:29.573694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 712/1408] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:30.129221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:30.132144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:30.377916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:30.460788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abab7-eb01-4185-81b4-53ba466adeab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:30.711565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:30.712627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:30.713132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:30.713652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:30.716936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:30.895454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:30.925921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:30.933542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99cfab-7747-460e-b8ee-b26473fd82cb service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:30.967181 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 697/1409] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:39.573798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=26 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:40.962351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=11 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:52.467639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8ffe-fb80-4d67-b230-115f1295f4ee None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:52.468501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8ffe-fb80-4d67-b230-115f1295f4ee None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:52.468501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8ffe-fb80-4d67-b230-115f1295f4ee None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:52.470395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 713/1410] 10.222.0.78 () {54 vars in 918 bytes} [Tue Oct 4 20:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:52.477769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc689c-6c6c-473a-8311-6ecf91ae7ff6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:52.478591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc689c-6c6c-473a-8311-6ecf91ae7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:52.478781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc689c-6c6c-473a-8311-6ecf91ae7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:52.629987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-04cc689c-6c6c-473a-8311-6ecf91ae7ff6 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:52.632320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-04cc689c-6c6c-473a-8311-6ecf91ae7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:52.798380 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 698/1411] 10.222.0.78 () {58 vars in 1015 bytes} [Tue Oct 4 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:52.821236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290267-2c57-43c4-b176-7a5e8968c0c5 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:52.821545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290267-2c57-43c4-b176-7a5e8968c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:52.821858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290267-2c57-43c4-b176-7a5e8968c0c5 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:52.823393 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 714/1412] 10.222.0.78 () {54 vars in 918 bytes} [Tue Oct 4 20:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:52.830510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84d82-c9d4-4884-bc84-48d08502a0ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:52.830987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84d82-c9d4-4884-bc84-48d08502a0ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:52.831499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84d82-c9d4-4884-bc84-48d08502a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:52.961126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:52.965428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bce84d82-c9d4-4884-bc84-48d08502a0ec None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:52.966742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bce84d82-c9d4-4884-bc84-48d08502a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:53.133487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 699/1413] 10.222.0.78 () {58 vars in 1015 bytes} [Tue Oct 4 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:55.884994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:55.886002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:55.886002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:55.888518 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:55.897773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d0100-e3ca-4070-a556-dbf8f84c192e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:55.898347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d0100-e3ca-4070-a556-dbf8f84c192e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:55.898347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d0100-e3ca-4070-a556-dbf8f84c192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:55.989975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-910d0100-e3ca-4070-a556-dbf8f84c192e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:55.991387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-910d0100-e3ca-4070-a556-dbf8f84c192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:56.059947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:56.122955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:56.419594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:56.421933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:56.613320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55db52-a529-4dc0-8eb9-0fc96022866f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:56.746017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:56.806915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:56.808028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:56.808686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:56.809079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:56.812327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:56.937670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:56.939311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d58e5-4025-4408-9ae3-04dc60247e50 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:56.967703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 716/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:58.221909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:58.222513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:58.222902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:58.225551 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:21:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:21:58.232885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dca8-fb35-45a9-ad29-ce51f82936ad None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:58.233456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dca8-fb35-45a9-ad29-ce51f82936ad None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:58.233456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dca8-fb35-45a9-ad29-ce51f82936ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:58.326854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8c78dca8-fb35-45a9-ad29-ce51f82936ad None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:21:58.329652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c78dca8-fb35-45a9-ad29-ce51f82936ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:58.376581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:58.473058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:21:58.648603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:21:58.650164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:58.861870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a855e1-5cbc-492e-acc2-237bc490642f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:21:58.911416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:58.996713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:21:58.997346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:21:58.997629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:21:58.997902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:21:58.999643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:21:59.123901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:21:59.127711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc1683-e157-4622-a5c3-45c48bda1d82 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:21:59.156576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 702/1419] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:22:00.490804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:00.491640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:00.491640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:00.494102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:00.502648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c46e-ce11-4075-86dd-45fe3f226eb3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:00.503515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c46e-ce11-4075-86dd-45fe3f226eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:00.503757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c46e-ce11-4075-86dd-45fe3f226eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:00.576573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:00.606239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fb30c46e-ce11-4075-86dd-45fe3f226eb3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:00.607719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb30c46e-ce11-4075-86dd-45fe3f226eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:00.758981 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:00.919813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:00.922632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:01.159123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c75427-4b3e-43dc-b242-85ebbf6d059b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:01.173802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:01.318674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:01.319962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:01.320400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:01.320951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:01.323911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:01.511426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:01.514663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0f144-8f76-43ab-bfbd-baef39d6dc57 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:01.553481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 719/1422] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:02.798531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56542-0551-495e-9189-f7419b056dfa None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:02.799219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56542-0551-495e-9189-f7419b056dfa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:02.799609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56542-0551-495e-9189-f7419b056dfa None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:02.802352 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:02.812354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02bb79-4542-4077-9a13-8eb1437885a7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:02.813192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02bb79-4542-4077-9a13-8eb1437885a7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:02.813192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02bb79-4542-4077-9a13-8eb1437885a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:02.847741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:02.920428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cf02bb79-4542-4077-9a13-8eb1437885a7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:02.922182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cf02bb79-4542-4077-9a13-8eb1437885a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:03.048004 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:03.203745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56542-0551-495e-9189-f7419b056dfa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:03.205710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-33e56542-0551-495e-9189-f7419b056dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:03.369819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:03.426061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56542-0551-495e-9189-f7419b056dfa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:03.604495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:03.605556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:03.606029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:03.606499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:03.609607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:03.726805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:03.752927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:03.756125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61802-ce60-4ca8-b32e-bcf6a4de6bdf service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:03.792324 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 705/1425] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:04.995032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:04.995594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:04.996004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:04.997707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:05.004919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5be4-56ec-4377-b5bd-7a953dbf43eb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:05.005615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5be4-56ec-4377-b5bd-7a953dbf43eb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:05.005615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5be4-56ec-4377-b5bd-7a953dbf43eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:05.106129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-108a5be4-56ec-4377-b5bd-7a953dbf43eb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:05.107509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-108a5be4-56ec-4377-b5bd-7a953dbf43eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:05.237259 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:05.399028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:05.400663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:05.522660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:05.597624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0493e-75d2-442e-bd6b-4d9d7a58863f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:05.722405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:05.723019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:05.723333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:05.723609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:05.725263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:05.781513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:05.829247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:05.832735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3100be-7741-43e7-b77d-525dc692ba7e service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:05.864599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 722/1428] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:07.247689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:07.248495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:07.248495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:07.250757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:07.258325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41906d-9cd1-4ae4-8297-19bc9e05eb14 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:07.258904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41906d-9cd1-4ae4-8297-19bc9e05eb14 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:07.259509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41906d-9cd1-4ae4-8297-19bc9e05eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:07.370090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8e41906d-9cd1-4ae4-8297-19bc9e05eb14 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:07.371472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8e41906d-9cd1-4ae4-8297-19bc9e05eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:07.494548 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:07.657243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:07.658788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:07.732608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:07.883345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a26f-9c3e-4618-9408-33427d9cf4ae None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:08.025168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:08.025691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:08.025970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:08.026238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:08.027948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:08.035493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:08.134773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:08.136552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d121-c550-4198-ab83-28adb077884b service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:08.160024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 708/1431] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:09.545587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:09.546657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:09.546657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:09.548564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:09.557505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0011b8-4c32-4e5e-ba08-250dc2adacf8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:09.559910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0011b8-4c32-4e5e-ba08-250dc2adacf8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:09.559910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0011b8-4c32-4e5e-ba08-250dc2adacf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:09.671294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cb0011b8-4c32-4e5e-ba08-250dc2adacf8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:09.672570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb0011b8-4c32-4e5e-ba08-250dc2adacf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:09.772412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:09.804426 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:09.958657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:09.960398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:09.978988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:10.157289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad339-2026-4076-8aae-5326bfe408d5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:10.266727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:10.297686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:10.298334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:10.298614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:10.298891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:10.300744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:10.418301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:10.419882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a7a87-15f5-4d2d-89b7-91912226168f service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:10.443867 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 725/1434] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:11.768606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:11.769400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:11.769400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:11.770560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:22:11.777623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471223b-623e-470a-8b81-9fc27bcb9181 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:11.778186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471223b-623e-470a-8b81-9fc27bcb9181 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:11.778186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471223b-623e-470a-8b81-9fc27bcb9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:11.866510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f471223b-623e-470a-8b81-9fc27bcb9181 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:11.867886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f471223b-623e-470a-8b81-9fc27bcb9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:11.913905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:12.000928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:12.153728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:12.157086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:12.354833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d361-cbca-431f-a542-d3a84aa17488 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:12.422623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:12.518178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:12.518830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:12.519102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:12.519410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:12.521218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:12.656505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:12.658314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba523b-5c70-4470-877d-11647c690f5b service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:12.685078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 711/1437] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:13.986436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:13.987064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:13.987064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:13.988337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:22:13.996823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06c5c-a063-44f6-8662-a235251e7654 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:13.997474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06c5c-a063-44f6-8662-a235251e7654 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:13.997474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06c5c-a063-44f6-8662-a235251e7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:14.088577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-17d06c5c-a063-44f6-8662-a235251e7654 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:14.089864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-17d06c5c-a063-44f6-8662-a235251e7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:14.092894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:14.211448 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:22:14.367721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:14.369319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:14.555304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f706d70-a13a-4377-b030-a1215689b9a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:14.596984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:14.710189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:14.710832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:14.711144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:14.711414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:14.713168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:14.821780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:14.823577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276638-ed5b-41a3-b533-d305175e85eb service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:14.846114 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 728/1440] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:17.171773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:17.172373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:17.172373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:17.173652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:17.179502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9117-c93d-4fee-bba2-b1ca517620bb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:17.179970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9117-c93d-4fee-bba2-b1ca517620bb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:17.180103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9117-c93d-4fee-bba2-b1ca517620bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:17.225289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:17.256761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e40e9117-c93d-4fee-bba2-b1ca517620bb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:17.258011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e40e9117-c93d-4fee-bba2-b1ca517620bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:17.378887 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:17.698747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:17.700395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:17.826012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd311d-c920-408c-bfbb-6562e87dd519 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:17.868319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:17.929324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:17.930106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:17.930519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:17.930954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:17.933167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:18.095037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:18.096813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0404bf-2189-4a89-97b4-688534a3f3a7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:18.123706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 714/1443] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:20.666734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:20.667359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:20.667811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:20.670956 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:20.680613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f425e5-cb5a-4952-97a7-b9061ba0290a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:20.681276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f425e5-cb5a-4952-97a7-b9061ba0290a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:20.681849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f425e5-cb5a-4952-97a7-b9061ba0290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:20.772949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e8f425e5-cb5a-4952-97a7-b9061ba0290a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:20.774216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8f425e5-cb5a-4952-97a7-b9061ba0290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:20.788910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:20.892275 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:21.192482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:21.195923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:21.365458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531dfa4-93fd-4cf2-93ba-9428a253552b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:21.388502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:21.491597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:21.492274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:21.492597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:21.493054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:21.494798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:21.642657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:21.644255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dea5f-4d27-490c-a392-e32c9d0a15ee service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:21.666335 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 731/1446] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:24.698550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:24.699361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:24.699361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:24.700492 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:22:24.706883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d397-a7db-4a86-acae-0d012e647ee8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:24.707512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d397-a7db-4a86-acae-0d012e647ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:24.707512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d397-a7db-4a86-acae-0d012e647ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:24.773511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:24.795707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6a43d397-a7db-4a86-acae-0d012e647ee8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:24.796943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a43d397-a7db-4a86-acae-0d012e647ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:24.948507 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:25.246138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:25.248605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:25.405029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f3f5-4def-49be-9f0c-a92076bc04bc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:25.457343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:25.513941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:25.516818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:25.516818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:25.516818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:25.516818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:25.682305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:25.685374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7d8ef-b32b-476c-ae99-b1101f385b14 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:25.711476 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 717/1449] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:22:28.273014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:28.273621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:28.273621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:28.274950 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:22:28.282394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6b7e-7220-4afc-bbc5-1360618f6add None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:28.283001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6b7e-7220-4afc-bbc5-1360618f6add None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:28.283181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6b7e-7220-4afc-bbc5-1360618f6add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:28.366121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9f2c6b7e-7220-4afc-bbc5-1360618f6add None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:28.367433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f2c6b7e-7220-4afc-bbc5-1360618f6add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:28.403722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:28.489377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:28.784051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:28.786950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:28.957380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2604-b426-4690-a9e5-972545955746 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:28.981645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:29.048051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:29.048672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:29.048948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:29.049223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:29.050898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:29.194397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:29.195875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e11044-bcc8-4286-800d-d4863f8e1065 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:29.219603 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 734/1452] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:31.567816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:31.568421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:31.568548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:31.569990 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:31.576498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8fc0-dcc5-4e90-a16f-0b81a2d04939 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:31.577046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8fc0-dcc5-4e90-a16f-0b81a2d04939 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:31.577169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8fc0-dcc5-4e90-a16f-0b81a2d04939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:31.698777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:31.706750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d35f8fc0-dcc5-4e90-a16f-0b81a2d04939 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:31.717410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d35f8fc0-dcc5-4e90-a16f-0b81a2d04939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:31.871524 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:32.352174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:32.355172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:32.520848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29277f98-e2a7-46a7-8946-5ad5d1e04a8a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:32.618329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:32.647060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:32.647699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:32.647982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:32.648259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:32.649916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:32.816061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:32.817610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8d47-1515-4a67-beb8-ab52b7c393bb service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:32.841191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 720/1455] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:35.141448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:35.142084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:35.142084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:35.143339 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:35.149356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b0af2-cbb5-4490-abf3-a318cd0ca8ba None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:35.149865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b0af2-cbb5-4490-abf3-a318cd0ca8ba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:35.149982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b0af2-cbb5-4490-abf3-a318cd0ca8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:35.225096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-907b0af2-cbb5-4490-abf3-a318cd0ca8ba None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:35.226239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-907b0af2-cbb5-4490-abf3-a318cd0ca8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:35.257479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:35.334322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:35.632532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:35.634087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:35.746908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cce85-05b5-429d-9b42-3120831081ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:35.776648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:35.826483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:35.827123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:35.827425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:35.827708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:35.829550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:35.942993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:35.944403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b511882-7a92-49e3-b97f-4ddf93462c9e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:35.963417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 737/1458] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:38.312882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:38.313527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:38.313527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:38.314986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:38.324592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927452-c58c-4429-8a42-7fb595e9a1f8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:38.325351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927452-c58c-4429-8a42-7fb595e9a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:38.325351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03927452-c58c-4429-8a42-7fb595e9a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:38.401695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-03927452-c58c-4429-8a42-7fb595e9a1f8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:38.402905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03927452-c58c-4429-8a42-7fb595e9a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:38.412080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:38.517803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:38.814735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:38.817950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:38.933471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac510e11-4302-4e33-95ed-d8e549c13c4c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:38.997402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:39.020224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:39.020875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:39.021197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:39.021485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:39.023175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:39.142058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:39.143577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10950232-5c9f-4e7e-b840-e81b3d00915e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:39.164717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 723/1461] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:41.476038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:41.476755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:41.476755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:41.477970 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:41.484566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd588d-858a-4f5f-b269-99f5cc705382 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:41.485171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd588d-858a-4f5f-b269-99f5cc705382 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:41.485171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd588d-858a-4f5f-b269-99f5cc705382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:41.564609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-20fd588d-858a-4f5f-b269-99f5cc705382 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:41.565852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20fd588d-858a-4f5f-b269-99f5cc705382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:41.727290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:41.790745 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:42.083380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:42.084946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:42.202547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955e417-ce27-42dc-a269-15d982337a92 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:42.254660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:42.292448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:42.293099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:42.293332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:42.293606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:42.295875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:42.417867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:42.419926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757750-2d97-4d10-a5b8-7bd30899147c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:42.442035 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 740/1464] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:44.708245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:44.708834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:44.708834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:44.710142 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:44.717121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1bae-1162-4a0b-9d04-63c79b3f76c1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:44.717646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1bae-1162-4a0b-9d04-63c79b3f76c1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:44.717646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1bae-1162-4a0b-9d04-63c79b3f76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:44.796925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-49db1bae-1162-4a0b-9d04-63c79b3f76c1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:44.798227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-49db1bae-1162-4a0b-9d04-63c79b3f76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:44.820205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:44.909150 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:45.202506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:45.204265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:45.324303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c34f8e-cabf-4927-84e1-49388d3192fb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:45.411359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:45.419754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:45.420381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:45.420661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:45.420933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:45.422592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:45.551279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:45.552656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf295ef-6b46-4f3d-b77e-f497284c89dd service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:45.573003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 726/1467] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:47.802318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:47.802916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:47.803018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:47.805836 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:22:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:22:47.813382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14395-8ecb-4a53-9522-7c5b8715b86c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:47.813953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14395-8ecb-4a53-9522-7c5b8715b86c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:47.814413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14395-8ecb-4a53-9522-7c5b8715b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:47.910258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-88f14395-8ecb-4a53-9522-7c5b8715b86c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:22:47.911540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88f14395-8ecb-4a53-9522-7c5b8715b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:47.963399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:48.018928 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:22:48.307261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:22:48.308906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:48.428466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74682cff-781a-4563-9837-5f1d7e6932d1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:22:48.491182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:48.522544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:22:48.523191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:22:48.523470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:22:48.523744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:22:48.526269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:22:48.657170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:22:48.658663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675ba1-362c-461e-b31c-c55d78487474 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:22:48.678749 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 743/1470] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:22:58.017406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=22 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:22:58.676379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=66 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:09.479428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbb1b-e9b3-4899-8869-3c4ff0f16cd7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:09.479973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbb1b-e9b3-4899-8869-3c4ff0f16cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:09.479973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dbb1b-e9b3-4899-8869-3c4ff0f16cd7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:09.481834 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 728/1471] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:09.487928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527906-3bf6-4aba-814a-cb73976edeab None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:09.488623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527906-3bf6-4aba-814a-cb73976edeab None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:09.488623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527906-3bf6-4aba-814a-cb73976edeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:09.564376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fc527906-3bf6-4aba-814a-cb73976edeab None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:09.565630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fc527906-3bf6-4aba-814a-cb73976edeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:09.685617 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 744/1472] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:23:09.994344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:09.994627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:09.994905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:09.996285 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 729/1473] 10.222.0.78 () {54 vars in 962 bytes} [Tue Oct 4 20:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:10.001506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb374d-5c99-4e96-bd99-7c985bae085b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:10.001795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb374d-5c99-4e96-bd99-7c985bae085b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:10.002077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb374d-5c99-4e96-bd99-7c985bae085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:10.083762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8bcb374d-5c99-4e96-bd99-7c985bae085b None None] MFA Rules not processed for user `426a3d7b9b2248b6b22051224a4baa17`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:10.084982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bcb374d-5c99-4e96-bd99-7c985bae085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:10.107313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:10.169573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 745/1474] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 4 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:10.178021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:10.179666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:10.305289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d525ad-a3d5-4d2a-966d-73fa5ea6772c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:10.393021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:10.393632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:10.393909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:10.394182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:10.395855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:10.461816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:10.530757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:10.532129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8a8d-10bd-4205-80c5-8f9068557dc0 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:10.552970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 730/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:12.911305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:12.911894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:12.912083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:12.913658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 746/1476] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:12.920664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025e2a-1ff8-4207-9a76-0464a0145d1a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:12.921275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025e2a-1ff8-4207-9a76-0464a0145d1a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:12.921275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025e2a-1ff8-4207-9a76-0464a0145d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:13.001794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-93025e2a-1ff8-4207-9a76-0464a0145d1a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:13.003068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-93025e2a-1ff8-4207-9a76-0464a0145d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:13.117774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 731/1477] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:13.395721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:13.397311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:13.548388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0d69-0736-4c43-a5fc-a839db018ced None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:13.605141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:13.655862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:13.656841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:13.657394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:13.657740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:13.658652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:13.661295 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:23:13.661295 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:23:13.661295 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:23:13.662741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf459ac-ba39-4de9-aa50-57115ac245de admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:13.684926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 747/1478] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 4 20:23:13 2022] GET /identity/v3/projects => generated 2553 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:23:15.945817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:15.946359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:15.946359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:15.947678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 732/1479] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:15.954308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55786-8070-4ae9-b193-b4c837185dac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:15.954827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55786-8070-4ae9-b193-b4c837185dac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:15.954938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55786-8070-4ae9-b193-b4c837185dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:16.035752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6fe55786-8070-4ae9-b193-b4c837185dac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:16.037202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fe55786-8070-4ae9-b193-b4c837185dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:16.146043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 748/1480] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:16.440840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:16.442447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:16.453279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:16.599278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0351f00-2d7c-40eb-81a9-c72e4d9a31d3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:16.690005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:16.725834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:16.726440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:16.726717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:16.726985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:16.728639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:16.834452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:16.836107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3da5-ed30-43a1-9473-6c886919ae7a service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:16.859381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 733/1481] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:19.255164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:19.255798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:19.255798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:19.257107 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 749/1482] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:23:19.262829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38921-7944-4b65-8e8b-46f2a5381200 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:19.263365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38921-7944-4b65-8e8b-46f2a5381200 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:19.263470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38921-7944-4b65-8e8b-46f2a5381200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:19.334571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c3c38921-7944-4b65-8e8b-46f2a5381200 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:19.335840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c3c38921-7944-4b65-8e8b-46f2a5381200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:19.385556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:19.441511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 734/1483] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:19.741503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:19.743102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:19.769002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:19.860610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a3f5e-0ea4-4239-a242-29acfb5325d7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:19.939256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:19.939745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:19.940027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:19.940301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:19.942036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:20.030530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:20.069348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:20.070869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994fe1-3b36-492d-a88e-8c621edd6bb0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:20.092772 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 750/1484] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:22.441545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:22.442112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:22.442112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:22.443663 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 735/1485] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:23:22.451881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b80e7-90f7-4194-aec8-dfb3ab3d3403 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:22.452853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b80e7-90f7-4194-aec8-dfb3ab3d3403 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:22.452853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b80e7-90f7-4194-aec8-dfb3ab3d3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:22.554732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fb0b80e7-90f7-4194-aec8-dfb3ab3d3403 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:22.556088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb0b80e7-90f7-4194-aec8-dfb3ab3d3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:22.686571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 751/1486] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:23.012691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:23.015616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:23.173773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eda71-a16a-4bdd-af28-6e2a5c35d729 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:23.273551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:23.275279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:23.275903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:23.276179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:23.276943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:23.278662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:23.434275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:23.436241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9ec53-af1b-429b-9b0a-520befc42df4 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:23.469757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 736/1487] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:25.931210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:25.931954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:25.931954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:25.933582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 752/1488] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:25.939454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803b2c-9cfa-4011-ac58-ee6c1937ce37 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:25.940282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803b2c-9cfa-4011-ac58-ee6c1937ce37 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:25.940473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803b2c-9cfa-4011-ac58-ee6c1937ce37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:26.012628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e6803b2c-9cfa-4011-ac58-ee6c1937ce37 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:26.013876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6803b2c-9cfa-4011-ac58-ee6c1937ce37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:26.077663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:26.126028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 737/1489] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:26.430782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:26.432716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:26.472429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:26.546775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe875e5d-4998-4ecb-8bc1-e1dcc691cce9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:26.627936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:26.628551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:26.628830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:26.629132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:26.630793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:26.718978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:26.748301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:26.749753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1568cb2-8a79-43ce-85b3-9a91b41fd1d5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:26.770013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 753/1490] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:29.500078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:29.500726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:29.500726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:29.501940 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 738/1491] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 4 20:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:23:29.507669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63608c2e-d7be-45f0-a0b4-12826b406715 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:29.508250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63608c2e-d7be-45f0-a0b4-12826b406715 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:29.508393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63608c2e-d7be-45f0-a0b4-12826b406715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:29.580856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-63608c2e-d7be-45f0-a0b4-12826b406715 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:23:29.582099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-63608c2e-d7be-45f0-a0b4-12826b406715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:29.691210 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 754/1492] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 4 20:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:23:29.982746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:23:29.984357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:30.100848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f5025-7f5b-4654-8a10-a80acf4c7e1e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:23:30.185794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:23:30.186425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:23:30.186706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:23:30.186980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:23:30.189217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:23:30.201500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:30.313632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:23:30.315116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2197ca4-bd79-4cba-a827-0508a0389b0e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:23:30.335305 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 739/1493] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:23:39.689439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:40.332829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=50 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:57.549037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:57.549775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:57.549775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:57.640201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:24:57.641428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:57.756011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 755/1494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:24:57.764218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:57.764839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:57.764839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:57.788767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:24:57.790017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:57.798825 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 740/1495] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:24:57.803672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:57.813638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7a48-6dd7-4da8-bdfd-51fb03c484c3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:57.818658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:57.819207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:57.819567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:57.819841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:57.820518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:24:57.820813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:57.821883 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:57.821883 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:24:57.821883 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:24:57.822745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:57.836055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 756/1496] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:24:57.844718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:57.854978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8322d-f60d-4d12-9e62-d803544500ef None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:57.859743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:57.860363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:57.860641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:57.860912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:57.861864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:57.863647 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:57.863647 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:24:57.863647 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:24:57.864861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:57.958685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 741/1497] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:24:57 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:24:57.963711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:57.974015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7742b-3498-45be-863e-771f594811c0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.026110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:58.033674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:24:58.037678 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:24:58.038395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:58.106330 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 757/1498] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:24:57 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:24:58.110593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:58.121307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660728-f858-42e5-a2fb-6a0867afbd7f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.126044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.126653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.126927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.127242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.127889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.128890 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:58.128890 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:24:58.128890 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:24:58.129776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:58.144606 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 742/1499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:24:58.150175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:58.161422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb97f0-bfa3-468f-9c1c-183e8bf78c95 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.166403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.168433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.168433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.168433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.168433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.169296 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:58.169296 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:24:58.169296 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:24:58.170194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ef213-bcf0-4aba-ac99-5c1aaf5e9f62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:58.184395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 758/1500] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:24:58.188869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:58.202078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f60b0-a2fd-4248-a2b1-59dcd8408929 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.206857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.207575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.207859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.208141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] PATH_INFO: `/v3/projects/e01ecb2955be4faab88dba044192892c/users/7cde1c89bda34bfb8c66e134c14f15ad/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.225297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01ecb2955be4faab88dba044192892c, user_id=7cde1c89bda34bfb8c66e134c14f15ad, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.226258 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:58.226258 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:24:58.226258 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:24:58.228263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6178a-43fe-4997-ac82-55cf67b0dbb9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:58.304733 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 743/1501] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:24:58 2022] PUT /identity/v3/projects/e01ecb2955be4faab88dba044192892c/users/7cde1c89bda34bfb8c66e134c14f15ad/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:24:58.317231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be415a-d2ec-4f1e-bc34-7d753e9103fa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.317509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be415a-d2ec-4f1e-bc34-7d753e9103fa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.317805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be415a-d2ec-4f1e-bc34-7d753e9103fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.348797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-98be415a-d2ec-4f1e-bc34-7d753e9103fa None None] MFA Rules not processed for user `7cde1c89bda34bfb8c66e134c14f15ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:24:58.350104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-98be415a-d2ec-4f1e-bc34-7d753e9103fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:58.478659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 759/1502] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:24:58.492977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41249-cf99-4e74-853d-c78c76b3f14a None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.493313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41249-cf99-4e74-853d-c78c76b3f14a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.493621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41249-cf99-4e74-853d-c78c76b3f14a None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.494877 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 744/1503] 10.222.0.78 () {54 vars in 963 bytes} [Tue Oct 4 20:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:24:58.499881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c2fa-4e2e-4400-8f9c-ddfcce7a05f3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.500215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c2fa-4e2e-4400-8f9c-ddfcce7a05f3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.500641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c2fa-4e2e-4400-8f9c-ddfcce7a05f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.568836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6e04c2fa-4e2e-4400-8f9c-ddfcce7a05f3 None None] MFA Rules not processed for user `a554eb26060549b48a431c579659ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:24:58.570699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6e04c2fa-4e2e-4400-8f9c-ddfcce7a05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:58.650023 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 760/1504] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 4 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:24:58.657834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41249-cf99-4e74-853d-c78c76b3f14a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:58.668592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41249-cf99-4e74-853d-c78c76b3f14a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.672109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.672709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.672988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.673260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.683084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.684549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:58.693670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 745/1505] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:24:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:24:58.742309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4ea7-d041-4465-972b-8eeaf10fe0a4 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.743666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4ea7-d041-4465-972b-8eeaf10fe0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.743948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4ea7-d041-4465-972b-8eeaf10fe0a4 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.745266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 761/1506] 10.222.0.78 () {52 vars in 830 bytes} [Tue Oct 4 20:24:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:24:58.749618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:58.815907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299de0e-83ad-469a-ab4d-4af5834bf090 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:58.820934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:58.821591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:58.821882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:58.822151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] PATH_INFO: `/v3/users/7cde1c89bda34bfb8c66e134c14f15ad` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:58.823425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cde1c89bda34bfb8c66e134c14f15ad)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:58.824453 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:58.824453 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:24:58.824453 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:24:58.825704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:59.025972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cde1c89bda34bfb8c66e134c14f15ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:24:59.026667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cde1c89bda34bfb8c66e134c14f15ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:24:59.083659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cde1c89bda34bfb8c66e134c14f15ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:24:59.113271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cde1c89bda34bfb8c66e134c14f15ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:24:59.123912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:59.129312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cde1c89bda34bfb8c66e134c14f15ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:24:59.136050 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 746/1507] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:24:58 2022] DELETE /identity/v3/users/7cde1c89bda34bfb8c66e134c14f15ad => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:24:59.140682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:59.140956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:59.141227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:59.161368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:24:59.162583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:59.194623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:59.247105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 762/1508] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:24:59.257127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:59.258554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:59.341835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba0d0-4649-439d-80b3-fb154858d8fa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:59.345750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:59.346369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:59.346651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:59.346925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:59.358567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:59.360063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0892c3-2e6a-453e-8622-b14f24b9a0bd service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:24:59.370363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 747/1509] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:24:59.861214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:24:59.863620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:24:59.876939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d2cce-f2ad-4dcb-8f01-d43838564922 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:24:59.883840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:24:59.884523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:24:59.884804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:24:59.885167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] PATH_INFO: `/v3/projects/e01ecb2955be4faab88dba044192892c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:24:59.886293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01ecb2955be4faab88dba044192892c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:24:59.887378 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:24:59.887378 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:24:59.887378 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:24:59.888729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:25:00.017721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01ecb2955be4faab88dba044192892c', 'request_id': 'req-e25b54c0-1db1-471c-9570-26c2ded58e9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:25:00.033856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01ecb2955be4faab88dba044192892c', 'request_id': 'req-e25b54c0-1db1-471c-9570-26c2ded58e9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:25:00.040558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01ecb2955be4faab88dba044192892c', 'request_id': 'req-e25b54c0-1db1-471c-9570-26c2ded58e9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:25:00.146831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] The token cache is being invalidate because project e01ecb2955be4faab88dba044192892c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:25:00.147182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:25:00.147886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e25b54c0-1db1-471c-9570-26c2ded58e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:25:00.149736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 763/1510] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:24:59 2022] DELETE /identity/v3/projects/e01ecb2955be4faab88dba044192892c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:25:09.365840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=38 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:25:10.142949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:28:33.947255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe79765-a0ba-4f61-8f67-b4059465516b None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:33.947860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe79765-a0ba-4f61-8f67-b4059465516b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:33.948117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe79765-a0ba-4f61-8f67-b4059465516b None None] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:33.949499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 748/1511] 10.222.0.83 () {54 vars in 925 bytes} [Tue Oct 4 20:28:33 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:28:33.956300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4767-9aa6-4302-b047-188886895ce0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:33.956837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4767-9aa6-4302-b047-188886895ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:33.956837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4767-9aa6-4302-b047-188886895ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:34.010271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9cbc4767-9aa6-4302-b047-188886895ce0 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:28:34.011547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9cbc4767-9aa6-4302-b047-188886895ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:28:34.090049 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 764/1512] 10.222.0.83 () {58 vars in 1015 bytes} [Tue Oct 4 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:28:34.720614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca19cb-fcc4-429c-ac0b-fa7725a77025 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:34.720890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca19cb-fcc4-429c-ac0b-fa7725a77025 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:34.721172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca19cb-fcc4-429c-ac0b-fa7725a77025 None None] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:34.722437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 749/1513] 10.222.0.85 () {54 vars in 925 bytes} [Tue Oct 4 20:28:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:28:34.732550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2584-3fd5-4ebb-9651-40e104b1711b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:34.732839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2584-3fd5-4ebb-9651-40e104b1711b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:34.733113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2584-3fd5-4ebb-9651-40e104b1711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:34.755250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ccd2584-3fd5-4ebb-9651-40e104b1711b None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:28:34.759931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ccd2584-3fd5-4ebb-9651-40e104b1711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:28:34.765409 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 765/1514] 10.222.0.85 () {58 vars in 1015 bytes} [Tue Oct 4 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:28:42.840470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60429fe-60bd-43d5-8364-6948be0376eb None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:42.845605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60429fe-60bd-43d5-8364-6948be0376eb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:42.845605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60429fe-60bd-43d5-8364-6948be0376eb None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:42.845605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 750/1515] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:28:42.847717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:42.848130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:42.848274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:42.868096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:28:42.869296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:28:42.878296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 766/1516] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:28:42.885806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60429fe-60bd-43d5-8364-6948be0376eb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:28:42.900374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60429fe-60bd-43d5-8364-6948be0376eb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:28:42.905316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:28:42.905910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:42.906238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:42.906584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:42.914844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:28:42.916527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474523d-10b1-4025-b6eb-cd9754f65f03 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:28:42.927678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 751/1517] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:28:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:28:43.629486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:28:43.639849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b590ca1-ba80-4a3f-88e1-78aa5fdac988 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:28:43.645092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:28:43.645707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:28:43.645985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:28:43.646596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:28:43.655668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:28:43.657784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcafd3-8c5f-4957-b20b-8141bf5d78a3 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:28:43.669717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 767/1518] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:28:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:28:52.922207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:28:53.664868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=56 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:29:01.794211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:01.794773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:01.794773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:01.796151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:29:01.801396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406796-b876-45c3-b988-a7c13b9290c7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:01.801848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406796-b876-45c3-b988-a7c13b9290c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:01.801967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406796-b876-45c3-b988-a7c13b9290c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:01.822992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fc406796-b876-45c3-b988-a7c13b9290c7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:29:01.824234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fc406796-b876-45c3-b988-a7c13b9290c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:01.884806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:29:02.039259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:29:02.040954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:02.146133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1157a5-dcff-433a-a73c-aa632d2bdb3b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:29:02.151507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:29:02.152096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:02.152403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:02.152670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:02.160695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:29:02.162267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d37a8-0be6-4ee8-a02e-7ebb9af2968e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:29:02.171901 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 753/1521] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:29:03.292638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ce4-1716-4e59-bc8f-7b25e1d9b600 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:03.293233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ce4-1716-4e59-bc8f-7b25e1d9b600 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:03.293233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ce4-1716-4e59-bc8f-7b25e1d9b600 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:03.294554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 20:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:29:03.302288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3a0d9-63ee-40b5-8db4-4ebdfa624203 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:03.302997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3a0d9-63ee-40b5-8db4-4ebdfa624203 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:03.302997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3a0d9-63ee-40b5-8db4-4ebdfa624203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:03.323467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f1e3a0d9-63ee-40b5-8db4-4ebdfa624203 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:29:03.324687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1e3a0d9-63ee-40b5-8db4-4ebdfa624203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:03.332859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:29:03.483122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c5ce4-1716-4e59-bc8f-7b25e1d9b600 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:29:03.498763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c5ce4-1716-4e59-bc8f-7b25e1d9b600 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:29:03.505308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:29:03.505952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:03.506229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:03.506502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:03.515360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:29:03.517010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf91e-2dfa-4940-b768-844c6f774c84 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:29:03.527720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 770/1524] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:29:08.617308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:08.617823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:08.617823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:08.619101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:29:08.624394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3641-8faa-4ea7-b169-38defcdb6a6f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:08.624821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3641-8faa-4ea7-b169-38defcdb6a6f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:08.624997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3641-8faa-4ea7-b169-38defcdb6a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:08.645797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-483b3641-8faa-4ea7-b169-38defcdb6a6f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:29:08.647066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-483b3641-8faa-4ea7-b169-38defcdb6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:08.655413 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:29:08.952494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:29:08.954871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:09.015013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d43f1-7432-4dd4-8941-362f6a260bc4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:29:09.019280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:29:09.019964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:09.020171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:09.020446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:09.029760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:29:09.031201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c667-5ca1-427a-a087-2fd4c118db51 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:29:09.040813 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 756/1527] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:29:11.222639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e7d3-fa2d-44bd-8bff-77fe98029db7 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:11.223239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e7d3-fa2d-44bd-8bff-77fe98029db7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:11.223239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e7d3-fa2d-44bd-8bff-77fe98029db7 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:11.224498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 20:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:29:11.229987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3391-88ae-433c-91e3-846c994fd0e5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:11.230443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3391-88ae-433c-91e3-846c994fd0e5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:11.230562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c3391-88ae-433c-91e3-846c994fd0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:11.250904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-620c3391-88ae-433c-91e3-846c994fd0e5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:29:11.252163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-620c3391-88ae-433c-91e3-846c994fd0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:29:11.260173 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:29:11.548849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e7d3-fa2d-44bd-8bff-77fe98029db7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:29:11.559967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e7d3-fa2d-44bd-8bff-77fe98029db7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:29:11.564016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:29:11.564615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:29:11.564893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:29:11.565162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:29:11.574139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:29:11.575617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f791f9c-8d68-4370-85a4-37e985d6acec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:29:11.585195 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 773/1530] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:29:21.244785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=78 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:29:21.580964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=42 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:04.608374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bd55-a22e-4f6f-97ce-2737515dbc57 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:04.609258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bd55-a22e-4f6f-97ce-2737515dbc57 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:04.609528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bd55-a22e-4f6f-97ce-2737515dbc57 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:04.611858 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 758/1531] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:30:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:30:04.617604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418f82-fa42-4a8c-b4e7-8876504eeea4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:04.618387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418f82-fa42-4a8c-b4e7-8876504eeea4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:04.618714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418f82-fa42-4a8c-b4e7-8876504eeea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:04.640089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c9418f82-fa42-4a8c-b4e7-8876504eeea4 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:04.641415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c9418f82-fa42-4a8c-b4e7-8876504eeea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:04.650631 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 774/1532] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:30:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:14.634806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:45.591262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.593698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.594660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:45.645336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:45.646770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:45.668133 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 759/1533] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:45.694957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421fbfc-fe5f-4042-9dec-db7b148db57b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.695831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421fbfc-fe5f-4042-9dec-db7b148db57b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.695831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421fbfc-fe5f-4042-9dec-db7b148db57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:45.746060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5421fbfc-fe5f-4042-9dec-db7b148db57b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:45.748174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5421fbfc-fe5f-4042-9dec-db7b148db57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:45.770378 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 775/1534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:45.776885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:45.799860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c054d4-cb13-4b50-abb7-afff9c4c7a9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:45.813649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:45.814486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.814835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.815117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:45.816364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:45.816817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:45.818148 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:30:45.818148 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:30:45.818148 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:30:45.823997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:45.833754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebbd-327c-49bf-812c-ef5d59f65e1d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.834244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebbd-327c-49bf-812c-ef5d59f65e1d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.834744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebbd-327c-49bf-812c-ef5d59f65e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:45.851607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 760/1535] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:30:45.876486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:45.893453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9857ebbd-327c-49bf-812c-ef5d59f65e1d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:45.899190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9857ebbd-327c-49bf-812c-ef5d59f65e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:45.911947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188747-a6b9-49be-ab0f-5a2e99baee3d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:45.921120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 776/1536] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:45.937127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:45.938948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.939829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.941086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:45.942726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:45.947195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597e291-6c66-4244-9260-c46c9fa27b83 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:45.966866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5407b-0dc8-4f30-b5c5-79e1dd7a6f0b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:45.972098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5407b-0dc8-4f30-b5c5-79e1dd7a6f0b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:45.972098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5407b-0dc8-4f30-b5c5-79e1dd7a6f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.041313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-18e5407b-0dc8-4f30-b5c5-79e1dd7a6f0b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.044570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-18e5407b-0dc8-4f30-b5c5-79e1dd7a6f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.066572 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 777/1537] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:30:46.069398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.070242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.070984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.120970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.122837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.141805 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 778/1538] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.143235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:46.161563 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 761/1539] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:45 2022] POST /identity/v3/projects => generated 401 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:30:46.164466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.171239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7b9d1-5470-47db-ad5b-574b8e416b16 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:46.179704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.179704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.258409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.258409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.348421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:46.349100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.349508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.349977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.351172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:46.351673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:46.354409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6c92-91f1-4f05-9fb6-179a53bd00c4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:46.372051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 779/1540] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:46.375164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e18b-e14c-44d6-9b9b-60c2243dc4dc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.375164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e18b-e14c-44d6-9b9b-60c2243dc4dc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.375693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404e18b-e14c-44d6-9b9b-60c2243dc4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.414193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3404e18b-e14c-44d6-9b9b-60c2243dc4dc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.416475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3404e18b-e14c-44d6-9b9b-60c2243dc4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.426919 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 762/1541] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.432726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:46.435763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 780/1542] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.438141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50efad-74ef-461e-a29d-e2b7f898a014 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.438636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50efad-74ef-461e-a29d-e2b7f898a014 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.439512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50efad-74ef-461e-a29d-e2b7f898a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.469504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aad821-f5f9-4fb4-b713-e55b2d33bd60 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:46.479968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:46.481637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.481637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.481942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.483681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:46.485189 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:30:46.485189 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:30:46.485189 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:30:46.487858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ef169-471c-4230-ad63-2259e2478440 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:46.490627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9d50efad-74ef-461e-a29d-e2b7f898a014 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.492834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d50efad-74ef-461e-a29d-e2b7f898a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.508883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 781/1543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.511084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ef12-e327-472e-b794-ec1cba952be2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.511609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ef12-e327-472e-b794-ec1cba952be2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.512084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ef12-e327-472e-b794-ec1cba952be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.546293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ffe3ef12-e327-472e-b794-ec1cba952be2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.547821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ffe3ef12-e327-472e-b794-ec1cba952be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.561256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 782/1544] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.563630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.564115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.564595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.594349 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 763/1545] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:46.600635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a6c98-6d88-40d3-ac72-7f5d31f3f0cc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.600635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a6c98-6d88-40d3-ac72-7f5d31f3f0cc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.600635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a6c98-6d88-40d3-ac72-7f5d31f3f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.609498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.611177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.624844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 783/1546] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.626429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:46.641013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9d2a6c98-6d88-40d3-ac72-7f5d31f3f0cc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.641411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f03eb-8186-4172-ac64-96a728b845d6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:46.643256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9d2a6c98-6d88-40d3-ac72-7f5d31f3f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.649124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:46.649915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.650427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.650860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.652541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:46.653775 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:30:46.653775 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:30:46.653775 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:30:46.656005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75abd15-c1ad-4a5e-a25f-edd9fd2cfb92 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:46.658317 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 764/1547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.660666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25deb84-0c18-46ba-9cce-c016d45683d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.661166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25deb84-0c18-46ba-9cce-c016d45683d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.661706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25deb84-0c18-46ba-9cce-c016d45683d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.691281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f25deb84-0c18-46ba-9cce-c016d45683d9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.697920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f25deb84-0c18-46ba-9cce-c016d45683d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.704604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 765/1548] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.706194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add654-27c3-4034-aa82-3997756ff951 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.706691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add654-27c3-4034-aa82-3997756ff951 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.707225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73add654-27c3-4034-aa82-3997756ff951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.739068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73add654-27c3-4034-aa82-3997756ff951 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.741322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73add654-27c3-4034-aa82-3997756ff951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.756471 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 766/1549] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.758101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73add654-27c3-4034-aa82-3997756ff951 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:46.773206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 784/1550] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:46.773206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.773206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.773206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.782342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73add654-27c3-4034-aa82-3997756ff951 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:46.806542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.808686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.910368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:46.910368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.910368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.910368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.911188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:46.911188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:46.913240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d59c77-c1b2-4374-9c44-12072056e5ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:46.922311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 785/1551] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.924022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:46.939795 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 767/1552] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:46.942439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.942952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.943506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.944403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af8e1e-a964-4749-a07a-1bbeb75f8059 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:46.953418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:46.956948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.956948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.956948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.956948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:46.962928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4ddf1-c8f8-46a2-b46a-b72975f0e031 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:46.976111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:46.977528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:46.980872 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 786/1553] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:46.983004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:46.983572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:46.984074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:46.991505 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 768/1554] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:46.992962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.008661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d85ee-2c50-437f-98b4-528a9e490070 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.017029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.017865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.018251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.018587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.019453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:47.019884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.020204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:47.021752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:47.021939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.025300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:47.036024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 787/1555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:47.037525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.040396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 769/1556] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:47.040396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.049666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:47.058020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009324-aaed-4408-b5d5-f31fa6bb7723 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.058557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21eb33-4d12-48ba-bcdc-1b277f7e5cc0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.065895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.066889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.067365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.067560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.067804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.068508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.068894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.069147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.069461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.070570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:47.071373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.072573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.074295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.099445 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 788/1557] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:47.101229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.121526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1e21-f687-44cd-b3bf-a36d1cc14bd6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.130446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.131633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.132114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.132573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.133800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:47.134326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.137397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.166685 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 789/1558] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:47.166685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.183241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366bcb2-09da-4fef-99fc-f07a32ad3757 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.191272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.192089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.192372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.192691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.193358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.195771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.207617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 770/1559] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:47.212651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.222936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045adf80-b0fb-4160-8395-57ce5a15d22e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.228672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.229454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.229841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.230242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.231157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.233835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.247274 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 771/1560] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:47.248371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.260402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a530d-2618-4343-996d-d1c29fc8ccad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.266389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.267088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.267457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.267792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.268501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:47.268843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.270584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.288475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 772/1561] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:47.289551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.301944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c475-fdd2-44cf-b98f-213832cd0e56 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.311725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.321597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.322334 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 790/1562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:47.322928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.349774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 773/1563] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:30:47.349774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.369787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66175-82e2-4120-822e-3bfbfd21852b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.432800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d9845-d3f8-4a9f-851b-48cc7799aa02 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.438802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.439657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.440074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.440471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.441579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.444356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.484849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.490464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.490464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.490464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.490464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.493082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.596423 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 791/1564] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:47.602255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.622007 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 774/1565] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/projects => generated 389 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:47.623391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.717335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19202faf-6210-4ea9-a611-ae7b82f3bdce admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.735625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013f8f-f2fd-49af-b332-a30ec3201324 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.742034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.742792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.743129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.743533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.744346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.746117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.760376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 775/1566] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:47.763437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.773426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69555e-7b6b-4d3b-815f-774a9648d0e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:47.778399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.779094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.779404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.779687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] PATH_INFO: `/v3/projects/d593ded97dc34546bfe79cdbdac0d4c2/users/9baf3883d6ac4328bf3aa9ffaaa48b4f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.802096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d593ded97dc34546bfe79cdbdac0d4c2, user_id=9baf3883d6ac4328bf3aa9ffaaa48b4f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.804416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:47.807675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.821562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:47.822326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:47.822644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:47.822961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:47.823717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:47.826131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:47.937300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:47.948843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 776/1567] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:47 2022] PUT /identity/v3/projects/d593ded97dc34546bfe79cdbdac0d4c2/users/9baf3883d6ac4328bf3aa9ffaaa48b4f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:47.950813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:47.983569 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 792/1568] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:47.983569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.084199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ba2d-578c-424e-b93d-c55ab0b998a1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.104623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47244f5-2b2a-416c-be1d-5f6a80177929 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.113122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.113924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.114327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.114795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.115924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.118883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.172223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.173019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.173373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.173788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.174546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.176931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.254150 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 793/1569] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.255755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.275473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695f8f-55d2-482c-93c1-484d2193c782 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.283908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.284596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.284928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.285419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.286563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.290419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.297793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 777/1570] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:47 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.300287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.431858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999ea6-eb12-492f-9937-b56d18451dd4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.441055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.447326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.447326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.447326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.447326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.448075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.462537 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 794/1571] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.462537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.568612 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 778/1572] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.569766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.587398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad480-f978-4aee-b03e-92c3a83c2c82 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.593455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dfe53-513c-4201-af74-a15b75f407d5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.596468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.597531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.597966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.598400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.599523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.602372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724141e6-4f8c-4fb9-ac7f-d7e66b5e1b6a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.604263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.605670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.606157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.606645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.607991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.612127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.623381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 779/1573] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:48.626101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.626553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.626978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.659441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:48.661347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:48.675049 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 780/1574] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:48.676508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.685624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:48.694146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb06a-0ee6-4d0b-83aa-73780aa4b540 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.702723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.703782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.704231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.704663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.705701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.709037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.741193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 795/1575] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.743079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.763971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa826-89df-4eb5-8be3-230a614fca73 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.773457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.774599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.775079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.775651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.776949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.780151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.801310 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 796/1576] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:48.803000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.829117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548407-4c0d-4233-a5dc-54865689345e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.830209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 781/1577] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.830964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:48.838018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.838994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.839487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.840362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.841023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.844549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.851743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57302-bae1-464b-bed1-2cb6c95eba1a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:48.864562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:48.865851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:48.866482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:48.867021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:48.868338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:48.872299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:48.982781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:48.999372 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 797/1578] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:48.999372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.012045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 782/1579] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:48 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:49.013465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.015944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b97df-3741-429e-ab73-3ad412b924d4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.024884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.025991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.026487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.026967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.028153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.031405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.033433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478da5-90d8-4eff-9368-fdacdfcda7bc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.042317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.043626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.044106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.044581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] PATH_INFO: `/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c/users/9cbd2fa6b7cc46788661bc5aaa8f5297/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.057594 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 798/1580] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.057594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.057594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:49.075565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5ff597f7974cb7b0ca20b154fdba8c, user_id=9cbd2fa6b7cc46788661bc5aaa8f5297, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.080923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.179964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6abca1-a2da-4748-a938-22bbc0f099c5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.192172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 783/1581] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:49 2022] PUT /identity/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c/users/9cbd2fa6b7cc46788661bc5aaa8f5297/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:49.205527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.281275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.282431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.282990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.283560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.333174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbbfed-9597-459c-bdda-f90ba1b82af6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.341931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.343612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.344423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.344716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.345906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.349256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.375198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 784/1582] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.376727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.393111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.394157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2cbb6-1df9-4833-823e-f9e8f9ab74cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.396240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.402099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.403094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.403600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.404003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.405652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.408269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.414118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 799/1583] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:49.415421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.426636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 785/1584] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.428467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.432587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7d5b-590b-4ad0-9b09-6f2ccad18b1d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.441592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.442474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.442951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.443368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.444499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.446807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.448778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27157eda-262c-40d8-8237-cf27da452b61 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.459819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.460692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.461041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.461365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.462120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.464239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 800/1585] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.464460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.465268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.479931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c0727-d6a6-4f17-8693-c26a7f8d7457 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.489056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 786/1586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.489056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.489496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.489496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.489496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.489496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.490130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.491242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e65f40-1f66-46e7-b3ae-c83400ed56f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.500711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93be6-5581-409f-a7c2-2da489539955 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.506580 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 801/1587] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.507466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.508360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.508609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.508820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.509116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.509286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.509591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.510827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.513968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.538130 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 787/1588] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.542890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.556185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf4b3-1858-410a-957d-95d80c46bfe8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.562737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.563667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.564105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.564511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.565551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.567539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.568470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] MFA Rules not processed for user `9cbd2fa6b7cc46788661bc5aaa8f5297`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:49.572635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:49.595117 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 788/1589] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.595117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.610468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb681f-9c04-4291-ab28-f93096ec42ea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.620956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.623448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.624552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.624552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] PATH_INFO: `/v3/projects/43a6c60df0b14717bf52f10dbe8d68c2/users/2a7aaeb417c04b7085a6e752268963c8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.629727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:49.659846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a6c60df0b14717bf52f10dbe8d68c2, user_id=2a7aaeb417c04b7085a6e752268963c8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.663574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.715021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 802/1590] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:49.716997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.735044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b11a8-25d5-43e5-99ab-5f6e41673ffb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.741738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.742780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.743311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.743703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.744830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.747645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.765285 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 803/1591] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.766497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.769487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 789/1592] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:49 2022] PUT /identity/v3/projects/43a6c60df0b14717bf52f10dbe8d68c2/users/2a7aaeb417c04b7085a6e752268963c8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:49.770588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.786330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc7e6-2b5a-4e2c-b406-4f0bebbaf98c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.870299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:49.908739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.909736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.910718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.910718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.912268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.915849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.938069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 804/1593] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.939879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:49.941447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f3832-00f4-40b5-bd38-ad41f2e9a688 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.954439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.955796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.956676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940412dd-667a-42e5-943b-ced66001a987 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:49.957344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.958600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.960946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:49.964549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:49.973106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:49.973106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:49.973106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:49.973106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] PATH_INFO: `/v3/projects/d0222cc92ab44873bb0fa83d41176327/users/010c61cd184d44738f9782856a99731b/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:49.999046 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 790/1594] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:49.999046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:50.013314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0222cc92ab44873bb0fa83d41176327, user_id=010c61cd184d44738f9782856a99731b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.016633 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:30:50.016633 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:30:50.016633 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:30:50.023983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8b741-cb4f-497d-86d8-7bd25b88d772 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:50.025328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.039018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:50.040504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.051062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.051062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] PATH_INFO: `/v3/projects/13bcdec8c8d64e97b49281a0e16b0d79/users/c0986e6de5204c4d86e24184039366e0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.073306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bcdec8c8d64e97b49281a0e16b0d79, user_id=c0986e6de5204c4d86e24184039366e0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.080191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.185396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 805/1595] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:49 2022] PUT /identity/v3/projects/d0222cc92ab44873bb0fa83d41176327/users/010c61cd184d44738f9782856a99731b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:50.187530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:50.231525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 791/1596] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:49 2022] PUT /identity/v3/projects/13bcdec8c8d64e97b49281a0e16b0d79/users/c0986e6de5204c4d86e24184039366e0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:50.270895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:50.353245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fec45-3555-473a-b41c-eda92a4effc0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:50.397337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060f59c-2acb-4a5a-8c09-acf1eea7fc43 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:50.406702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:50.408207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.409774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.409774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] PATH_INFO: `/v3/projects/d0ded24c70b54fc5bb73d54fd1537abb/users/72398073905c49ee952b40ce1a53fd28/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.416644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:50.458558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ded24c70b54fc5bb73d54fd1537abb, user_id=72398073905c49ee952b40ce1a53fd28, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.464544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f73235-0b24-478b-a06c-abafbfbf0e3f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.490678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:50.497370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.497370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.497370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.497370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.501848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.622511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 792/1597] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:50 2022] PUT /identity/v3/projects/d0ded24c70b54fc5bb73d54fd1537abb/users/72398073905c49ee952b40ce1a53fd28/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:50.625665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.626654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.626936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.678587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 806/1598] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:50 2022] POST /identity/v3/projects => generated 379 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:50.680244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:50.684740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] MFA Rules not processed for user `2a7aaeb417c04b7085a6e752268963c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:50.688934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:50.777706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f68e7-7cd8-47d1-9da6-77788b0f0d7d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:50.787488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:50.789154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.789357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.789747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] PATH_INFO: `/v3/projects/70afd75b4b4c4e758a784365a7c45d67/users/907fc7095b8e4c63a9fe0fb8ae71a2b2/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.808846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 793/1599] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:50.808846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:50.839618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70afd75b4b4c4e758a784365a7c45d67, user_id=907fc7095b8e4c63a9fe0fb8ae71a2b2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.839618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc5e9d-6bae-437e-899c-c546bb3ebd84 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.839916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2110837-717f-4e86-b8aa-80fdd8d90c4b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:50.842763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:50.843916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.844489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.844954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] PATH_INFO: `/v3/projects/f269e58e08544c53985cabdb7c9328be/users/43c0d58694f7488181731c3089759fed/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.870332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:50.876761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f269e58e08544c53985cabdb7c9328be, user_id=43c0d58694f7488181731c3089759fed, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:50.881763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac12f4-8c60-4a59-bfed-eb26839b85f9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:50.937872 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 807/1600] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:50 2022] PUT /identity/v3/projects/70afd75b4b4c4e758a784365a7c45d67/users/907fc7095b8e4c63a9fe0fb8ae71a2b2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:50.939430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06e572-ebcd-4f60-933f-ba04558043b3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.939833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06e572-ebcd-4f60-933f-ba04558043b3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.940244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06e572-ebcd-4f60-933f-ba04558043b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.969375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 794/1601] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:50 2022] PUT /identity/v3/projects/f269e58e08544c53985cabdb7c9328be/users/43c0d58694f7488181731c3089759fed/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:50.972088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:50.972677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:50.973242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:50.981557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8e06e572-ebcd-4f60-933f-ba04558043b3 None None] MFA Rules not processed for user `010c61cd184d44738f9782856a99731b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:50.983723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8e06e572-ebcd-4f60-933f-ba04558043b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:51.020862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] MFA Rules not processed for user `c0986e6de5204c4d86e24184039366e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:51.023041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:51.091922 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 808/1602] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:51.098694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.100215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.100215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.158705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] MFA Rules not processed for user `72398073905c49ee952b40ce1a53fd28`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:51.161272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:51.173439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 795/1603] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:51.175039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:51.206930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:51.277634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d1fd6-8fe6-4a0d-bba8-6e26a856b24e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:51.283634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:51.284271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.288445 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 809/1604] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:51.288684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.288684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.288940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:51.289081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:51.289081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1755bf-1d3b-4f5b-8af0-857c151142bb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:51.303054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95010c-f536-4d87-bdeb-c46932fbe032 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:51.308446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:51.309353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.309713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.309976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.310639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:51.313310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cee3e-1f4d-4575-9cd6-652e30e05a9d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:51.422831 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 796/1605] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:51.424216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.424591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.424874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.457239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 810/1606] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/projects => generated 397 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:51.459111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.459648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.460065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.476086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] MFA Rules not processed for user `907fc7095b8e4c63a9fe0fb8ae71a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:51.477575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:51.514830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] MFA Rules not processed for user `43c0d58694f7488181731c3089759fed`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:51.517987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:51.593038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:51.611126 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 797/1607] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:51.613218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:51.667428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 811/1608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:51.670233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:51.748902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855a31-ccf6-4fe6-bd80-1eb2ef368e43 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:51.760761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:51.762037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.762325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.762601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.764226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:51.765467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:51.809296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c16cc-11e1-4a40-a6b6-b284d60a05ea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:51.816267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:51.817097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:51.817502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:51.817789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:51.818601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:51.821947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:51.955588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 798/1609] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:51.957139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:51.994702 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 812/1610] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/projects => generated 389 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:51.996007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.015909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:52.069260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587aea7-dabb-41aa-80f0-e17646875d60 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.085531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92e6c6-97f8-4a7a-8fb4-c26b558a3907 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.093565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.095051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.095541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.095990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.097447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.100673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.126571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 813/1611] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:52.126571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.144510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555b93-f536-4757-9a8c-7243dd21a3d5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.152437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.153591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.154066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.154305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.154707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.155519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.156237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.156466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.156970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.158009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.160130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.162080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.280364 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 814/1612] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:52 2022] POST /identity/v3/users => generated 305 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:52.284712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.297085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700d73-9f9e-43b1-9116-79437e44bdcb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.302544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.303263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.303890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.304038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.304727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.307077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.329624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 799/1613] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:51 2022] POST /identity/v3/projects => generated 381 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:52.329929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.362023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:52.442864 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 815/1614] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:52 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:52.444978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.463280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7236a-e93d-4707-954d-7f6c65f69fba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.567783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998ea24-bf13-4a92-94b8-c89169396a46 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.579710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.581310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.582097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.582531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.583686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.589178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.607074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.607837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.615478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.615478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.615478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.615478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.739176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 816/1615] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:52 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:52.741081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.767505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf327cc-5f1c-48fc-830b-683e42805025 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.775669 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 800/1616] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:52 2022] POST /identity/v3/projects => generated 369 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:52.775669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:52.903522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:52.919444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.920495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.921330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.922333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.923759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.926942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:52.950504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd426d-11de-447b-a753-3d6451b479b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:52.957409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:52.958180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:52.958464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:52.958773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] PATH_INFO: `/v3/projects/7ca6436b25f44bd18223ac14ddee19fb/users/956215fdf043407180604d92e0270ae8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:52.993603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca6436b25f44bd18223ac14ddee19fb, user_id=956215fdf043407180604d92e0270ae8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:52.998897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.055628 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 817/1617] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:52 2022] POST /identity/v3/users => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:53.059187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.080488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678a2d-9f59-4f79-8c0e-40e74d22e203 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.091622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.093165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.093622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.094165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.095444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.099168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.121175 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 801/1618] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:52 2022] PUT /identity/v3/projects/7ca6436b25f44bd18223ac14ddee19fb/users/956215fdf043407180604d92e0270ae8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:53.122856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.128648 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 818/1619] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:53.133731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.160822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd8747-f4b0-4cc4-82dd-e01b9ead9795 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.312770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:53.314998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.316038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.317180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.317945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.319346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.323760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.357009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48a7b-6e2a-48f1-aec6-e756befff5f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.367611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.368496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.369029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.369406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.370343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.374721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.441829 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 819/1620] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:53 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:53.443348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.458649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d3589-de2b-408d-8b3b-ea4e7c98a0a4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.465384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.466409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.466891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.467407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.470140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.470287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.485867 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 820/1621] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:53.486937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.508127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc38b-6767-4304-99df-59f02fe7ab6e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.510488 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 802/1622] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:53 2022] POST /identity/v3/users => generated 297 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:53.511573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.518690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.519895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.520515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.521358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.522535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.527208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.534571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c3ca7-4cbd-419c-bc37-92a49448a9ff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.546727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.547567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.547912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.548200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.549037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.552338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.569392 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 803/1623] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:53.570556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.586173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443827b-6ec8-47fb-9164-39ad9d9fcb62 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.598788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.599968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.600541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.602034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.602676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.606199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.631770 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 804/1624] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:53.634692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.655329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 821/1625] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:53 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:53.655329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.655888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae16179-d841-4e30-8d59-6367a9451f38 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.666792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.668644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.669278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.670031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] PATH_INFO: `/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791/users/fa6f52cb0cd643e98535ba532fe2c384/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.683712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636264e-a556-4e40-9923-fbe517b41e5b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.692684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.693944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.694412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.694973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.696304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.703185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.726411 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 822/1626] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:53.726411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.726977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8231cbd10e4f4ea7eb62bf99dd0791, user_id=fa6f52cb0cd643e98535ba532fe2c384, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.733537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.741739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697ef9-bc90-4be8-b4e1-5cff581c2c25 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:53.747597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:53.748701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:53.749175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:53.749626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] PATH_INFO: `/v3/projects/e9622ed2749c4a8785d3edecc6716b2c/users/05dafcdf88774daca960a9cee0e7f6b9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:53.771276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9622ed2749c4a8785d3edecc6716b2c, user_id=05dafcdf88774daca960a9cee0e7f6b9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:53.774714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:53.887177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 823/1627] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:53 2022] PUT /identity/v3/projects/e9622ed2749c4a8785d3edecc6716b2c/users/05dafcdf88774daca960a9cee0e7f6b9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:53.888434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:53.893166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 805/1628] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:53 2022] PUT /identity/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791/users/fa6f52cb0cd643e98535ba532fe2c384/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:53.894850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.053497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138002c6-d65d-4fd0-a36c-356185273975 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.078103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.079607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.080116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.084329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.085733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.089105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.097365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfda2-f09e-4ae7-9160-ee7048b4b687 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.104026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:54.123050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.124901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.125392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.125884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] PATH_INFO: `/v3/projects/420d26b06e914da99f8e6227a04b57f0/users/1706d4347fc44b2abcafb2695fd40111/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.140691 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 824/1629] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:54.141345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.166057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9894-36c7-4a5c-9eb0-62e9c8b4988c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.169944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420d26b06e914da99f8e6227a04b57f0, user_id=1706d4347fc44b2abcafb2695fd40111, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.176797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.177725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.178087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.178471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.178949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] PATH_INFO: `/v3/projects/7ca6436b25f44bd18223ac14ddee19fb/users/956215fdf043407180604d92e0270ae8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.186612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca6436b25f44bd18223ac14ddee19fb, user_id=956215fdf043407180604d92e0270ae8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.189865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.206776 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 825/1630] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:54 2022] PUT /identity/v3/projects/7ca6436b25f44bd18223ac14ddee19fb/users/956215fdf043407180604d92e0270ae8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:54.208178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.342123 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 806/1631] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:53 2022] PUT /identity/v3/projects/420d26b06e914da99f8e6227a04b57f0/users/1706d4347fc44b2abcafb2695fd40111/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:54.347181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.370530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107cda4-a86b-41c0-a513-8f82ffc8297a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.540459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.548575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.548575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.548575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.548575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.554535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.555488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244291-cc43-4287-a60f-9e4ca2dc80e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.568119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.569262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.569755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.570247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] PATH_INFO: `/v3/projects/4b6b8f4c31f2484f89d2235e761451ee/users/5be6dbec0a6549e699a2482abe677e30/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.574733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:54.598613 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 826/1632] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:54.600264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.620107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b8f4c31f2484f89d2235e761451ee, user_id=5be6dbec0a6549e699a2482abe677e30, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.626518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16e904-821f-4a75-92ae-da5b8e059602 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.634808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1583-cebe-4e8d-a248-7db7bd873ae0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.643250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.644483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.645080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.645557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.646813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.650233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.673560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 827/1633] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:54.675523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.700049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7600291-e758-47e2-896f-c68b27993f04 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.709692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.710792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.711451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.711934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.713261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.716333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.743397 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 828/1634] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:54.743397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.758386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab03c-df78-4c0c-ab54-5dd8dab86e4a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:54.780597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 807/1635] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:54 2022] PUT /identity/v3/projects/4b6b8f4c31f2484f89d2235e761451ee/users/5be6dbec0a6549e699a2482abe677e30/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:54.780597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.780597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.780597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.838818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] MFA Rules not processed for user `956215fdf043407180604d92e0270ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:54.841912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:54.867637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:54.868779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:54.869084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:54.869344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] PATH_INFO: `/v3/projects/3c732865ac764dfc83bace2444770db8/users/b8be11263dbb46b6988fcf068c452374/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:54.886588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:54.891978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c732865ac764dfc83bace2444770db8, user_id=b8be11263dbb46b6988fcf068c452374, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:54.894856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:54.971763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 808/1636] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:54.973031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:54.990828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f5c7c-9a61-4498-aaae-b3407987d0f3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.004392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.004392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.004392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.004392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.004949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.007979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.037537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 809/1637] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:55.037537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.045850 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 829/1638] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:54 2022] PUT /identity/v3/projects/3c732865ac764dfc83bace2444770db8/users/b8be11263dbb46b6988fcf068c452374/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:55.056456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.060395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874858c2-05a3-4d64-9697-6f98adf13e9d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.198749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.200185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.200686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.201184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] PATH_INFO: `/v3/projects/02d504da91c54df2be5cec5d151ec44f/users/b5f6fb845ef94a309d0127e1636bb9be/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.213615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ec6bd-e855-4d66-8c2e-51bc1395efe6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.230697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.231732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.233436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.233436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] PATH_INFO: `/v3/projects/e9622ed2749c4a8785d3edecc6716b2c/users/05dafcdf88774daca960a9cee0e7f6b9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.237956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9622ed2749c4a8785d3edecc6716b2c, user_id=05dafcdf88774daca960a9cee0e7f6b9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.244570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d504da91c54df2be5cec5d151ec44f, user_id=b5f6fb845ef94a309d0127e1636bb9be, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.244770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.245438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.271666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 830/1639] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:55 2022] PUT /identity/v3/projects/e9622ed2749c4a8785d3edecc6716b2c/users/05dafcdf88774daca960a9cee0e7f6b9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:55.274741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.385764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 810/1640] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:55 2022] PUT /identity/v3/projects/02d504da91c54df2be5cec5d151ec44f/users/b5f6fb845ef94a309d0127e1636bb9be/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:55.393615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.445024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0df4f-9011-4ac0-8d6e-f3bb8c474b3e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.508000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:55.562267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e66b27-8561-4219-b313-6ad21964ce25 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.574007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.575112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.575731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.576120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.578531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.581247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.588208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.589005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.589350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.591236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] PATH_INFO: `/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791/users/fa6f52cb0cd643e98535ba532fe2c384/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.598538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8231cbd10e4f4ea7eb62bf99dd0791, user_id=fa6f52cb0cd643e98535ba532fe2c384, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.598538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ca79e-a130-4f34-8ccb-92bb92a84da5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.615816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 831/1641] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:55 2022] PUT /identity/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791/users/fa6f52cb0cd643e98535ba532fe2c384/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:55.617460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ece7-93b0-42e6-87c5-f3b9f469c1cf None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.619416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ece7-93b0-42e6-87c5-f3b9f469c1cf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.619416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ece7-93b0-42e6-87c5-f3b9f469c1cf None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.621203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 811/1642] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:55.623026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.643323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 832/1643] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:30:55 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:30:55.644555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783898-b4c2-4bda-82c2-db7137ad3748 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.644973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746ece7-93b0-42e6-87c5-f3b9f469c1cf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:55.749770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:55.806495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:55.810083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.810571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.811780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] PATH_INFO: `/v3/projects/420d26b06e914da99f8e6227a04b57f0/users/1706d4347fc44b2abcafb2695fd40111/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.815954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420d26b06e914da99f8e6227a04b57f0, user_id=1706d4347fc44b2abcafb2695fd40111, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:55.823162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b43a33-2487-4c14-8ae9-a74650bed146 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:55.861221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746ece7-93b0-42e6-87c5-f3b9f469c1cf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:55.871185 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 812/1644] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:55 2022] PUT /identity/v3/projects/420d26b06e914da99f8e6227a04b57f0/users/1706d4347fc44b2abcafb2695fd40111/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:55.871185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51b22-cd3e-416b-adbe-ca1845e38916 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:55.871185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51b22-cd3e-416b-adbe-ca1845e38916 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:55.871185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd51b22-cd3e-416b-adbe-ca1845e38916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:55.970066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0fd51b22-cd3e-416b-adbe-ca1845e38916 None None] MFA Rules not processed for user `05dafcdf88774daca960a9cee0e7f6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:55.975815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0fd51b22-cd3e-416b-adbe-ca1845e38916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:56.055361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:56.058389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.059574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.060711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.063949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:56.069583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:56.109982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 833/1645] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:56.117892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:56.161582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1283a82-4355-43a4-8607-8d08335be475 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:56.183739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:56.184938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.185522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.186128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.187448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:56.190700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:56.220573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 834/1646] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:30:56.222624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:56.224553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 813/1647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:56.229213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.229889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.230558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.261945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d065-9b8e-4ade-94d1-d682c7bedf2c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:56.270325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:56.272254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.272877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.273468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] PATH_INFO: `/v3/projects/4b6b8f4c31f2484f89d2235e761451ee/users/5be6dbec0a6549e699a2482abe677e30/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.280487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b8f4c31f2484f89d2235e761451ee, user_id=5be6dbec0a6549e699a2482abe677e30, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:56.286953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63455084-dd41-497a-a999-879795f4b4e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:56.333762 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 835/1648] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:56 2022] PUT /identity/v3/projects/4b6b8f4c31f2484f89d2235e761451ee/users/5be6dbec0a6549e699a2482abe677e30/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:56.336181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c656-0ac8-4e05-b063-5f5444a2a7fa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.336889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c656-0ac8-4e05-b063-5f5444a2a7fa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.338773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c656-0ac8-4e05-b063-5f5444a2a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.384299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:56.386444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:56.415688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9165c656-0ac8-4e05-b063-5f5444a2a7fa None None] MFA Rules not processed for user `fa6f52cb0cd643e98535ba532fe2c384`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:56.418440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9165c656-0ac8-4e05-b063-5f5444a2a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:56.535751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.598352 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 836/1649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:56.599439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a55d-ce83-4985-9a84-8b6c83844345 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.600112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a55d-ce83-4985-9a84-8b6c83844345 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.600762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214a55d-ce83-4985-9a84-8b6c83844345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.612442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 814/1650] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:56.613860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:56.663029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0214a55d-ce83-4985-9a84-8b6c83844345 None None] MFA Rules not processed for user `1706d4347fc44b2abcafb2695fd40111`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:56.665134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0214a55d-ce83-4985-9a84-8b6c83844345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:56.707311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.765227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc5bbb-9614-4028-9d23-a6569e62c335 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:56.776930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:56.778054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.778543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.779015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] PATH_INFO: `/v3/projects/3c732865ac764dfc83bace2444770db8/users/b8be11263dbb46b6988fcf068c452374/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.784011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c732865ac764dfc83bace2444770db8, user_id=b8be11263dbb46b6988fcf068c452374, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:56.790165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:56.817086 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 815/1651] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:56 2022] PUT /identity/v3/projects/3c732865ac764dfc83bace2444770db8/users/b8be11263dbb46b6988fcf068c452374/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:56.840088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:56.889406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 837/1652] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:56.892355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225d89-f9f9-4093-b52b-9ec6f9ea8c31 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.893581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225d89-f9f9-4093-b52b-9ec6f9ea8c31 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.894081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5225d89-f9f9-4093-b52b-9ec6f9ea8c31 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:56.907081 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 838/1653] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:30:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:30:56.918659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd8c7-b9e4-4288-8dea-028715eb81b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:56.918659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd8c7-b9e4-4288-8dea-028715eb81b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:56.918659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd8c7-b9e4-4288-8dea-028715eb81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.005731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318525a-5a07-4270-a47d-f2313b6560c5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:57.016549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:57.017758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.018183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.018708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] PATH_INFO: `/v3/projects/02d504da91c54df2be5cec5d151ec44f/users/b5f6fb845ef94a309d0127e1636bb9be/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.022970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d504da91c54df2be5cec5d151ec44f, user_id=b5f6fb845ef94a309d0127e1636bb9be, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:57.028662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:57.036206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-94ddd8c7-b9e4-4288-8dea-028715eb81b4 None None] MFA Rules not processed for user `5be6dbec0a6549e699a2482abe677e30`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:57.038332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94ddd8c7-b9e4-4288-8dea-028715eb81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:57.051424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 816/1654] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:30:56 2022] PUT /identity/v3/projects/02d504da91c54df2be5cec5d151ec44f/users/b5f6fb845ef94a309d0127e1636bb9be/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:30:57.053024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:57.167593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:57.199808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e8b27-b9e6-4601-8e96-0acec0762743 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:57.212996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:57.214009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.214483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.214943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.223876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 839/1655] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:57.227562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.228679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.229427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.334878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:57.336910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc09f24-c3c1-4df7-937d-c4c2694b56b4 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:57.339337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] MFA Rules not processed for user `b8be11263dbb46b6988fcf068c452374`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:57.351532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 817/1656] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:57.353136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0d0c-d142-462a-be73-8e9caba144e5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.353427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0d0c-d142-462a-be73-8e9caba144e5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.353710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0d0c-d142-462a-be73-8e9caba144e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.367442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:57.400678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0f0e0d0c-d142-462a-be73-8e9caba144e5 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:57.402068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0f0e0d0c-d142-462a-be73-8e9caba144e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:57.415815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 818/1657] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:57.416744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39935a-000b-47a3-a30e-eee63589f164 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.422246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39935a-000b-47a3-a30e-eee63589f164 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.422526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39935a-000b-47a3-a30e-eee63589f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.464503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dd39935a-000b-47a3-a30e-eee63589f164 None None] MFA Rules not processed for user `c0986e6de5204c4d86e24184039366e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:57.475184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dd39935a-000b-47a3-a30e-eee63589f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:57.608910 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 819/1658] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:57.611279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.611877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.612622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.620057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 840/1659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:57.621861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:57.657073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] MFA Rules not processed for user `b5f6fb845ef94a309d0127e1636bb9be`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:57.658542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:57.664608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c950-ed74-4364-92ad-8cabc5ced8ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:57.689155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:57.690288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:57.690831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:57.691417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:57.751097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:57.819080 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 820/1660] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:57.841506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:57.843351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:57.856526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 841/1661] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:58.081412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.115020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1fe53-2a3c-4e39-a7e4-404a55e81f19 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.129914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.130960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.131464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.131871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.168472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:58.250115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.253663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:58.274071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 821/1662] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:30:58.308045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.324148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81369-7b06-4d61-8f59-b6ef3f8b657d service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.332279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.332995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.333279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.333552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.352435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.355711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:58.411686 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 842/1663] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:30:58.419385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.439845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb8d3-e625-4334-b02b-842cb12c0e71 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.461746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.463058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.463768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.464343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.482565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.485808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5201-7191-44b7-8b8f-a1aa23c22d17 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:58.507530 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 822/1664] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:58.554244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.573507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d186f-bd9f-47fd-9243-1f6fc421bed4 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.583849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.584623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.584928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.585334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.607235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26857-e2d7-4da8-a01d-4375b632d2d0 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.608403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26857-e2d7-4da8-a01d-4375b632d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.610771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26857-e2d7-4da8-a01d-4375b632d2d0 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.612852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.614764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 823/1665] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:30:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:30:58.618207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:58.621008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.621525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.621973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.653401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:58.654725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:58.656331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 843/1666] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:30:58.672125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 824/1667] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:58.687091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.689727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:58.810220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:58.836021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d8289-6e3d-430f-a8c3-7135b25ff1ef None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.864395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.868225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.868225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.868225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.913165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.920470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc385e-2e90-4bed-82d9-4e15e935a620 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:58.921887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfd15-4d1d-4be5-9cdf-253a175e9fbb service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:58.929321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:58.930925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:58.931606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:58.934882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:58.962718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 825/1668] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:58.979892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:58.989004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:59.017082 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 844/1669] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:59.175240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f1f5-1325-40ec-abab-46dc59643918 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:59.176130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f1f5-1325-40ec-abab-46dc59643918 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:59.176282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181f1f5-1325-40ec-abab-46dc59643918 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:59.178384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 826/1670] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:30:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:30:59.189507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:30:59.211388 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 04 20:30:59.212196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:59.214624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:59.215088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:59.215793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:59.235221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34963c9-1be4-40ca-8ebf-da68f8c86249 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:59.247851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '956215fdf043407180604d92e0270ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ca6436b25f44bd18223ac14ddee19fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:59.249331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:59.249905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:59.251191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] PATH_INFO: `/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:59.256319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: Authorizing `identity:get_project(project_id=0c5ff597f7974cb7b0ca20b154fdba8c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:59.261810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:59.274976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 845/1671] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:30:59 2022] GET /identity/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c => generated 377 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:30:59.275363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] MFA Rules not processed for user `9baf3883d6ac4328bf3aa9ffaaa48b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:30:59.275363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:30:59.395539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 827/1672] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:30:59.407669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:59.549881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c0fd-cae7-404d-9dcc-4baa54e4d619 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:59.557130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:59.557778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:59.558056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:59.558400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:59.559081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:59.561463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:30:59.577774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:59.772441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 846/1673] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:30:59 2022] POST /identity/v3/projects => generated 403 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:30:59.773762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:30:59.793900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd462f6-79a0-492e-b5df-5b69b3ee370d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:30:59.905767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:30:59.906898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:30:59.907477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:30:59.908007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:30:59.909988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:30:59.914454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:00.029408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:00.045216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 828/1674] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:30:59 2022] POST /identity/v3/users => generated 308 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:00.052018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:00.070022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e1514-aa09-4fec-be16-fa7ef5daff08 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:00.073714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:00.081070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:00.081856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.082173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.082471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.083617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:00.086270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:00.102592 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 847/1675] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:00.103660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:00.128702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a80d9-365b-43ff-a633-b9d51ac86993 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:00.135968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:00.136772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.137357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.137715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] PATH_INFO: `/v3/users/43c0d58694f7488181731c3089759fed` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.139832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c0d58694f7488181731c3089759fed)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:00.144112 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:31:00.144112 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:31:00.144112 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:31:00.148350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:00.262555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a117ef4-7e9b-4892-9714-7fbf16ee2e68 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:00.275961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:00.279876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.279876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.279876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.425311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:00.428064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:00.459848 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 829/1676] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:00.465957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:00.500047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89881-6ade-450d-a29c-908b41a0c8bf service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:00.516486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:00.518186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.519420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.521817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] PATH_INFO: `/v3/projects/d9d8207cd41c4b6d982277b75699008c/users/2ba27228585a404dbc2c996987759176/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.562863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8207cd41c4b6d982277b75699008c, user_id=2ba27228585a404dbc2c996987759176, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:00.568691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c86c-86fd-4300-b4a8-bd0317897356 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:00.637702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c0d58694f7488181731c3089759fed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:00.946802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c0d58694f7488181731c3089759fed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:00.959489 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 830/1677] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:00 2022] PUT /identity/v3/projects/d9d8207cd41c4b6d982277b75699008c/users/2ba27228585a404dbc2c996987759176/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:00.962132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b68-f187-4b39-a91f-dd2404746136 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.962628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b68-f187-4b39-a91f-dd2404746136 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.963162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b68-f187-4b39-a91f-dd2404746136 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.969027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c0d58694f7488181731c3089759fed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:00.974078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 831/1678] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 4 20:31:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:00.976872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b603-6093-4c6b-827d-63e97afe507e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.977431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b603-6093-4c6b-827d-63e97afe507e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.978073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b603-6093-4c6b-827d-63e97afe507e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.980875 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 832/1679] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:00.983406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cded8d-f85d-41ec-924e-97847228d297 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:00.983889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cded8d-f85d-41ec-924e-97847228d297 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:00.984400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cded8d-f85d-41ec-924e-97847228d297 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:00.995085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 833/1680] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:00.996691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cded8d-f85d-41ec-924e-97847228d297 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.010600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c0d58694f7488181731c3089759fed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:01.011905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b876724e-83c4-45d7-9ebd-0f63e83c7f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c0d58694f7488181731c3089759fed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:01.022417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 848/1681] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:00 2022] DELETE /identity/v3/users/43c0d58694f7488181731c3089759fed => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:01.024608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770f71-a0e4-4868-92a6-4707e9558bc8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.025008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770f71-a0e4-4868-92a6-4707e9558bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.025370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770f71-a0e4-4868-92a6-4707e9558bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.052618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00770f71-a0e4-4868-92a6-4707e9558bc8 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:01.054427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00770f71-a0e4-4868-92a6-4707e9558bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.140116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cded8d-f85d-41ec-924e-97847228d297 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.150278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 849/1682] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:01.151733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.152024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.152306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.166214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:01.192690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:01.195189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.239099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.240009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.240259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.240620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.241386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.243282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dce54-ea33-49ce-8d7d-b3235372ab30 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:01.256618 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 834/1683] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:01.260639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3da1-7dcc-4866-90bb-5306f820887b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.260639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3da1-7dcc-4866-90bb-5306f820887b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.260639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3da1-7dcc-4866-90bb-5306f820887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.288471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-510f3da1-7dcc-4866-90bb-5306f820887b None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:01.290183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-510f3da1-7dcc-4866-90bb-5306f820887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.299016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:01.304874 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 835/1684] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:01.307672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.307886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.308184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.347861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:01.349910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.350466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 850/1685] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:01.352530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.378576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef225e-f933-4565-b9f7-0b122582d3a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.379357 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 836/1686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:01.381625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.388618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.388877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.390060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.390601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.391438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.395091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.418273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf7225-37dd-4552-b2bb-b983acc9e42c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.421923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.425193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:01.431689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.431689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.431689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.431689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] PATH_INFO: `/v3/projects/d9d8207cd41c4b6d982277b75699008c/users/2ba27228585a404dbc2c996987759176/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.439104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8207cd41c4b6d982277b75699008c, user_id=2ba27228585a404dbc2c996987759176, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.445077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:01.447198 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 851/1687] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:01.449090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.457222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.486311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 837/1688] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:01 2022] PUT /identity/v3/projects/d9d8207cd41c4b6d982277b75699008c/users/2ba27228585a404dbc2c996987759176/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:01.488447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.498551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf670f6-4835-4dac-b254-2501774bcca7 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.503711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:01.683820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.685764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.685764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.685764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.695554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730d07-f1bd-4ecc-890e-157131ec234f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.709339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.710681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.712746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.713462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.715582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.718781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:01.757687 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 852/1689] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:01.760851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:01.796668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a040-ff1c-474f-adb9-6066985c44fd service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:01.810668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:01.812093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:01.812724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:01.814468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:01.961364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.965635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd228d9d-d13d-401a-bad8-996abaf25f9f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:01.991913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:01.992635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 838/1690] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:01.995623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:02.013276 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 853/1691] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:02.188852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adb-4607-41b4-a19e-8e20a1de1b11 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:02.204414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adb-4607-41b4-a19e-8e20a1de1b11 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:02.204414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adb-4607-41b4-a19e-8e20a1de1b11 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:02.204414 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 839/1692] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:02.205215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:02.209199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:02.238582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:02.240476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:02.315573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:02.344483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fceedb-df2a-4c6a-8626-52c70e228d05 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:02.353273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '956215fdf043407180604d92e0270ae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ca6436b25f44bd18223ac14ddee19fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:02.354959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:02.355768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:02.356513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] PATH_INFO: `/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:02.359546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: Authorizing `identity:get_project(project_id=0c5ff597f7974cb7b0ca20b154fdba8c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:02.378471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017677-0497-4e14-96d4-85991dabeff7 tempest-FlavorsAccessTestJSON-1807878219 tempest-FlavorsAccessTestJSON-1807878219-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:02.381950 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 854/1693] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:02 2022] GET /identity/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c => generated 377 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:31:02.755972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d5fc-55f7-41c3-8e71-b03c4d62c2eb None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:02.755972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d5fc-55f7-41c3-8e71-b03c4d62c2eb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:02.755972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d5fc-55f7-41c3-8e71-b03c4d62c2eb None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:02.755972 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 840/1694] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:31:02.763658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:02.764401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:02.764713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:02.818001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:02.820973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:02.855427 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 855/1695] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:02.905587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d5fc-55f7-41c3-8e71-b03c4d62c2eb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:02.943870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5d5fc-55f7-41c3-8e71-b03c4d62c2eb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:02.966256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:02.968277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:02.968878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:02.969658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:02.989953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:02.993454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:03.017262 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 841/1696] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:03.223242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:03.226751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:03.280138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7b2f-dd5f-409e-92f3-57e5ecf73851 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:03.296383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:03.298969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:03.299622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:03.301651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] PATH_INFO: `/v3/projects/f269e58e08544c53985cabdb7c9328be` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:03.305151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f269e58e08544c53985cabdb7c9328be)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:03.314533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:03.548653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f269e58e08544c53985cabdb7c9328be', 'request_id': 'req-f26d8d44-9711-434f-a9d1-ceb8da0db64f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:03.564963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f269e58e08544c53985cabdb7c9328be', 'request_id': 'req-f26d8d44-9711-434f-a9d1-ceb8da0db64f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:03.603315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f269e58e08544c53985cabdb7c9328be', 'request_id': 'req-f26d8d44-9711-434f-a9d1-ceb8da0db64f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:03.742248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] The token cache is being invalidate because project f269e58e08544c53985cabdb7c9328be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:03.742899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:03.744641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:03.748317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 856/1697] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:03 2022] DELETE /identity/v3/projects/f269e58e08544c53985cabdb7c9328be => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:03.759491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:03.784615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189465-b48a-4486-9f28-7873e2a48151 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:03.818350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:04.010230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:04.011785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:04.012253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:04.012739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] PATH_INFO: `/v3/users/b5f6fb845ef94a309d0127e1636bb9be` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:04.016527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f6fb845ef94a309d0127e1636bb9be)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:04.022124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:04.320899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:04.327285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:04.376309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f6fb845ef94a309d0127e1636bb9be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:04.377510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f6fb845ef94a309d0127e1636bb9be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:04.545916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f6fb845ef94a309d0127e1636bb9be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:04.561312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8d44-9711-434f-a9d1-ceb8da0db64f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:04.574693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:04.575830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:04.590161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:04.590161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:04.590161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:04.623064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f6fb845ef94a309d0127e1636bb9be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:04.683517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f6fb845ef94a309d0127e1636bb9be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:04.746849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 842/1698] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:03 2022] DELETE /identity/v3/users/b5f6fb845ef94a309d0127e1636bb9be => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:04.749420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:04.764767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:04.856916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:04.866100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:04.889138 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 857/1699] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:05.090342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e720c-8be3-45c0-bc68-22e8df7983ad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:05.126473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:05.129837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:05.129837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:05.129837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] PATH_INFO: `/v3/users/9cbd2fa6b7cc46788661bc5aaa8f5297` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:05.138260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbd2fa6b7cc46788661bc5aaa8f5297)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:05.142828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:05.475266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:05.517368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbd2fa6b7cc46788661bc5aaa8f5297'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:05.518977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbd2fa6b7cc46788661bc5aaa8f5297'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:05.661202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:05.665736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:05.680953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbd2fa6b7cc46788661bc5aaa8f5297'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:05.704342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:05.788569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7097-355e-4125-afa8-7aa9ca31ea94 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:05.813192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbd2fa6b7cc46788661bc5aaa8f5297'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:05.833526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:05.835426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:05.835938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:05.836412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] PATH_INFO: `/v3/projects/02d504da91c54df2be5cec5d151ec44f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:05.843646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d504da91c54df2be5cec5d151ec44f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:05.847385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:05.928579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7155fd75-9c97-48b8-931a-12c1b11e3fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbd2fa6b7cc46788661bc5aaa8f5297'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:05.941194 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 843/1700] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:04 2022] DELETE /identity/v3/users/9cbd2fa6b7cc46788661bc5aaa8f5297 => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:05.947424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:05.948244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:05.948856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:06.022581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:06.024166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:06.169146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d504da91c54df2be5cec5d151ec44f', 'request_id': 'req-f6a64c2c-2ef0-4702-9942-9a2987232004'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:06.209720 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 844/1701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:06.211041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d504da91c54df2be5cec5d151ec44f', 'request_id': 'req-f6a64c2c-2ef0-4702-9942-9a2987232004'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:06.233596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:06.234404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d504da91c54df2be5cec5d151ec44f', 'request_id': 'req-f6a64c2c-2ef0-4702-9942-9a2987232004'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:06.237005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:06.350537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] The token cache is being invalidate because project 02d504da91c54df2be5cec5d151ec44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:06.351263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:06.356202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6a64c2c-2ef0-4702-9942-9a2987232004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:06.361153 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 858/1702] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:05 2022] DELETE /identity/v3/projects/02d504da91c54df2be5cec5d151ec44f => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:06.376000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69191-bc0c-46a8-b949-762d17b9eaf5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:06.376515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69191-bc0c-46a8-b949-762d17b9eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:06.378819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69191-bc0c-46a8-b949-762d17b9eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:06.433392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a7e9-f0e8-48a6-9632-7186762ba645 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:06.453208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e8e69191-bc0c-46a8-b949-762d17b9eaf5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:06.468558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e8e69191-bc0c-46a8-b949-762d17b9eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:06.572514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:06.573633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:06.573953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:06.574228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:06.578350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:06.637319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 859/1703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:06.653143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:06.655881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:06.656373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:06.745147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:06.746858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:06.766018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:06.769369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:06.772605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 845/1704] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:06.808959 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 860/1705] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:06.814902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:06.877508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1882-6999-46e3-b44f-1e76e025314f service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:06.913490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:06.915043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:06.920077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:06.920585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:06.921867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:06.922448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:06.927307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:06.971198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 846/1706] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:06.976286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:07.031749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e77079-7751-42e6-b22a-7b21601cea92 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:07.043120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:07.045113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:07.046012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:07.047490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:07.049886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:07.055472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:07.078836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:07.146667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:07.159932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:07.183372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38bd68-98b9-4405-ae35-7e19655c6187 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:07.207759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:07.207759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:07.207759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:07.207759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] PATH_INFO: `/v3/users/907fc7095b8e4c63a9fe0fb8ae71a2b2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:07.208561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907fc7095b8e4c63a9fe0fb8ae71a2b2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:07.213308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:07.272523 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 861/1707] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:06 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:07.282516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:07.540145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:07.554171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320c080-122c-429d-8094-a960936e13ac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:07.560822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:07.561720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:07.568000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:07.568000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:07.568000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:07.568000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:07.587630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907fc7095b8e4c63a9fe0fb8ae71a2b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:07.589251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907fc7095b8e4c63a9fe0fb8ae71a2b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:07.699079 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 862/1708] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:07 2022] POST /identity/v3/users => generated 294 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:31:07.703912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:07.709604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:07.769763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907fc7095b8e4c63a9fe0fb8ae71a2b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:07.824929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907fc7095b8e4c63a9fe0fb8ae71a2b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:07.863420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907fc7095b8e4c63a9fe0fb8ae71a2b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:07.929596 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 847/1709] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:07 2022] DELETE /identity/v3/users/907fc7095b8e4c63a9fe0fb8ae71a2b2 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:07.936758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:07.939872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:08.004167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a06be-910d-44d6-a79d-7ef0fe8665cd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:08.216900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf261d4-1b5a-482c-9709-defd86a7e5d7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:08.241920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:08.243784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:08.244509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:08.245167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:08.246584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:08.258773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:08.326348 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 848/1710] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:08.326348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:08.334403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:08.384259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf04fd-c676-420b-8063-8e5b1c92e23a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:08.405516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:08.420879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:08.422977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:08.424062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:08.424617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:08.425108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:08.426422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:08.430573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] PATH_INFO: `/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:08.431608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:08.440093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5ff597f7974cb7b0ca20b154fdba8c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:08.449958 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:31:08.449958 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:31:08.449958 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:31:08.459110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:08.540332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:08.817843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:08.830101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2915f6-5b62-4f14-9bb7-13f78ddfd0f0 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:08.861986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 863/1711] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:08.866266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:08.866937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:08.867526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:08.928374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:08.938658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:08.963447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5ff597f7974cb7b0ca20b154fdba8c', 'request_id': 'req-989f09be-35bd-498b-8c54-173d5c1676d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:08.994766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:09.157930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5ff597f7974cb7b0ca20b154fdba8c', 'request_id': 'req-989f09be-35bd-498b-8c54-173d5c1676d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.171845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 864/1712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:09.173316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:09.188789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5ff597f7974cb7b0ca20b154fdba8c', 'request_id': 'req-989f09be-35bd-498b-8c54-173d5c1676d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.202324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e890-2242-4b31-a4cd-a9471f26558e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:09.216514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:09.218747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:09.219269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:09.220847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:09.223269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] The token cache is being invalidate because project 0c5ff597f7974cb7b0ca20b154fdba8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:09.223662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.226914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:09.237637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:09.257414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-989f09be-35bd-498b-8c54-173d5c1676d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.263006 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 849/1713] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:08 2022] DELETE /identity/v3/projects/0c5ff597f7974cb7b0ca20b154fdba8c => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:09.271589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:09.272274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:09.272758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:09.300130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 865/1714] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:09.314679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:09.321425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:09.340278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] MFA Rules not processed for user `72398073905c49ee952b40ce1a53fd28`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:09.346205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:09.370393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b87d-5bd5-40b1-a05f-6901eda4028d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:09.381726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:09.383449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:09.384174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:09.385614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] PATH_INFO: `/v3/users/956215fdf043407180604d92e0270ae8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:09.389148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956215fdf043407180604d92e0270ae8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:09.394197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:09.515763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 850/1715] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:09.519583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:09.524252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:09.564963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1a79-5827-4c16-834d-678f7f58d826 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:09.575105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:09.576661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:09.577305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:09.580006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] PATH_INFO: `/v3/projects/cca5ac4fa025454cab4aa8e3f9fa9644/users/d43c12d5f59b43ebb3580c53d4301267/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:09.651650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca5ac4fa025454cab4aa8e3f9fa9644, user_id=d43c12d5f59b43ebb3580c53d4301267, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:09.659900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f30e-c813-4b9a-b04f-033c1aefb830 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:09.748378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956215fdf043407180604d92e0270ae8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.799957 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 851/1716] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:09 2022] PUT /identity/v3/projects/cca5ac4fa025454cab4aa8e3f9fa9644/users/d43c12d5f59b43ebb3580c53d4301267/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:09.802493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:09.803224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:09.803744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:09.867027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956215fdf043407180604d92e0270ae8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.890054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956215fdf043407180604d92e0270ae8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.925360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:09.927223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:09.931664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956215fdf043407180604d92e0270ae8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.933223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956215fdf043407180604d92e0270ae8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:09.947045 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 866/1717] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:09 2022] DELETE /identity/v3/users/956215fdf043407180604d92e0270ae8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:09.948831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:09.952412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:10.032997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:10.081203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 852/1718] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:10.085042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:10.090421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:10.137660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb797-df23-495d-a293-bbfc46e6f773 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:10.158352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:10.159708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:10.160211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:10.160702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:10.170585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:10.473349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:10.557904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4cef9-20b1-4328-b2b0-35564368dd60 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:10.564517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:10.574587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6281fa7-0039-4614-affd-ba06dc8e6cb9 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:10.610904 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 867/1719] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:10.617333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:10.617926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:10.618438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:10.754468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] MFA Rules not processed for user `d43c12d5f59b43ebb3580c53d4301267`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:10.756927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:10.886584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:10.897475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:10.898157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:10.900129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:10.906668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:11.040520 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 868/1720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:11.042384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:11.049847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:11.070366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:11.072963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:11.111005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 853/1721] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1029 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:11.126494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:11.129429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:11.173929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3aa66-0478-4e64-b6d2-cdc92a52faba service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:11.192662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:11.193555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:11.193996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:11.194393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:11.195576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:11.198106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:11.245537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bebe8d-933c-49f4-954a-f67204276885 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:11.255593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:11.257314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:11.257597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:11.257875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:11.356536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:11.376369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:11.378622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:11.379757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 854/1722] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:11 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:11.390115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:11.403263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:11.422294 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 869/1723] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:11.659435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfef0f-36b4-404f-a11d-a2a761e2caff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:11.706744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:11.707267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:11.708612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:11.709122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:11.710691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:11.714948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:11.891659 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 855/1724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:11 2022] POST /identity/v3/users => generated 300 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:11.900650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:11.950159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ea3f-64ad-4a8d-b216-024cb4b05a23 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:11.964078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:11.965291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:11.965793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:11.966867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:11.968389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:11.973127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55813-f5fd-48d7-9dba-dbec5696ead8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:12.004559 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 870/1725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:31:12.009713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:12.088485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983597d-de4d-42b8-b5b1-f97010de3726 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:12.116804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:12.124241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:12.124904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:12.128634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] PATH_INFO: `/v3/projects/c082618393b04fb998b0bfa587f3619d/users/ad95d1c62e7e4130b1c8092d5f00c630/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:12.272874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c082618393b04fb998b0bfa587f3619d, user_id=ad95d1c62e7e4130b1c8092d5f00c630, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:12.283958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:12.481689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:12.484075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:12.484075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:12.583247 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 856/1726] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:12 2022] PUT /identity/v3/projects/c082618393b04fb998b0bfa587f3619d/users/ad95d1c62e7e4130b1c8092d5f00c630/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:12.596308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:12.672395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:12.724384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:12.902884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 871/1727] 10.222.0.83 () {58 vars in 1015 bytes} [Tue Oct 4 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:12.961669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:12.964398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:12.988275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221cd34-68ee-426b-98c1-e7766c0e181a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:12.995128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:12.996458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:12.997200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:12.999171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:13.016387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:13.023008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:13.032815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff35d-b168-49bf-8237-602e5072290e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:13.049314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:13.051744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:13.053017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:13.053793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:13.055933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:13.062276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201fad7-64aa-4396-b78b-bc2a3b127ef6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:13.066885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 872/1728] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:13.102251 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 857/1729] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:13.109488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:13.132711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5cac-7a7e-4550-9a42-1da1cb99b866 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:13.152100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:13.153293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:13.156817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:13.157683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] PATH_INFO: `/v3/projects/c082618393b04fb998b0bfa587f3619d/users/ad95d1c62e7e4130b1c8092d5f00c630/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:13.165574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c082618393b04fb998b0bfa587f3619d, user_id=ad95d1c62e7e4130b1c8092d5f00c630, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:13.176204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:13.227319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 873/1730] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:13 2022] PUT /identity/v3/projects/c082618393b04fb998b0bfa587f3619d/users/ad95d1c62e7e4130b1c8092d5f00c630/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:13.237164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:13.237948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:13.238485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:13.370480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] MFA Rules not processed for user `ad95d1c62e7e4130b1c8092d5f00c630`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:13.375108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:13.576419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:13.580398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:13.645572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:13.711627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 858/1731] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:13.872461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acead8-421a-496f-af89-d25e319eca78 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:13.894580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:13.898354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:13.898812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:13.899120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] PATH_INFO: `/v3/projects/7ca6436b25f44bd18223ac14ddee19fb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:13.904701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca6436b25f44bd18223ac14ddee19fb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:13.910614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:13.967805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:13.974071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:14.235645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:14.250679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca6436b25f44bd18223ac14ddee19fb', 'request_id': 'req-79b4c023-c544-4847-a1d1-45ce1daf5237'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:14.280939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca6436b25f44bd18223ac14ddee19fb', 'request_id': 'req-79b4c023-c544-4847-a1d1-45ce1daf5237'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:14.302145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca6436b25f44bd18223ac14ddee19fb', 'request_id': 'req-79b4c023-c544-4847-a1d1-45ce1daf5237'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:14.349394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b69838-c88c-4f02-b435-cb41b0714d9d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:14.472877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] The token cache is being invalidate because project 7ca6436b25f44bd18223ac14ddee19fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:14.473305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:14.478508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:14.482405 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 874/1732] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:13 2022] DELETE /identity/v3/projects/7ca6436b25f44bd18223ac14ddee19fb => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:14.496708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:14.505184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:14.761628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:14.764373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:14.766892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:14.766892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:14.776875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:14.846699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4c023-c544-4847-a1d1-45ce1daf5237 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:14.880409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:14.882819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:14.892718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:14.897950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] PATH_INFO: `/v3/projects/70afd75b4b4c4e758a784365a7c45d67` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:14.900588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70afd75b4b4c4e758a784365a7c45d67)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:14.909982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:15.098642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:15.101083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53deb07-8fd4-41fc-9ebe-f6a8691fb2e8 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:15.119002 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 859/1733] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 1153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:15.121622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908990dd-f633-4b27-84eb-0729f27562ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:15.122042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908990dd-f633-4b27-84eb-0729f27562ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:15.122404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908990dd-f633-4b27-84eb-0729f27562ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:15.177859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-908990dd-f633-4b27-84eb-0729f27562ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:15.188612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-908990dd-f633-4b27-84eb-0729f27562ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:15.280569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:15.290632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70afd75b4b4c4e758a784365a7c45d67', 'request_id': 'req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:15.413266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70afd75b4b4c4e758a784365a7c45d67', 'request_id': 'req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:15.413266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70afd75b4b4c4e758a784365a7c45d67', 'request_id': 'req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:15.484586 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 860/1734] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:15.487642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:15.488044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:15.488342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:15.554531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] The token cache is being invalidate because project 70afd75b4b4c4e758a784365a7c45d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:15.555032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:15.557620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:15.562801 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 875/1735] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:14 2022] DELETE /identity/v3/projects/70afd75b4b4c4e758a784365a7c45d67 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:15.564100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:15.564764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:15.568109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:15.571266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:15.613304 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 861/1736] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:15.613304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:15.617497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:15.658407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cc09f-3701-49c7-a51d-658f9b63fc57 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:15.667505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:15.668665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:15.670801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:15.671423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] PATH_INFO: `/v3/users/5be6dbec0a6549e699a2482abe677e30` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:15.689078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be6dbec0a6549e699a2482abe677e30)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:15.693743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:15.842092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:15.858209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2519-d84b-4d4a-a4b6-df0adc959ca5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:15.877768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:15.878540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:15.878842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:15.879230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:15.887170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:16.009602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be6dbec0a6549e699a2482abe677e30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:16.011678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be6dbec0a6549e699a2482abe677e30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:16.109807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:16.114900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:16.155761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 876/1737] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:16.157798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:16.199522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749ae2-616a-461a-b286-0de7aa539149 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:16.206867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:16.207366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be6dbec0a6549e699a2482abe677e30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:16.211395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:16.215839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:16.215839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:16.215839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:16.215839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:16.215839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:16.270788 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 877/1738] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:16.272375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:16.297497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be6dbec0a6549e699a2482abe677e30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:16.308399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae1b2-aaa3-4528-a50a-4e8bcb13a12d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:16.336608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be6dbec0a6549e699a2482abe677e30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:16.354463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:16.357956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:16.363021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:16.364850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:16.367531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:16.372541 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 862/1739] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:15 2022] DELETE /identity/v3/users/5be6dbec0a6549e699a2482abe677e30 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:16.383400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:16.589369 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 878/1740] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:16 2022] POST /identity/v3/projects => generated 393 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:31:16.599075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:16.599075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:16.837350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a569ae-03fc-4371-a522-5ac06686de9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:17.010498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:17.090000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:17.092144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:17.093070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:17.093938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:17.096443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:17.102066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:17.279209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 863/1741] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:16 2022] POST /identity/v3/users => generated 297 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:17.283506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:17.307477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd823-0501-4a7e-942b-cac557137376 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:17.315598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:17.318832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:17.318832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:17.318832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:17.318832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:17.326402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:17.355029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 879/1742] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:17.359888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:17.379482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fa839-c0d5-4287-aa66-e147b3f9034b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:17.400124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:17.401754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:17.402669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:17.403625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:17.405148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:17.410474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e811b3f-4622-4c17-994a-26308607642f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:17.476154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:17.488587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 864/1743] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:17.503738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110388-e263-45cd-a357-0d7d1222a714 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:17.511600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:17.511600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:17.527001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:17.530771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74/users/003a541ef0c54e64bc7f02b3196a5ba1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:17.583894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c71e3ed7854c4c82df7a4a34375b74, user_id=003a541ef0c54e64bc7f02b3196a5ba1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:17.605394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:17.748051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 880/1744] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:17 2022] PUT /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74/users/003a541ef0c54e64bc7f02b3196a5ba1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:17.775889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:17.775889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:17.775889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:17.895504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] MFA Rules not processed for user `003a541ef0c54e64bc7f02b3196a5ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:17.900307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:17.915618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:17.920082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:18.282840 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 865/1745] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:18.289059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f41a4-8de6-42dc-b82d-729cc4979d36 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:18.321483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:18.329648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:18.339933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:18.346852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:18.347671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:18.348342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] PATH_INFO: `/v3/users/d43c12d5f59b43ebb3580c53d4301267` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:18.354548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43c12d5f59b43ebb3580c53d4301267)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:18.364671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:18.396409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1792ed-d3f8-4f2c-852e-04ef722303ba None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:18.416020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:18.419978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:18.427420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:18.428049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] PATH_INFO: `/v3/users/010c61cd184d44738f9782856a99731b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:18.451176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010c61cd184d44738f9782856a99731b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:18.463766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:18.766145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:18.803804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43c12d5f59b43ebb3580c53d4301267'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:18.890078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010c61cd184d44738f9782856a99731b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:18.892407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010c61cd184d44738f9782856a99731b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:18.923078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43c12d5f59b43ebb3580c53d4301267'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:18.941997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43c12d5f59b43ebb3580c53d4301267'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:18.997557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43c12d5f59b43ebb3580c53d4301267'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.009777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43c12d5f59b43ebb3580c53d4301267'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.034752 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 881/1746] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:17 2022] DELETE /identity/v3/users/d43c12d5f59b43ebb3580c53d4301267 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:19.036270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:19.038081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:19.063210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010c61cd184d44738f9782856a99731b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.088071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010c61cd184d44738f9782856a99731b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.117726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010c61cd184d44738f9782856a99731b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.149970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 866/1747] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:18 2022] DELETE /identity/v3/users/010c61cd184d44738f9782856a99731b => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:19.151157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:19.160576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:19.256464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:19.323527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e354df-5fb3-4d70-9a39-b43e01405fa9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:19.493319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:19.495295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:19.496204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:19.497003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] PATH_INFO: `/v3/projects/4b6b8f4c31f2484f89d2235e761451ee` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:19.500244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6b8f4c31f2484f89d2235e761451ee)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:19.500448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2340f-d4f4-4911-bed4-4458f1302964 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:19.503576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:19.511673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:19.513102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:19.517975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:19.517975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:19.517975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:19.519716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a561-2b00-491a-848f-e27c9ade5968 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:19.745956 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 867/1748] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:19 2022] POST /identity/v3/projects => generated 395 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:19.762933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218c86-292f-43b4-b642-967a5872b592 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:19.763689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218c86-292f-43b4-b642-967a5872b592 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:19.764217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c218c86-292f-43b4-b642-967a5872b592 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:19.767060 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 868/1749] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:31:19 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:19.772833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:19.777257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:19.779857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:19.793630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6b8f4c31f2484f89d2235e761451ee', 'request_id': 'req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.814073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6b8f4c31f2484f89d2235e761451ee', 'request_id': 'req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.834574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:19.853541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6b8f4c31f2484f89d2235e761451ee', 'request_id': 'req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:19.869354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:19.877068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.085134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] The token cache is being invalidate because project 4b6b8f4c31f2484f89d2235e761451ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:20.086310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:20.089916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1c13ca7b-2869-4648-96c1-34c6bbb9f6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:20.098211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 882/1750] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:19 2022] DELETE /identity/v3/projects/4b6b8f4c31f2484f89d2235e761451ee => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:20.102711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361e74-00e7-453a-8926-a96ec5c58802 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.107593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361e74-00e7-453a-8926-a96ec5c58802 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.108030 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 869/1751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:20.108825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:20.110358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361e74-00e7-453a-8926-a96ec5c58802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.146601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257c7c-2dd1-49ae-aebc-042157d4d08d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:20.159281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:20.160602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.161671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.162292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.163701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:20.171879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760de33-6e9b-4d88-b8a3-60059a66d472 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:20.180964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9a361e74-00e7-453a-8926-a96ec5c58802 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:20.186615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9a361e74-00e7-453a-8926-a96ec5c58802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.207884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 883/1752] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:20.211631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.212832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.214171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.270518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:20.274877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.346315 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 870/1753] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:20 2022] POST /identity/v3/users => generated 304 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:20.351725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.352742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.353666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.445154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:20.447583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.494279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 871/1754] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:20.495774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:20.498564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.620550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 884/1755] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:20.622664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:20.638161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.753359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a8336-c2fc-40cf-a506-63ced081eb87 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:20.776080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:20.781157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.783316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.783832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.803074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:20.906161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1cdc-564e-4d98-8b5f-5141f3895490 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:20.914506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:20.916411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:20.917331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:20.918468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:20.928516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:20.937662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461b083-e2cd-47b5-bb03-7c9987e625b3 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:20.942309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:20.945252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:20.966926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 885/1756] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:20.968857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:20.970423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:21.005362 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 872/1757] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:21.007808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.015435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.015966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.045993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a60874-ff0d-48ad-858d-7c129bcbd748 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:21.067650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:21.078557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.079461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.080194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.091527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:21.097198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:21.150474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:21.151834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 886/1758] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:21.152779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:21.153916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:21.162239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:21.221301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2844-b366-4b8d-a11c-30fcc2303263 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:21.233067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:21.234455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.235516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.236156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.244688 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 873/1759] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:21.244688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:21.299510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5168c4d-0f91-479c-be37-47afb4d2d14f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:21.300186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:21.309244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:21.317272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:21.318462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.318953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.319509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] PATH_INFO: `/v3/projects/7ed4ed8d04654505aab32609420b930e/users/282befeaa1a94c40a9bba4f8d5441677/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.363581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:21.381007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 887/1760] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:21.382494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed4ed8d04654505aab32609420b930e, user_id=282befeaa1a94c40a9bba4f8d5441677, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:21.384465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:21.388522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:21.495515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a15-28fe-4896-a8f6-a8faa138e362 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:21.501467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 874/1761] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:21 2022] PUT /identity/v3/projects/7ed4ed8d04654505aab32609420b930e/users/282befeaa1a94c40a9bba4f8d5441677/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:21.503194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:21.896026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:21.916235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d877d-8469-4202-979e-63745f4ae336 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:21.942198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:21.951438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.951438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.951438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.951891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:21.953676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:21.954259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:21.954815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:21.957210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:21.961418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:21.962248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:21.962870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:21.972159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:22.005965 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 875/1762] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:22.030147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:22.035816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 888/1763] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:22.038522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:22.050841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05446785-98fd-4591-837e-eda70ec58cfc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:22.065470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e702e-3e24-4806-998c-0aaffa7de72f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:22.073412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:22.074428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.074828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.075803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.076609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:22.079523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:22.082846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:22.083996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.084482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.086868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] PATH_INFO: `/v3/projects/7ed4ed8d04654505aab32609420b930e/users/282befeaa1a94c40a9bba4f8d5441677/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.092546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed4ed8d04654505aab32609420b930e, user_id=282befeaa1a94c40a9bba4f8d5441677, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:22.096183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd836b5f-391d-433a-8507-5db59de82111 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:22.138394 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 876/1764] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:22 2022] PUT /identity/v3/projects/7ed4ed8d04654505aab32609420b930e/users/282befeaa1a94c40a9bba4f8d5441677/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:22.155156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.155935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.155935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.229545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 889/1765] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:22 2022] POST /identity/v3/projects => generated 401 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:22.237662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:22.248257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] MFA Rules not processed for user `282befeaa1a94c40a9bba4f8d5441677`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:22.251447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:22.545436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1dab-da82-4b0e-abed-fa46053202a2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:22.558346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:22.562987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.563527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.563967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.564991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:22.568062 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 877/1766] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:22.573272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f48b3-8974-43ce-a301-24f53540361d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:22.575984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:22.638966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc75cb-c697-43ed-96f4-5f616d414489 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:22.665127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:22.671219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.671219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.671219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.671219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:22.718737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:22.771011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 890/1767] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:22 2022] POST /identity/v3/users => generated 301 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:22.778159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:22.782470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:22.785187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:22.941449 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 878/1768] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:22 2022] POST /identity/v3/projects => generated 393 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:22.943751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:22.966636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] MFA Rules not processed for user `2ba27228585a404dbc2c996987759176`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:22.970682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:23.173042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:23.318351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72504-98a2-4e37-a5a3-b992617949e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:23.358736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:23.360297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:23.361116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:23.361799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:23.363616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:23.374580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:23.405156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 891/1769] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 633 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:23.411229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:23.429568 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 879/1770] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:23.439245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:23.441941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:23.466042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5a5b6-1590-4007-991a-28dc9b0f5661 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:23.485206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:23.487107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:23.488529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:23.488529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:23.489665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:23.494665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:23.636258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 892/1771] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:23 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:23.649000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:23.698994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e761b-e519-47a4-9114-bce27b348d86 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:23.726642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:23.728214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:23.728719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:23.729210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:23.730497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:23.741594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:23.806321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66741c-6650-4745-8c96-46f25e50e921 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:23.807424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 893/1772] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:23.811909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:23.831187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:23.832522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:23.833029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:23.833578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:23.846170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:23.870303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19b470-bb3e-4949-bd6d-4ae6d6aa16e2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:23.904479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:23.907890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:23.911015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:23.912560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:23.914087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:23.924759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:23.936158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:23.962932 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 894/1773] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:23.964744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:23.997351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befffc3-190f-4f61-9547-134c3908603c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:24.006765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:24.007991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:24.008447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:24.008990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] PATH_INFO: `/v3/projects/d5e1a6ff56a04eb894224826f792e6bf/users/3b681070354e428580e1ff15c29995ac/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:24.041068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:24.051227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:24.054453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e1a6ff56a04eb894224826f792e6bf, user_id=3b681070354e428580e1ff15c29995ac, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:24.065252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:24.089723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 880/1774] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:24.092781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:24.123054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0bf9-20b1-4782-aacb-ff082090d857 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:24.148940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:24.148940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:24.161275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:24.162000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:24.165988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:24.172872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:24.230593 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 881/1775] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:24.238739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:24.248997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 895/1776] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:23 2022] PUT /identity/v3/projects/d5e1a6ff56a04eb894224826f792e6bf/users/3b681070354e428580e1ff15c29995ac/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:24.252012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:24.338046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c6a29-4f04-4423-9e9b-13f63b2f4861 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:24.443943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935339-3ab1-4781-a6bd-74a0816c13a9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:24.451999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:24.451999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:24.451999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:24.451999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] PATH_INFO: `/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a/users/7f6feba870cb418da73b3c23e42e7f82/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:24.511286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8efdc4b00404ebfb9af2fc44fe4c92a, user_id=7f6feba870cb418da73b3c23e42e7f82, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:24.531517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015ebf1-71c9-48f4-ac61-a89f11ebad25 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:24.580341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:24.622877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:24.624576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:24.625317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:24.626115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:24.716711 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 896/1777] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:24 2022] PUT /identity/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a/users/7f6feba870cb418da73b3c23e42e7f82/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:24.719171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b7b6-a40d-4c8c-b98a-08c9a4d07712 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:24.719969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b7b6-a40d-4c8c-b98a-08c9a4d07712 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:24.720458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b7b6-a40d-4c8c-b98a-08c9a4d07712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:24.830556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7b91b7b6-a40d-4c8c-b98a-08c9a4d07712 None None] MFA Rules not processed for user `3b681070354e428580e1ff15c29995ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:24.832207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b91b7b6-a40d-4c8c-b98a-08c9a4d07712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:24.900480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:24.903946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:24.935648 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 882/1778] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:24.937418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:24.952202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:25.010987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af821-ccb5-411a-bc1a-5b8a3428930d service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:25.113531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 897/1779] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:25.116423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:25.116804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:25.117080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:25.265951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] MFA Rules not processed for user `7f6feba870cb418da73b3c23e42e7f82`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:25.267982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:25.367676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:25.372788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:25.373022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:25.373478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] PATH_INFO: `/v3/projects/cca5ac4fa025454cab4aa8e3f9fa9644` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:25.381604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:25.387098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca5ac4fa025454cab4aa8e3f9fa9644)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:25.395357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:25.465470 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 898/1780] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:25.466982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:25.469111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:25.531327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e835-c990-4fdb-9f73-0326adfd3186 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:25.539252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:25.539252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:25.539252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:25.540523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] PATH_INFO: `/v3/projects/d0222cc92ab44873bb0fa83d41176327` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:25.540967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0222cc92ab44873bb0fa83d41176327)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:25.543580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:25.613748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'request_id': 'req-95949f28-0da8-4a16-b44e-29dff2b84c19'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.717574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'request_id': 'req-95949f28-0da8-4a16-b44e-29dff2b84c19'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.730557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca5ac4fa025454cab4aa8e3f9fa9644', 'request_id': 'req-95949f28-0da8-4a16-b44e-29dff2b84c19'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.764240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] The token cache is being invalidate because project cca5ac4fa025454cab4aa8e3f9fa9644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:25.764564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.767969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.781486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 883/1781] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:24 2022] DELETE /identity/v3/projects/cca5ac4fa025454cab4aa8e3f9fa9644 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:25.781486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:25.781486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:25.834738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:25.851431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0222cc92ab44873bb0fa83d41176327', 'request_id': 'req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.877225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0222cc92ab44873bb0fa83d41176327', 'request_id': 'req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.896662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0222cc92ab44873bb0fa83d41176327', 'request_id': 'req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:25.926241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949f28-0da8-4a16-b44e-29dff2b84c19 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:26.014075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] The token cache is being invalidate because project d0222cc92ab44873bb0fa83d41176327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:26.014436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:26.015206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:26.026491 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 899/1782] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:25 2022] DELETE /identity/v3/projects/d0222cc92ab44873bb0fa83d41176327 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:26.029670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:26.053519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:26.211550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:26.213913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:26.215953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:26.217740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:26.226970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:26.239480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:26.393248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd17b-1e1f-41dc-aa3b-99467c4d341a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:26.414485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:26.415924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:26.416634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:26.417154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:26.422975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:26.514115 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 884/1783] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:25 2022] POST /identity/v3/projects => generated 403 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:26.516954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:26.527269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:26.646976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:26.723871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:26.749869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:26.786515 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 900/1784] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:26.790451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:26.796134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:26.839082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b32d7-7b42-4f76-a87f-e70c845c2531 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:26.880997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529ee95-f7b1-4cc6-b738-4f5c756c7690 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:26.891425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:26.892932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:26.893474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:26.894059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] PATH_INFO: `/v3/users/ad95d1c62e7e4130b1c8092d5f00c630` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:26.897103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad95d1c62e7e4130b1c8092d5f00c630)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:26.901644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:27.002134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:27.002823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:27.003102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:27.003516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] PATH_INFO: `/v3/users/05dafcdf88774daca960a9cee0e7f6b9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:27.007742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05dafcdf88774daca960a9cee0e7f6b9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:27.017332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:27.228583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad95d1c62e7e4130b1c8092d5f00c630'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.230811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad95d1c62e7e4130b1c8092d5f00c630'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.391632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad95d1c62e7e4130b1c8092d5f00c630'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.393545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:27.420195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad95d1c62e7e4130b1c8092d5f00c630'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.461866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad95d1c62e7e4130b1c8092d5f00c630'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.464692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05dafcdf88774daca960a9cee0e7f6b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.477140 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 885/1785] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:26 2022] DELETE /identity/v3/users/ad95d1c62e7e4130b1c8092d5f00c630 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:27.483571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:27.485618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:27.579948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05dafcdf88774daca960a9cee0e7f6b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.616841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca13e-d1ae-4ada-90a4-99badae04966 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:27.619868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05dafcdf88774daca960a9cee0e7f6b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.632715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:27.633619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:27.637047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:27.639697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:27.642023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:27.647472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:27.660007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05dafcdf88774daca960a9cee0e7f6b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.662412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3927616-3510-48e6-9706-18dfb68bca91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05dafcdf88774daca960a9cee0e7f6b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:27.683047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 901/1786] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:26 2022] DELETE /identity/v3/users/05dafcdf88774daca960a9cee0e7f6b9 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:27.688565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:27.692032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:27.692847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:27.696662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 902/1787] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:27.710668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:27.714249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:27.858207 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 886/1788] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:27 2022] POST /identity/v3/users => generated 308 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:27.865834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:27.874781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:27.913353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6976-e2ed-4131-b80e-b3e30649edce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:27.995025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:27.998250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:28.008424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:28.158354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:28.158821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:28.159111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:28.159416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:28.160087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:28.171522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:28.206486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 887/1789] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:31:28.212813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:28.262316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9197b-cc05-465d-92eb-ead497cdde9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:28.274660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbe8b-8cb2-4517-8586-f5b0c993002e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:28.314977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:28.325589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:28.325589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:28.325589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] PATH_INFO: `/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58/users/6b8add2d3f284861ba56957a35079b50/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:28.327023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:28.327960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:28.328333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:28.328741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:28.330681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:28.338875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:28.345339 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 903/1790] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:27 2022] GET /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 393 bytes in 635 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:31:28.423185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9055bcef5eaa491cbec9b0283ee1ec58, user_id=6b8add2d3f284861ba56957a35079b50, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:28.428766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f56846-2309-4560-b153-aec9118d8864 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:28.554492 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 888/1791] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:28 2022] PUT /identity/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58/users/6b8add2d3f284861ba56957a35079b50/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:28.560473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:28.594892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8fea-595a-43ea-91d6-d65a229cdab3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:28.725031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:28.730712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:28.730712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:28.730712 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 889/1792] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:31:28.743600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:28.821980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:28.823264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:28.823769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:28.826905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:28.828541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:28.842158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:28.920317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:28.935079 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 904/1793] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:31:28.942939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:28.981245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6d51-f1aa-46de-b514-523b31be5c4d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:29.007842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:29.008773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:29.009150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:29.009454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] PATH_INFO: `/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58/users/6b8add2d3f284861ba56957a35079b50/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:29.028996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9055bcef5eaa491cbec9b0283ee1ec58, user_id=6b8add2d3f284861ba56957a35079b50, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:29.033844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98455789-a5be-4afd-94b7-34b0e57e8177 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:29.046866 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 04 20:31:29.047514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:29.086929 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 905/1794] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:28 2022] PUT /identity/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58/users/6b8add2d3f284861ba56957a35079b50/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:29.099255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1304d-80f4-4fe9-af19-83f6a6538928 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:29.099770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1304d-80f4-4fe9-af19-83f6a6538928 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:29.100262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1304d-80f4-4fe9-af19-83f6a6538928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:29.215156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-17f1304d-80f4-4fe9-af19-83f6a6538928 None None] MFA Rules not processed for user `6b8add2d3f284861ba56957a35079b50`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:29.218390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-17f1304d-80f4-4fe9-af19-83f6a6538928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:29.224822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f40d3-e0e8-48c5-82f7-e68e4da55806 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:29.408205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:29.409215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:29.409627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:29.410071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:29.412259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:29.420716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:29.422222 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 890/1795] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:28 2022] GET /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 393 bytes in 680 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:31:29.789368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 906/1796] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:29.994836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:30.050850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:30.117157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09cd3-6bbf-4fca-af8e-c839db4f8e5e tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:30.151397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:30.152921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:30.153498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:30.154030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:30.173295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:30.174015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:30.174459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:30.174665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:30.176839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 907/1797] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:31:30.178062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:30.214132 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 891/1798] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:30.220307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:30.276544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:30.313562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520aadbf-b79e-4131-a974-3bb93ced0caf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:30.360548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:30.361834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:30.364848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:30.365460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:30.372370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:30.386985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:30.390973 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 908/1799] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:30 2022] GET /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 393 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:30.982916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:30.984405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:30.984905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:30.988114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.010040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:31.120267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade8ee-72a6-4a0d-b0b4-a0e2b93b9310 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:31.127410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:31.128273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.128678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.129111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] PATH_INFO: `/v3/projects/c082618393b04fb998b0bfa587f3619d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.131611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c082618393b04fb998b0bfa587f3619d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:31.136823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:31.211200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d7be-6bc6-45e4-b538-799408849d74 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:31.223213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:31.224945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.225824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.226723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] PATH_INFO: `/v3/projects/e9622ed2749c4a8785d3edecc6716b2c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.230310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9622ed2749c4a8785d3edecc6716b2c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:31.239969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:31.295899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c082618393b04fb998b0bfa587f3619d', 'request_id': 'req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.432195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c082618393b04fb998b0bfa587f3619d', 'request_id': 'req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.446974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c082618393b04fb998b0bfa587f3619d', 'request_id': 'req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.468494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] The token cache is being invalidate because project c082618393b04fb998b0bfa587f3619d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:31.468990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.470208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c0b30d6d-7b3d-4bbb-8d8a-edf932288760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.473656 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 892/1800] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:30 2022] DELETE /identity/v3/projects/c082618393b04fb998b0bfa587f3619d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:31.475668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.476038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.476489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.485622 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 893/1801] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:31:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:31.488845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:31.491128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.515206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9622ed2749c4a8785d3edecc6716b2c', 'request_id': 'req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.532260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9622ed2749c4a8785d3edecc6716b2c', 'request_id': 'req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.547419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9622ed2749c4a8785d3edecc6716b2c', 'request_id': 'req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.614417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777dcbc-3ef2-4f11-8ca3-11b57dbd8a3d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:31.620795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:31.621526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.621920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.622229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.624319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.685977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] The token cache is being invalidate because project e9622ed2749c4a8785d3edecc6716b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:31.686276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.686999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e06925b3-dd7c-4c30-af20-a3cc1b408ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:31.689101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 909/1802] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:30 2022] DELETE /identity/v3/projects/e9622ed2749c4a8785d3edecc6716b2c => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:31.690197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.690493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.691045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.718683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:31.720361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.739781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:31.741644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1924-1220-45d9-8bea-33d7017977c8 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:31.765198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:31.769599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 894/1803] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:31.769599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90171f-5509-4b81-bbd8-a7a5f6a641b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.769599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90171f-5509-4b81-bbd8-a7a5f6a641b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.770374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90171f-5509-4b81-bbd8-a7a5f6a641b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.818389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4f90171f-5509-4b81-bbd8-a7a5f6a641b9 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:31.819794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f90171f-5509-4b81-bbd8-a7a5f6a641b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.860677 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 895/1804] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:31.860677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb2a7e-2547-4827-9165-c8c7f92cf74a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.860677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb2a7e-2547-4827-9165-c8c7f92cf74a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.860677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb2a7e-2547-4827-9165-c8c7f92cf74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.892149 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 910/1805] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:31.898493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:31.898493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.908432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-acdb2a7e-2547-4827-9165-c8c7f92cf74a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:31.910462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acdb2a7e-2547-4827-9165-c8c7f92cf74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.925352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d2877-feb2-439d-9101-12414e680ad7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:31.939333 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 896/1806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:31.939333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0451f1-88ae-412c-92c9-481c7cd26fec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.939333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0451f1-88ae-412c-92c9-481c7cd26fec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.939333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0451f1-88ae-412c-92c9-481c7cd26fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.944671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:31.945926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.946484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.946960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:31.966533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:31.970128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:31.974961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1e0451f1-88ae-412c-92c9-481c7cd26fec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:31.977828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1e0451f1-88ae-412c-92c9-481c7cd26fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:31.988935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 897/1807] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:31.990236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:31.990597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:31.991010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.000170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 911/1808] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:32.003068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.017152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:32.018921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:32.030053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 898/1809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:32.030763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83334ba-7771-4e25-88dc-96312fba3e4b service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.034807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.043610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.045500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.045976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.046419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.047511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:32.047972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.092505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.093161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784705d-b929-4d22-9e40-3209bee551d5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.093161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.093161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.093377 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 912/1810] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:32.093455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.093455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.093455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:32.093455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.093455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.102616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.118568 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 899/1811] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:31:32.119914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.130524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406413-bd8c-40fa-b6e9-306da132a5f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.133786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3421-1b6c-4647-bf20-9a8e52f46659 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.179035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.179035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.179035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.179035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.179641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.179641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.179928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.179928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.179928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.179928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.180521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.180521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.370021 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 900/1812] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:32.381823 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 913/1813] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:32 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:32.382695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.385158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.578459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e46d5-2abc-450c-9cd6-7b3f525bedae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.639675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48662-23f7-46ac-a306-72f3d56b4837 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.656835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.657884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.658408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.658833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.660092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.663962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f146-3bc9-4731-930f-f93e6781d5dd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.687190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.688274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.688822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.689501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.691124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.694369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.847059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 914/1814] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:32 2022] POST /identity/v3/users => generated 287 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:32.847059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.847059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.847059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.847859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 901/1815] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:32 2022] POST /identity/v3/users => generated 293 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:32.849106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.863268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491269c-d29d-4616-810f-a6837dd0280d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.869739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.875409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.875409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.875409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.875409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.875409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.878260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] MFA Rules not processed for user `9baf3883d6ac4328bf3aa9ffaaa48b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:32.879633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:32.895421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 902/1816] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:31:32.897451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.912170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11bf1-7112-484e-9593-97c969bc6fd6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.921036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.922029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.922490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.923192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.924820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.927633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.947394 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 903/1817] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:32.948437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:32.966289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904288e-ea36-4cd4-9584-e23d93e03320 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:32.973721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:32.975017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:32.975534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:32.976118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:32.976561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:32.977284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:32.980233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:32.997410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 915/1818] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:32.998898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.000223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 904/1819] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:33.004610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.018398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281e1-c63c-4cfb-95c1-2697a3f4d913 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.020451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4294b7-5a71-4e65-ac90-986e5671179e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.024993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:33.027468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.027618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.028600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.028932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.029701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.031094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.031945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.032229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.032642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.033061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] PATH_INFO: `/v3/projects/e756f3ec49694205b5dccf3408cee098/users/4b8c35b4791b41fea4edf6b6f1ef6de1/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.044973 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 916/1820] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:33.049839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.056421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e756f3ec49694205b5dccf3408cee098, user_id=4b8c35b4791b41fea4edf6b6f1ef6de1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.060612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160ff73-7a66-49d9-b873-2dfdf0d04a19 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.061965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ecc3-35f8-45b4-9da6-8bbab52700d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.067675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.068446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.068727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.069000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] PATH_INFO: `/v3/projects/b13aa2a32be74c288022b978036b78a9/users/b54a51e7733f40d0bbb1a70ac1b9f4b1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.098388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13aa2a32be74c288022b978036b78a9, user_id=b54a51e7733f40d0bbb1a70ac1b9f4b1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.104114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2be2f-4b1e-43ef-a55a-80a89291dbad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.166784 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 905/1821] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:33 2022] PUT /identity/v3/projects/e756f3ec49694205b5dccf3408cee098/users/4b8c35b4791b41fea4edf6b6f1ef6de1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:33.177896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.178184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.178495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.206010 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 917/1822] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:33 2022] PUT /identity/v3/projects/b13aa2a32be74c288022b978036b78a9/users/b54a51e7733f40d0bbb1a70ac1b9f4b1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:33.217487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29462be-684a-4592-9e78-82813f61b82e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.217802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29462be-684a-4592-9e78-82813f61b82e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.218086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29462be-684a-4592-9e78-82813f61b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.218508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] MFA Rules not processed for user `4b8c35b4791b41fea4edf6b6f1ef6de1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:33.220240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:33.250891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a29462be-684a-4592-9e78-82813f61b82e None None] MFA Rules not processed for user `b54a51e7733f40d0bbb1a70ac1b9f4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:33.252121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a29462be-684a-4592-9e78-82813f61b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:33.331179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 906/1823] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:33.338198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.384852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 918/1824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:33.384852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29462be-684a-4592-9e78-82813f61b82e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.485616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793111-b503-406f-a5cc-06995f6c8708 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.497511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.498569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.499064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.499587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.500823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.504325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.523571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29462be-684a-4592-9e78-82813f61b82e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.533620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.533620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.533620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.533620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.534686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:33.644148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.647075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.671278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 919/1825] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:33.674049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.705097 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 907/1826] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:33 2022] POST /identity/v3/projects => generated 387 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:31:33.707523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d0164-7519-460e-a145-44f3897eacb0 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.708812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:33.825132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.826072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.826358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.826633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.828351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.831686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.869248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4537ee3-eb95-4469-b874-5e5efdbd3202 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:33.887237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:33.887237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:33.887237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:33.887237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:33.892712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:33.892712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36f6b-55a2-4ee7-8ff8-3346dd366b49 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:33.997754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 920/1827] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:33 2022] POST /identity/v3/projects => generated 373 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:33.997754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.000224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:34.027400 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 908/1828] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:33 2022] POST /identity/v3/users => generated 300 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:34.030006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8315b7-f90b-43db-a009-9339e067ad59 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.030899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8315b7-f90b-43db-a009-9339e067ad59 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.032113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8315b7-f90b-43db-a009-9339e067ad59 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.036264 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 909/1829] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:34.037654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8315b7-f90b-43db-a009-9339e067ad59 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.149240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8cc4e-8228-432a-8f12-9ca8f1c1e672 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:34.159087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:34.160777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.161257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.161830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] PATH_INFO: `/v3/users/3b681070354e428580e1ff15c29995ac` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.164190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b681070354e428580e1ff15c29995ac)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:34.168028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:34.200769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8315b7-f90b-43db-a009-9339e067ad59 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:34.211749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:34.213520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.213984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.214368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.215893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:34.220388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:34.376411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 910/1830] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:34 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:34.378639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.400401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c8d4-1a44-4b43-acd5-da847b9eb477 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:34.410367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:34.411622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.429488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.429488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.429488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:34.429488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20479a07-6399-4ab5-90a9-fd7da3ed6398 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:34.448349 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 911/1831] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:34.448349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.448349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.448349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:31:34.468067 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:31:34.469666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:31:34.481732 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 912/1832] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:31:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:31:34.481732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.509617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103658-8a67-4d18-a1df-ff5c263a76e7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:34.514559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b681070354e428580e1ff15c29995ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:34.519089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:34.520824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.521185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.521694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.522780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:34.529954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:34.554471 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 913/1833] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:34.554471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.573046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c55d-aacb-4f8e-aaca-5bbc98d04d0b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:34.611192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:34.611192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.611192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.611192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] PATH_INFO: `/v3/projects/8208e592a1494535b5d215fedbc63704/users/a839bd7f69904d51a0fa4f325911c43d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.638409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8208e592a1494535b5d215fedbc63704, user_id=a839bd7f69904d51a0fa4f325911c43d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:34.642881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24f2c-c657-43e8-ab42-d4a77c309162 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:34.649504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b681070354e428580e1ff15c29995ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:34.662843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b681070354e428580e1ff15c29995ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:34.697636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b681070354e428580e1ff15c29995ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:34.699439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b681070354e428580e1ff15c29995ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:34.712688 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 921/1834] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:33 2022] DELETE /identity/v3/users/3b681070354e428580e1ff15c29995ac => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:34.714325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:34.718228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:34.791779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 914/1835] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:34 2022] PUT /identity/v3/projects/8208e592a1494535b5d215fedbc63704/users/a839bd7f69904d51a0fa4f325911c43d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:34.795890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2575-c16f-4f28-8dae-72ffc8389745 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.796423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2575-c16f-4f28-8dae-72ffc8389745 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.797318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2575-c16f-4f28-8dae-72ffc8389745 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.801060 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 915/1836] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:34.804655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:34.804655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:34.804655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:34.850485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:34.853878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:34.881708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b1d5-c072-4e47-a6cb-db0ece285fe0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.019069 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 916/1837] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:35.021329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:35.021693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.022888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.023631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.025619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:35.033019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] PATH_INFO: `/v3/projects/050091874cc142bc8320d2a065d3a3c4/users/27f231bb32224414a4e88bef233b65be/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.052047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64de112-5af0-4f76-b368-8f627ee8bba0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.064769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.065990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.066795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.067426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.069061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.072601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.079069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050091874cc142bc8320d2a065d3a3c4, user_id=27f231bb32224414a4e88bef233b65be, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.085374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.098054 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 917/1838] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:35.101000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:35.104180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:35.135652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.267987 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 922/1839] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:34 2022] PUT /identity/v3/projects/050091874cc142bc8320d2a065d3a3c4/users/27f231bb32224414a4e88bef233b65be/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:35.269975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:35.273182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:35.281874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.300076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:35.316756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:35.407160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76e48-2aec-4ddb-82dd-d22852fb3f23 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.414912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.416083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.416586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.418036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.463655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa23268-1420-423a-9761-c605a2f4646d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.633079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.656884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.733151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.734314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.734892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.735595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.738460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.743336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.747549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 918/1840] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:35 2022] GET /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 393 bytes in 648 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:35.749246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:35.807297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.813363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.817797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.842203 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 923/1841] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:35.847267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:35.896566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6857-5052-4cfd-baab-044c9b7ee29a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.896845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:35.926818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.928941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.932387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.933435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7eebc-68c9-4d13-a5bf-c7fac22e0d6a tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:35.935430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.942405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.943620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:35.944884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:35.945379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:35.946053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] PATH_INFO: `/v3/projects/8208e592a1494535b5d215fedbc63704/users/a839bd7f69904d51a0fa4f325911c43d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:35.950450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8208e592a1494535b5d215fedbc63704, user_id=a839bd7f69904d51a0fa4f325911c43d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:35.953065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.956617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4fca7-a6d0-42dd-a229-6612dfd1c628 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:35.994905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 919/1842] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:35 2022] PUT /identity/v3/projects/8208e592a1494535b5d215fedbc63704/users/a839bd7f69904d51a0fa4f325911c43d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:36.011298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d62c-67e2-4a09-8e28-c8f961478fea None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.012046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d62c-67e2-4a09-8e28-c8f961478fea None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.013014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d62c-67e2-4a09-8e28-c8f961478fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.036418 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 924/1843] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:36.046753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:36.065196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:36.090167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9cd3f-2f0a-49a4-af83-deadec5525d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:36.122280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1485d62c-67e2-4a09-8e28-c8f961478fea None None] MFA Rules not processed for user `a839bd7f69904d51a0fa4f325911c43d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:36.125112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1485d62c-67e2-4a09-8e28-c8f961478fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:36.263965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:36.297802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:36.300485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.301213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.302355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] PATH_INFO: `/v3/projects/050091874cc142bc8320d2a065d3a3c4/users/27f231bb32224414a4e88bef233b65be/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.317256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050091874cc142bc8320d2a065d3a3c4, user_id=27f231bb32224414a4e88bef233b65be, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:36.323473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9911a-23a5-4d9c-9edd-d8273d639c88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:36.363205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 925/1844] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:36 2022] PUT /identity/v3/projects/050091874cc142bc8320d2a065d3a3c4/users/27f231bb32224414a4e88bef233b65be/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:36.373491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f84b-04cd-4280-9bf0-7a5fb96d98b5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.374031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f84b-04cd-4280-9bf0-7a5fb96d98b5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.374530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f84b-04cd-4280-9bf0-7a5fb96d98b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.391199 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 920/1845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:36.404284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.406078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.407127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.454887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ddb3f84b-04cd-4280-9bf0-7a5fb96d98b5 None None] MFA Rules not processed for user `27f231bb32224414a4e88bef233b65be`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:36.457412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddb3f84b-04cd-4280-9bf0-7a5fb96d98b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:36.458767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] MFA Rules not processed for user `4b8c35b4791b41fea4edf6b6f1ef6de1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:36.463007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:36.626753 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 921/1846] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:36.705914 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 926/1847] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:36.709212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:36.712893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:36.849695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:36.893356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.894099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.894888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.898032 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 927/1848] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:31:36.908594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:36.920319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f47df-914b-4bc3-b3b0-7f1247febb8c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:36.938625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:36.959098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:36.962573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:36.962848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:36.963533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:36.973668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:36.999367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:37.003653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:37.026454 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 922/1849] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:37.089142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf55394-d779-48d2-b035-a22c97e73d20 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:37.098507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:37.099959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:37.100580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:37.101031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:37.103357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:37.105903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:37.112539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 928/1850] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:36 2022] GET /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 393 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:37.271980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:37.293805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c9423-9933-47ef-be36-ae7246113a08 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:37.301862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:37.304008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:37.304493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:37.306132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:37.323124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:37.324180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:37.340932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 923/1851] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:37.561302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:37.565889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:37.735528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33c89c-cb19-4032-bc9b-966eea2b57ca tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:37.751872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:37.751872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:37.751872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:37.751872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] PATH_INFO: `/v3/projects/d5e1a6ff56a04eb894224826f792e6bf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:37.752510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e1a6ff56a04eb894224826f792e6bf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:37.754443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:37.772415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:37.830845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:37.852786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a2772-ff58-46c1-b8a7-bcbf95356755 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:37.869732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:37.870840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:37.877630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:37.877630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:37.877630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:37.978958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e1a6ff56a04eb894224826f792e6bf', 'request_id': 'req-fc7bc286-0415-4f76-8c42-619db2819832'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:37.995627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e1a6ff56a04eb894224826f792e6bf', 'request_id': 'req-fc7bc286-0415-4f76-8c42-619db2819832'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.009175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e1a6ff56a04eb894224826f792e6bf', 'request_id': 'req-fc7bc286-0415-4f76-8c42-619db2819832'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.033161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:38.036521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:38.059092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 924/1852] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:38.138743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] The token cache is being invalidate because project d5e1a6ff56a04eb894224826f792e6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:38.139304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.149672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc7bc286-0415-4f76-8c42-619db2819832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.161668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 929/1853] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:37 2022] DELETE /identity/v3/projects/d5e1a6ff56a04eb894224826f792e6bf => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:38.164470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:38.202371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a55d6-7bd6-4eff-ae9f-5a56a658d376 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:38.360666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:38.362048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:38.363222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:38.364045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] PATH_INFO: `/v3/users/6b8add2d3f284861ba56957a35079b50` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:38.366915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8add2d3f284861ba56957a35079b50)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:38.372174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:38.703121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8add2d3f284861ba56957a35079b50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.706689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8add2d3f284861ba56957a35079b50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.816979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:38.817779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:38.818227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:38.821103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 930/1854] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:31:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:31:38.822946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8add2d3f284861ba56957a35079b50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.843414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:31:38.845843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:38.849828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:38.871033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8add2d3f284861ba56957a35079b50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.896512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8add2d3f284861ba56957a35079b50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:38.916119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 925/1855] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:38 2022] DELETE /identity/v3/users/6b8add2d3f284861ba56957a35079b50 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:39.086123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:39.088441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:39.237883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59401-bd92-429d-b532-7a6b4165d196 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:39.391466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:39.395068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:39.399445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:39.452806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282befeaa1a94c40a9bba4f8d5441677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed4ed8d04654505aab32609420b930e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:39.454374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:39.455006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:39.455560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] PATH_INFO: `/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:39.458978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorizing `identity:get_project(project_id=a8efdc4b00404ebfb9af2fc44fe4c92a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:39.464052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e9ac2-a798-4c49-935c-c946e1bf64b3 tempest-FlavorsAccessNegativeTestJSON-1287260464 tempest-FlavorsAccessNegativeTestJSON-1287260464-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:39.468029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 931/1856] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:31:38 2022] GET /identity/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a => generated 393 bytes in 625 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:39.626593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444c354-b1b9-4dfd-970a-3b051b9cdf04 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:39.636312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:39.638167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:39.638738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:39.639492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] PATH_INFO: `/v3/users/b54a51e7733f40d0bbb1a70ac1b9f4b1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:39.642879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54a51e7733f40d0bbb1a70ac1b9f4b1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:39.647253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:40.039908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54a51e7733f40d0bbb1a70ac1b9f4b1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.041552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54a51e7733f40d0bbb1a70ac1b9f4b1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.199168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54a51e7733f40d0bbb1a70ac1b9f4b1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.244824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54a51e7733f40d0bbb1a70ac1b9f4b1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.263992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54a51e7733f40d0bbb1a70ac1b9f4b1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.279859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 926/1857] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:39 2022] DELETE /identity/v3/users/b54a51e7733f40d0bbb1a70ac1b9f4b1 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:40.288215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:40.297892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:40.298289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:40.364677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:40.377303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:40.508103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 932/1858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:40.538707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:40.539704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:40.541047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:40.546213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:40.568008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7b9db-1ad6-4525-afdc-2a7488728c69 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:40.617058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:40.618097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:40.619815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:40.620178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] PATH_INFO: `/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:40.623376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9055bcef5eaa491cbec9b0283ee1ec58)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:40.626452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:40.841415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16580-ab22-4f06-bc73-b694ad6128b5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:40.850370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:40.851551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:40.852111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:40.852691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:40.873209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:40.876257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:40.912701 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 927/1859] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:40.915491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:40.920084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:40.952426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9055bcef5eaa491cbec9b0283ee1ec58', 'request_id': 'req-2e2175c6-bdf9-4929-982a-1058683d6369'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:40.977407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9055bcef5eaa491cbec9b0283ee1ec58', 'request_id': 'req-2e2175c6-bdf9-4929-982a-1058683d6369'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.003885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:41.005990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9055bcef5eaa491cbec9b0283ee1ec58', 'request_id': 'req-2e2175c6-bdf9-4929-982a-1058683d6369'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.029298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9d00-0c76-45c4-92aa-ea87d5bdf376 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:41.170491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] The token cache is being invalidate because project 9055bcef5eaa491cbec9b0283ee1ec58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:41.171338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.172695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e2175c6-bdf9-4929-982a-1058683d6369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.182037 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 933/1860] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:40 2022] DELETE /identity/v3/projects/9055bcef5eaa491cbec9b0283ee1ec58 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:41.184763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b795-43d2-48a7-a643-2a185f99be44 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.185298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b795-43d2-48a7-a643-2a185f99be44 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.185998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b795-43d2-48a7-a643-2a185f99be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.233715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8f71b795-43d2-48a7-a643-2a185f99be44 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:41.237497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f71b795-43d2-48a7-a643-2a185f99be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:41.251104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:41.252038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.252038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.252477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] PATH_INFO: `/v3/users/003a541ef0c54e64bc7f02b3196a5ba1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.255488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003a541ef0c54e64bc7f02b3196a5ba1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:41.259762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:41.263786 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 934/1861] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:41.293013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.294671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.295249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.390886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:41.395648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:41.422869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 935/1862] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:41.424655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:41.445421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c192-247c-451d-9e2c-12e4f15328df None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:41.465408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:41.466514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.466951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.467484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.468788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:41.469207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:41.486870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:41.551680 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 936/1863] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:41.555969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:41.598862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8da4-f33d-4f3e-9fda-78ae9902f7bb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:41.629082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:41.632923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.633331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.633648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.635087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:41.656554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4052c2-7dc0-4b9c-8f00-7c2777b7a249 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:41.663680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003a541ef0c54e64bc7f02b3196a5ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.668860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003a541ef0c54e64bc7f02b3196a5ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.820703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003a541ef0c54e64bc7f02b3196a5ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.858453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003a541ef0c54e64bc7f02b3196a5ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.870448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 937/1864] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:41 2022] POST /identity/v3/projects => generated 411 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:41.877722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.879457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.884532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3df85ab-0370-4a50-bfe2-6c8bb5cdf9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003a541ef0c54e64bc7f02b3196a5ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:41.885561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.888337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 938/1865] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:31:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:41.890109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:41.898775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 928/1866] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:40 2022] DELETE /identity/v3/users/003a541ef0c54e64bc7f02b3196a5ba1 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:41.899126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:41.907506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c2afe-3705-4b22-9e5f-7fa681ded937 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:41.907959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c2afe-3705-4b22-9e5f-7fa681ded937 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:41.910008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c2afe-3705-4b22-9e5f-7fa681ded937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:41.943289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-485c2afe-3705-4b22-9e5f-7fa681ded937 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:41.946303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-485c2afe-3705-4b22-9e5f-7fa681ded937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:41.966732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:42.083766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cb4f9-d06a-448e-917c-2bb3bb9dfc98 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:42.095304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:42.095912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.096409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.096898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.098449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:42.102010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:42.141383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 929/1867] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:42.141383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.141383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.141383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.178532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:42.180842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:42.213548 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 939/1868] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:41 2022] POST /identity/v3/users => generated 306 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:42.213548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:42.213548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:42.216137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:42.229821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4b2-dfb9-45ff-a53c-96fe77725a1a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:42.244012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:42.244856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.245147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.248224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] PATH_INFO: `/v3/projects/b13aa2a32be74c288022b978036b78a9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.248224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13aa2a32be74c288022b978036b78a9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:42.250835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:42.304839 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 930/1869] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:31:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:42.306080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:42.308952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:42.464401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23931-b982-4283-a99b-96cb6cea7a50 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:42.520798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13aa2a32be74c288022b978036b78a9', 'request_id': 'req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:42.543375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13aa2a32be74c288022b978036b78a9', 'request_id': 'req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:42.562841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13aa2a32be74c288022b978036b78a9', 'request_id': 'req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:42.646417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:42.647581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.648113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.648595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.689553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] The token cache is being invalidate because project b13aa2a32be74c288022b978036b78a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:42.691557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:42.694806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:42.712328 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 940/1870] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:42 2022] DELETE /identity/v3/projects/b13aa2a32be74c288022b978036b78a9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:42.714331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:42.735374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:42.865370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:42.868886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:42.895442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 931/1871] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:42.897289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:42.919387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301532b-fa32-411d-bd98-40cfabbe3543 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:42.932553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4ccd-5cbe-4a57-acd2-6b2631f08b84 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:42.933007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:42.934866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.935793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.937290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] PATH_INFO: `/v3/users/27f231bb32224414a4e88bef233b65be` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.939832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f231bb32224414a4e88bef233b65be)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:42.942459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:42.943764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:42.944563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:42.945056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:42.946071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:42.946279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:42.950242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:42.979314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 941/1872] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:42.981096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:42.990513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:43.000369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:43.077018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:43.162448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c1b2-f0f4-4c14-8c19-313fe852d423 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:43.171676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:43.172648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:43.173032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:43.173496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:43.175832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:43.194848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:43.197363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:43.225386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 942/1873] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:43.227175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:43.266228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f231bb32224414a4e88bef233b65be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:43.267565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f231bb32224414a4e88bef233b65be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:43.269734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a208d-9b02-4023-94a8-475c8a1edac7 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:43.296980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:43.299627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:43.299627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:43.299627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:43.299627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:43.301217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:43.330778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 943/1874] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:43.338368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:43.381071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f5b8-79ff-4420-b22b-275d5c10685c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:43.395904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f231bb32224414a4e88bef233b65be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:43.397011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:43.397719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:43.398000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:43.398280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] PATH_INFO: `/v3/projects/0ce6d5049a93493289028932b886affd/users/3b96fba70dbf4586b522c5bd1cb74f16/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:43.426592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f231bb32224414a4e88bef233b65be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:43.444907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3aedabdc-124d-409f-8ee7-f129820caf63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f231bb32224414a4e88bef233b65be'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:43.453572 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 932/1875] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:42 2022] DELETE /identity/v3/users/27f231bb32224414a4e88bef233b65be => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:43.463343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce6d5049a93493289028932b886affd, user_id=3b96fba70dbf4586b522c5bd1cb74f16, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:43.466550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:43.587973 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 944/1876] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:43 2022] PUT /identity/v3/projects/0ce6d5049a93493289028932b886affd/users/3b96fba70dbf4586b522c5bd1cb74f16/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:43.600385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:43.615383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:43.615383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:43.707843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] MFA Rules not processed for user `3b96fba70dbf4586b522c5bd1cb74f16`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:43.716406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:43.936416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:43.940808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:43.947800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 933/1877] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:44.168872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba2f8-6e92-49cb-885c-fba898b90628 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:44.186123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:44.187975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:44.188911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:44.189530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:44.192798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:44.197073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:44.372904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:44.375549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:44.421434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 945/1878] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:43 2022] POST /identity/v3/projects => generated 411 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:44.427703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:44.454021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7c6b1-cabc-49db-8f1d-5f9f3d63afe1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:44.651050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e5d3-1823-4a45-aa29-5bf9f0f1e420 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:44.662462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:44.663451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:44.663904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:44.666377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:44.666377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:44.676169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:44.690332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:44.705846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:44.707170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:44.707821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:44.711532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] PATH_INFO: `/v3/projects/98c71e3ed7854c4c82df7a4a34375b74` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:44.717890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c71e3ed7854c4c82df7a4a34375b74)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:44.718136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:44.817886 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 946/1879] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:44 2022] POST /identity/v3/users => generated 312 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:44.822973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:44.861413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a39f8-b007-4392-9075-0cd7e1bcceed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:44.884418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:44.885680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:44.890725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:44.891468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:44.893504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:44.896877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:44.933682 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 947/1880] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:44.944182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:44.966927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac57dd-8ec0-43ae-aef2-ce44854a2ea0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:44.975867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:44.977120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:44.977709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:44.978238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] PATH_INFO: `/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a/users/1675b0dea7ee471d846310c2581e2d1e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:45.011240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b8f92c44fc4a7d98fa4cef12af2e6a, user_id=1675b0dea7ee471d846310c2581e2d1e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:45.021620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:45.027093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:45.068130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c71e3ed7854c4c82df7a4a34375b74', 'request_id': 'req-d66236fb-4561-4891-9be3-7865211ee9d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.179640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 948/1881] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:44 2022] PUT /identity/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a/users/1675b0dea7ee471d846310c2581e2d1e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:45.181005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:45.188258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:45.216515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c71e3ed7854c4c82df7a4a34375b74', 'request_id': 'req-d66236fb-4561-4891-9be3-7865211ee9d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.248994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c71e3ed7854c4c82df7a4a34375b74', 'request_id': 'req-d66236fb-4561-4891-9be3-7865211ee9d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.299746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] The token cache is being invalidate because project 98c71e3ed7854c4c82df7a4a34375b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:45.300422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.302013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.305719 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 934/1882] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:44 2022] DELETE /identity/v3/projects/98c71e3ed7854c4c82df7a4a34375b74 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:45.315479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:45.318158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:45.557746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6fe1-b7fe-4ef8-9c0f-a7f18945fbb4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:45.581382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:45.582509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:45.583000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:45.583517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] PATH_INFO: `/v3/projects/050091874cc142bc8320d2a065d3a3c4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:45.600330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] RBAC: Authorizing `identity:delete_project(project_id=050091874cc142bc8320d2a065d3a3c4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:45.605347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:45.631185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66236fb-4561-4891-9be3-7865211ee9d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:45.641475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:45.642570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:45.643088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:45.643633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:45.645218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:45.649303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:45.678098 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 935/1883] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:45.678098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:45.681607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:45.715451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a81d0-b034-498e-bf82-2b3560a22b57 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:45.725509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:45.727274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:45.727775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:45.728273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] PATH_INFO: `/v3/users/282befeaa1a94c40a9bba4f8d5441677` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:45.730732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282befeaa1a94c40a9bba4f8d5441677)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:45.734259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:45.886081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050091874cc142bc8320d2a065d3a3c4', 'request_id': 'req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.914999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050091874cc142bc8320d2a065d3a3c4', 'request_id': 'req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:45.928257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050091874cc142bc8320d2a065d3a3c4', 'request_id': 'req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.019202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282befeaa1a94c40a9bba4f8d5441677'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.019202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282befeaa1a94c40a9bba4f8d5441677'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.074277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] The token cache is being invalidate because project 050091874cc142bc8320d2a065d3a3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:46.074806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.076897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.082320 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 949/1884] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:45 2022] DELETE /identity/v3/projects/050091874cc142bc8320d2a065d3a3c4 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:46.083953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:46.086419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:46.190376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282befeaa1a94c40a9bba4f8d5441677'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.235698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282befeaa1a94c40a9bba4f8d5441677'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.238464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:46.272214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4259a49e-4d08-4139-831a-ae03d08817a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282befeaa1a94c40a9bba4f8d5441677'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:46.282466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c2b4-4a4e-4fff-b23c-8b724db6338d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:46.296280 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 936/1885] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:45 2022] DELETE /identity/v3/users/282befeaa1a94c40a9bba4f8d5441677 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:46.298495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:46.298849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:46.299163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:46.300984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:46.302210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:46.302826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:46.303443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] PATH_INFO: `/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a/users/1675b0dea7ee471d846310c2581e2d1e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:46.321217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b8f92c44fc4a7d98fa4cef12af2e6a, user_id=1675b0dea7ee471d846310c2581e2d1e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:46.321217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c9799-4e55-42ec-936c-5a88ca6a0d4d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:46.360625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 950/1886] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:46 2022] PUT /identity/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a/users/1675b0dea7ee471d846310c2581e2d1e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:46.368871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179bcf3-51a0-4a97-a3e4-f4cfb1f157c8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:46.369531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179bcf3-51a0-4a97-a3e4-f4cfb1f157c8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:46.370013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179bcf3-51a0-4a97-a3e4-f4cfb1f157c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:46.463517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c179bcf3-51a0-4a97-a3e4-f4cfb1f157c8 None None] MFA Rules not processed for user `1675b0dea7ee471d846310c2581e2d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:46.468118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c179bcf3-51a0-4a97-a3e4-f4cfb1f157c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:46.477817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:46.479773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:46.688849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:46.867408 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 951/1887] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:46.882355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 937/1888] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:46.895352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:46.896356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:46.896356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:46.946591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:46.948837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:46.977047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 952/1889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:46.978292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:47.013079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853995f5-cdb5-43b4-a959-3e81e1f7a390 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:47.021367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:47.022309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:47.022712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:47.023317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:47.024508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:47.025795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:47.028450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:47.068895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:47.089722 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 938/1890] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:31:47.103694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4e5da-3ee7-444b-a67e-a8a86c294162 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:47.116406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:47.119577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:47.122530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:47.130162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:47.131796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:47.149043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:47.359529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:47.363317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:47.364318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 953/1891] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:47.374765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:47.546247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160e378-d5e8-409b-9ef2-8d85f56c818e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:47.563377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:47.564580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:47.565095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:47.565437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:47.566760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:47.570329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:47.646874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0059-b914-46c6-bdaf-89a1eccd7bd0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:47.695268 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 954/1892] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:47 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:47.695268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:47.707573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:47.734467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be908b7a-62b5-4cc6-9877-356ca6ecb499 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:47.744291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:47.745329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:47.745715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:47.746616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] PATH_INFO: `/v3/projects/7ed4ed8d04654505aab32609420b930e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:47.748790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed4ed8d04654505aab32609420b930e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:47.751248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:47.773712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:47.774812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:47.776613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:47.777011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:47.786001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:47.891374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:47.927947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:47.930380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:47.931375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed4ed8d04654505aab32609420b930e', 'request_id': 'req-0c7a5332-30a6-4e8e-895f-d138f06d74a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:47.943204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed4ed8d04654505aab32609420b930e', 'request_id': 'req-0c7a5332-30a6-4e8e-895f-d138f06d74a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:47.954453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed4ed8d04654505aab32609420b930e', 'request_id': 'req-0c7a5332-30a6-4e8e-895f-d138f06d74a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:47.958779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 939/1893] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:47 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:47.972969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:48.020020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22133-f3e5-4f72-9e1c-6a89254cb73a service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:48.101069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] The token cache is being invalidate because project 7ed4ed8d04654505aab32609420b930e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:48.101608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.106588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.113887 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 955/1894] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:47 2022] DELETE /identity/v3/projects/7ed4ed8d04654505aab32609420b930e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:48.115560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:48.123005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:48.191258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:48.192501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:48.193006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:48.193422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:48.194603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:48.199766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:48.235470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 940/1895] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:48.236727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:48.239518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:48.271915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1bea-5306-4da5-a773-9b6875748e12 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:48.295905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:48.296760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:48.297105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:48.297376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] PATH_INFO: `/v3/users/7f6feba870cb418da73b3c23e42e7f82` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:48.299597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6feba870cb418da73b3c23e42e7f82)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:48.302004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:48.359970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a5332-30a6-4e8e-895f-d138f06d74a2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:48.371533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:48.374350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:48.375236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:48.375538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:48.397497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:48.683642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6feba870cb418da73b3c23e42e7f82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.685932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6feba870cb418da73b3c23e42e7f82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.704747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:48.707902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:48.733821 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 956/1896] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:48 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:48.738071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:48.743583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:48.795053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae91d-2584-4345-956e-b9f2cab526a8 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:48.799487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6feba870cb418da73b3c23e42e7f82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.817723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:48.819101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:48.819405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:48.819818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:48.820790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:48.827034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:48.848426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6feba870cb418da73b3c23e42e7f82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.866135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6feba870cb418da73b3c23e42e7f82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:48.878303 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 941/1897] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:48 2022] DELETE /identity/v3/users/7f6feba870cb418da73b3c23e42e7f82 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:48.900523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:48.900694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 957/1898] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:48.902811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:49.049789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:49.084885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f398-9109-4b0f-a537-571ced3949a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:49.099059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:49.100968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:49.101576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:49.102292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] PATH_INFO: `/v3/projects/7e6ee9bb90b1425eb42d43b703756e41/users/a822d19cf385466b8b33dcf17a5ed7df/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:49.147653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6ee9bb90b1425eb42d43b703756e41, user_id=a822d19cf385466b8b33dcf17a5ed7df, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:49.154113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca13af4-b163-451e-a203-2cb4ee27832c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:49.161499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:49.164474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:49.193977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7ba77-22fc-48dc-9b4f-fc8fbed3adc6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:49.205636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:49.205636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:49.205636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:49.205636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] PATH_INFO: `/v3/users/3b96fba70dbf4586b522c5bd1cb74f16` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:49.209212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b96fba70dbf4586b522c5bd1cb74f16)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:49.213955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:49.301094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 942/1899] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:48 2022] PUT /identity/v3/projects/7e6ee9bb90b1425eb42d43b703756e41/users/a822d19cf385466b8b33dcf17a5ed7df/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:49.318024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:49.318527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:49.319085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:49.368537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] MFA Rules not processed for user `a822d19cf385466b8b33dcf17a5ed7df`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:49.371464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:49.451089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:49.531319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 943/1900] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:49.538980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:49.570867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b96fba70dbf4586b522c5bd1cb74f16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:49.700273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9341745-a33f-49f5-9053-490bd1be92ef None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:49.703395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b96fba70dbf4586b522c5bd1cb74f16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:49.717624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:49.718626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:49.722505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b96fba70dbf4586b522c5bd1cb74f16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:49.723409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:49.724053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:49.727764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:49.732007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:49.752623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b96fba70dbf4586b522c5bd1cb74f16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:49.755113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-abec5586-bcff-48f6-915d-9a04f7531fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b96fba70dbf4586b522c5bd1cb74f16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:49.768300 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 958/1901] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:49 2022] DELETE /identity/v3/users/3b96fba70dbf4586b522c5bd1cb74f16 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:49.776020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:49.776580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:49.777302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:49.813672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:49.815257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:49.876800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 944/1902] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:49 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:49.881590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:49.885547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:49.942664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 959/1903] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:49.961766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:49.963747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:50.010854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:50.042321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f6a98-40b8-4976-84b4-322da1db58b4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:50.058110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:50.060239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:50.060759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:50.062108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:50.066674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:50.067389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:50.091474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8eaa-62cc-45d0-8e88-1eda5508593b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:50.240131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:50.241205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:50.241365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:50.241769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:50.272327 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 945/1904] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:49 2022] POST /identity/v3/users => generated 297 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:50.274158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:50.278763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:50.281965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:50.285087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:50.314939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 960/1905] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:50.316978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:50.322730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:50.345913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:50.357004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867edd0-9dea-4534-a9fb-4189cdc6c900 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:50.378710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:50.380664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:50.385851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:50.387468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] PATH_INFO: `/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:50.391371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8efdc4b00404ebfb9af2fc44fe4c92a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:50.397624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:50.532102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca965a9-3029-4532-81d9-caef3996c146 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:50.552259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:50.553919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:50.554663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:50.559630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:50.563905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:50.765945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:50.770549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:50.798934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8efdc4b00404ebfb9af2fc44fe4c92a', 'request_id': 'req-979ee310-a457-4730-ba6f-c6931ec4a1ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:50.799771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 946/1906] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:50.801806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:50.827202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ee31-ec65-4847-a820-fa2b43092d39 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:50.859819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8efdc4b00404ebfb9af2fc44fe4c92a', 'request_id': 'req-979ee310-a457-4730-ba6f-c6931ec4a1ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:50.893245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8efdc4b00404ebfb9af2fc44fe4c92a', 'request_id': 'req-979ee310-a457-4730-ba6f-c6931ec4a1ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:51.032643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] The token cache is being invalidate because project a8efdc4b00404ebfb9af2fc44fe4c92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:51.033239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:51.041579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-979ee310-a457-4730-ba6f-c6931ec4a1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:51.048966 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 961/1907] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:50 2022] DELETE /identity/v3/projects/a8efdc4b00404ebfb9af2fc44fe4c92a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:51.064194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e546b-983d-4f85-ac8a-ae8cb3630635 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.064840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e546b-983d-4f85-ac8a-ae8cb3630635 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.065338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e546b-983d-4f85-ac8a-ae8cb3630635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.136382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e19e546b-983d-4f85-ac8a-ae8cb3630635 None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:51.147896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e19e546b-983d-4f85-ac8a-ae8cb3630635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:51.149630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.151948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.152510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.153031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.154299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.162135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb6e72-6976-49db-aecf-2092c870dd3a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.210032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 947/1908] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:51.213451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.215271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.215837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.264466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:51.299730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:51.301227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:51.317737 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 948/1909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:51.329178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.329178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:51.331486 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 962/1910] 10.222.0.85 () {58 vars in 1015 bytes} [Tue Oct 4 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:51.334240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.334702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.335239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.360502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bee8-13eb-4e7d-97e6-03d9305e6337 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.369957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.372232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.372884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.373719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] PATH_INFO: `/v3/projects/3ddceb77c1474bd58bae01ddba7b722b/users/0fb1df0ca433427db82836e92a08d568/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.411767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddceb77c1474bd58bae01ddba7b722b, user_id=0fb1df0ca433427db82836e92a08d568, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.413965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:51.419264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:51.423037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.437556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 963/1911] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:51.439276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.442502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:51.489933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb24a-17cf-4745-ba6b-d3e8f6641913 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.507270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.508393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.508885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.509391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.538723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.546891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.552121 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 949/1912] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:51 2022] PUT /identity/v3/projects/3ddceb77c1474bd58bae01ddba7b722b/users/0fb1df0ca433427db82836e92a08d568/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:51.562585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.587707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 964/1913] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:51.587707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.645316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de909-568d-4ebf-bfc0-0018e26ba979 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.786459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7904181-8e6a-414f-a3b7-de8ca07cee6d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.809624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.810946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.811547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.812440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.813936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:51.814699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.817756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.836479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.837627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.838156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.838977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.843001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.846124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 950/1914] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:51.846638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.853586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.873118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 965/1915] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:51.876146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb002de-75e6-477b-ad35-89b102dcb1f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.884348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.890063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.891385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.892805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.893471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.894772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.899413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b164d-c369-4ddc-af54-c776b8d2b896 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:51.899694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5431ad-11ce-4211-8f88-5d4ffd7548c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.921412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:51.931512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:51.932463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:51.933538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] PATH_INFO: `/v3/projects/3ddceb77c1474bd58bae01ddba7b722b/users/0fb1df0ca433427db82836e92a08d568/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:51.937908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddceb77c1474bd58bae01ddba7b722b, user_id=0fb1df0ca433427db82836e92a08d568, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:51.954278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:51.985568 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 966/1916] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:51 2022] PUT /identity/v3/projects/3ddceb77c1474bd58bae01ddba7b722b/users/0fb1df0ca433427db82836e92a08d568/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:31:51.988238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:51.992424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:52.058604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 951/1917] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:51 2022] POST /identity/v3/projects => generated 407 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:52.067521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:52.068308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:52.068955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:52.162114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] MFA Rules not processed for user `0fb1df0ca433427db82836e92a08d568`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:52.164506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:52.241726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6c97d-3c20-462e-88d2-5f46fa803a6c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:52.331889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 952/1918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:52.333700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:52.375523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:52.536600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:52.538137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:52.543983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:52.544804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] PATH_INFO: `/v3/projects/0ce6d5049a93493289028932b886affd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:52.546585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b31bcd-2820-47e4-8d47-02a8f53d4f04 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:52.548193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce6d5049a93493289028932b886affd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:52.551965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:52.555942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:52.557280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:52.557777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:52.558829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:52.560288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:52.575663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:52.688440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:52.749635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 953/1919] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:52 2022] POST /identity/v3/users => generated 304 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:52.750729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:52.753502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:52.806493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce6d5049a93493289028932b886affd', 'request_id': 'req-5ceeaeba-b630-4e85-bd52-9e44016298c3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:52.841823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce6d5049a93493289028932b886affd', 'request_id': 'req-5ceeaeba-b630-4e85-bd52-9e44016298c3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:52.854741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce6d5049a93493289028932b886affd', 'request_id': 'req-5ceeaeba-b630-4e85-bd52-9e44016298c3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:52.877156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4806c-0137-442d-8564-8e47f34234b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.000833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.003218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.003807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.004435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.034635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] The token cache is being invalidate because project 0ce6d5049a93493289028932b886affd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:53.041217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.041217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ceeaeba-b630-4e85-bd52-9e44016298c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.041217 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 967/1920] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:51 2022] DELETE /identity/v3/projects/0ce6d5049a93493289028932b886affd => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:53.046461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.048345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.049140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.052764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 968/1921] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:31:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:31:53.055307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:53.059730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:53.173871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.177936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.200431 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 954/1922] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:53.202195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:53.287567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e4cb5-57e6-4b4a-b121-b355dea668d7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.293609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.295565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.296934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.298010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.301673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.307337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9ec3-9623-4463-85f4-315364606ec1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.322392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99c82-8538-4c2e-b91d-bea9265708b2 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.332385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.336020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 969/1923] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:53.336020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.336020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.336386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.337826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.338380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.338944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] PATH_INFO: `/v3/users/1675b0dea7ee471d846310c2581e2d1e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.340733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1675b0dea7ee471d846310c2581e2d1e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.343069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.394034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:53.396508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:53.546414 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 970/1924] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:53.548226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:53.576492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003cb6d-d82d-4b6d-90dc-8dc762731c87 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.594951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.597005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.598982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.601590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.602885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.612890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.664602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 971/1925] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:53.664602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:53.664602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:53.691936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1675b0dea7ee471d846310c2581e2d1e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.693913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1675b0dea7ee471d846310c2581e2d1e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.694113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3a80-295a-4649-9847-424f0a887408 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.703679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.704809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.705080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.705632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.733174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.737003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.780820 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 972/1926] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:53.783093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:53.817041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7c97-7aeb-497f-8586-ff67f6dd00c6 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:53.823394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1675b0dea7ee471d846310c2581e2d1e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.828650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:53.830117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:53.830713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:53.831342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] PATH_INFO: `/v3/projects/77f749d752d24c0dad0e30c671ab132a/users/3746dba8216340c1b88ed1cba03efac9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:53.879269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1675b0dea7ee471d846310c2581e2d1e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.891572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f749d752d24c0dad0e30c671ab132a, user_id=3746dba8216340c1b88ed1cba03efac9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:53.898792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:53.910270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-51e38a80-c26b-48b6-9a24-3e582cedd992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1675b0dea7ee471d846310c2581e2d1e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:53.922068 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 955/1927] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:53 2022] DELETE /identity/v3/users/1675b0dea7ee471d846310c2581e2d1e => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:54.052853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 973/1928] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:53 2022] PUT /identity/v3/projects/77f749d752d24c0dad0e30c671ab132a/users/3746dba8216340c1b88ed1cba03efac9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:54.074187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:54.074848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:54.075246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:54.132223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] MFA Rules not processed for user `3746dba8216340c1b88ed1cba03efac9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:54.134696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:54.229955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:54.293043 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 956/1929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:54.298167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:54.301182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:54.473327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b1837-c226-4add-861a-44daf69b3cd0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:54.506822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:54.517278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:54.517278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:54.517278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:54.517278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:54.519063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:54.609947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:54.716885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 974/1930] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:54 2022] POST /identity/v3/projects => generated 409 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:54.720628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:54.748427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58316a83-89eb-47a0-ac58-813b3d42a88a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:54.879411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:54.880733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:54.881375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:54.882191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:54.883800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:54.888718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.016696 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 957/1931] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:54 2022] POST /identity/v3/users => generated 311 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:31:55.023447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.044779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21954bb-28e9-40a2-9c91-a45bb8261481 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.053576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.054780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.055267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.055670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.056607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.059205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.081317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 975/1932] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:55.088067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.101402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.104857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:55.108643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14ffe-983c-43c8-bac9-aa930d2409de admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.118071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.119363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.120815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.120815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] PATH_INFO: `/v3/projects/4077681dfa494f79806ad8e9597eb381/users/933db2f9ffc242c9b4bf36091a0d6e10/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.135797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8fdc-f5de-4d9c-a1dd-b5580a7e775a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.147293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.149294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.154045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.154045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] PATH_INFO: `/v3/users/a822d19cf385466b8b33dcf17a5ed7df` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.154732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a822d19cf385466b8b33dcf17a5ed7df)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.155579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4077681dfa494f79806ad8e9597eb381, user_id=933db2f9ffc242c9b4bf36091a0d6e10, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.159437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.161775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.258998 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 958/1933] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:55 2022] PUT /identity/v3/projects/4077681dfa494f79806ad8e9597eb381/users/933db2f9ffc242c9b4bf36091a0d6e10/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:55.260908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.379617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:55.469528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0751e3-67d2-42b6-8844-b8bf90941ca3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.477544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.478984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.479591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.480741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.481882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.486150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.506079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a822d19cf385466b8b33dcf17a5ed7df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:55.507924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 959/1934] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:55.517634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.541692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1b7d-aedc-4ae0-8276-6daa1782094d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.563514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.564545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.564834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.565118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] PATH_INFO: `/v3/projects/4077681dfa494f79806ad8e9597eb381/users/933db2f9ffc242c9b4bf36091a0d6e10/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.567783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4077681dfa494f79806ad8e9597eb381, user_id=933db2f9ffc242c9b4bf36091a0d6e10, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.571237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659bfd6-1350-4dfb-9761-e42282c5768c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:55.592009 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 960/1935] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:55 2022] PUT /identity/v3/projects/4077681dfa494f79806ad8e9597eb381/users/933db2f9ffc242c9b4bf36091a0d6e10/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:55.608499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.608999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.609506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.616047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a822d19cf385466b8b33dcf17a5ed7df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:55.640161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a822d19cf385466b8b33dcf17a5ed7df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:55.695610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a822d19cf385466b8b33dcf17a5ed7df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:55.699647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-462efe36-15ee-4c76-aba0-75b7ac2d99cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a822d19cf385466b8b33dcf17a5ed7df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:55.705714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] MFA Rules not processed for user `933db2f9ffc242c9b4bf36091a0d6e10`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:55.709231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:55.714329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 976/1936] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:55 2022] DELETE /identity/v3/users/a822d19cf385466b8b33dcf17a5ed7df => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:55.721716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.721716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.721716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.762849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:55.765443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:55.906132 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 977/1937] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:55.908279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 961/1938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:31:55.908635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:55.911418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:55.931507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:55.944163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5f2c-89b2-41d9-97d0-748a6e0760e7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:55.951484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:55.953458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:55.954450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:55.954987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] PATH_INFO: `/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:55.957804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b8f92c44fc4a7d98fa4cef12af2e6a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:55.962059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:56.013042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:56.014413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:56.152566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb87ae-afb1-4c68-8e24-9a6610222c9f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:56.155787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b8f92c44fc4a7d98fa4cef12af2e6a', 'request_id': 'req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:56.182892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b8f92c44fc4a7d98fa4cef12af2e6a', 'request_id': 'req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:56.201183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b8f92c44fc4a7d98fa4cef12af2e6a', 'request_id': 'req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:56.302563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:56.309438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.313030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.313657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.375623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] The token cache is being invalidate because project d6b8f92c44fc4a7d98fa4cef12af2e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:31:56.376152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:56.383592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:56.395449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 978/1939] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:55 2022] DELETE /identity/v3/projects/d6b8f92c44fc4a7d98fa4cef12af2e6a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:56.401230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:56.402894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:56.434356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:56.544261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:56.546401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:56.549063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a029d-2aef-4b3f-8621-5d0da6fe1bec service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:56.601428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 962/1940] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:56.603405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac57c0-d0e3-4f96-bb13-5b43105d48bc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.603800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac57c0-d0e3-4f96-bb13-5b43105d48bc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.604214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac57c0-d0e3-4f96-bb13-5b43105d48bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.648911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6544-aee8-4646-8fa0-0cb93eb2aeab admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:56.650840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-20ac57c0-d0e3-4f96-bb13-5b43105d48bc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:56.653727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20ac57c0-d0e3-4f96-bb13-5b43105d48bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:56.662003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:56.664563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.665453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.666185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.678949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 963/1941] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:56.687505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:56.688629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.689224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.690446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.741786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:56.745235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:56.768839 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 964/1942] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:56.773203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:56.795187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4179a5-68e0-407a-9eaf-1708fc9a5424 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:56.805649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:56.808506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.809277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.810334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.812952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:31:56.815118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:56.818440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:56.850499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:56.852004 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 965/1943] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:31:56.858775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:56.860870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:56.895959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a523-1c5d-4aa1-b811-2371f5057d0b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:56.904857 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 979/1944] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:56 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:56.910889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:56.913737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:56.914291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:56.914666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:56.915707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:56.920890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:56.970667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:57.035016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:57.037934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:57.059544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab507-e3b5-4a73-9285-53b227a1dfe4 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:57.067298 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 966/1945] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:31:56 2022] POST /identity/v3/projects => generated 395 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:31:57.068881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:57.070271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:57.070759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:57.071269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:57.075118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:57.075708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:57.185741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:57.190011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:57.208246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31a61-95f1-4fbd-9923-0e8b30815ec3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:57.212170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 980/1946] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:31:57.222472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:57.224538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:57.225231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:57.234235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:57.234235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:57.234235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:57.421392 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 967/1947] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:31:57 2022] POST /identity/v3/users => generated 298 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:31:57.423940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:57.467575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbab8f-ced4-4d92-b336-a94983db2c8c service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:57.498295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:57.501739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:57.504545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:57.505672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:57.511055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:57.518509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:57.568148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 981/1948] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:31:57.574203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:57.618533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efc84c-930c-442d-bf2a-72a290bb5382 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:57.650626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:57.654279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:57.655702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:57.659828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:57.661263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:57.677865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd95a3-02ac-4b55-97c7-f43babbe8a77 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:57.731612 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 968/1949] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:31:57.737668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:57.772108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527642e6-ac8c-4be2-942a-0a0417febfb2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:57.788312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:57.789815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:57.790433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:57.791022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] PATH_INFO: `/v3/projects/3f55ea5d23454a1783f1719ec6bac06e/users/f2337ea7fc534f7f967d58d4947eb4e4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:57.817388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:57.841677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f55ea5d23454a1783f1719ec6bac06e, user_id=f2337ea7fc534f7f967d58d4947eb4e4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:57.847994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:57.990372 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 982/1950] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:31:57 2022] PUT /identity/v3/projects/3f55ea5d23454a1783f1719ec6bac06e/users/f2337ea7fc534f7f967d58d4947eb4e4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:58.003254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:58.004200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:58.004651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:58.064164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:58.067366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:58.082680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:58.087425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:58.323189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f5c6-3541-4857-ab4f-31a24a76eb0a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:58.355480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 969/1951] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:58.359274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:58.359999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:58.364537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:58.364537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] PATH_INFO: `/v3/users/3746dba8216340c1b88ed1cba03efac9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:58.369169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3746dba8216340c1b88ed1cba03efac9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:58.370084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:58.372142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:58.372555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:58.485412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d55f5e-7bd3-4d58-99ba-18472885bc73 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:58.498709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:58.499871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:58.500542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:58.500891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:58.520203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:58.524002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91c60e-fda8-4319-80e5-fa8d62125114 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:58.544333 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 970/1952] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:58.684118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3746dba8216340c1b88ed1cba03efac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:58.792853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3746dba8216340c1b88ed1cba03efac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:58.815378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3746dba8216340c1b88ed1cba03efac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:58.858777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3746dba8216340c1b88ed1cba03efac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:58.860013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3746dba8216340c1b88ed1cba03efac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:58.877472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 983/1953] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:58 2022] DELETE /identity/v3/users/3746dba8216340c1b88ed1cba03efac9 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:31:58.887038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:58.887575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:58.887994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:58.937452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:31:58.939814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:58.962473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:59.166740 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 971/1954] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:31:59.233201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:59.235998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:59.329479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:31:59.333448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:31:59.384017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0228b-70a2-4bc3-add7-8d1766104817 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:59.414138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:59.418692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:59.421066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:59.422683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] PATH_INFO: `/v3/projects/7e6ee9bb90b1425eb42d43b703756e41` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:59.445771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6ee9bb90b1425eb42d43b703756e41)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:59.465697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:59.508068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075c1e-df49-496d-97c6-4b832adaf952 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:31:59.535795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:31:59.537307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:31:59.540354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:31:59.541302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:31:59.577860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:31:59.582498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:31:59.618825 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 984/1955] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:31:59.794159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6ee9bb90b1425eb42d43b703756e41', 'request_id': 'req-a5163aee-82ff-4803-a388-8eb8dbd7413d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:59.965742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6ee9bb90b1425eb42d43b703756e41', 'request_id': 'req-a5163aee-82ff-4803-a388-8eb8dbd7413d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:31:59.997481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6ee9bb90b1425eb42d43b703756e41', 'request_id': 'req-a5163aee-82ff-4803-a388-8eb8dbd7413d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.025857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] The token cache is being invalidate because project 7e6ee9bb90b1425eb42d43b703756e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:00.027515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.030636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a5163aee-82ff-4803-a388-8eb8dbd7413d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.040453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 972/1956] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:31:59 2022] DELETE /identity/v3/projects/7e6ee9bb90b1425eb42d43b703756e41 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:00.044369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:00.075211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887693-b9fe-4c88-a6a8-46bcfee211ba service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:00.092461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:00.284019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:00.285700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:00.286494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:00.287544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] PATH_INFO: `/v3/users/0fb1df0ca433427db82836e92a08d568` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:00.290591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb1df0ca433427db82836e92a08d568)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:00.295571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:00.755552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb1df0ca433427db82836e92a08d568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.900597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb1df0ca433427db82836e92a08d568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.935061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:00.935912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:00.936050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:00.949524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb1df0ca433427db82836e92a08d568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:00.996225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb1df0ca433427db82836e92a08d568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:01.000132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb1df0ca433427db82836e92a08d568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:01.008895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] MFA Rules not processed for user `c0986e6de5204c4d86e24184039366e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:01.013399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:01.023291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 985/1957] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:00 2022] DELETE /identity/v3/users/0fb1df0ca433427db82836e92a08d568 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:01.224005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 973/1958] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:01.225956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:01.228932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:01.511996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb256f-747f-4eb6-a478-ff765c73f552 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:01.526747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:01.527246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:01.527517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:01.527791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] PATH_INFO: `/v3/projects/77f749d752d24c0dad0e30c671ab132a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:01.534339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f749d752d24c0dad0e30c671ab132a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:01.536583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:01.967040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:01.967040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f749d752d24c0dad0e30c671ab132a', 'request_id': 'req-48f0eb5a-21a7-45ba-8502-f600e1dbb216'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:01.967040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f749d752d24c0dad0e30c671ab132a', 'request_id': 'req-48f0eb5a-21a7-45ba-8502-f600e1dbb216'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:01.982295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f749d752d24c0dad0e30c671ab132a', 'request_id': 'req-48f0eb5a-21a7-45ba-8502-f600e1dbb216'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:02.290453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] The token cache is being invalidate because project 77f749d752d24c0dad0e30c671ab132a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:02.291191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:02.305652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:02.315752 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 986/1959] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:01 2022] DELETE /identity/v3/projects/77f749d752d24c0dad0e30c671ab132a => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:02.318150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:02.364328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25ad3-0afb-4f41-b865-dd739ef9efc9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:02.533797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:02.633761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:02.644694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:02.645831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:02.647776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] PATH_INFO: `/v3/users/933db2f9ffc242c9b4bf36091a0d6e10` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:02.656422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933db2f9ffc242c9b4bf36091a0d6e10)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:02.671884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:03.124747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933db2f9ffc242c9b4bf36091a0d6e10'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.126090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933db2f9ffc242c9b4bf36091a0d6e10'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.281908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933db2f9ffc242c9b4bf36091a0d6e10'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.328253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933db2f9ffc242c9b4bf36091a0d6e10'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.361691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0822fdaf-4231-4ff6-b79c-49a1c76f9c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933db2f9ffc242c9b4bf36091a0d6e10'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.369810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:03.374065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:03.390301 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 974/1960] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:02 2022] DELETE /identity/v3/users/933db2f9ffc242c9b4bf36091a0d6e10 => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:03.414934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0eb5a-21a7-45ba-8502-f600e1dbb216 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:03.584115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:03.585411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:03.585800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:03.586148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] PATH_INFO: `/v3/projects/3ddceb77c1474bd58bae01ddba7b722b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:03.587771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddceb77c1474bd58bae01ddba7b722b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:03.593926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:03.929873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddceb77c1474bd58bae01ddba7b722b', 'request_id': 'req-ece8a499-a276-4948-87ee-d6b4192bafc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.961607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddceb77c1474bd58bae01ddba7b722b', 'request_id': 'req-ece8a499-a276-4948-87ee-d6b4192bafc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:03.976214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddceb77c1474bd58bae01ddba7b722b', 'request_id': 'req-ece8a499-a276-4948-87ee-d6b4192bafc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:04.120894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] The token cache is being invalidate because project 3ddceb77c1474bd58bae01ddba7b722b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:04.124015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:04.129155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ece8a499-a276-4948-87ee-d6b4192bafc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:04.147951 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 987/1961] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:03 2022] DELETE /identity/v3/projects/3ddceb77c1474bd58bae01ddba7b722b => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:04.155741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:04.156153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:04.156740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:04.218106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:04.226057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:04.453452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 975/1962] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:32:04.470910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:04.471850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:04.471850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:04.596941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:04.605645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:04.661026 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 988/1963] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:32:04.663609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:04.694445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7303cd-aca2-455a-bf5c-c1d87be2d4c2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:04.717853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:04.719352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:04.722607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:04.723692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:04.725281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:04.734625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:04.738668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:04.777656 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 976/1964] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:04.782549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:04.827128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed13d-60d2-4d14-a1f5-4300897fa556 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:04.848446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:04.853390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:04.855294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:04.858092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:04.860435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:04.865467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.063947 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 989/1965] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:04 2022] POST /identity/v3/projects => generated 397 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:05.070290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.094965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5b6f-55fb-426e-b69f-c3f946263a42 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:05.231695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:05.233125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:05.233807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:05.234516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:05.236002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:05.241012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.439256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 977/1966] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:05 2022] POST /identity/v3/users => generated 299 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:32:05.444173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.446214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.447047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:05.474320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8db8f-925b-40b3-ba61-955bd0a4f29c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:05.488378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:05.489314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:05.489604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:05.490606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279a9f-bb2e-437f-9e8f-b25d7afd2db9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:05.493116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:05.494809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:05.500015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.534041 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 978/1967] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:05.537328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:05.537926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.538062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:05.538273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:05.538558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] PATH_INFO: `/v3/projects/4077681dfa494f79806ad8e9597eb381` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:05.542631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4077681dfa494f79806ad8e9597eb381)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:05.544780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.565800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf498187-c0c8-4c13-886b-0417e48de4e9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:05.586095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:05.587606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:05.588974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:05.594438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:05.597272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:05.611703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.646423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:05.691167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 979/1968] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:05.698332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.744613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d6741-41c5-485a-bfa8-f86ec52be121 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:05.771179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:05.774437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:05.778639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:05.779175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] PATH_INFO: `/v3/projects/b2549113f2a84de09ec0c0094762c4a1/users/b36382b47d6541a8b810035d777fd624/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:05.837346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:05.845060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2549113f2a84de09ec0c0094762c4a1, user_id=b36382b47d6541a8b810035d777fd624, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:05.850451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:05.858284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4077681dfa494f79806ad8e9597eb381', 'request_id': 'req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:05.867906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4077681dfa494f79806ad8e9597eb381', 'request_id': 'req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:05.878095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4077681dfa494f79806ad8e9597eb381', 'request_id': 'req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:05.975450 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 980/1969] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:05 2022] PUT /identity/v3/projects/b2549113f2a84de09ec0c0094762c4a1/users/b36382b47d6541a8b810035d777fd624/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:05.976506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:05.985316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:06.085441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] The token cache is being invalidate because project 4077681dfa494f79806ad8e9597eb381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:06.085785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.086903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49dff483-ce2b-43d9-bd98-114b3a3cd5cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.090671 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 990/1970] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:05 2022] DELETE /identity/v3/projects/4077681dfa494f79806ad8e9597eb381 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:06.093632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9497f1-249c-4dfe-a328-5e8a85295b41 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.094377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9497f1-249c-4dfe-a328-5e8a85295b41 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.094881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9497f1-249c-4dfe-a328-5e8a85295b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.185214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5f9497f1-249c-4dfe-a328-5e8a85295b41 None None] MFA Rules not processed for user `b36382b47d6541a8b810035d777fd624`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:06.194344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f9497f1-249c-4dfe-a328-5e8a85295b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:06.215560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149868a-d856-49b8-bf9f-22b0f71d253f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:06.266904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:06.267796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.268288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.270487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] PATH_INFO: `/v3/users/9baf3883d6ac4328bf3aa9ffaaa48b4f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.275782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baf3883d6ac4328bf3aa9ffaaa48b4f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:06.282780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:06.397564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 991/1971] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:06.403724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.403724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.403724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.458571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:06.472695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:06.492844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 992/1972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:06.494041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:06.505841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:06.531624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a9bde-dd6c-44b8-88bf-2ef4bc9b7f75 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:06.544084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:06.545708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.546579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.547297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.549339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:06.551870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64284539-6e78-40f5-a0c2-f34fb749e2c9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:06.649494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baf3883d6ac4328bf3aa9ffaaa48b4f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.651991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baf3883d6ac4328bf3aa9ffaaa48b4f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.749295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 993/1973] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:06 2022] POST /identity/v3/projects => generated 397 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:06.751455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.752001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.752438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.788232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:06.790553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:06.907059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 994/1974] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:06.907059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:06.915763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baf3883d6ac4328bf3aa9ffaaa48b4f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.928039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ee1f-2dfe-4ac2-b0b8-6bcf43438d1f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:06.950844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:06.952471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:06.952607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:06.957497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:06.957497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:06.958217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:06.969063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baf3883d6ac4328bf3aa9ffaaa48b4f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:06.989965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baf3883d6ac4328bf3aa9ffaaa48b4f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:07.011984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 981/1975] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:05 2022] DELETE /identity/v3/users/9baf3883d6ac4328bf3aa9ffaaa48b4f => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:07.026715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:07.034366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:07.065692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 995/1976] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:06 2022] POST /identity/v3/users => generated 305 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:07.074155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:07.083016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:07.137539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685970b-f03a-400f-92ef-6ed5c2908f34 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:07.218654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36c56c-cb3a-40f7-b177-05380ef74326 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:07.235550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:07.237151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:07.239555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:07.241589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:07.243552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:07.244772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:07.249364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:07.280922 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 982/1977] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:07.287387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:07.360671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf038ce-2b16-4619-9b76-1239ff90c638 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:07.380001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:07.380305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:07.381079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:07.381374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:07.381552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:07.381688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:07.381954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:07.382308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:07.382468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:07.384571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:07.392407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:07.396359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:07.488965 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 996/1978] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:07.494136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:07.545072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5a1d7-0dcc-40c6-a9d2-4a8d1dbd7fd0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:07.574416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:07.586827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:07.587546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:07.588075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] PATH_INFO: `/v3/projects/069c65953ec14f159b943500c268603e/users/c14176100e684d63a997c4b8038b0416/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:07.591916 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 983/1979] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:07 2022] POST /identity/v3/projects => generated 359 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:07.599599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:07.677291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] RBAC: Authorizing `identity:create_grant(project_id=069c65953ec14f159b943500c268603e, user_id=c14176100e684d63a997c4b8038b0416, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:07.681990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:07.810330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cef026-b530-4e93-87e4-4ff8f214dce3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:07.828472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:07.831885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:07.832728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:07.833688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:07.835562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:07.836302 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 997/1980] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:07 2022] PUT /identity/v3/projects/069c65953ec14f159b943500c268603e/users/c14176100e684d63a997c4b8038b0416/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:07.840496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:07.842181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.022110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb88d0-7bd0-418f-821a-f8ba39c0690c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:08.032028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:08.037956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.038637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.039651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.041195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:08.045549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:08.052566 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 984/1981] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:07 2022] POST /identity/v3/users => generated 280 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:08.057715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.077558 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 998/1982] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:08.079592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b708b0-9e58-41bc-9ccc-825478bfff64 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:08.094452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.097384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:08.099582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.100301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.101177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.102629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:08.113089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:08.136165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750c0b-8145-49b1-9921-abf8bd41ccdc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:08.140203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 985/1983] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:08.143197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.146969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:08.148575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:08.149473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.150096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.151034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] PATH_INFO: `/v3/projects/069c65953ec14f159b943500c268603e/users/c14176100e684d63a997c4b8038b0416/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.157852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069c65953ec14f159b943500c268603e, user_id=c14176100e684d63a997c4b8038b0416, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:08.166280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:08.197651 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 999/1984] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:08 2022] PUT /identity/v3/projects/069c65953ec14f159b943500c268603e/users/c14176100e684d63a997c4b8038b0416/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:08.208128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661120e-6707-46c1-8079-c94024c33841 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:08.210913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.360232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:08.364283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.370550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.371091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] PATH_INFO: `/v3/projects/d593ded97dc34546bfe79cdbdac0d4c2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.374504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d593ded97dc34546bfe79cdbdac0d4c2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:08.381254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:08.491725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048ec6-d92b-4792-bb0b-20faecb3c6a2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:08.527785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:08.529273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.532108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.533535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.540339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:08.546379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9f522-9584-46bb-b007-cdfee614dd6d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:08.579532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd593ded97dc34546bfe79cdbdac0d4c2', 'request_id': 'req-10374694-2d91-44ac-855b-38d4b03f5830'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:08.594262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1000/1985] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:08.594262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:08.594262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:08.594262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:08.663279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] MFA Rules not processed for user `c14176100e684d63a997c4b8038b0416`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:08.666111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:08.731796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd593ded97dc34546bfe79cdbdac0d4c2', 'request_id': 'req-10374694-2d91-44ac-855b-38d4b03f5830'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:08.755531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd593ded97dc34546bfe79cdbdac0d4c2', 'request_id': 'req-10374694-2d91-44ac-855b-38d4b03f5830'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:08.804390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] The token cache is being invalidate because project d593ded97dc34546bfe79cdbdac0d4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:08.805236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:08.808469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:08.818778 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 986/1986] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:08 2022] DELETE /identity/v3/projects/d593ded97dc34546bfe79cdbdac0d4c2 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:08.827681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:08.836031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:08.989668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1001/1987] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:08.996562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:09.003069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:09.095683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:09.141022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374694-2d91-44ac-855b-38d4b03f5830 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:09.168818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:09.177692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:09.178423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:09.179248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] PATH_INFO: `/v3/projects/59b62d6fbcb14cd4bd32099a599e539e/users/0cae0d11ca114a22aab58c4faf9950f2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:09.226449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b62d6fbcb14cd4bd32099a599e539e, user_id=0cae0d11ca114a22aab58c4faf9950f2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:09.234426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fefbf-b64e-466c-ab86-be889176eaa9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:09.271478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ad00-ead3-426f-bd79-f3b09eaccf40 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:09.290627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:09.292334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:09.292837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:09.293338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] PATH_INFO: `/v3/users/2ba27228585a404dbc2c996987759176` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:09.295661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:09.297631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba27228585a404dbc2c996987759176)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:09.308295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:09.337293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 987/1988] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:08 2022] PUT /identity/v3/projects/59b62d6fbcb14cd4bd32099a599e539e/users/0cae0d11ca114a22aab58c4faf9950f2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:09.361020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:09.361648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:09.362181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:09.453824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] MFA Rules not processed for user `0cae0d11ca114a22aab58c4faf9950f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:09.455864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:09.632253 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 988/1989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:09.647183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:09.755730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba27228585a404dbc2c996987759176'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:09.880733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba27228585a404dbc2c996987759176'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:09.909932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba27228585a404dbc2c996987759176'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:09.920067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75671-805a-4fda-ab68-4f7ec4b35eec None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:09.941344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:09.941629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba27228585a404dbc2c996987759176'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:09.942114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba27228585a404dbc2c996987759176'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:09.942220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:09.942734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:09.943240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:09.944489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:09.949156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:09.954929 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1002/1990] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:08 2022] DELETE /identity/v3/users/2ba27228585a404dbc2c996987759176 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:09.956439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:09.962413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:10.124587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 989/1991] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:09 2022] POST /identity/v3/projects => generated 359 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:10.126919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:10.144683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:10.354714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace126f-a613-469f-95f9-5c86597a1c8e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:10.433815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce279-b79e-4eb1-8144-68063ec068d4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:10.456246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:10.457400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:10.457881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:10.458804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:10.462651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:10.473570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:10.652975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:10.655161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:10.669172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:10.676708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:10.687421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:10.687994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 990/1992] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:10 2022] POST /identity/v3/users => generated 286 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:10.694456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:10.739163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ed964-ef05-4510-b333-bbd9b2489241 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:10.761952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:10.763204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:10.764148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:10.764148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:10.765309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:10.770081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:10.795803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 991/1993] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:10.804078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:10.829989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269973a-be47-4eef-9c8c-3b2fe85c5dbe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:10.849911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:10.851293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:10.851929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:10.852485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] PATH_INFO: `/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6/users/831f418fccb44f89b0831d8770c5897d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:10.905937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf838ed69ed146f48c1d09fbc8c3b7f6, user_id=831f418fccb44f89b0831d8770c5897d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:10.913508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:10.953255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:10.955746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:10.989903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1003/1994] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 1034 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:11.079764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 992/1995] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:10 2022] PUT /identity/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6/users/831f418fccb44f89b0831d8770c5897d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:11.080977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:11.124794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f64da-e1a5-440f-ba43-408f1536a87e service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:11.410334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:11.425863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:11.427049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:11.427581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:11.428069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:11.429308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:11.443954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509c16-bb4e-4461-9746-64e71e174abc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:11.504024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1004/1996] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:11.513023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:11.549774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3857f-c862-4589-9126-0c606e8b0b54 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:11.565776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:11.567754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:11.568524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:11.569287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] PATH_INFO: `/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6/users/831f418fccb44f89b0831d8770c5897d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:11.574281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf838ed69ed146f48c1d09fbc8c3b7f6, user_id=831f418fccb44f89b0831d8770c5897d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:11.580849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:11.641126 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 993/1997] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:11 2022] PUT /identity/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6/users/831f418fccb44f89b0831d8770c5897d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:11.646600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:11.647092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:11.649023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:11.728217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] MFA Rules not processed for user `831f418fccb44f89b0831d8770c5897d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:11.731464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:11.805211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:11.918278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1005/1998] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:11.975709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:11.981143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:12.245167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444f95-b5a3-437b-a82c-369bf9779b10 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:12.268807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:12.271839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:12.272465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:12.273061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] PATH_INFO: `/v3/projects/d9d8207cd41c4b6d982277b75699008c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:12.276966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d8207cd41c4b6d982277b75699008c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:12.281659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:12.282465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:12.286098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:12.530763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749df17-5e7c-488e-9a8a-ac80dffd5354 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:12.556873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d8207cd41c4b6d982277b75699008c', 'request_id': 'req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:12.661533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d8207cd41c4b6d982277b75699008c', 'request_id': 'req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:12.681302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d8207cd41c4b6d982277b75699008c', 'request_id': 'req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:12.763020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] The token cache is being invalidate because project d9d8207cd41c4b6d982277b75699008c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:12.764020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:12.765864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3510e3f8-fffb-4a26-9c87-81e36d4d51e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:12.776208 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 994/1999] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:11 2022] DELETE /identity/v3/projects/d9d8207cd41c4b6d982277b75699008c => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:12.778619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:12.779965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824740ec-6169-49ca-9375-136d49489a1c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:12.780841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824740ec-6169-49ca-9375-136d49489a1c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:12.781734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824740ec-6169-49ca-9375-136d49489a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:12.781912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:12.782292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:12.782980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:12.790160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:12.829505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-824740ec-6169-49ca-9375-136d49489a1c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:12.833378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-824740ec-6169-49ca-9375-136d49489a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:13.026296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:13.047979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14913c-dd17-4276-8d5d-daff56455b62 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:13.073190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 995/2000] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:13.076572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824740ec-6169-49ca-9375-136d49489a1c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:13.087042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-824740ec-6169-49ca-9375-136d49489a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:13.122476 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1006/2001] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:32:13.124811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.130120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.130435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.148797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824740ec-6169-49ca-9375-136d49489a1c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:13.164830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:13.169070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.169835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.170439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.175851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:13.193526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:13.198315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:13.220402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1007/2002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:13.230267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:13.270016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a71ad-dedb-4220-a418-a74520c8b51f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:13.279191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:13.280343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.280690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.281148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.282224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:13.283198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:13.286549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:13.331186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1008/2003] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:13.339377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:13.346205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:13.379097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117a2e-b023-4d4c-a1d2-c7fec9b27b07 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:13.403198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:13.403959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.404585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.405285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.406600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:13.416092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4ecc-43d3-4720-98ee-8fcc45581fc5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:13.420193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:13.424017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:13.480142 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 996/2004] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:13.486353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:13.591078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1009/2005] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:13 2022] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:32:13.600910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:13.667426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c60f6-3742-4b13-aad1-cc43ad576fe9 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:13.747896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956697c-27ce-4132-82bb-e17c24f34efd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.748720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956697c-27ce-4132-82bb-e17c24f34efd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.749633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956697c-27ce-4132-82bb-e17c24f34efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f956697c-27ce-4132-82bb-e17c24f34efd None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:32:13.784694 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:13.786515 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:32:13.788604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1010/2006] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:32:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:32:13.853793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.854820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.855381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.971686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] MFA Rules not processed for user `4b8c35b4791b41fea4edf6b6f1ef6de1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:13.974313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:13.977277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:13.980224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:13.982949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:13.982949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:13.984607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:13.990478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:14.147239 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 997/2007] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:13 2022] POST /identity/v3/users => generated 286 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:14.147239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:14.158815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:14.195848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1011/2008] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:32:14.197596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:14.242344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6f86-7327-4453-a03b-e91ceb8a3d8e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:14.266405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:14.267574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:14.267879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:14.268352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:14.269600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:14.289723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:14.324105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1012/2009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:14.334499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:14.372217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b10b8-a69a-4d73-bc3f-21f295c38065 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:14.401377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:14.402704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:14.403391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:14.404029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:14.405396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:14.412237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:14.427494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513f24-d149-49d6-9173-9e712a7fc73d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:14.444650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:14.446244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:14.446775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:14.447303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:14.448836 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1013/2010] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:32:14.456437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:14.458674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:14.484912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87b2a-be7b-43d4-9d12-18e2351910de admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:14.504534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:14.512202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:14.512812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:14.514489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] PATH_INFO: `/v3/projects/245cdda5c75542a492e519d3e7cb9f80/users/0a86f9c3d293418e8cad33b78f1d9f48/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:14.559701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245cdda5c75542a492e519d3e7cb9f80, user_id=0a86f9c3d293418e8cad33b78f1d9f48, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:14.567405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d034-0c34-46b9-b4ee-032b24259a08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:14.658447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:14.663397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:14.700704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1014/2011] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:14 2022] PUT /identity/v3/projects/245cdda5c75542a492e519d3e7cb9f80/users/0a86f9c3d293418e8cad33b78f1d9f48/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:14.715068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:14.715068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:14.715456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:14.721900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 998/2012] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:14.778104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] MFA Rules not processed for user `0a86f9c3d293418e8cad33b78f1d9f48`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:14.780407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:14.925299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1015/2013] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:32:14.933526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:14.959513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3b58-3642-4f84-978c-304abaa2f765 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:14.991478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:15.071409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:15.073944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:15.075200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:15.081728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:15.083308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:15.093797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:15.133984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:15.251492 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 999/2014] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:14 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:32:15.259835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:15.300557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a3048-16cb-4200-ac63-5b9c5e573aba None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:15.492808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:15.492808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:15.492808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:15.492808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:15.497055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:15.500807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:15.636505 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1016/2015] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:15 2022] POST /identity/v3/users => generated 292 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:15.642600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:15.662843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db09f1-ce12-4532-b58d-958515e84a59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:15.672550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:15.673771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:15.675404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:15.676270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:15.677605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:15.681336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:15.701571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1000/2016] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:32:15.708436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:15.730762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2576c-443e-441a-b0f0-478c8f4a3d62 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:15.740383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:15.741401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:15.742006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:15.742428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] PATH_INFO: `/v3/projects/88b112cc188f49cc987f5f71896081a8/users/040dfb1b2d5f4093a1eea54059ecfe5c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:15.776107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b112cc188f49cc987f5f71896081a8, user_id=040dfb1b2d5f4093a1eea54059ecfe5c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:15.782322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:15.900830 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1017/2017] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:15 2022] PUT /identity/v3/projects/88b112cc188f49cc987f5f71896081a8/users/040dfb1b2d5f4093a1eea54059ecfe5c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:15.906798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:15.920899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d1c6-3027-444f-bbcb-59bb80155f64 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:16.053245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:16.053245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:16.053245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:16.053245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:16.053809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:16.053809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:16.075104 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1001/2018] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:32:16.081231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:16.096959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b0ef-c89d-4965-a76a-f28c5648f720 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:16.106779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:16.108719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:16.108996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:16.109563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] PATH_INFO: `/v3/projects/88b112cc188f49cc987f5f71896081a8/users/040dfb1b2d5f4093a1eea54059ecfe5c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:16.113512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b112cc188f49cc987f5f71896081a8, user_id=040dfb1b2d5f4093a1eea54059ecfe5c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:16.117718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6519-4416-4c61-8e38-f4b6a4e8f5c5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:16.135758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:16.139772 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1018/2019] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:16 2022] PUT /identity/v3/projects/88b112cc188f49cc987f5f71896081a8/users/040dfb1b2d5f4093a1eea54059ecfe5c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:16.150718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:16.162829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:16.170692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:16.173109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:16.176404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:16.207461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f398c1-ca4b-461e-8e2a-155e5ae68b7b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:16.257570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] MFA Rules not processed for user `040dfb1b2d5f4093a1eea54059ecfe5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:16.259874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:16.289541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:16.411449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:16.413225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:16.413951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:16.414681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] PATH_INFO: `/v3/users/0cae0d11ca114a22aab58c4faf9950f2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:16.418127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cae0d11ca114a22aab58c4faf9950f2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:16.423466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:16.469241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1019/2020] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:16.545426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:16.548631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:16.581705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cfb64-1d7f-4e56-bf30-edddb6a19178 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:16.612962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:16.633736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:16.634615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:16.635282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:16.635874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] PATH_INFO: `/v3/users/2a7aaeb417c04b7085a6e752268963c8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:16.638945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7aaeb417c04b7085a6e752268963c8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:16.644050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:16.761804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cae0d11ca114a22aab58c4faf9950f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:16.764380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cae0d11ca114a22aab58c4faf9950f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:16.934200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cae0d11ca114a22aab58c4faf9950f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:16.972095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cae0d11ca114a22aab58c4faf9950f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:16.995123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98575456-f09d-42d6-83dd-2aa3809ea6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cae0d11ca114a22aab58c4faf9950f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.019068 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1002/2021] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:16 2022] DELETE /identity/v3/users/0cae0d11ca114a22aab58c4faf9950f2 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:17.038510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7aaeb417c04b7085a6e752268963c8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.065724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:17.066843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:17.077395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:17.170294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:17.172551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:17.225759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7aaeb417c04b7085a6e752268963c8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.256875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7aaeb417c04b7085a6e752268963c8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.310425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7aaeb417c04b7085a6e752268963c8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.312170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-018983fa-dba7-42c8-808b-5ac84a5be953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7aaeb417c04b7085a6e752268963c8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:17.331706 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1020/2022] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:16 2022] DELETE /identity/v3/users/2a7aaeb417c04b7085a6e752268963c8 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:17.331706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44c30-f1b9-4400-ab55-d96efc6a4479 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:17.333822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44c30-f1b9-4400-ab55-d96efc6a4479 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:17.334602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44c30-f1b9-4400-ab55-d96efc6a4479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:17.356723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1003/2023] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:17.358331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:17.372361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:17.411339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22d44c30-f1b9-4400-ab55-d96efc6a4479 None None] MFA Rules not processed for user `f2337ea7fc534f7f967d58d4947eb4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:17.417462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22d44c30-f1b9-4400-ab55-d96efc6a4479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:17.460494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:17.578252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:17.585042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6b4d-67ca-4587-975b-8f05dc92e2ac None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:17.737814 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1021/2024] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:17.754803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:17.761546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:17.762035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:17.814452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:17.816994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:17.826343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:17.828094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:17.840660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:17.840660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:17.840660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:18.011669 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1022/2025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:18.014572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:18.022868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:18.024720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:18.128851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:18.136709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:18.143864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48aad0-951e-45be-8ac9-ef8638a2b3cd service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:18.191964 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1004/2026] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:18.196644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.197678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.198470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:18.212988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2f791-1ce5-4d38-969f-ff9a97c0e4cb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:18.221862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:18.223431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.223918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.224400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:18.256482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:18.269667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:18.271878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] MFA Rules not processed for user `f2337ea7fc534f7f967d58d4947eb4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:18.276307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:18.297481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1005/2027] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:18.308156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:18.319730 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1023/2028] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:18.321274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:18.323764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:18.326474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f55a0-e655-46d5-a05e-31c72189426d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:18.333872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:18.336911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.337760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.338343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:18.358013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:18.362553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:18.391234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ade0e-e40f-41b6-998c-6d8f4bf8f37c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:18.392749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1006/2029] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:18.403066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:18.404708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.405198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.407891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] PATH_INFO: `/v3/users/b36382b47d6541a8b810035d777fd624` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:18.408812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36382b47d6541a8b810035d777fd624)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:18.413187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:18.542433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:18.693178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:18.695635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:18.748697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36382b47d6541a8b810035d777fd624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:18.766220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bbbc-92c6-4f66-b9ef-4972a79369f6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:18.785045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:18.787925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.788900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.789658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:18.811952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:18.817030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf9e3-8a05-4ad1-a155-2d9208612889 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:18.838083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1007/2030] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:32:18.846795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36382b47d6541a8b810035d777fd624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:18.875895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36382b47d6541a8b810035d777fd624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:18.928393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36382b47d6541a8b810035d777fd624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:18.930958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36382b47d6541a8b810035d777fd624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:18.964824 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1024/2031] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:18 2022] DELETE /identity/v3/users/b36382b47d6541a8b810035d777fd624 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:18.971716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb9cc-7d64-44a3-976e-a4227b47d896 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:18.972579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb9cc-7d64-44a3-976e-a4227b47d896 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:18.973298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb9cc-7d64-44a3-976e-a4227b47d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:19.020409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ed2cb9cc-7d64-44a3-976e-a4227b47d896 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:19.025444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ed2cb9cc-7d64-44a3-976e-a4227b47d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:19.231470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1008/2032] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:19.233253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:19.236098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:19.409766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:19.496737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4e14-0d5f-47d1-9f5f-7f038daa11dc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:19.511084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:19.511999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:19.512475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:19.513603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:19.536026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:19.539467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:19.566795 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1025/2033] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:32:19.669299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:19.669862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:19.670225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:32:19.689311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:19.691184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:32:19.696729 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1009/2034] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:32:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:32:20.337187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:20.340455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:20.387781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838e0c0-feb1-45c9-ac95-c57fceda61c1 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:20.397283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:20.398261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:20.398697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:20.399165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] PATH_INFO: `/v3/projects/59b62d6fbcb14cd4bd32099a599e539e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:20.401550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b62d6fbcb14cd4bd32099a599e539e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:20.404711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:20.496882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:20.498995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:20.551480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb2157-cded-48d3-95dd-972b7d2cc859 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:20.579714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:20.585786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:20.586965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:20.589194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] PATH_INFO: `/v3/projects/43a6c60df0b14717bf52f10dbe8d68c2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:20.599217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a6c60df0b14717bf52f10dbe8d68c2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:20.599217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:20.720739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b62d6fbcb14cd4bd32099a599e539e', 'request_id': 'req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:20.760595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b62d6fbcb14cd4bd32099a599e539e', 'request_id': 'req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:20.810363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b62d6fbcb14cd4bd32099a599e539e', 'request_id': 'req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.001153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:21.012205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] The token cache is being invalidate because project 59b62d6fbcb14cd4bd32099a599e539e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:21.012717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.027042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.027242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a6c60df0b14717bf52f10dbe8d68c2', 'request_id': 'req-1eaeeefa-ebee-4ced-b8ba-7012187caac7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.044512 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1026/2035] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:20 2022] DELETE /identity/v3/projects/59b62d6fbcb14cd4bd32099a599e539e => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:21.046131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:21.059667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:21.150960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a6c60df0b14717bf52f10dbe8d68c2', 'request_id': 'req-1eaeeefa-ebee-4ced-b8ba-7012187caac7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.198336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a6c60df0b14717bf52f10dbe8d68c2', 'request_id': 'req-1eaeeefa-ebee-4ced-b8ba-7012187caac7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.261533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] The token cache is being invalidate because project 43a6c60df0b14717bf52f10dbe8d68c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:21.261950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.264283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:21.285311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1010/2036] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:20 2022] DELETE /identity/v3/projects/43a6c60df0b14717bf52f10dbe8d68c2 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:21.288263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:21.292818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:21.362237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e12e-8975-4cd7-ae8b-c9d79cb77cc1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:21.604798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeeefa-ebee-4ced-b8ba-7012187caac7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:21.624731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:21.628629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:21.629097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:21.629581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] PATH_INFO: `/v3/users/fa6f52cb0cd643e98535ba532fe2c384` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:21.632598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6f52cb0cd643e98535ba532fe2c384)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:21.636126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:21.637361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:21.637845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:21.641809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] PATH_INFO: `/v3/users/831f418fccb44f89b0831d8770c5897d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:21.643968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:21.647564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831f418fccb44f89b0831d8770c5897d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:21.653080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:21.685796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:22.116605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831f418fccb44f89b0831d8770c5897d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.116947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6f52cb0cd643e98535ba532fe2c384'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.120455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6f52cb0cd643e98535ba532fe2c384'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.240561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831f418fccb44f89b0831d8770c5897d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.263195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831f418fccb44f89b0831d8770c5897d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.294344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831f418fccb44f89b0831d8770c5897d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.295054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831f418fccb44f89b0831d8770c5897d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.310554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1027/2037] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:21 2022] DELETE /identity/v3/users/831f418fccb44f89b0831d8770c5897d => generated 0 bytes in 1261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:22.310554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:22.310554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:22.404031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6f52cb0cd643e98535ba532fe2c384'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.471059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6f52cb0cd643e98535ba532fe2c384'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.542393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa7914-488a-4c6b-b3f3-1466185117c2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:22.543439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6f52cb0cd643e98535ba532fe2c384'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.566888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:22.569296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:22.569736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:22.570501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] PATH_INFO: `/v3/projects/b2549113f2a84de09ec0c0094762c4a1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:22.574746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2549113f2a84de09ec0c0094762c4a1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:22.576742 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1011/2038] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:21 2022] DELETE /identity/v3/users/fa6f52cb0cd643e98535ba532fe2c384 => generated 0 bytes in 1291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:22.578362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:22.578985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:22.582849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:22.752054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:22.783417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571986-c16e-4a43-bb44-b560342506ef admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:22.794109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:22.795413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:22.796511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:22.803582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] PATH_INFO: `/v3/users/0a86f9c3d293418e8cad33b78f1d9f48` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:22.803582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a86f9c3d293418e8cad33b78f1d9f48)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:22.812593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:22.858523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2549113f2a84de09ec0c0094762c4a1', 'request_id': 'req-a889b1a8-a341-441e-84aa-96cb86cf3979'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.882889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2549113f2a84de09ec0c0094762c4a1', 'request_id': 'req-a889b1a8-a341-441e-84aa-96cb86cf3979'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:22.898796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2549113f2a84de09ec0c0094762c4a1', 'request_id': 'req-a889b1a8-a341-441e-84aa-96cb86cf3979'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.049615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] The token cache is being invalidate because project b2549113f2a84de09ec0c0094762c4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:23.049959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.064161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.072862 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1028/2039] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:22 2022] DELETE /identity/v3/projects/b2549113f2a84de09ec0c0094762c4a1 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:23.079951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:23.089099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:23.200191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:23.205526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a86f9c3d293418e8cad33b78f1d9f48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.208450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a86f9c3d293418e8cad33b78f1d9f48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.338793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a86f9c3d293418e8cad33b78f1d9f48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.450169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a86f9c3d293418e8cad33b78f1d9f48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.491459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a86f9c3d293418e8cad33b78f1d9f48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:23.515666 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1012/2040] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:22 2022] DELETE /identity/v3/users/0a86f9c3d293418e8cad33b78f1d9f48 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:23.517648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:23.520973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:23.539952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889b1a8-a341-441e-84aa-96cb86cf3979 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:23.831404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9e3c-1cdd-40ad-bf35-cbab6042d633 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:23.849822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:23.851004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:23.851546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:23.852048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] PATH_INFO: `/v3/users/c14176100e684d63a997c4b8038b0416` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:23.852978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:23.854654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14176100e684d63a997c4b8038b0416)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:23.858647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:23.866297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:23.867981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:23.867981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] PATH_INFO: `/v3/users/72398073905c49ee952b40ce1a53fd28` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:23.869034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72398073905c49ee952b40ce1a53fd28)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:23.875746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:24.346187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72398073905c49ee952b40ce1a53fd28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.412901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14176100e684d63a997c4b8038b0416'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.422073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14176100e684d63a997c4b8038b0416'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.517892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72398073905c49ee952b40ce1a53fd28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.546973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72398073905c49ee952b40ce1a53fd28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.594442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72398073905c49ee952b40ce1a53fd28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.596710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e23a6c91-a2ff-4f01-84f1-60c43ea32a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72398073905c49ee952b40ce1a53fd28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.603502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14176100e684d63a997c4b8038b0416'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.612764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1029/2041] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:23 2022] DELETE /identity/v3/users/72398073905c49ee952b40ce1a53fd28 => generated 0 bytes in 1537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:24.614130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:24.619806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:24.619806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:24.688030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:24.702644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:24.707850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:24.716896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14176100e684d63a997c4b8038b0416'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.771854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36e6072e-6759-4485-937f-abecf2582d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14176100e684d63a997c4b8038b0416'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:24.816605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1013/2042] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:23 2022] DELETE /identity/v3/users/c14176100e684d63a997c4b8038b0416 => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:24.820168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:24.820592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:24.827624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:24.927460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:24.932992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:24.948865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:25.060957 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1030/2043] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:25.063535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:25.068984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:25.159935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff89ca-9887-4304-8d5f-0400609497d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:25.296493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1014/2044] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:25.298195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:25.312125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:25.517483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:25.519486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:25.520399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:25.521439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] PATH_INFO: `/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:25.525968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8231cbd10e4f4ea7eb62bf99dd0791)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:25.532001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:25.549306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e817dbc-bcf5-4783-b788-528e0ac44d4d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:25.557014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:25.558131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:25.558713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:25.559242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:25.616512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:25.626170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:25.700526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1015/2045] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:25.702690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:25.716077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:25.746082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48dfd-a6f4-4a37-a5fa-f7b875b35c5a service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:25.779707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:25.784669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:25.786809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:25.787981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:25.821530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:25.833377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ebbb2-b2ea-4bd2-8159-f3f3d03a795f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:25.857082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8231cbd10e4f4ea7eb62bf99dd0791', 'request_id': 'req-36dc5297-9463-48d0-a7f0-4db979e8c60f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:25.883537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1016/2046] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:25.889143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8231cbd10e4f4ea7eb62bf99dd0791', 'request_id': 'req-36dc5297-9463-48d0-a7f0-4db979e8c60f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:25.905763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8231cbd10e4f4ea7eb62bf99dd0791', 'request_id': 'req-36dc5297-9463-48d0-a7f0-4db979e8c60f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:26.078393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] The token cache is being invalidate because project cb8231cbd10e4f4ea7eb62bf99dd0791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:26.080188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:26.081975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:26.084984 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1031/2047] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:25 2022] DELETE /identity/v3/projects/cb8231cbd10e4f4ea7eb62bf99dd0791 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:26.093468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64f9d-9e02-45a2-9d95-e2ff4d83e95d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:26.094227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64f9d-9e02-45a2-9d95-e2ff4d83e95d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:26.094370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64f9d-9e02-45a2-9d95-e2ff4d83e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:26.142961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c6a64f9d-9e02-45a2-9d95-e2ff4d83e95d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:26.145805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c6a64f9d-9e02-45a2-9d95-e2ff4d83e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:26.205082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:26.208352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:26.368800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1017/2048] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:26.383206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42078724-aa08-45cc-b274-62392b327b87 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:26.383938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42078724-aa08-45cc-b274-62392b327b87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:26.384553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42078724-aa08-45cc-b274-62392b327b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:26.438740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-42078724-aa08-45cc-b274-62392b327b87 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:26.442489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42078724-aa08-45cc-b274-62392b327b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:26.479042 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1018/2049] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:32:26.486160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42078724-aa08-45cc-b274-62392b327b87 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:26.523238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42078724-aa08-45cc-b274-62392b327b87 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:26.534366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:26.535756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:26.537131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:26.537131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:26.538427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:26.538997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:26.545400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:26.566184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:26.577243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5297-9463-48d0-a7f0-4db979e8c60f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:26.583472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1019/2050] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:32:26.591665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:26.601787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:26.611410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:26.612082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:26.612832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] PATH_INFO: `/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:26.618748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf838ed69ed146f48c1d09fbc8c3b7f6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:26.621475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950439d0-8df5-4961-99ba-7fd096e17dcd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:26.628628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:26.636951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:26.639363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:26.640619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:26.641512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:26.643415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:26.650333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:26.717652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:26.834367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1020/2051] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:26.842448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:27.026971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf838ed69ed146f48c1d09fbc8c3b7f6', 'request_id': 'req-5fc9a691-45d5-4586-ab35-e64197c90535'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.061377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf838ed69ed146f48c1d09fbc8c3b7f6', 'request_id': 'req-5fc9a691-45d5-4586-ab35-e64197c90535'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.081301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf838ed69ed146f48c1d09fbc8c3b7f6', 'request_id': 'req-5fc9a691-45d5-4586-ab35-e64197c90535'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.215829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1f30-12be-413f-9115-684bed753625 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:27.224012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] The token cache is being invalidate because project bf838ed69ed146f48c1d09fbc8c3b7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:27.229424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.233319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.242170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1032/2052] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:26 2022] DELETE /identity/v3/projects/bf838ed69ed146f48c1d09fbc8c3b7f6 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:27.251172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:27.266200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:27.479647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:27.482496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:27.484150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:27.487291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:27.488406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a691-45d5-4586-ab35-e64197c90535 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:27.489139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:27.494185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316987-fa3b-4e9d-872c-3115d6323534 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:27.497898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:27.499525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:27.500331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:27.501044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] PATH_INFO: `/v3/projects/d0ded24c70b54fc5bb73d54fd1537abb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:27.510790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ded24c70b54fc5bb73d54fd1537abb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:27.515704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:27.701743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1021/2053] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:26 2022] POST /identity/v3/users => generated 292 bytes in 858 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:27.701743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:27.701743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:27.701743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:27.778612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:27.783681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:27.806931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ded24c70b54fc5bb73d54fd1537abb', 'request_id': 'req-a7c695a9-9345-453e-84e0-991ac2b1b4a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.826314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ded24c70b54fc5bb73d54fd1537abb', 'request_id': 'req-a7c695a9-9345-453e-84e0-991ac2b1b4a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.842958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ded24c70b54fc5bb73d54fd1537abb', 'request_id': 'req-a7c695a9-9345-453e-84e0-991ac2b1b4a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.962577 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1022/2054] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:27.964327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:27.967481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:27.984990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] The token cache is being invalidate because project d0ded24c70b54fc5bb73d54fd1537abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:27.985792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.989421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7c695a9-9345-453e-84e0-991ac2b1b4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:27.992561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1033/2055] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:27 2022] DELETE /identity/v3/projects/d0ded24c70b54fc5bb73d54fd1537abb => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:28.002131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.002616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.002973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.007367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab2dd-7256-4f8d-a269-58cf6dab131e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.021481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:28.023763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.027020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.028112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.029885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:28.034721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:28.042108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:28.044589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:28.067927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1034/2056] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:28.067927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:28.068504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:28.069624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1023/2057] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:28.073424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:28.076713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:28.100203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:28.106112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809a11-aa16-46e3-b292-71497dd5583a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.112992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e71e0-8e68-46c6-be38-686c61883660 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.122627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:28.126251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.127825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.128332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] PATH_INFO: `/v3/users/b8be11263dbb46b6988fcf068c452374` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.130933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8be11263dbb46b6988fcf068c452374)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:28.133111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:28.135848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.136233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:28.136699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.137338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.139258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:28.144433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:28.183315 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1024/2058] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:28.185181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:28.193620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:28.213860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cc22c-a1cf-4e0c-a02e-adad0b872e00 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.227669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:28.230324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.230924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.231802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.234105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:28.234664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:28.240206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:28.273005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1025/2059] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:28.275860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:28.297708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c944602-a921-4e82-8cb3-b49c98f9dcf5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.306866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:28.308195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.308675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.310875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] PATH_INFO: `/v3/projects/79686f2f544349ffa36e0944a137f9fe/users/2d8909b51ba844efbba5bf3304903772/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.371258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=79686f2f544349ffa36e0944a137f9fe, user_id=2d8909b51ba844efbba5bf3304903772, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:28.377056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:28.518560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8be11263dbb46b6988fcf068c452374'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:28.603205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1026/2060] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:28 2022] PUT /identity/v3/projects/79686f2f544349ffa36e0944a137f9fe/users/2d8909b51ba844efbba5bf3304903772/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:28.604105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:28.682217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8be11263dbb46b6988fcf068c452374'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:28.701340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8be11263dbb46b6988fcf068c452374'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:28.752140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8be11263dbb46b6988fcf068c452374'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:28.756115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac5150c6-1b3f-4cc5-bbdb-9d6dc3becf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8be11263dbb46b6988fcf068c452374'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:28.780141 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1035/2061] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:28 2022] DELETE /identity/v3/users/b8be11263dbb46b6988fcf068c452374 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:28.783364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:28.787000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:28.788564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:28.795918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d70e-1205-40d4-add9-0a156d99cdee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:28.930300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] MFA Rules not processed for user `2d8909b51ba844efbba5bf3304903772`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:28.937578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:29.086499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:29.088317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:29.089112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:29.089835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:29.091795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:29.096701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:29.186602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1036/2062] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:29.189408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:29.194177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:29.226532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2a7e-0c75-4e65-8cd5-703e7c7ddca1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:29.234294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:29.235788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:29.236773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:29.237670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] PATH_INFO: `/v3/projects/245cdda5c75542a492e519d3e7cb9f80` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:29.240322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245cdda5c75542a492e519d3e7cb9f80)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:29.245009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:29.329240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1027/2063] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:28 2022] POST /identity/v3/projects => generated 375 bytes in 723 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:29.332673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:29.338641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:29.529709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:29.539702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245cdda5c75542a492e519d3e7cb9f80', 'request_id': 'req-67e13c03-2b25-4e97-a35a-16c0de0c7522'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.568272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245cdda5c75542a492e519d3e7cb9f80', 'request_id': 'req-67e13c03-2b25-4e97-a35a-16c0de0c7522'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.570340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab202-6738-4a6d-8f3f-a9910c70a360 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:29.586618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245cdda5c75542a492e519d3e7cb9f80', 'request_id': 'req-67e13c03-2b25-4e97-a35a-16c0de0c7522'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.716188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:29.717182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:29.717715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:29.718244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] PATH_INFO: `/v3/projects/069c65953ec14f159b943500c268603e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:29.720761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=069c65953ec14f159b943500c268603e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:29.725799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:29.762909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] The token cache is being invalidate because project 245cdda5c75542a492e519d3e7cb9f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:29.762909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.771370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.781318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1037/2064] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:29 2022] DELETE /identity/v3/projects/245cdda5c75542a492e519d3e7cb9f80 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:29.784387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:29.793229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:29.841499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:29.930114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069c65953ec14f159b943500c268603e', 'request_id': 'req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:29.952660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13c03-2b25-4e97-a35a-16c0de0c7522 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:30.054488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069c65953ec14f159b943500c268603e', 'request_id': 'req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.073591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069c65953ec14f159b943500c268603e', 'request_id': 'req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.082406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:30.083995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:30.084398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:30.084900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:30.089192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.100907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] The token cache is being invalidate because project 069c65953ec14f159b943500c268603e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:30.101552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.102903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.106149 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1028/2065] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:29 2022] DELETE /identity/v3/projects/069c65953ec14f159b943500c268603e => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:30.107711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:30.110316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.249339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:30.253680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:30.268072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c489b-a6b2-47c4-bf32-ba8c74bcb5ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:30.278203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:30.280986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:30.281469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:30.282165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:30.284190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:30.288089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188da0-eb1a-4197-9fac-5c6e625636f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:30.292723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1038/2066] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:30.297125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:30.307280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.354557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ff8f-5fbf-4de5-97fe-0b13ee7bb625 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:30.369452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:30.371192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:30.372356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:30.372977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] PATH_INFO: `/v3/users/040dfb1b2d5f4093a1eea54059ecfe5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:30.375492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040dfb1b2d5f4093a1eea54059ecfe5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:30.380116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:30.568969 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1029/2067] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:30 2022] POST /identity/v3/users => generated 288 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:30.573069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:30.574561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:30.575372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:30.667626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:30.669978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.696813 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1030/2068] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:30.698901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:30.701804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.729652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed715b-9f66-48ce-9bdd-d17b7995afae None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:30.741205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:30.743186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:30.744475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:30.745007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] PATH_INFO: `/v3/projects/3c732865ac764dfc83bace2444770db8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:30.747941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c732865ac764dfc83bace2444770db8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:30.753248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:30.756784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:30.808406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040dfb1b2d5f4093a1eea54059ecfe5c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.904740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040dfb1b2d5f4093a1eea54059ecfe5c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.925591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040dfb1b2d5f4093a1eea54059ecfe5c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.961316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040dfb1b2d5f4093a1eea54059ecfe5c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.962439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040dfb1b2d5f4093a1eea54059ecfe5c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:30.982978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1039/2069] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:30 2022] DELETE /identity/v3/users/040dfb1b2d5f4093a1eea54059ecfe5c => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:30.984911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:30.989337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:30.998238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c732865ac764dfc83bace2444770db8', 'request_id': 'req-044ce1b9-812e-4474-8ca5-50478cfac766'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.196246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c732865ac764dfc83bace2444770db8', 'request_id': 'req-044ce1b9-812e-4474-8ca5-50478cfac766'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.233916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c732865ac764dfc83bace2444770db8', 'request_id': 'req-044ce1b9-812e-4474-8ca5-50478cfac766'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.235719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e8e2-23b7-47ae-9a83-62b208801601 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:31.246898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:31.248172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.254440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.256896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.258404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:31.266300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:31.286981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] The token cache is being invalidate because project 3c732865ac764dfc83bace2444770db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:31.287849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.290560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-044ce1b9-812e-4474-8ca5-50478cfac766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.301510 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1031/2070] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:30 2022] DELETE /identity/v3/projects/3c732865ac764dfc83bace2444770db8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:31.301510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29dbb-a610-4751-950d-52fddd9984a8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.301510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29dbb-a610-4751-950d-52fddd9984a8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.301510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29dbb-a610-4751-950d-52fddd9984a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.312109 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1040/2071] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:31.317639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:31.324298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:31.356557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-25d29dbb-a610-4751-950d-52fddd9984a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:31.361626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-25d29dbb-a610-4751-950d-52fddd9984a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:31.387287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1032/2072] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:31.387287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.387287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.387287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.391547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c3a5-4a3f-4092-b3e6-028c182364ff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:31.421578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:31.422726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.423243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.423755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] PATH_INFO: `/v3/users/2d8909b51ba844efbba5bf3304903772` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.426560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8909b51ba844efbba5bf3304903772)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:31.427121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:31.429354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:31.430591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:31.444253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:31.445140 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1033/2073] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:31.455620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:31.455620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:31.476657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5a09-0e39-40f9-9e8c-6fca7118112a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:31.488851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:31.490263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.490772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.491848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.493014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:31.497037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:31.529679 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1034/2074] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:31.529679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:31.560644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838feac3-302f-4105-98ad-4b6b551278de admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:31.570407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:31.571865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.573137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.574023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.575505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:31.576075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:31.579744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8fd90-d3a7-4c9f-9e6a-1bf6a61bfc7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:31.612731 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1035/2075] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:31.614844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.615318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.615644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.657394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:31.659047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:31.687734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1036/2076] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:31.687734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:31.704876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d3391-9ba6-45f8-8624-3f95c4f1da0c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:31.713412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:31.715226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:31.715226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:31.715605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8/users/d750e689140e47958e7b1011c0d07986/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:31.738563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92914d55af6f49398edc52da69b55cd8, user_id=d750e689140e47958e7b1011c0d07986, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:31.742812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:31.886196 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1037/2077] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:31 2022] PUT /identity/v3/projects/92914d55af6f49398edc52da69b55cd8/users/d750e689140e47958e7b1011c0d07986/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:31.887791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:31.889215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8909b51ba844efbba5bf3304903772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:31.997933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8909b51ba844efbba5bf3304903772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:32.027119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8909b51ba844efbba5bf3304903772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:32.055195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028875a-41f9-48ae-9fae-a46f69c466d0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:32.067665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:32.070103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.070752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.071676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.076564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:32.080129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8909b51ba844efbba5bf3304903772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:32.082697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0768084-b7f2-4bf0-b75c-1964f5024a76 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:32.087654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8909b51ba844efbba5bf3304903772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:32.109477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1041/2078] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:31 2022] DELETE /identity/v3/users/2d8909b51ba844efbba5bf3304903772 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:32.117658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:32.121901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.219248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1038/2079] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:31 2022] POST /identity/v3/projects => generated 393 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:32.219248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa4d7b-1881-4919-92a2-526c0e359af2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.219728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa4d7b-1881-4919-92a2-526c0e359af2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.220243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa4d7b-1881-4919-92a2-526c0e359af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.282042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-00fa4d7b-1881-4919-92a2-526c0e359af2 None None] MFA Rules not processed for user `d750e689140e47958e7b1011c0d07986`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:32.285061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-00fa4d7b-1881-4919-92a2-526c0e359af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.287735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266b70-4d8d-41f2-988e-e7e16027e2a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:32.383989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:32.462826 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1039/2080] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:32.472162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.472996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.473505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.483766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:32.485015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.485737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.486218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.487737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:32.488243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:32.492670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:32.517084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:32.525719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.541981 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1040/2081] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:32.546028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1042/2082] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:32.547986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:32.550705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.555760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:32.559714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.578889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b752e51-69e8-432b-88e7-9f7567f48679 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:32.587317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c9ce-64d0-41b6-9857-71feb2b9b542 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:32.590612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:32.596130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.596130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.596130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.596130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:32.600175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:32.617622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:32.619545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.620791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.622098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] PATH_INFO: `/v3/projects/88b112cc188f49cc987f5f71896081a8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.623838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b112cc188f49cc987f5f71896081a8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:32.628499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:32.757543 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1043/2083] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:32 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:32.759344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:32.767994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:32.797608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146278-20af-42e6-ae89-0dc00804340c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:32.860086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b112cc188f49cc987f5f71896081a8', 'request_id': 'req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:32.949877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:32.951476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:32.952203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:32.952873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:32.954355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:32.958451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:33.311763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b112cc188f49cc987f5f71896081a8', 'request_id': 'req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:33.326628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b112cc188f49cc987f5f71896081a8', 'request_id': 'req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:33.328113 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1044/2084] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:33.329320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:33.348925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] The token cache is being invalidate because project 88b112cc188f49cc987f5f71896081a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:33.349695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:33.351008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:33.354441 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1041/2085] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:32 2022] DELETE /identity/v3/projects/88b112cc188f49cc987f5f71896081a8 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:33.362148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:33.365974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:33.512331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803934b-044e-4b9f-a978-3c6626cf28ff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:33.524502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:33.527271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a7ed-afae-45dd-b06c-1c2c0b0a3b14 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:33.533289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:33.533289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:33.533289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:33.533289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:33.536583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:33.604564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:33.710254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:33.714622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:33.723951 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1045/2086] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:33 2022] POST /identity/v3/projects => generated 383 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:33.727832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:33.729232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:33.734714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:33.736678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:33.749068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:33.798258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:33.805013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:33.875467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1042/2087] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:33.884186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:33.896758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:33.951473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40794ad-44de-455b-a12a-9dfd25dabd9f service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.098517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e3a5-e58b-47a2-b61e-ef4f39d9ba80 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.120428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.121549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.122080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.127300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.128531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.131706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dda3d1-9af7-4d31-88ed-8681cc0eacb4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.179974 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1046/2088] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:34.186526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.187037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.187567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.250289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.251405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.251879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.252367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.253616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.276149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.295015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:34.298828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:34.325108 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1047/2089] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:34.325108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:34.325108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:34.353298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0831-6e3a-4007-850d-6165f1800c2d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.368232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.370673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.370673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.371526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.375673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.381229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.452461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1043/2090] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:33 2022] POST /identity/v3/users => generated 294 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:34.454452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:34.507909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-634d-495a-bc48-123a022bdd80 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.507909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.507909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.507909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.508513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.508513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.508513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f2e5b-8346-4520-abbc-947789f071c1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.533741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1044/2091] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:34.536714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.537306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.537882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.576881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:34.579515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:34.598932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1045/2092] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:34.598932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:34.602269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:34.627197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719c18-78bb-4ff4-9d4d-c0f0b7c60670 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.636007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.637192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.637718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.638218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] PATH_INFO: `/v3/users/f2337ea7fc534f7f967d58d4947eb4e4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.640595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2337ea7fc534f7f967d58d4947eb4e4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.644448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.660130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1048/2093] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:34 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:34.689656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:34.704877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c1118-66ec-4da5-a697-dad03a32b759 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.713831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.715644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.716211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.716768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.718376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.721725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:34.752345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1049/2094] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:34.752345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:34.768133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f9e2c-5262-4ef8-af4f-9addd2d398c5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:34.776650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:34.777843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:34.778326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:34.778792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] PATH_INFO: `/v3/projects/f4187c9ebefe40caa730d09c6a4f3e52/users/627b14d5fba7409d8bcbde3621b3cb7d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:34.809135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4187c9ebefe40caa730d09c6a4f3e52, user_id=627b14d5fba7409d8bcbde3621b3cb7d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:34.817403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:35.094619 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1050/2095] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:34 2022] PUT /identity/v3/projects/f4187c9ebefe40caa730d09c6a4f3e52/users/627b14d5fba7409d8bcbde3621b3cb7d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:35.105397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:35.380096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524ad5-fa5e-4917-9f8b-b58dd9773f80 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:35.387678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:35.417168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:35.419671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:35.419671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:35.419671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:35.424435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:35.428395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2337ea7fc534f7f967d58d4947eb4e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:35.429654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:35.432582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2337ea7fc534f7f967d58d4947eb4e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:35.438390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:35.471525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1051/2096] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:35.474512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:35.529699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8a70-0c5d-4444-a8d2-270cd6ee08c7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:35.546145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2337ea7fc534f7f967d58d4947eb4e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:35.559607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:35.559607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:35.559607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:35.562854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:35.567158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:35.574720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:35.627058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2337ea7fc534f7f967d58d4947eb4e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:35.664323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab08ec29-807c-462e-bd95-81569a955509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2337ea7fc534f7f967d58d4947eb4e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:35.669117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1052/2097] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:35.672159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:35.680371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:35.696251 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1046/2098] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:34 2022] DELETE /identity/v3/users/f2337ea7fc534f7f967d58d4947eb4e4 => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:35.705812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:35.710514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:35.711158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:35.767673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0fab-8a0a-4518-87c8-f304b24db8f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:35.827605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] MFA Rules not processed for user `627b14d5fba7409d8bcbde3621b3cb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:35.835470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:35.973542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:36.081591 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1047/2099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:36.084789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:36.087979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:36.092663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:36.093926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:36.094406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:36.094834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] PATH_INFO: `/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd/users/02f14af16e13444ea605ddf1ee15c207/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:36.126663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ca53-7ace-4e4c-8937-fd7a9032844f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:36.142018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4847fb61a84bb9bf3c65ef62ad31bd, user_id=02f14af16e13444ea605ddf1ee15c207, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:36.147765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:36.154352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:36.154352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:36.154352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:36.154352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:36.155041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:36.168795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:36.285306 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1053/2100] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:35 2022] PUT /identity/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd/users/02f14af16e13444ea605ddf1ee15c207/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:36.287063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:36.295502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:36.450622 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1048/2101] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:36 2022] POST /identity/v3/projects => generated 375 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:36.458181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:36.466913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:36.574494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb82b-4390-4537-ada3-7c6543ed83f0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:36.744885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c7fb-839c-40a5-a52a-ea543aa49c70 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:36.767686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:36.768923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:36.769412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:36.770695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] PATH_INFO: `/v3/projects/79686f2f544349ffa36e0944a137f9fe` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:36.777556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79686f2f544349ffa36e0944a137f9fe)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:36.787209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:36.819701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:36.821523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:36.823225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:36.824316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:36.826302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:36.845799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:36.912580 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1054/2102] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 627 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:36.914966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:36.924062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:36.974146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2889-eb7b-4e27-9598-32cfaa7be4e3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:36.980998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:36.985742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:36.987715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:36.988225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:36.988741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:36.990066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:36.994717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:37.131419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79686f2f544349ffa36e0944a137f9fe', 'request_id': 'req-06954e66-0cc3-48b0-bd6a-17ad9d89030e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.132368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:37.148571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1055/2103] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:36 2022] POST /identity/v3/projects => generated 395 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:37.148571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:37.289346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b1551-a9f1-4429-8016-80e2aff18609 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:37.298686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:37.299910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:37.300332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:37.300859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:37.302545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:37.304730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79686f2f544349ffa36e0944a137f9fe', 'request_id': 'req-06954e66-0cc3-48b0-bd6a-17ad9d89030e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.310298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:37.321603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79686f2f544349ffa36e0944a137f9fe', 'request_id': 'req-06954e66-0cc3-48b0-bd6a-17ad9d89030e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.332664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1056/2104] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:37.334331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:37.352990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d0ae-78d6-4dd2-8a01-f4c7309bd7f4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:37.354860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] The token cache is being invalidate because project 79686f2f544349ffa36e0944a137f9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:37.355403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.356658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.371672 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1049/2105] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:36 2022] DELETE /identity/v3/projects/79686f2f544349ffa36e0944a137f9fe => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:37.371672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:37.372111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:37.372111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:37.372111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:37.372583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:37.372722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:37.372722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:37.372722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:37.519445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954e66-0cc3-48b0-bd6a-17ad9d89030e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:37.528037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:37.529348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:37.529936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:37.530562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] PATH_INFO: `/v3/projects/ea226747e7e040709df16ed103fc9e21/users/0acc7c4c03484060b83b33fa2d374ee4/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:37.561969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea226747e7e040709df16ed103fc9e21, user_id=0acc7c4c03484060b83b33fa2d374ee4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:37.568313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:37.610319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1057/2106] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:37 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:37.612856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:37.618357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:37.647601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d36-8e02-4360-9aee-6668bf410cbe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:37.659282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:37.660559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:37.661212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:37.661561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] PATH_INFO: `/v3/projects/3f55ea5d23454a1783f1719ec6bac06e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:37.664099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f55ea5d23454a1783f1719ec6bac06e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:37.670864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:37.715036 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1050/2107] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:37 2022] PUT /identity/v3/projects/ea226747e7e040709df16ed103fc9e21/users/0acc7c4c03484060b83b33fa2d374ee4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:37.716769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:37.731326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:37.940348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f55ea5d23454a1783f1719ec6bac06e', 'request_id': 'req-a5a668fd-b987-4fdf-b94b-735907092d05'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.969638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f55ea5d23454a1783f1719ec6bac06e', 'request_id': 'req-a5a668fd-b987-4fdf-b94b-735907092d05'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:37.980531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efed08-dda3-459b-abc1-417dafc536d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.002375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f55ea5d23454a1783f1719ec6bac06e', 'request_id': 'req-a5a668fd-b987-4fdf-b94b-735907092d05'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:38.168197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.169969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.170492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.171033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.172430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.175172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:38.178795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] The token cache is being invalidate because project 3f55ea5d23454a1783f1719ec6bac06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:38.180331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:38.187097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:38.196136 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1058/2108] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:37 2022] DELETE /identity/v3/projects/3f55ea5d23454a1783f1719ec6bac06e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:38.198161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.203466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.215550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:38.263366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a668fd-b987-4fdf-b94b-735907092d05 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.272848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.274889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.275817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.276605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] PATH_INFO: `/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd/users/02f14af16e13444ea605ddf1ee15c207/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.280805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4847fb61a84bb9bf3c65ef62ad31bd, user_id=02f14af16e13444ea605ddf1ee15c207, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.285039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee6c4-95c9-4896-b3ee-8dc5ff1e1a6f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:38.300671 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1059/2109] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:38 2022] PUT /identity/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd/users/02f14af16e13444ea605ddf1ee15c207/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:38.303457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448938b-4913-4af8-a170-2322e2d0033e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.304314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448938b-4913-4af8-a170-2322e2d0033e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.304802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448938b-4913-4af8-a170-2322e2d0033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.344483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e448938b-4913-4af8-a170-2322e2d0033e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.346177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e448938b-4913-4af8-a170-2322e2d0033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.377877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:38.420537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1051/2110] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:37 2022] POST /identity/v3/users => generated 304 bytes in 705 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:38.422732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.426486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.450687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47699f-f0ba-47bd-a3bc-5560bdde07c0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.456432 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1060/2111] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.458508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.458970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.459462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.460187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.461412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.462064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.462699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.464139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.467946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b9cd-412d-4e7d-a97f-8f22b2d74f7b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:38.493268 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1052/2112] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:38.497090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3f58-51e8-4105-a279-6836edec4a16 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.497718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3f58-51e8-4105-a279-6836edec4a16 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.498945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3f58-51e8-4105-a279-6836edec4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.517632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] MFA Rules not processed for user `0acc7c4c03484060b83b33fa2d374ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.520052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.536925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8eea3f58-51e8-4105-a279-6836edec4a16 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.542028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8eea3f58-51e8-4105-a279-6836edec4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.561354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1053/2113] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.563998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.570402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.570402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.627673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] MFA Rules not processed for user `02f14af16e13444ea605ddf1ee15c207`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.630062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.651932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:38.702373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1061/2114] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.704818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.713237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.743363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fedd7f-a461-4d4f-a295-064b69aef6af None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.754271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.755882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.756385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.757208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.758561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.761858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47604c1a-09f3-4ecd-a838-064a36e4201d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:38.787855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1062/2115] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:38.791213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ddc3-fb90-490a-85d3-c366edc8f59d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.791735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ddc3-fb90-490a-85d3-c366edc8f59d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.792270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ddc3-fb90-490a-85d3-c366edc8f59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.835509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2879ddc3-fb90-490a-85d3-c366edc8f59d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.843544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2879ddc3-fb90-490a-85d3-c366edc8f59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.850615 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1054/2116] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.851911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.873802 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1063/2117] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.874080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:38.877897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.878938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fc969-4e18-48fc-b9a2-c7d8c0068af4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.880424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.881281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.888614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.889758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.890397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.891301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.892688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.896113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:38.924982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:38.926946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1055/2118] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:38.927512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.928618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.932703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:38.949241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1064/2119] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:38.949241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:38.963509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc023-5870-48a8-b182-8a10858745e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.971570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8c4c2-f723-4203-aa7c-aae9b1f3d0b2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:38.974807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.975901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.976489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.977117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.979092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:38.981488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:38.982700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:38.983413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:38.983883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] PATH_INFO: `/v3/projects/2bdb4e7959fa4d91b37149dd28824765/users/908daf3f20f34b2ea65be691a9dbe646/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:38.984234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.022656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdb4e7959fa4d91b37149dd28824765, user_id=908daf3f20f34b2ea65be691a9dbe646, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.029307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.145860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1065/2120] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:38 2022] PUT /identity/v3/projects/2bdb4e7959fa4d91b37149dd28824765/users/908daf3f20f34b2ea65be691a9dbe646/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:39.147845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.186150 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1056/2121] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:39.188378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.374558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb7e2e-f90e-43fe-985d-9dbc18032006 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.410679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310c6c-fe5e-4a9a-98d3-9d3deb7690e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.422347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.424031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.425220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.425220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.426213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:39.426772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.434300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.464527 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1057/2122] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:39.466326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.488656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac88676-b4a3-49cb-87c8-d6ad98135557 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.504476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.506874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.507547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.508209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] PATH_INFO: `/v3/projects/ddae2a3c419b42c393970ac7f545ba24/users/b042acd64e254b5b9e4b333b29070d5a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.548735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddae2a3c419b42c393970ac7f545ba24, user_id=b042acd64e254b5b9e4b333b29070d5a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.554705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.620971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:39.635906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.637287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.638012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.638510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.656297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:39.657928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.663062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.694404 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1066/2123] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:39.696931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.700279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1058/2124] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:39 2022] PUT /identity/v3/projects/ddae2a3c419b42c393970ac7f545ba24/users/b042acd64e254b5b9e4b333b29070d5a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:39.701802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.722607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbae6b-361f-4658-ad94-2f13bf13026d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.813608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:39.866509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd823b-2bcd-4898-bb04-f8f0c59a5709 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.875651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.880292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.880292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.880292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.880292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.883269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.885252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.886376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.886855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.887268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.888453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:39.889055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.893573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.914503 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1059/2125] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:39.914503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.930522 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1067/2126] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:39.933220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:39.944549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca8a4-c348-4d40-b969-44b26b0b273a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.956392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.958271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.958896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.959510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.960839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.961048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4a89-49ba-4203-b7cb-c1500c30e35e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:39.966350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:39.975957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:39.977076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:39.977568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:39.978534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:39.979831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:39.984318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc3e40-648f-4a1a-9a38-b8442195fc6e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.091963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1060/2127] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:39 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:40.093409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:40.189740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1068/2128] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:40.199066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.201145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.201795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.219053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9632b8-a1a7-4ede-a3a8-4d8dae7017f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:40.264558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] MFA Rules not processed for user `b042acd64e254b5b9e4b333b29070d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:40.266944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:40.346054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:40.347071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.347802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.348298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.349541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:40.353599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.410758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1069/2129] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:40.412229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:40.489509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:40.511377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c076a1-cc94-4ef4-9978-80e6c98ddedf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:40.519433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:40.520698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.521136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.521527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] PATH_INFO: `/v3/projects/2bdb4e7959fa4d91b37149dd28824765/users/908daf3f20f34b2ea65be691a9dbe646/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.525189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdb4e7959fa4d91b37149dd28824765, user_id=908daf3f20f34b2ea65be691a9dbe646, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:40.529609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.546781 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1061/2130] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:40 2022] POST /identity/v3/projects => generated 369 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:40.548585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:40.558784 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1070/2131] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:40 2022] PUT /identity/v3/projects/2bdb4e7959fa4d91b37149dd28824765/users/908daf3f20f34b2ea65be691a9dbe646/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:40.561136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:40.673935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:40.709264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42042a-f761-43be-9c1c-3332e314073b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:40.721964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:40.723687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.725346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.725346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.725799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d344e-3917-469d-84a4-575f61bd1d75 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:40.726907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:40.731663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.739376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:40.741120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.744334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.745286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.746655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:40.754286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.786875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1071/2132] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:40.786875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:40.818591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696778-c62a-4221-8528-fff88421ba8f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:40.833739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:40.835191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:40.835692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:40.836168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:40.839960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:40.845372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:40.931955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1062/2133] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:40 2022] POST /identity/v3/projects => generated 371 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:40.937039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.091756 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1072/2134] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:40 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:41.092417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ee44e-ba40-42f4-84f6-c42d7e66b1ca admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.093831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.105292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.106543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.106985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.107498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.108752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.113060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125f0dd-29fa-4e18-9b7e-1bb85fc93c92 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.220207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d318-e2de-41dc-994a-778911eabc81 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.252701 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1063/2135] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:40 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:41.252701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.252701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.252701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.299893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] MFA Rules not processed for user `908daf3f20f34b2ea65be691a9dbe646`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:41.302717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:41.307909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.308975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.309456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.310200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.311291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:41.311737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.314278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.337741 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1073/2136] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:41.339298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.354099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:41.360324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cbce9-5b15-4392-bd4d-49d453564352 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.436120 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1064/2137] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:41.442921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.484198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.485679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.487114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.488040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] PATH_INFO: `/v3/projects/ef47f7982a7d435aaf9057af1253f427/users/e1146c59032d433f92d58bbe3044e4f2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.523805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef47f7982a7d435aaf9057af1253f427, user_id=e1146c59032d433f92d58bbe3044e4f2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.529515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.540636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:41.579109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb36ab-7b20-4aaf-bfd2-d8da582df2ab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.588011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.589108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.589602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.590109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.591381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.595596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.712724 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1074/2138] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:41 2022] PUT /identity/v3/projects/ef47f7982a7d435aaf9057af1253f427/users/e1146c59032d433f92d58bbe3044e4f2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:41.713978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.716092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:41.751065 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1065/2139] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:41 2022] POST /identity/v3/users => generated 286 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:41.756773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.772855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959fc2-f015-41ec-a7e8-4595207c55d8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.851556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417d9b9-d39c-42bb-ba1e-62a70ef5d819 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.861258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.862662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.863268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.863773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] PATH_INFO: `/v3/users/c0986e6de5204c4d86e24184039366e0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.866238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0986e6de5204c4d86e24184039366e0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.870434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.879334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.881188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.881685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.883575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.883575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.886644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:41.907428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1066/2140] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:41.910235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:41.929980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eea02-9ad9-4bd9-b9a3-74ce6f0fc628 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:41.938566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:41.944743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:41.944743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:41.944743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:41.944743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:41.946098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.087814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1067/2141] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:41 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:42.088806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.091986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.155748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0986e6de5204c4d86e24184039366e0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:42.248807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82652456-47fe-4c4f-aca4-e7c763adeed8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.258801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0986e6de5204c4d86e24184039366e0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:42.259909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.261006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.261581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.262085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.276213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0986e6de5204c4d86e24184039366e0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:42.305622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0986e6de5204c4d86e24184039366e0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:42.306858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0986e6de5204c4d86e24184039366e0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:42.319866 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1075/2142] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:41 2022] DELETE /identity/v3/users/c0986e6de5204c4d86e24184039366e0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:42.321995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.324476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.344372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:42.350074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:42.376277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.380410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.401214 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1068/2143] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:42.402386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.424270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddff2b-9e82-4a4e-9659-4483e9a027ff service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.463493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ec09-9fa3-420d-86ec-176f1784544b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.472980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.474060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.475255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.476018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.480294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.520429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.521321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.521695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.521978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.522778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.524874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.545042 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1069/2144] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:42.546961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.550046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.574510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234d7d5-90b5-413a-afe0-d565e88783a4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.583795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.584880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.585369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.585855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.587192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.590372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.612824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.617796 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1070/2145] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:42.617796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.618754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.618927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.635781 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1076/2146] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:42.637009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.638984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.644436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4d6ba-f7e7-440a-8f6e-60b42ed3c7e1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.655017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.656063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.656540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.656999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.657757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a560-26e2-4adf-8fd7-f2495db8b8d1 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.658122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.662377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952e9d2-209b-4911-91d6-761fb3e83c58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.664267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.665260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.665696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.666161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.667296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.669440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468698-4af8-4372-a691-8fb74b184fdb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.692651 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1077/2147] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:42.692651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.692651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.693208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.707966 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1071/2148] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:42.710638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.711381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.712009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.714967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1072/2149] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:32:42.716529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.720088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.741792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:42.745277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf91ff-9ac7-4b59-96f3-9a65a18a22e1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.745520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:42.751929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.753102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.753683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.754085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] PATH_INFO: `/v3/projects/ef47f7982a7d435aaf9057af1253f427/users/e1146c59032d433f92d58bbe3044e4f2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.758331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef47f7982a7d435aaf9057af1253f427, user_id=e1146c59032d433f92d58bbe3044e4f2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.763290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.765116 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1078/2150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:42.770729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.795643 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1073/2151] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:42 2022] PUT /identity/v3/projects/ef47f7982a7d435aaf9057af1253f427/users/e1146c59032d433f92d58bbe3044e4f2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:42.795945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e295b2-d5d2-4a88-b2a1-c3f963d34677 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.796114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.917091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.918395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.918909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.919448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.920892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.925463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.929736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ecdb1-66a9-4e49-8c0c-d5a89401293f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.937934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.939684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.940229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.940721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] PATH_INFO: `/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f/users/73c41babb0f44012b3c4628351070fad/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:42.955269 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1079/2152] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:42.955269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:42.971289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8ac881eb442c1bdaa098f0eb41f4f, user_id=73c41babb0f44012b3c4628351070fad, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:42.974484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:42.974746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73828d1-4abc-4211-933f-77324f630744 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:42.984095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:42.985288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:42.985776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:42.986276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] PATH_INFO: `/v3/projects/73ae2334a3254012948437ddf5316073/users/93adfef1844741e383b6935778c2daca/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.010522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ae2334a3254012948437ddf5316073, user_id=93adfef1844741e383b6935778c2daca, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.014409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.018031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:43.058903 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1074/2153] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:42 2022] PUT /identity/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f/users/73c41babb0f44012b3c4628351070fad/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:43.059825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:43.062065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:43.134848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:43.135538 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1080/2154] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:42 2022] PUT /identity/v3/projects/73ae2334a3254012948437ddf5316073/users/93adfef1844741e383b6935778c2daca/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:43.139580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:43.140092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:43.222216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:43.224995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:43.256927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461420-822d-4d76-8308-1e0eb639254f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:43.262172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:43.263064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.263447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.263807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.333143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b05d-e468-4fdf-ac75-bbfee3ec701c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:43.379550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.381921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05a10c-bcf7-4063-ab33-5f7f389c52a3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.402048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1081/2155] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:43.404933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.405560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.406151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.446660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:43.447922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.448423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.448883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/2a266a03ad794c38ade55e55ee8255d7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.451241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a266a03ad794c38ade55e55ee8255d7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.455803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.459907 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1075/2156] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:43 2022] GET /identity/v3/projects/2a266a03ad794c38ade55e55ee8255d7 => generated 369 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:43.461292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:43.474007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] MFA Rules not processed for user `e1146c59032d433f92d58bbe3044e4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:43.476015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:43.484524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afedab-0029-4a3c-be3e-fe80d5393a71 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:43.492165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:43.493575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.493994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.494436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] PATH_INFO: `/v3/projects/d46af312da444babba7e71a9891196b0/users/189426fe824e454384a818a7d8fdb8ff/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.573263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46af312da444babba7e71a9891196b0, user_id=189426fe824e454384a818a7d8fdb8ff, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.578954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.695658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1082/2157] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:43.698576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:43.704923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:43.713907 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1076/2158] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:43 2022] PUT /identity/v3/projects/d46af312da444babba7e71a9891196b0/users/189426fe824e454384a818a7d8fdb8ff/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:43.722945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:43.735700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec2f39-9204-45ac-82fb-0f16b210f3bd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:43.802958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:43.852462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:43.874642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:43.876337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.876984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.877639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] PATH_INFO: `/v3/users/627b14d5fba7409d8bcbde3621b3cb7d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.880550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627b14d5fba7409d8bcbde3621b3cb7d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.885215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.887587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf493-ba69-4c0a-94b6-ae4c43231f7b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:43.897117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:43.898207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.898699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.899319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.901155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:43.904623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447425e-a151-4c34-a53f-cf7c6c2a726a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:43.929797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1077/2159] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:43.932657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856753c5-341d-4a93-8bdd-7e5886adf72d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:43.933162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856753c5-341d-4a93-8bdd-7e5886adf72d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:43.933665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856753c5-341d-4a93-8bdd-7e5886adf72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:43.992978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-856753c5-341d-4a93-8bdd-7e5886adf72d None None] MFA Rules not processed for user `93adfef1844741e383b6935778c2daca`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:43.996140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-856753c5-341d-4a93-8bdd-7e5886adf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.149063 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1078/2160] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:44.150426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627b14d5fba7409d8bcbde3621b3cb7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.152001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7005b1-63fd-4a80-9b23-5a455a03185f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:44.152678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7005b1-63fd-4a80-9b23-5a455a03185f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:44.153252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7005b1-63fd-4a80-9b23-5a455a03185f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:44.156071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1079/2161] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:32:44.158064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:44.160010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:44.160662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:44.199362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:44.201833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.216774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1080/2162] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:44.217980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:44.240449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b584-878c-44a3-bbd6-7d8e8108c4a8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:44.251903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627b14d5fba7409d8bcbde3621b3cb7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.254330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:44.255996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:44.256511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:44.259672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] PATH_INFO: `/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f/users/73c41babb0f44012b3c4628351070fad/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:44.261810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8ac881eb442c1bdaa098f0eb41f4f, user_id=73c41babb0f44012b3c4628351070fad, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:44.269728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:44.272445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627b14d5fba7409d8bcbde3621b3cb7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.299489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627b14d5fba7409d8bcbde3621b3cb7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.300934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627b14d5fba7409d8bcbde3621b3cb7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.301462 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1081/2163] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:44 2022] PUT /identity/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f/users/73c41babb0f44012b3c4628351070fad/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:44.303275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:44.308815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.322699 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1083/2164] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:43 2022] DELETE /identity/v3/users/627b14d5fba7409d8bcbde3621b3cb7d => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:44.325010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:44.329807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.474716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ab844-e380-4922-a54d-93c2cdd57772 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:44.483903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:44.485158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:44.485785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:44.486427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] PATH_INFO: `/v3/projects/13bcdec8c8d64e97b49281a0e16b0d79` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:44.488519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bcdec8c8d64e97b49281a0e16b0d79)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:44.494595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:44.503478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc1eb-34bd-49a7-9e10-394f0accd504 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:44.611207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:44.644132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:44.645265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:44.645758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:44.646247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:44.649740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.682936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bcdec8c8d64e97b49281a0e16b0d79', 'request_id': 'req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.698550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bcdec8c8d64e97b49281a0e16b0d79', 'request_id': 'req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.701602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:44.714370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bcdec8c8d64e97b49281a0e16b0d79', 'request_id': 'req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.806101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:44.809409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:44.822380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] The token cache is being invalidate because project 13bcdec8c8d64e97b49281a0e16b0d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:44.832076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.832076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:44.832076 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1084/2165] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:44 2022] DELETE /identity/v3/projects/13bcdec8c8d64e97b49281a0e16b0d79 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:44.832076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:44.832707 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1082/2166] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:44.832886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.833037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:44.834560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.856083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:44.861164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:44.987035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267b8fc-0e5b-4a3e-97f1-0f264ecf6f42 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.000804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7179bf-ee5a-44d3-b041-d39a4d8af1f9 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.005185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.006277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.006816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.007452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.008642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.013473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608085e0-0f18-42bb-a177-91bc81f666e0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.132100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.133684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.134211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.134698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/2a266a03ad794c38ade55e55ee8255d7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.137125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a266a03ad794c38ade55e55ee8255d7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.141331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.144736 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1083/2167] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:44 2022] GET /identity/v3/projects/2a266a03ad794c38ade55e55ee8255d7 => generated 369 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:45.146280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:45.149452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.182784 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1085/2168] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:44 2022] POST /identity/v3/projects => generated 383 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:45.185077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6f92-c2eb-450e-94ee-261b42992949 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.185579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6f92-c2eb-450e-94ee-261b42992949 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.186140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6f92-c2eb-450e-94ee-261b42992949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.230692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:45.254887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6cdc6f92-c2eb-450e-94ee-261b42992949 None None] MFA Rules not processed for user `73c41babb0f44012b3c4628351070fad`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:45.257320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6cdc6f92-c2eb-450e-94ee-261b42992949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.295228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7ca1-8ebe-4f31-95db-1fb4d4854975 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.428574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.438139 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1086/2169] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:45.438433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.438433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.438433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.438914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067357a-a319-444d-9438-96241f388077 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.438914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067357a-a319-444d-9438-96241f388077 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.438914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067357a-a319-444d-9438-96241f388077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.443107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.472592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c067357a-a319-444d-9438-96241f388077 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:45.475498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c067357a-a319-444d-9438-96241f388077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.604361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:45.620021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.623195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.652031 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1087/2170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:45.652216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1084/2171] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:45.653682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067357a-a319-444d-9438-96241f388077 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:45.653959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:45.659251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c067357a-a319-444d-9438-96241f388077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.678817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067357a-a319-444d-9438-96241f388077 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.680740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e1e24-080b-4400-932a-4fa58b0e4f61 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.690582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.691998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.692687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.693031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.693587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.694089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.694675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.695330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.697577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] PATH_INFO: `/v3/users/1706d4347fc44b2abcafb2695fd40111` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.699095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.704736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1706d4347fc44b2abcafb2695fd40111)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.709144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.880057 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1085/2172] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:45 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:45.886296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:45.886296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:45.909058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f7b2-46da-4bfb-bac9-bf54c0d1a090 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:45.917369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:45.920175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:45.920644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:45.921122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:45.940333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:45.943261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:45.965309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1086/2173] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:45.966447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:45.968956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:46.051516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1706d4347fc44b2abcafb2695fd40111'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:46.160118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:46.170605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1db4-caf9-499c-9038-0148e6df9648 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:46.176344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:46.177531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:46.178044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:46.178540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:46.197355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:46.200813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:46.212859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1706d4347fc44b2abcafb2695fd40111'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:46.229664 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1087/2174] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:46.231508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:46.261124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0f89-2540-4850-b8fd-a522f4045d24 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:46.262672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1706d4347fc44b2abcafb2695fd40111'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:46.276650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:46.279981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:46.279981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:46.279981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:46.279981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:46.282625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:46.306767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1706d4347fc44b2abcafb2695fd40111'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:46.309440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92056bc8-26e5-4340-89ea-52b5bbec8079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1706d4347fc44b2abcafb2695fd40111'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:46.315265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1088/2175] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:46.322731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:46.326579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:46.339903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1088/2176] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:45 2022] DELETE /identity/v3/users/1706d4347fc44b2abcafb2695fd40111 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:46.359191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0eb05-9ec9-4779-a472-fb374a4bb989 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:46.549646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:46.550857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:46.551398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:46.551896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] PATH_INFO: `/v3/projects/f379f29426f24e83a6479b432e50d6a0/users/78525e839e324084950804c42ea75644/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:46.584272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f379f29426f24e83a6479b432e50d6a0, user_id=78525e839e324084950804c42ea75644, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:46.590111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:46.664050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:46.664466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:46.665664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:46.668284 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1089/2177] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:32:46.681974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:46.683500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:46.730578 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1089/2178] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:46 2022] PUT /identity/v3/projects/f379f29426f24e83a6479b432e50d6a0/users/78525e839e324084950804c42ea75644/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:32:46.739038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:46.951130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:46.953955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abb98-e218-4ebe-97d7-787feb115e52 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:46.956240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:46.979695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:46.982167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:46.982954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:46.984857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:46.986845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:46.994411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:47.034829 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1090/2179] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:47.034829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:47.044630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:47.088370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9ea1-f6e7-4e07-b259-665ce1b5efa9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:47.099527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:47.100756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.101228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.101709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] PATH_INFO: `/v3/projects/f4187c9ebefe40caa730d09c6a4f3e52` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.104773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4187c9ebefe40caa730d09c6a4f3e52)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:47.108811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:47.119452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:47.132019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3983a-4d11-4be4-9d87-85606b9c674c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:47.258240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:47.259268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.259861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.260363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/2a266a03ad794c38ade55e55ee8255d7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.262819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=2a266a03ad794c38ade55e55ee8255d7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:47.267227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:47.271613 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1090/2180] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:46 2022] GET /identity/v3/projects/2a266a03ad794c38ade55e55ee8255d7 => generated 369 bytes in 592 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:47.272865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:47.326145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2d2a2-87f8-45ba-ae56-a3f487e0695e tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:47.376731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4187c9ebefe40caa730d09c6a4f3e52', 'request_id': 'req-7e20e91c-d3bd-4f65-92c8-12bc3385960d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:47.389328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:47.510931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:47.512048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.512721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.513385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] PATH_INFO: `/v3/projects/f379f29426f24e83a6479b432e50d6a0/users/78525e839e324084950804c42ea75644/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.520637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f379f29426f24e83a6479b432e50d6a0, user_id=78525e839e324084950804c42ea75644, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:47.526680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4187c9ebefe40caa730d09c6a4f3e52', 'request_id': 'req-7e20e91c-d3bd-4f65-92c8-12bc3385960d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:47.535802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:47.543605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4187c9ebefe40caa730d09c6a4f3e52', 'request_id': 'req-7e20e91c-d3bd-4f65-92c8-12bc3385960d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:47.565274 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1091/2181] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:47 2022] PUT /identity/v3/projects/f379f29426f24e83a6479b432e50d6a0/users/78525e839e324084950804c42ea75644/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:47.576033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:47.576033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:47.576413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] The token cache is being invalidate because project f4187c9ebefe40caa730d09c6a4f3e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:47.576715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:47.577904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e20e91c-d3bd-4f65-92c8-12bc3385960d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:47.581939 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1091/2182] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:47 2022] DELETE /identity/v3/projects/f4187c9ebefe40caa730d09c6a4f3e52 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:47.585209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.587861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.588503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:32:47.610114 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:32:47.612578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:32:47.615439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1092/2183] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:32:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:32:47.618214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:47.620435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:47.815025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb54f-17d4-4985-9e7d-a379104d3f85 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:47.830287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:47.832084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.833055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.834166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] PATH_INFO: `/v3/users/0acc7c4c03484060b83b33fa2d374ee4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.836784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0acc7c4c03484060b83b33fa2d374ee4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:47.842840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:47.843512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df81e-89ac-4290-8aba-0bb10d6e8988 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:47.852449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:47.853596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:47.854121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:47.854641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/2a266a03ad794c38ade55e55ee8255d7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:47.856978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a266a03ad794c38ade55e55ee8255d7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:47.860425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:48.236048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a266a03ad794c38ade55e55ee8255d7', 'request_id': 'req-daff9b59-4974-4191-8ae7-ab5583f2d538'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.240985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0acc7c4c03484060b83b33fa2d374ee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.390523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a266a03ad794c38ade55e55ee8255d7', 'request_id': 'req-daff9b59-4974-4191-8ae7-ab5583f2d538'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.407706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a266a03ad794c38ade55e55ee8255d7', 'request_id': 'req-daff9b59-4974-4191-8ae7-ab5583f2d538'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.432210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] The token cache is being invalidate because project 2a266a03ad794c38ade55e55ee8255d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:48.432753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.434232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-daff9b59-4974-4191-8ae7-ab5583f2d538 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.442266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1093/2184] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:47 2022] DELETE /identity/v3/projects/2a266a03ad794c38ade55e55ee8255d7 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:48.442266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:48.442266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:48.442266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:48.511239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] MFA Rules not processed for user `78525e839e324084950804c42ea75644`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:48.513827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:48.572052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0acc7c4c03484060b83b33fa2d374ee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.597464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0acc7c4c03484060b83b33fa2d374ee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.629963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0acc7c4c03484060b83b33fa2d374ee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.632473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0acc7c4c03484060b83b33fa2d374ee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:48.645033 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1092/2185] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:47 2022] DELETE /identity/v3/users/0acc7c4c03484060b83b33fa2d374ee4 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:48.646601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:48.651851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:48.701959 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1094/2186] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:48.701959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:48.705587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:48.882166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281f98-fe9d-4947-bedd-8cce6f523d7d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:48.889607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f605a1-9200-47af-b1ed-2a0b60c9329a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:48.892393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:48.893948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:48.894514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:48.907222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] PATH_INFO: `/v3/users/908daf3f20f34b2ea65be691a9dbe646` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:48.907222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=908daf3f20f34b2ea65be691a9dbe646)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:48.907729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:48.907729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:48.908092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:48.908257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:48.908257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] PATH_INFO: `/v3/projects/420d26b06e914da99f8e6227a04b57f0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:48.908257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=420d26b06e914da99f8e6227a04b57f0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:48.908646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:49.047606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:49.269114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908daf3f20f34b2ea65be691a9dbe646'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.272384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420d26b06e914da99f8e6227a04b57f0', 'request_id': 'req-75485525-f2e0-4ab0-bbc8-ea0584549e2e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.284319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:49.373572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908daf3f20f34b2ea65be691a9dbe646'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.391615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908daf3f20f34b2ea65be691a9dbe646'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.423949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908daf3f20f34b2ea65be691a9dbe646'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.425144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908daf3f20f34b2ea65be691a9dbe646'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.441742 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1093/2187] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:48 2022] DELETE /identity/v3/users/908daf3f20f34b2ea65be691a9dbe646 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:49.445717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:49.448061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:49.526839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420d26b06e914da99f8e6227a04b57f0', 'request_id': 'req-75485525-f2e0-4ab0-bbc8-ea0584549e2e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.542989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420d26b06e914da99f8e6227a04b57f0', 'request_id': 'req-75485525-f2e0-4ab0-bbc8-ea0584549e2e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.576822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] The token cache is being invalidate because project 420d26b06e914da99f8e6227a04b57f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:49.577547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.579214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75485525-f2e0-4ab0-bbc8-ea0584549e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:49.589949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1095/2188] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:48 2022] DELETE /identity/v3/projects/420d26b06e914da99f8e6227a04b57f0 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:49.593209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36c42-acb6-4f61-be4e-1fb6655d0d51 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:49.593732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36c42-acb6-4f61-be4e-1fb6655d0d51 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:49.594360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36c42-acb6-4f61-be4e-1fb6655d0d51 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:49.597215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1096/2189] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:32:49.599687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:49.600197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:49.600754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:49.650582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:49.651368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaa51-165e-40e1-b3bb-460651acfc45 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:49.653527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:49.661797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:49.665144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:49.665144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:49.665144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] PATH_INFO: `/v3/users/b042acd64e254b5b9e4b333b29070d5a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:49.669941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b042acd64e254b5b9e4b333b29070d5a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:49.672850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:49.674386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1097/2190] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:49.676029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:49.679063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:49.892330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb01ee-00cc-42d1-9f65-7516b6c25d92 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:49.908304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:49.909916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:49.910422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:49.912515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:49.917225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.044266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b042acd64e254b5b9e4b333b29070d5a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:50.118923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:50.121430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4133-0f4b-4f27-9de3-f489a4955bf5 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:50.158014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b042acd64e254b5b9e4b333b29070d5a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:50.173615 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1098/2191] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:50.179429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:50.179885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:50.180963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:50.184733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b042acd64e254b5b9e4b333b29070d5a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:50.252176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:50.252471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b042acd64e254b5b9e4b333b29070d5a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:50.254066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.256622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b042acd64e254b5b9e4b333b29070d5a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:50.286608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1094/2192] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:49 2022] DELETE /identity/v3/users/b042acd64e254b5b9e4b333b29070d5a => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:50.286608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:50.287078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1099/2193] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:50.287078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:50.299744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.300171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.456977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc339bf-988c-4ad6-95bd-3b7725cbe466 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:50.488466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:50.516406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:50.523580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.626847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:50.628422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:50.629961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:50.630356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:50.630724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:50.634089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.776268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d525e-68aa-497b-88bd-8b1b942311dc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:50.787212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:50.792285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:50.792678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:50.793127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:50.795830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=92914d55af6f49398edc52da69b55cd8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:50.804242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:50.809927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1095/2194] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:50 2022] GET /identity/v3/projects/92914d55af6f49398edc52da69b55cd8 => generated 375 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:50.812855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:50.818608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.839876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:50.847535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a161-4810-4de5-b6a2-dc7ba9cd1640 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:50.893167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1100/2195] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:50.896590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1061c-a070-418e-a3b5-90fe6d65261b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:50.900191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1061c-a070-418e-a3b5-90fe6d65261b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:50.901636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1061c-a070-418e-a3b5-90fe6d65261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:50.919265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc6722-94ed-49e3-97b1-18af97c8c963 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:50.933921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:50.938096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:50.939434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:50.940857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] PATH_INFO: `/v3/users/93adfef1844741e383b6935778c2daca` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:50.954470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93adfef1844741e383b6935778c2daca)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:50.959011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:50.973094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d8f1061c-a070-418e-a3b5-90fe6d65261b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:50.975758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d8f1061c-a070-418e-a3b5-90fe6d65261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:50.997211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1101/2196] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:51.000378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:51.001610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:51.002410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:51.052971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:51.055192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:51.075856 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1102/2197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:51.077488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:51.082707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:51.117285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8762f24-d8c3-43be-b242-823e488cadd8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:51.129297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:51.130575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:51.131061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:51.134985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] PATH_INFO: `/v3/projects/2bdb4e7959fa4d91b37149dd28824765` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:51.138544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bdb4e7959fa4d91b37149dd28824765)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:51.142878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:51.292395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93adfef1844741e383b6935778c2daca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.412739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93adfef1844741e383b6935778c2daca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.442009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93adfef1844741e383b6935778c2daca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.461724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bdb4e7959fa4d91b37149dd28824765', 'request_id': 'req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.478734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93adfef1844741e383b6935778c2daca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.480847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93adfef1844741e383b6935778c2daca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.496129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1096/2198] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:50 2022] DELETE /identity/v3/users/93adfef1844741e383b6935778c2daca => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:51.498142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:51.502428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:51.591015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bdb4e7959fa4d91b37149dd28824765', 'request_id': 'req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.620791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bdb4e7959fa4d91b37149dd28824765', 'request_id': 'req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.651517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] The token cache is being invalidate because project 2bdb4e7959fa4d91b37149dd28824765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:51.652920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.653280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:51.657375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1103/2199] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:51 2022] DELETE /identity/v3/projects/2bdb4e7959fa4d91b37149dd28824765 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:51.658715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:51.667100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:51.715554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8cf25-8f47-4266-85b1-8c4f787bcb5c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:51.728186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:51.730421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:51.730421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:51.730826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:51.733557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:51.739840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:51.739840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:51.778910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1097/2200] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:51.780687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:51.784412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:51.879683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ab2e-ed2b-4b9e-b7d4-b8ba4c8f6654 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:51.907202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:51.957942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:51.978639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed6df-49ea-494e-8302-af3c30214f10 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:51.986790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:51.988224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:51.988730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:51.989307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:51.990556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:51.991099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:51.995039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33cc52-af99-456c-abcf-a7a2b151d9f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:52.027659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:52.029783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.030494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.031311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.036247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.051589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1098/2201] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:52.057414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1205c6-a9f1-41e2-846c-dde0899d287a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.058188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1205c6-a9f1-41e2-846c-dde0899d287a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.058684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1205c6-a9f1-41e2-846c-dde0899d287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.085360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:52.089004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:52.108420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4d1205c6-a9f1-41e2-846c-dde0899d287a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:52.112899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4d1205c6-a9f1-41e2-846c-dde0899d287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.135472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1099/2202] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:52.135472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.135472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.140920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.144689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1104/2203] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:52.151924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:52.157932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.201010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a71d4-f2d5-4e30-bd17-7f952bfbcb36 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:52.208440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:52.209772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:52.210899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.211476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.212570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.213124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.214264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:52.219769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:52.242105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1100/2204] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:52.244321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:52.283957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40270-ec65-4dcf-b955-e95d503cb756 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:52.314093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:52.317020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.318044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.319294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.323553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:52.328248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb859bd-3f82-42c5-a56f-f1d38359759a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:52.434040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1105/2205] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:52 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:52.435928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:52.448946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.615427 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1101/2206] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:52 2022] POST /identity/v3/projects => generated 375 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:52.628956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.629439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.653396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:52.663281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:52.719981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:52.722332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:52.740782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37a95-d037-4c71-9b81-37679549bc4b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:52.930860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:52.932466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:52.934992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:52.934992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.024048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1102/2207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:53.025355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.190758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.197637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.216613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:53.268091 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1106/2208] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 833 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:53.270063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.315214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658757-acaa-4163-9368-63a493196a8b service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.315549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0342be6-a4f1-4651-a45e-033bc7c3eadf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.336126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.337310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.337686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.339167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.342613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.343121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.344684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.347677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.348335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.349631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:53.350452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.354559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.367222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.426978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1103/2209] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:53.451897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.458849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:53.534877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e1ba-75dd-4589-8bb6-ae0339365aac tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.535590 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1107/2210] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:53 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:53.537561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.563889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.566716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.569092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.571484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] PATH_INFO: `/v3/projects/ea226747e7e040709df16ed103fc9e21` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.578340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea226747e7e040709df16ed103fc9e21)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.585142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739df0c-32b3-49d0-a544-90a678e6fb47 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.590731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.618899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.620757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.621339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.621824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.623571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:53.624473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.627660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75589501-9857-4b4c-ac7e-8bbb89812958 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.668456 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1108/2211] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:53.672505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5eb8-7873-444b-baeb-50ba98d8f2fe None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.675660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5eb8-7873-444b-baeb-50ba98d8f2fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.676352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5eb8-7873-444b-baeb-50ba98d8f2fe None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.678378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1109/2212] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:32:53.680967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca5eb8-7873-444b-baeb-50ba98d8f2fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.706362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca5eb8-7873-444b-baeb-50ba98d8f2fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.718752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.730029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.731262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.751046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.756508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.768611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.811773 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1110/2213] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:53.813624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:53.835439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405f41-cad1-43fe-8890-4c292b729248 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:53.844286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:53.845318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:53.845815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:53.846296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:53.847540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:53.850504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:53.896849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea226747e7e040709df16ed103fc9e21', 'request_id': 'req-37a0b573-267a-42cb-9237-66a05888a604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:53.917043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea226747e7e040709df16ed103fc9e21', 'request_id': 'req-37a0b573-267a-42cb-9237-66a05888a604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:53.940351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea226747e7e040709df16ed103fc9e21', 'request_id': 'req-37a0b573-267a-42cb-9237-66a05888a604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:54.028847 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1111/2214] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:53 2022] POST /identity/v3/projects => generated 397 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:54.030864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:54.052203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:54.104397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] The token cache is being invalidate because project ea226747e7e040709df16ed103fc9e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:54.109661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:54.118154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:54.128637 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1104/2215] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:53 2022] DELETE /identity/v3/projects/ea226747e7e040709df16ed103fc9e21 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:54.132720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:54.160694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:54.187747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:54.236323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:54.312797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:54.398299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b573-267a-42cb-9237-66a05888a604 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:54.495816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899469-9f89-4f51-b7a2-6e01b68ec3f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:54.529394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:54.531517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:54.538437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:54.538437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/56a57934eecd4bf48d329faaa39cbd4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:54.542177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=56a57934eecd4bf48d329faaa39cbd4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:54.550094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:54.557717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1112/2216] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:54 2022] GET /identity/v3/projects/56a57934eecd4bf48d329faaa39cbd4d => generated 371 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:54.559558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:54.568460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:54.591766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:54.594442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:54.595218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:54.595642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] PATH_INFO: `/v3/projects/ddae2a3c419b42c393970ac7f545ba24` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:54.598479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddae2a3c419b42c393970ac7f545ba24)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:54.602462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:54.837131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddae2a3c419b42c393970ac7f545ba24', 'request_id': 'req-cb34e254-b5e1-482b-8507-d6bf35234906'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:54.843695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27e27-b344-4084-80e3-97723326192d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:54.862239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddae2a3c419b42c393970ac7f545ba24', 'request_id': 'req-cb34e254-b5e1-482b-8507-d6bf35234906'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:54.877472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddae2a3c419b42c393970ac7f545ba24', 'request_id': 'req-cb34e254-b5e1-482b-8507-d6bf35234906'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.015207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] The token cache is being invalidate because project ddae2a3c419b42c393970ac7f545ba24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:55.015752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.017280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.017555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.018605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.019099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.019619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.021573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:55.021897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1105/2217] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:54 2022] DELETE /identity/v3/projects/ddae2a3c419b42c393970ac7f545ba24 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:55.023452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:55.026556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:55.028811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:55.053158 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1113/2218] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:55.054757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:55.058677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:55.064566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e254-b5e1-482b-8507-d6bf35234906 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:55.079655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.082547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.082547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.082547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.083398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:55.086870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:55.090839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328129a1-e3ca-4ac3-8ab3-1807e620a871 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:55.097354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.098518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.099115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.099762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] PATH_INFO: `/v3/users/e1146c59032d433f92d58bbe3044e4f2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.101981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1146c59032d433f92d58bbe3044e4f2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:55.106528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:55.110873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:55.245982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1106/2219] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:55 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:55.247218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:55.249910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:55.268208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:55.278874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5628571-7ace-4575-ac43-7773113d55b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:55.298189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.298189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.298189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.298189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] PATH_INFO: `/v3/projects/73ae2334a3254012948437ddf5316073` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.299380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ae2334a3254012948437ddf5316073)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:55.303654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:55.394981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1146c59032d433f92d58bbe3044e4f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.397196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1146c59032d433f92d58bbe3044e4f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.542263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ae2334a3254012948437ddf5316073', 'request_id': 'req-8e3ee03d-c88d-4362-9838-e02eb605e931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.556477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ae2334a3254012948437ddf5316073', 'request_id': 'req-8e3ee03d-c88d-4362-9838-e02eb605e931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.563010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1146c59032d433f92d58bbe3044e4f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.570355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ae2334a3254012948437ddf5316073', 'request_id': 'req-8e3ee03d-c88d-4362-9838-e02eb605e931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.598200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1146c59032d433f92d58bbe3044e4f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.619713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3550a13-0973-4809-9b70-365f89bb3957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1146c59032d433f92d58bbe3044e4f2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.632848 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1114/2220] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:55 2022] DELETE /identity/v3/users/e1146c59032d433f92d58bbe3044e4f2 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:55.637445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.637922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.639771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.648953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1115/2221] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:32:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:32:55.656277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:55.659427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:55.731525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] The token cache is being invalidate because project 73ae2334a3254012948437ddf5316073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:55.732570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.749631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:55.755974 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1107/2222] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:55 2022] DELETE /identity/v3/projects/73ae2334a3254012948437ddf5316073 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:55.763555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:55.765308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:55.926218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1edb2-1e78-4f37-a408-b4d47b3d4e11 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:55.941681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.941681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.942097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.942596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] PATH_INFO: `/v3/users/73c41babb0f44012b3c4628351070fad` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:55.945116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c41babb0f44012b3c4628351070fad)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:55.949916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:55.955892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee03d-c88d-4362-9838-e02eb605e931 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:55.978171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:55.979457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:55.979893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:55.980371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] PATH_INFO: `/v3/projects/c87ac73d88394351a5c60110cd7e2207/users/db7ce3caf2f543b0a3a4f9db6c7c2783/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:56.026291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87ac73d88394351a5c60110cd7e2207, user_id=db7ce3caf2f543b0a3a4f9db6c7c2783, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:56.038989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:56.278356 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1108/2223] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:55 2022] PUT /identity/v3/projects/c87ac73d88394351a5c60110cd7e2207/users/db7ce3caf2f543b0a3a4f9db6c7c2783/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:56.293687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:56.302791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:56.443200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c41babb0f44012b3c4628351070fad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:56.446190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c41babb0f44012b3c4628351070fad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:56.492317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44e81-2455-4911-91f2-f32f5869e3ce admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:56.505384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:56.507247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:56.507759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:56.508295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:56.509551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:56.513030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:56.544887 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1109/2224] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:56.544887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:32:56.546873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:56.581614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:56.621179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c41babb0f44012b3c4628351070fad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:56.687846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c41babb0f44012b3c4628351070fad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:56.708391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c41babb0f44012b3c4628351070fad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:56.712687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:56.726605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1116/2225] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:55 2022] DELETE /identity/v3/users/73c41babb0f44012b3c4628351070fad => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:56.729330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:56.733428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:56.788540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:56.793140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:56.964044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c4455-d434-4c4d-b1c5-555478a0b42b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:56.989108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:56.990265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:56.997073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:56.997790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] PATH_INFO: `/v3/users/78525e839e324084950804c42ea75644` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:57.000487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78525e839e324084950804c42ea75644)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:57.004579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:57.021158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494a37-a0e8-4616-b5a9-f6d52b9a48cd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:57.155660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:57.156782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:57.157278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:57.157845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/56a57934eecd4bf48d329faaa39cbd4d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:57.160569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=56a57934eecd4bf48d329faaa39cbd4d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:57.165980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca01c0-e3ae-435b-9b7b-e2030ce26679 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:57.170220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1110/2226] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:32:56 2022] GET /identity/v3/projects/56a57934eecd4bf48d329faaa39cbd4d => generated 371 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:57.174013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:57.174930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:57.175686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:57.328674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78525e839e324084950804c42ea75644'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:57.332035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78525e839e324084950804c42ea75644'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:57.334302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] MFA Rules not processed for user `db7ce3caf2f543b0a3a4f9db6c7c2783`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:57.337575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:57.458990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78525e839e324084950804c42ea75644'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:57.505654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78525e839e324084950804c42ea75644'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:57.540145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78525e839e324084950804c42ea75644'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:57.557781 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1111/2227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:57.557781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:57.558229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1117/2228] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:32:56 2022] DELETE /identity/v3/users/78525e839e324084950804c42ea75644 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:57.558229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:57.558544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:57.571656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:57.618737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a3a7-6f22-4faf-82ec-2ebe76c3d0d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:57.809082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc41c-cbed-42c9-8471-f0cfdb2cda2a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:57.840391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:57.840391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:57.840391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:57.840391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] PATH_INFO: `/v3/projects/ef47f7982a7d435aaf9057af1253f427` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:57.841170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef47f7982a7d435aaf9057af1253f427)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:57.850534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:57.859993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:57.862735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:57.863564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:57.864159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:57.868340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:57.879640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:57.924336 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1112/2229] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:32:57.935402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:57.948901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:58.085062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:58.152691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:58.198266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105bb1-a383-43b0-99b8-fa38e957cec0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:58.201061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef47f7982a7d435aaf9057af1253f427', 'request_id': 'req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:58.365593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:58.368051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:58.368547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:58.369054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:58.371933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:32:58.372622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:58.377004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:58.390653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef47f7982a7d435aaf9057af1253f427', 'request_id': 'req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:58.412988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef47f7982a7d435aaf9057af1253f427', 'request_id': 'req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:58.427415 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1113/2230] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:32:58.430701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:58.439250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:58.479283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] The token cache is being invalidate because project ef47f7982a7d435aaf9057af1253f427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:58.480104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:58.484990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:58.492121 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1118/2231] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:57 2022] DELETE /identity/v3/projects/ef47f7982a7d435aaf9057af1253f427 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:58.503512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:58.503512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:58.599453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:58.741705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257ae6-8764-49ad-82c5-0c6899159494 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:58.750456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:58.751729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:58.752312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:58.753163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:58.754531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:58.760824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:58.798859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3875a68-9d2f-4e69-9ce1-1a4e903065f5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:58.822915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:58.826264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:58.826995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:58.827675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] PATH_INFO: `/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:58.831665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac8ac881eb442c1bdaa098f0eb41f4f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:58.838565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:58.915243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1114/2232] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:32:58 2022] POST /identity/v3/projects => generated 375 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:58.915243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:58.917420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:59.122430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac8ac881eb442c1bdaa098f0eb41f4f', 'request_id': 'req-ba26aee8-8b67-43e4-84bd-a025a6976516'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:59.173529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961e64-5e99-46f1-8bbc-f111c9dd2782 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:59.230322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac8ac881eb442c1bdaa098f0eb41f4f', 'request_id': 'req-ba26aee8-8b67-43e4-84bd-a025a6976516'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:59.254068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac8ac881eb442c1bdaa098f0eb41f4f', 'request_id': 'req-ba26aee8-8b67-43e4-84bd-a025a6976516'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:59.294450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] The token cache is being invalidate because project 4ac8ac881eb442c1bdaa098f0eb41f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:32:59.295102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:59.297605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:32:59.305789 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1119/2233] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:32:58 2022] DELETE /identity/v3/projects/4ac8ac881eb442c1bdaa098f0eb41f4f => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:59.309880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:59.324006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:59.406733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:59.415354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:59.416144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:59.416580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] PATH_INFO: `/v3/projects/cf616fd82dd34c7d92f4d8e9e80f89f4/users/6a310d2bd16e4d52841042364253a86b/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:59.489633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf616fd82dd34c7d92f4d8e9e80f89f4, user_id=6a310d2bd16e4d52841042364253a86b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:59.500859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f3d2-57f4-4a13-8ade-7e6acf3f1f14 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:59.510509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aee8-8b67-43e4-84bd-a025a6976516 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:59.525258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:32:59.525574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:59.525950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:59.527336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:59.528922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:32:59.534197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:32:59.546979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:59.633767 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1115/2234] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:32:58 2022] PUT /identity/v3/projects/cf616fd82dd34c7d92f4d8e9e80f89f4/users/6a310d2bd16e4d52841042364253a86b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:32:59.636618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce80db-f198-4f63-b584-5548781fb141 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:59.637280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce80db-f198-4f63-b584-5548781fb141 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:59.637862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce80db-f198-4f63-b584-5548781fb141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:59.675208 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1120/2235] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:59 2022] POST /identity/v3/users => generated 381 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:32:59.677527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:32:59.682866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-58ce80db-f198-4f63-b584-5548781fb141 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:59.689804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-58ce80db-f198-4f63-b584-5548781fb141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:59.693211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:32:59.778957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6cc5-51cd-4b32-854a-585da7d75174 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:32:59.805103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:59.922897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1116/2236] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:32:59.926082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da937-cb11-450d-94ce-03e97985e688 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:32:59.934388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da937-cb11-450d-94ce-03e97985e688 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:32:59.934388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803da937-cb11-450d-94ce-03e97985e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:32:59.967050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-803da937-cb11-450d-94ce-03e97985e688 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:32:59.969331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-803da937-cb11-450d-94ce-03e97985e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:00.026770 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1117/2237] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:00.026770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803da937-cb11-450d-94ce-03e97985e688 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:00.028436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-803da937-cb11-450d-94ce-03e97985e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:00.077754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803da937-cb11-450d-94ce-03e97985e688 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:00.082278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:00.084608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:00.085120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:00.090240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:00.091863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:00.092262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:00.094197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:00.095007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:00.095771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] PATH_INFO: `/v3/projects/f379f29426f24e83a6479b432e50d6a0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:00.097563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f46ad-a78a-4f89-bec3-5e148418df8c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:00.099650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f379f29426f24e83a6479b432e50d6a0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:00.105254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:00.313109 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1121/2238] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:32:59 2022] POST /identity/v3/users => generated 294 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:00.316585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3df9f-818b-47a2-b578-cce555cac3d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:00.320097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3df9f-818b-47a2-b578-cce555cac3d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:00.321667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3df9f-818b-47a2-b578-cce555cac3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:00.433707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3cc3df9f-818b-47a2-b578-cce555cac3d4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:00.439187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3cc3df9f-818b-47a2-b578-cce555cac3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:00.511670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f379f29426f24e83a6479b432e50d6a0', 'request_id': 'req-000fa9c3-1ede-4320-979d-1eb45d72394a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:00.527112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f379f29426f24e83a6479b432e50d6a0', 'request_id': 'req-000fa9c3-1ede-4320-979d-1eb45d72394a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:00.542809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f379f29426f24e83a6479b432e50d6a0', 'request_id': 'req-000fa9c3-1ede-4320-979d-1eb45d72394a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:00.700950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] The token cache is being invalidate because project f379f29426f24e83a6479b432e50d6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:00.701701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:00.705870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:00.718281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1118/2239] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:00 2022] DELETE /identity/v3/projects/f379f29426f24e83a6479b432e50d6a0 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:00.719021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:00.725826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:00.774540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1122/2240] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:00.777359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309313e4-3d5f-468c-88e7-50e5b3f6ca9f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:00.778229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309313e4-3d5f-468c-88e7-50e5b3f6ca9f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:00.779081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309313e4-3d5f-468c-88e7-50e5b3f6ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:00.851225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-309313e4-3d5f-468c-88e7-50e5b3f6ca9f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:00.855641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-309313e4-3d5f-468c-88e7-50e5b3f6ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:00.894324 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1123/2241] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:00.904888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:00.904888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:00.904888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:00.968830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:00.973312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.020155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa9c3-1ede-4320-979d-1eb45d72394a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.023074 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1124/2242] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:01.037081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.050246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.052219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.056187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.057744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.059854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.064877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:01.065648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.070343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86702eb4-f4ef-4190-802e-c53ec01ec040 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.079063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba101a-2fb7-4de8-b506-35e2583573ed None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.111923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.113273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.113779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.114250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.115477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.118658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.119955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1119/2243] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:01.124799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608653-6700-4883-b107-0c69d1ec7b97 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.127966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608653-6700-4883-b107-0c69d1ec7b97 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.130116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608653-6700-4883-b107-0c69d1ec7b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.179806 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1125/2244] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:01.185884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.195988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.257171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c8608653-6700-4883-b107-0c69d1ec7b97 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:01.266492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c8608653-6700-4883-b107-0c69d1ec7b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.303477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1120/2245] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:01.306566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.307076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.307650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.365902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:01.411542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] MFA Rules not processed for user `189426fe824e454384a818a7d8fdb8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:01.414037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.453324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b733fe-5631-448a-a24e-0cf0b632c23a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.461572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.463668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.464635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.466066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.471217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:01.497097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.500321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.526022 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1126/2246] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:01.527810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.567429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543ad5-f54e-4033-8a3b-3c0c42aed863 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.588008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.589100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.589590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.590075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.592250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:01.598093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.598093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.630244 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1127/2247] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:01.635281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.655732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a90c6-582a-4a09-9014-1a194f30ddbc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.656435 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1121/2248] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:01.667276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.691329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.695584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.696596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.697379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.700326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:01.700891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.708078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac9e97-2802-486b-81c4-c8bfd0ab68be admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.720038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa003863-49fb-4c3b-a475-73fde10bbd32 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.732062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.733181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.733620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.734064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] PATH_INFO: `/v3/projects/78cc8c254abc490e8197521c24609c7a/users/410ed971a3c74739943849c6bfc0ddbd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.757582 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1128/2249] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:01.760946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942e0a-a35a-47c6-bb0d-9d9eff8d7639 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.760946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942e0a-a35a-47c6-bb0d-9d9eff8d7639 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.762442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942e0a-a35a-47c6-bb0d-9d9eff8d7639 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.764960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1129/2250] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:01.767480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.767976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.768522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.796086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cc8c254abc490e8197521c24609c7a, user_id=410ed971a3c74739943849c6bfc0ddbd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.812184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.812367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:01.812367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:01.837318 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1130/2251] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:01.838777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.862920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae46e4-56dc-4187-8d75-5d5403e83e8b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:01.873537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:01.874793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:01.875442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:01.876606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:01.877482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:01.882755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:01.941248 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1122/2252] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:01 2022] PUT /identity/v3/projects/78cc8c254abc490e8197521c24609c7a/users/410ed971a3c74739943849c6bfc0ddbd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:01.943475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:01.947128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:02.099397 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1131/2253] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:01 2022] POST /identity/v3/projects => generated 391 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:02.101198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:02.400394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d2d33-48f8-4b72-8dc9-e2d244710824 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:02.425881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:02.427072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:02.427764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:02.428418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:02.430473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:02.436999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:02.534521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a35fa-e7d7-4a26-95f1-776e5b08ea83 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:02.601097 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1132/2254] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:02 2022] POST /identity/v3/projects => generated 407 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:02.601097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:02.607819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:02.748413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:02.749639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:02.750272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:02.750927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:02.822237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:02.826897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:02.831823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:02.897199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:02.902196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:02.937723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1123/2255] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 996 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:02.940041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:02.966315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551497-130f-46bb-ab0b-4db464faeae6 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.110069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb492e69-bcdd-4726-8265-1854753314df admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.135182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.137833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.139660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.141524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.144773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:03.146797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.152757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.154013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.155863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.157152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.157650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/56a57934eecd4bf48d329faaa39cbd4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.163034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=56a57934eecd4bf48d329faaa39cbd4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.179328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.202895 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1133/2256] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:02 2022] GET /identity/v3/projects/56a57934eecd4bf48d329faaa39cbd4d => generated 371 bytes in 595 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:03.208166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.222803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1124/2257] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:03.222803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.278413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511650-453f-4ac7-b724-cf7374620add admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.288416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce47f9f-e39c-46be-8178-bab8c1eb4b80 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.302962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.304096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.304702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.305086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.306380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.310316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.327915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.329278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.333014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.337419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.340257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.354644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.422474 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1134/2258] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:03.427175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.479022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0b6c3-4de5-4383-bb0b-c4566fc0f9bf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.504709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.506776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.510070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1125/2259] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:03 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:03.510755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.511760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.512019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.515858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.529318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.555775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e84eb-42e8-4901-8d5d-09528f3c0948 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.582188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.583378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.583879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.584380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.587666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.606514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.730302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1135/2260] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:03 2022] POST /identity/v3/users => generated 304 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:03.733143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.768403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730723-abb2-40c4-a50e-d19a3fab73fb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:03.781467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:03.782900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:03.783636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:03.785652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] PATH_INFO: `/v3/projects/78cc8c254abc490e8197521c24609c7a/users/410ed971a3c74739943849c6bfc0ddbd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:03.789850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cc8c254abc490e8197521c24609c7a, user_id=410ed971a3c74739943849c6bfc0ddbd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:03.797680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:03.844338 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1136/2261] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:03 2022] PUT /identity/v3/projects/78cc8c254abc490e8197521c24609c7a/users/410ed971a3c74739943849c6bfc0ddbd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:03.854071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:03.865290 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1126/2262] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:03 2022] POST /identity/v3/projects => generated 387 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:03.877125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:04.115755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742927-449e-4110-a94e-02904679e3e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.171646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fc76-2d6d-478d-b923-186476a21006 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.185696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.187044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.187595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.188145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.189509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.194409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b368649-2934-43f9-a2f9-05fcb142223c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:04.227785 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1127/2263] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:04.229101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.229657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.230104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.334007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] MFA Rules not processed for user `410ed971a3c74739943849c6bfc0ddbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:04.339025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:04.385758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:04.418068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.420975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.422996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.424864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.426584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.430279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:04.468085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1137/2264] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 623 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:04.472451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:04.504789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:04.530867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690ecb9-4c18-4ff7-98d6-513aaf963ffc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.553240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.554479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.557394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.558250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.560548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.567067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbd5ac-95ce-4c59-819b-3b145d8ac091 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:04.657194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1128/2265] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:04.659409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:04.662095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:04.707022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058136-37da-4173-a93c-95f2868307d3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.724648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.725860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.726390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.726899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] PATH_INFO: `/v3/users/4b8c35b4791b41fea4edf6b6f1ef6de1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.729747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8c35b4791b41fea4edf6b6f1ef6de1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.733306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:04.771288 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1138/2266] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:04 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:04.771288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efebd8-4127-4dcc-a831-f421eb7c92f2 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.771288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efebd8-4127-4dcc-a831-f421eb7c92f2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.771288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efebd8-4127-4dcc-a831-f421eb7c92f2 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.804246 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1139/2267] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:04 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:04.804246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efebd8-4127-4dcc-a831-f421eb7c92f2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:04.829561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efebd8-4127-4dcc-a831-f421eb7c92f2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.847791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.849694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.850824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.851736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.852930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.858093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:04.895056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1140/2268] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:04.895056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:04.936728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47afe-56d8-47a5-a3a2-290e4be2ff6a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:04.950566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:04.952652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:04.953341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:04.953957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:04.955516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:04.964799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:05.001569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1141/2269] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:05.005146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:05.030560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df449b5-bd26-4fc3-b953-c615aeb05ca7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:05.041849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:05.044593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:05.046040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:05.046495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:05.048255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:05.051828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:05.082574 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1142/2270] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:05.089253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:05.123060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8c35b4791b41fea4edf6b6f1ef6de1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:05.230145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8c35b4791b41fea4edf6b6f1ef6de1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:05.256895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8c35b4791b41fea4edf6b6f1ef6de1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:05.270477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:05.336754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8c35b4791b41fea4edf6b6f1ef6de1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:05.338357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8c35b4791b41fea4edf6b6f1ef6de1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:05.368526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1129/2271] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:04 2022] DELETE /identity/v3/users/4b8c35b4791b41fea4edf6b6f1ef6de1 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:05.376421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:05.384367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:05.437778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecdeea-b9c2-47a5-8137-addf27c32723 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:05.572008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:05.590749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:05.591713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:05.592368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:05.593302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/56a57934eecd4bf48d329faaa39cbd4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:05.596238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=56a57934eecd4bf48d329faaa39cbd4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:05.601065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:05.606532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1143/2272] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:05 2022] GET /identity/v3/projects/56a57934eecd4bf48d329faaa39cbd4d => generated 371 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:05.608246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:05.611763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:05.645022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc1f56-10a8-4095-b04c-feabf1e90dd8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:05.646374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0793-edae-439b-b9e5-04b5bd65b73d tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:05.658474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:05.659002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:05.660006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:05.660427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:05.660706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:05.661256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:05.661429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] PATH_INFO: `/v3/projects/0d505d480d1446279e7e271b9122e5f7/users/8849949fc62f47b0ac77833145a5b816/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:05.662971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] PATH_INFO: `/v3/projects/9a03ec3d503847aaa0570841395555a9/users/b5370506142c4042b4a5f2869b355b2d/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:05.697811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d505d480d1446279e7e271b9122e5f7, user_id=8849949fc62f47b0ac77833145a5b816, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:05.704925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:05.718485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a03ec3d503847aaa0570841395555a9, user_id=b5370506142c4042b4a5f2869b355b2d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:05.724120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248ee8b-3082-45c9-91f7-75e581cda4d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:05.903063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:05.913849 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1130/2273] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:05 2022] PUT /identity/v3/projects/0d505d480d1446279e7e271b9122e5f7/users/8849949fc62f47b0ac77833145a5b816/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:05.920070 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1144/2274] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:05 2022] PUT /identity/v3/projects/9a03ec3d503847aaa0570841395555a9/users/b5370506142c4042b4a5f2869b355b2d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:05.921634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:05.923967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:05.925396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:05.928587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:05.928943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:05.977193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:05.979411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:06.177277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1145/2275] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:06.178898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:06.181608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:06.218580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1960a-0e41-4e02-bad9-2f0e39043b3e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:06.228343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:06.230520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:06.230906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:06.231684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:06.233535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:06.238178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:06.294649 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1131/2276] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:06.296866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:06.300333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:06.484963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f124a-9cf9-4786-a638-9c5c1eca452c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:06.514230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:06.515709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:06.521970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:06.523604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/users/8fe5737629e64e84a2c46f636cde0997` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:06.605243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8fe5737629e64e84a2c46f636cde0997)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:06.607964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:06.613464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fc89f-ed30-40fb-86a3-fea890926e61 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:06.638589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:06.640128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:06.642048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:06.642718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:06.653464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:06.886895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe5737629e64e84a2c46f636cde0997'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:06.888779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe5737629e64e84a2c46f636cde0997'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:06.925387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:06.928954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b70cd-84ec-4d06-b8b7-85c627a33b53 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:06.954265 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1132/2277] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:06.956907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:06.957417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:06.957920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:07.059740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe5737629e64e84a2c46f636cde0997'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:07.127411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:07.150090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] MFA Rules not processed for user `8849949fc62f47b0ac77833145a5b816`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:07.152567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:07.182718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe5737629e64e84a2c46f636cde0997'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:07.247244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-181aabdd-ad37-4039-ae80-d6e38a1eca7f tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe5737629e64e84a2c46f636cde0997'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:07.283257 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1146/2278] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:06 2022] DELETE /identity/v3/users/8fe5737629e64e84a2c46f636cde0997 => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:07.290301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:07.294404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:07.295117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:07.306161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:07.428740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] MFA Rules not processed for user `b5370506142c4042b4a5f2869b355b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:07.432014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:07.567022 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1133/2279] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 612 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:07.569942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:07.589397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:07.819720 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1147/2280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:07.819720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:07.820770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:07.918993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd197ed-c6ad-4809-9742-f4ec9e98ff36 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:08.058226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769121b-f11c-408a-93b2-d175ecd36ec5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:08.081719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:08.083274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:08.084091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:08.084784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] PATH_INFO: `/v3/projects/05dbcecc14b940fba8ddb3c509444055/users/b9b0a2408b1c49c8864f7d9b16cf4ee2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:08.119230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:08.120389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:08.120869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:08.121357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:08.124858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:08.143391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dbcecc14b940fba8ddb3c509444055, user_id=b9b0a2408b1c49c8864f7d9b16cf4ee2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:08.147309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:08.150603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:08.158955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:08.178289 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1134/2281] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:08.181045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:08.196518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:08.317863 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1148/2282] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:07 2022] PUT /identity/v3/projects/05dbcecc14b940fba8ddb3c509444055/users/b9b0a2408b1c49c8864f7d9b16cf4ee2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:08.332565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:08.352313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:08.584609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40a62-08e3-4aca-b14f-7472dd16d98b service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:08.620720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:08.643046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798d96-9ee9-46d4-986c-f2f923273c97 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:08.659290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:08.660928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:08.661856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:08.663043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:08.664854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/56a57934eecd4bf48d329faaa39cbd4d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:08.672670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56a57934eecd4bf48d329faaa39cbd4d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:08.682697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:08.860516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:08.861606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:08.862199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:08.872742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:08.878614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:08.990070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a57934eecd4bf48d329faaa39cbd4d', 'request_id': 'req-75595d6a-ccf8-4ead-8da6-c68117c6476b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:09.093139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:09.098264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:09.136422 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1135/2283] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 956 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:09.140264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:09.143648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a57934eecd4bf48d329faaa39cbd4d', 'request_id': 'req-75595d6a-ccf8-4ead-8da6-c68117c6476b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:09.147074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:09.169717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a57934eecd4bf48d329faaa39cbd4d', 'request_id': 'req-75595d6a-ccf8-4ead-8da6-c68117c6476b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:09.221729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] The token cache is being invalidate because project 56a57934eecd4bf48d329faaa39cbd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:09.222081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:09.224809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:09.244016 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1149/2284] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:08 2022] DELETE /identity/v3/projects/56a57934eecd4bf48d329faaa39cbd4d => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:09.244654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:09.250727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:09.550233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e671f4-ae91-49e6-b30d-cef80fed38c4 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:09.645856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6a-ccf8-4ead-8da6-c68117c6476b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:09.700254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:09.702230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:09.702950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:09.703416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:09.712753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:09.716228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ac301-6029-4966-9eb1-5d23d23b8912 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:09.799917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:09.801463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:09.802944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:09.803668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:09.806974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:09.811488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba30b-4b40-4438-a07a-cd855e8f1d01 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:09.824906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:09.972371 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1150/2285] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:09 2022] POST /identity/v3/projects => generated 391 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:09.977868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:09.978492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:09.978980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:10.040135 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1136/2286] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:09 2022] POST /identity/v3/projects => generated 409 bytes in 903 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:10.042749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:10.043307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:10.048617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:10.055193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1137/2287] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:10.056759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:10.066422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:10.128825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] MFA Rules not processed for user `b9b0a2408b1c49c8864f7d9b16cf4ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:10.133121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:10.445992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:10.462789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bab74-5610-4810-acb6-15a9b7e073e2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:10.463314 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1151/2288] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:10.465283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:10.482326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:10.514625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:10.514625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:10.514625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] PATH_INFO: `/v3/projects/e756f3ec49694205b5dccf3408cee098` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:10.515076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00c2eb-64d2-4ee5-abd8-071bb0a3766c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:10.515302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e756f3ec49694205b5dccf3408cee098)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:10.515302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:10.517645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:10.519053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:10.520680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:10.521325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:10.522601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:10.526747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:10.838176 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1152/2289] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:10 2022] POST /identity/v3/users => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:10.838176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:10.842274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:10.871423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30055-deae-4a42-8584-d24f6733d1e9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:10.883008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:10.884668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:10.885116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:10.885625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:10.886978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:10.892424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:10.951347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e756f3ec49694205b5dccf3408cee098', 'request_id': 'req-54ee8678-4a53-4076-9770-7026256d8d5e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:10.972633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e756f3ec49694205b5dccf3408cee098', 'request_id': 'req-54ee8678-4a53-4076-9770-7026256d8d5e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:10.990109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e756f3ec49694205b5dccf3408cee098', 'request_id': 'req-54ee8678-4a53-4076-9770-7026256d8d5e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:11.093400 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1153/2290] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:10 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:11.093400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:11.093400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.136478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] The token cache is being invalidate because project e756f3ec49694205b5dccf3408cee098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:11.137124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:11.140392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:11.145082 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1138/2291] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:10 2022] DELETE /identity/v3/projects/e756f3ec49694205b5dccf3408cee098 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:11.146909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:11.151799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.283126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:11.286219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.339819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8678-4a53-4076-9770-7026256d8d5e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:11.354015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:11.356528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:11.357289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:11.358057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:11.360036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:11.366788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:11.452677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee097-e87a-4615-b976-4f77b518a6aa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:11.593717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:11.626879 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1139/2292] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:11 2022] POST /identity/v3/projects => generated 387 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:11.628726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:11.632090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.658913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:11.660850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:11.663551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:11.667032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:11.671819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=92914d55af6f49398edc52da69b55cd8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:11.681373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:11.703942 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1154/2293] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:11 2022] GET /identity/v3/projects/92914d55af6f49398edc52da69b55cd8 => generated 375 bytes in 614 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:11.705130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:11.708464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.761315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1288f-404c-4688-90ee-83ff316d18e2 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:11.850269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f53f1-c784-4782-874a-5d3290e45efd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:11.863100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:11.864018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:11.864913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:11.865411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:11.866669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:11.874636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:11.903384 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1140/2294] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:11.904942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:11.908305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:11.937597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89707-3c0d-41b3-aab5-6c98b4cb336c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:11.955484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:11.956644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:11.957133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:11.957643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] PATH_INFO: `/v3/users/a839bd7f69904d51a0fa4f325911c43d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:11.964994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a839bd7f69904d51a0fa4f325911c43d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:11.971789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:11.996510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:11.997679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:11.998406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:11.998770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:12.000062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:12.013482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:12.041552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1155/2295] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:12.043346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:12.058409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:12.078065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7e5b-98f2-4d24-b34b-e984c531c8d9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:12.088524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:12.089790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:12.090380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:12.090870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:12.092348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:12.097838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:12.325737 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1156/2296] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:12 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:12.328554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:12.354043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f233134-5ee3-43af-b82d-d21efa076640 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:12.364776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:12.366632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:12.367551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:12.368450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] PATH_INFO: `/v3/projects/07aec6f307a245169888f093a68bcca9/users/0bc251e547014c93a5ee3318e0849166/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:12.406139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aec6f307a245169888f093a68bcca9, user_id=0bc251e547014c93a5ee3318e0849166, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:12.412356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a609203-bb0e-40ac-9892-c018da7998ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:12.463895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a839bd7f69904d51a0fa4f325911c43d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:12.556486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1157/2297] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:12 2022] PUT /identity/v3/projects/07aec6f307a245169888f093a68bcca9/users/0bc251e547014c93a5ee3318e0849166/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:12.559888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f236-c595-49c5-b45d-9b0ef5b198a1 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:12.562281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f236-c595-49c5-b45d-9b0ef5b198a1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:12.562884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f236-c595-49c5-b45d-9b0ef5b198a1 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:12.568075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1158/2298] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:12.570452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f236-c595-49c5-b45d-9b0ef5b198a1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:12.653725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a839bd7f69904d51a0fa4f325911c43d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:12.694085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a839bd7f69904d51a0fa4f325911c43d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:12.762599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a839bd7f69904d51a0fa4f325911c43d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:12.767771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a839bd7f69904d51a0fa4f325911c43d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:12.792493 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1141/2299] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:11 2022] DELETE /identity/v3/users/a839bd7f69904d51a0fa4f325911c43d => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:12.811069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:12.817066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f236-c595-49c5-b45d-9b0ef5b198a1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:12.819379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:13.045303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a995-2a9d-414d-84bb-cb4000f67f5b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:13.065142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.066330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.066874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.067363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.074155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.082274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:13.095764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.100186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.101608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.102198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] PATH_INFO: `/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c/users/a19fea397df74d64adaf78a0773f8c7a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.146242 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1142/2300] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:13.149637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:13.158243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:13.168891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ddc3ccebc84a62a2c1dc1ff58ae53c, user_id=a19fea397df74d64adaf78a0773f8c7a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.175347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:13.193984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3bdf4-715a-4385-9f14-1fa68fd20aa7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:13.205511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.207932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.208614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.209250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.211094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.217151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:13.257546 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1143/2301] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:13.261336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:13.265627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:13.281759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1159/2302] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:12 2022] PUT /identity/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c/users/a19fea397df74d64adaf78a0773f8c7a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:13.284062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:13.316646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:13.415482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:13.519963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:13.522810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:13.524800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fab9c1-81e1-4e22-8a15-1999246ba746 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:13.533372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.534773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.535798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.536327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] PATH_INFO: `/v3/projects/d6394102a5a741b8a3620d2044de1329/users/e7a7c9b1dc664392b8a2a9f10ad94b07/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.568352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6394102a5a741b8a3620d2044de1329, user_id=e7a7c9b1dc664392b8a2a9f10ad94b07, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.574562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:13.707767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a74b80-7a06-411e-aa37-1e6ad8bb1093 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:13.753375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1160/2303] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:13 2022] PUT /identity/v3/projects/d6394102a5a741b8a3620d2044de1329/users/e7a7c9b1dc664392b8a2a9f10ad94b07/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:13.760225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:13.938949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.941578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.942410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.943116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.946030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=92914d55af6f49398edc52da69b55cd8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.950521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9238cd-37dd-473a-8d01-1ce71ac52b00 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:13.951796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:13.955692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1144/2304] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:13 2022] GET /identity/v3/projects/92914d55af6f49398edc52da69b55cd8 => generated 375 bytes in 697 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:13.957663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:13.959400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:13.962151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:13.962459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:13.962952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:13.963577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] PATH_INFO: `/v3/projects/07aec6f307a245169888f093a68bcca9/users/0bc251e547014c93a5ee3318e0849166/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:13.974043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aec6f307a245169888f093a68bcca9, user_id=0bc251e547014c93a5ee3318e0849166, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:13.981345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:14.001732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7f07-2962-490f-b263-65f9dc233f1b tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:14.011815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1161/2305] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:13 2022] PUT /identity/v3/projects/07aec6f307a245169888f093a68bcca9/users/0bc251e547014c93a5ee3318e0849166/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:14.019054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:14.019054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:14.182296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:14.190454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.190454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.190454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:14.190454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:14.192110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:14.206137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b11c8-52e8-4fc8-8ab1-c8c0de6fe757 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:14.218031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:14.219539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.219996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.221458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] PATH_INFO: `/v3/projects/8208e592a1494535b5d215fedbc63704` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:14.223916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8208e592a1494535b5d215fedbc63704)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:14.229455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:14.235564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1145/2306] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:14.237606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:14.265138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7893-695f-4290-8d13-da6afc57a1f6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:14.277502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:14.285921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:14.286146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.286146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.286146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:14.286146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:14.286146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c072f9f-9a7f-4b4c-aa45-f2ade914fced admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:14.311220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1146/2307] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:14.315386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.321090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.321090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:14.378465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] MFA Rules not processed for user `0bc251e547014c93a5ee3318e0849166`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:14.381003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:14.580361 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1147/2308] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:14.582265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:14.613432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8208e592a1494535b5d215fedbc63704', 'request_id': 'req-1d12f831-9bdb-4e31-8453-08d1dc3307b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:14.634930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163ccd-5d18-4ac5-8ce5-0349e821e8e9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:14.729230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8208e592a1494535b5d215fedbc63704', 'request_id': 'req-1d12f831-9bdb-4e31-8453-08d1dc3307b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:14.754200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8208e592a1494535b5d215fedbc63704', 'request_id': 'req-1d12f831-9bdb-4e31-8453-08d1dc3307b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:14.787551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] The token cache is being invalidate because project 8208e592a1494535b5d215fedbc63704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:14.788179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:14.794695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:14.794695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1162/2309] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:14 2022] DELETE /identity/v3/projects/8208e592a1494535b5d215fedbc63704 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:14.795876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:14.799231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:14.836499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:14.915658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:14.918970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.919737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.920285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] PATH_INFO: `/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c/users/a19fea397df74d64adaf78a0773f8c7a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:14.925028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ddc3ccebc84a62a2c1dc1ff58ae53c, user_id=a19fea397df74d64adaf78a0773f8c7a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:14.931393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278aa6-3650-4a69-982e-b02a1f564f89 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:14.975434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1148/2310] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:14 2022] PUT /identity/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c/users/a19fea397df74d64adaf78a0773f8c7a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:14.975662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a24a1-5a66-450e-8b21-271a40ffd2ef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:14.976447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a24a1-5a66-450e-8b21-271a40ffd2ef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:14.976936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a24a1-5a66-450e-8b21-271a40ffd2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.031300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1e6a24a1-5a66-450e-8b21-271a40ffd2ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:15.033537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e6a24a1-5a66-450e-8b21-271a40ffd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:15.062289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12f831-9bdb-4e31-8453-08d1dc3307b6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:15.212714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:15.216119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.220694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.220694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] PATH_INFO: `/v3/projects/d6394102a5a741b8a3620d2044de1329/users/e7a7c9b1dc664392b8a2a9f10ad94b07/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.222894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6394102a5a741b8a3620d2044de1329, user_id=e7a7c9b1dc664392b8a2a9f10ad94b07, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:15.230712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e804c-b7be-4754-a0a8-5c13a4016d50 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:15.235743 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1149/2311] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:15.238488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.238881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.239391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.258636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1163/2312] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:14 2022] PUT /identity/v3/projects/d6394102a5a741b8a3620d2044de1329/users/e7a7c9b1dc664392b8a2a9f10ad94b07/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:15.261597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5be5d-4315-4e94-806d-5b8c2dacfe33 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.262427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5be5d-4315-4e94-806d-5b8c2dacfe33 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.263159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5be5d-4315-4e94-806d-5b8c2dacfe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.293980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:15.305013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e6e5be5d-4315-4e94-806d-5b8c2dacfe33 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:15.307372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6e5be5d-4315-4e94-806d-5b8c2dacfe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:15.323579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] MFA Rules not processed for user `a19fea397df74d64adaf78a0773f8c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:15.326799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:15.521291 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1164/2313] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:15.525390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.526817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.536102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.596587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1150/2314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:15.600378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:15.635000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] MFA Rules not processed for user `e7a7c9b1dc664392b8a2a9f10ad94b07`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:15.641862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:15.642121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc77a-cf18-433d-b8dd-d8762a1cecf8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:15.648885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:15.649871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.651189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.652142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.653300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:15.653914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:15.657397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:15.701683 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1151/2315] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:15.703068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:15.709074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:15.730602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:15.751771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06878-b879-4c0e-95a7-93c1b757c0b5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:15.763804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:15.766054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.766615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.767200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] PATH_INFO: `/v3/users/8849949fc62f47b0ac77833145a5b816` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.770735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8849949fc62f47b0ac77833145a5b816)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:15.775696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:15.854799 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1165/2316] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:15.856869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:15.881217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931975b-0edd-4b1c-a407-0f57efbf0934 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:15.895709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:15.896932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:15.897440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:15.898600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:15.900019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:15.904193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:16.106683 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1166/2317] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:15 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:16.108449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:16.122884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8849949fc62f47b0ac77833145a5b816'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:16.223279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8849949fc62f47b0ac77833145a5b816'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:16.255532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8849949fc62f47b0ac77833145a5b816'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:16.267906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60507-4557-477c-ae5c-215da0c7092c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:16.286442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:16.289187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:16.289837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:16.290582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:16.293872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:16.301005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:16.301637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8849949fc62f47b0ac77833145a5b816'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:16.302762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2115807e-5861-44c1-8657-20d41ca5f23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8849949fc62f47b0ac77833145a5b816'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:16.319940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1152/2318] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:15 2022] DELETE /identity/v3/users/8849949fc62f47b0ac77833145a5b816 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:16.338785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:16.345282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:16.345996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:16.412469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:16.417091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:16.545365 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1167/2319] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:16 2022] POST /identity/v3/users => generated 288 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:16.558354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:16.564336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:16.608266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1153/2320] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:16.608266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:16.611293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:16.630624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267f53-f4f5-4dc3-8bfb-8dfacac81439 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:16.645717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:16.648428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:16.650714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:16.651118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:16.656006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:16.670806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:16.723389 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1168/2321] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:16.725162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:16.729932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:16.788107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:16.977974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3dba8-d245-4636-9c36-16bce2265fd3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.009906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b7ffb-a1db-4657-befa-1cea843dbf4b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.018535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:17.019262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:17.020491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.021307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.021930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.026186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.026995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.027505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.035714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:17.053333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:17.057369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:17.090867 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1169/2322] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:17.093183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:17.117196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62547-3b38-4293-a6e4-07b7be0375e9 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.130088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:17.132545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.133017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.133500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.134710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:17.139193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:17.176858 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1170/2323] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:17.178669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:17.208002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ab72-2908-4f5b-b689-4da071615f4d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.222348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:17.223575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.224089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.224662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] PATH_INFO: `/v3/projects/74eef3bf938c491d8a2f5192ba598c19/users/4360a08eed56405b99333776285fef3a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.283042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eef3bf938c491d8a2f5192ba598c19, user_id=4360a08eed56405b99333776285fef3a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:17.289970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:17.290853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b291cca-2e90-4070-b5e1-cf7f7e9e5172 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:17.295294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:17.320583 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1154/2324] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:17.327937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:17.461014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:17.485928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c6aa-bae2-436f-94d2-752521d11953 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.498092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:17.499447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.500023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.500812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.504383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:17.578977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1171/2325] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:17 2022] PUT /identity/v3/projects/74eef3bf938c491d8a2f5192ba598c19/users/4360a08eed56405b99333776285fef3a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:17.587023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30713-878f-4b4e-863b-174650532c2c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.587023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30713-878f-4b4e-863b-174650532c2c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.587023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30713-878f-4b4e-863b-174650532c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.646168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f6e30713-878f-4b4e-863b-174650532c2c None None] MFA Rules not processed for user `4360a08eed56405b99333776285fef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:17.648381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f6e30713-878f-4b4e-863b-174650532c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:17.682175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:17.693789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:17.740367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1155/2326] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:33:17.866891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1172/2327] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:33:17.875191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:17.911381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637571a-1dad-458f-ab57-d1de7645050c service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:17.945902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:17.946908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:17.948238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:17.953010 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1173/2328] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:33:17.963393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:18.000024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:18.134645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:18.139205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:18.139913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:18.140524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:18.142442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:18.146867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39fef9-c28f-459d-b7a8-3a3e2997e422 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:18.308536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:18.310144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:18.339830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:18.431035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e892-9b15-47bc-9baf-6f3b428ed433 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:18.440306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f14af16e13444ea605ddf1ee15c207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:18.440656 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1156/2329] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:17 2022] POST /identity/v3/projects => generated 373 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:18.441441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:18.441972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:18.442435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:18.444413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:18.446384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:18.447100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:18.447328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorizing `identity:get_project(project_id=92914d55af6f49398edc52da69b55cd8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:18.452105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:18.470631 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1174/2330] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:17 2022] GET /identity/v3/projects/92914d55af6f49398edc52da69b55cd8 => generated 375 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:33:18.471846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:18.477926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:18.534772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee491-8190-4692-998b-abe471013e81 tempest-QuotasAdminTestJSON-1216372600 tempest-QuotasAdminTestJSON-1216372600-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:18.546002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] MFA Rules not processed for user `6a310d2bd16e4d52841042364253a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:18.555356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:18.700852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:18.703357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:18.703891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:18.704368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] PATH_INFO: `/v3/users/db7ce3caf2f543b0a3a4f9db6c7c2783` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:18.707196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7ce3caf2f543b0a3a4f9db6c7c2783)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:18.714311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:18.871367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1157/2331] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:18.874245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:18.878391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:18.930613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3791-e4cd-41ca-be09-cafbeefa34ba None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:18.941891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:18.943767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:18.945041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:18.946302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] PATH_INFO: `/v3/projects/0d505d480d1446279e7e271b9122e5f7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:18.952879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d505d480d1446279e7e271b9122e5f7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:18.958351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:19.134647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7ce3caf2f543b0a3a4f9db6c7c2783'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.140849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7ce3caf2f543b0a3a4f9db6c7c2783'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.172710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d505d480d1446279e7e271b9122e5f7', 'request_id': 'req-a249fd6a-2553-46ac-97c1-1bbe72188fc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.186485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d505d480d1446279e7e271b9122e5f7', 'request_id': 'req-a249fd6a-2553-46ac-97c1-1bbe72188fc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.199520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d505d480d1446279e7e271b9122e5f7', 'request_id': 'req-a249fd6a-2553-46ac-97c1-1bbe72188fc3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.203564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:19.242771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7ce3caf2f543b0a3a4f9db6c7c2783'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.281172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7ce3caf2f543b0a3a4f9db6c7c2783'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.299295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7ce3caf2f543b0a3a4f9db6c7c2783'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.315176 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1175/2332] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:18 2022] DELETE /identity/v3/users/db7ce3caf2f543b0a3a4f9db6c7c2783 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:19.316258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:19.320344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:19.404815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] The token cache is being invalidate because project 0d505d480d1446279e7e271b9122e5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:19.405200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.406574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:19.415175 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1158/2333] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:18 2022] DELETE /identity/v3/projects/0d505d480d1446279e7e271b9122e5f7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:19.417190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:19.420388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:19.445395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:19.513591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b8c4-8c5b-4486-81d2-c733df03c0d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:19.526442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:19.527805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:19.528305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:19.529072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:19.530312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:19.535037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8956f2-a757-4b99-ab35-0efaf6954022 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:19.602837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249fd6a-2553-46ac-97c1-1bbe72188fc3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:19.614537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:19.616281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:19.617011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:19.617765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:19.619619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:19.624868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:19.704525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1176/2334] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:19 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:19.707778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:19.707778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:19.708387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:19.746279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:19.749035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:19.764960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1177/2335] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:19.768943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:19.772065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:19.805107 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1159/2336] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:19 2022] POST /identity/v3/projects => generated 395 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:19.806940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:19.810567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:19.812656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa73937-e789-4bdb-85f9-c78d1042253b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:19.988653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2723-6d9a-4f1c-817b-bd7db6d9236f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:20.001062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:20.002207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:20.002416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:20.002723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:20.003265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:20.003976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:20.004477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:20.004870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:20.005046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] PATH_INFO: `/v3/users/a19fea397df74d64adaf78a0773f8c7a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:20.008534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19fea397df74d64adaf78a0773f8c7a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:20.008948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:20.012816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:20.035584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1160/2337] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:20.037557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:20.042945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:20.178822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c7bca-db4d-4fa3-a817-7128f003d5ed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:20.196356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:20.197348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:20.197821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:20.198298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:20.216454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:20.219835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:20.245205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1161/2338] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:20.245205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:20.264300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34c0f-8863-4f26-80bc-14e0e2f0d3a7 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:20.285810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:20.287649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:20.294629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:20.297288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:20.305154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:20.331880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:20.433022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19fea397df74d64adaf78a0773f8c7a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:20.434623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19fea397df74d64adaf78a0773f8c7a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:20.505396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:20.519638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1162/2339] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:20 2022] POST /identity/v3/users => generated 304 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:20.521124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:20.541666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4d742-1c05-4108-b3e9-c2eb4e06c6d6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:20.549679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:20.550914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:20.551510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:20.551898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] PATH_INFO: `/v3/projects/7c51aa34a4434d0a931063ba18400be8/users/2e3ada01045e4d4b9295b266315e2cd1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:20.582490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c51aa34a4434d0a931063ba18400be8, user_id=2e3ada01045e4d4b9295b266315e2cd1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:20.588823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:20.596501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19fea397df74d64adaf78a0773f8c7a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:20.637037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19fea397df74d64adaf78a0773f8c7a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:20.655048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19fea397df74d64adaf78a0773f8c7a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:20.672393 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1178/2340] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:19 2022] DELETE /identity/v3/users/a19fea397df74d64adaf78a0773f8c7a => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:20.678827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:20.682569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:20.755983 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1163/2341] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:20 2022] PUT /identity/v3/projects/7c51aa34a4434d0a931063ba18400be8/users/2e3ada01045e4d4b9295b266315e2cd1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:20.758088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:20.762088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:20.883553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:21.001756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298873-cbc8-46d9-b620-7b3a977248bf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.024403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95f59b-1327-40b9-a869-539c9bc83c55 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.035414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.036373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.037366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.038478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.039529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.042963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.071256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1164/2342] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:21.074115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:21.080028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:21.111810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a7247-5605-46bd-96af-1d8ca2e36c6d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.131493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.132968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.133472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.134324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.137281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.141879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.188781 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1165/2343] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:21.188781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:21.248179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c2fb-00e7-4cd3-8d68-1d465baf531b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.249156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.250569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.251894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.252593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.256834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:21.271845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.273931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.275036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.275036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] PATH_INFO: `/v3/projects/d6f013a44999493b83fa035e0bb80cb5/users/e8c306ba0e2a4e2e8f2ca22d3cef384c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.332100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f013a44999493b83fa035e0bb80cb5, user_id=e8c306ba0e2a4e2e8f2ca22d3cef384c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.339022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.456821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.461387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.491503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1166/2344] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:21 2022] PUT /identity/v3/projects/d6f013a44999493b83fa035e0bb80cb5/users/e8c306ba0e2a4e2e8f2ca22d3cef384c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:21.492380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:21.505214 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1179/2345] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:21.507249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:21.517296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:21.578481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7abd0-466b-4f2a-93b8-3ae94be1fa36 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.718213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf56d2-12e0-43e8-bd4e-8f67e4ce3293 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:21.738947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.740281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.740860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.742310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] PATH_INFO: `/v3/projects/7c51aa34a4434d0a931063ba18400be8/users/2e3ada01045e4d4b9295b266315e2cd1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.754856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c51aa34a4434d0a931063ba18400be8, user_id=2e3ada01045e4d4b9295b266315e2cd1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.794591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.837374 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1167/2346] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:21 2022] PUT /identity/v3/projects/7c51aa34a4434d0a931063ba18400be8/users/2e3ada01045e4d4b9295b266315e2cd1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:21.854308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:21.859575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:21.861366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:21.862273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:21.863092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] PATH_INFO: `/v3/projects/c87ac73d88394351a5c60110cd7e2207` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:21.865227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87ac73d88394351a5c60110cd7e2207)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:21.870367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:21.988785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:22.121129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87ac73d88394351a5c60110cd7e2207', 'request_id': 'req-0470d954-faea-4297-89c8-16b34cc8712e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.146439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee618-4a57-4829-99b8-062479b3a1d6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:22.234352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87ac73d88394351a5c60110cd7e2207', 'request_id': 'req-0470d954-faea-4297-89c8-16b34cc8712e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.250775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87ac73d88394351a5c60110cd7e2207', 'request_id': 'req-0470d954-faea-4297-89c8-16b34cc8712e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.278939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:22.280614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:22.281548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:22.283735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:22.285792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:22.288939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:22.302370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] The token cache is being invalidate because project c87ac73d88394351a5c60110cd7e2207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:22.309634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.311203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.314446 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1180/2347] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:21 2022] DELETE /identity/v3/projects/c87ac73d88394351a5c60110cd7e2207 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:22.316320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:22.320629 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1168/2348] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:22.322614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:22.324109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:22.329115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:22.355313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c377d0-de29-493e-9881-e2d6cfe05fff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:22.356150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470d954-faea-4297-89c8-16b34cc8712e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:22.370098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:22.371238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:22.371715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:22.372192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] PATH_INFO: `/v3/users/b5370506142c4042b4a5f2869b355b2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:22.373665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:22.374378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5370506142c4042b4a5f2869b355b2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:22.374716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:22.375464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:22.375950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] PATH_INFO: `/v3/users/d750e689140e47958e7b1011c0d07986` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:22.378462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d750e689140e47958e7b1011c0d07986)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:22.378758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:22.383304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:22.435559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:22.799859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd750e689140e47958e7b1011c0d07986'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.801297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd750e689140e47958e7b1011c0d07986'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.877336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5370506142c4042b4a5f2869b355b2d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.931516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd750e689140e47958e7b1011c0d07986'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:22.983704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd750e689140e47958e7b1011c0d07986'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.002051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b5abde5f-3342-492d-b302-10bd89a55ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd750e689140e47958e7b1011c0d07986'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.017056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1181/2349] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:22 2022] DELETE /identity/v3/users/d750e689140e47958e7b1011c0d07986 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:23.019739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:23.023464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:23.023464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:23.080218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] MFA Rules not processed for user `2e3ada01045e4d4b9295b266315e2cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:23.082423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:23.102640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5370506142c4042b4a5f2869b355b2d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.120368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5370506142c4042b4a5f2869b355b2d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.152494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5370506142c4042b4a5f2869b355b2d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.153262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5370506142c4042b4a5f2869b355b2d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.172436 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1169/2350] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:22 2022] DELETE /identity/v3/users/b5370506142c4042b4a5f2869b355b2d => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:23.175118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:23.187247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:23.329591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:23.372537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1182/2351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:23.377285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a890d-af51-4b3a-a6de-2c5e3ddd5c6c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:23.383835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:23.386813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:23.392324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:23.394034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:23.395573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:23.401774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] PATH_INFO: `/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:23.401981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:23.402117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ddc3ccebc84a62a2c1dc1ff58ae53c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:23.404597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:23.550216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ec711-72b8-493d-bd92-daa7f086db26 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:23.559734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:23.562303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:23.563833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:23.564384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] PATH_INFO: `/v3/users/410ed971a3c74739943849c6bfc0ddbd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:23.570418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410ed971a3c74739943849c6bfc0ddbd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:23.579488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:23.632883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ddc3ccebc84a62a2c1dc1ff58ae53c', 'request_id': 'req-5c10815e-b289-49a7-bea5-caaa3a9b4d12'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.649838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ddc3ccebc84a62a2c1dc1ff58ae53c', 'request_id': 'req-5c10815e-b289-49a7-bea5-caaa3a9b4d12'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.682814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ddc3ccebc84a62a2c1dc1ff58ae53c', 'request_id': 'req-5c10815e-b289-49a7-bea5-caaa3a9b4d12'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.856032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] The token cache is being invalidate because project 72ddc3ccebc84a62a2c1dc1ff58ae53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:23.856653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.863519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.866997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1170/2352] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:23 2022] DELETE /identity/v3/projects/72ddc3ccebc84a62a2c1dc1ff58ae53c => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:23.876178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:23.879389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:23.925733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410ed971a3c74739943849c6bfc0ddbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:23.929090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410ed971a3c74739943849c6bfc0ddbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.033329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10815e-b289-49a7-bea5-caaa3a9b4d12 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:24.039375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410ed971a3c74739943849c6bfc0ddbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.042534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:24.045035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.045035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.045035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] PATH_INFO: `/v3/projects/d6f013a44999493b83fa035e0bb80cb5/users/e8c306ba0e2a4e2e8f2ca22d3cef384c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.049089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f013a44999493b83fa035e0bb80cb5, user_id=e8c306ba0e2a4e2e8f2ca22d3cef384c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:24.055437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a25c4a-6bce-4107-b522-4aeadb1ecbe9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:24.079508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1171/2353] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:23 2022] PUT /identity/v3/projects/d6f013a44999493b83fa035e0bb80cb5/users/e8c306ba0e2a4e2e8f2ca22d3cef384c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:24.081536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.082019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.082511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.085176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410ed971a3c74739943849c6bfc0ddbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.103908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c06b9101-4849-4aaf-bf36-74cf0e02abc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410ed971a3c74739943849c6bfc0ddbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.120641 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1183/2354] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:23 2022] DELETE /identity/v3/users/410ed971a3c74739943849c6bfc0ddbd => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:24.123059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a240-dd3f-45dc-b088-c2f26a740073 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.123646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a240-dd3f-45dc-b088-c2f26a740073 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.124119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a240-dd3f-45dc-b088-c2f26a740073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.124390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:24.127005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.170018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-31e6a240-dd3f-45dc-b088-c2f26a740073 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:24.173250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-31e6a240-dd3f-45dc-b088-c2f26a740073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.277682 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1172/2355] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:24.279354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:24.281744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.309264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914abb1-1b89-4fcc-9257-a4a0b46fb9f0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:24.318177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:24.319319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.319993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.320480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] PATH_INFO: `/v3/users/b9b0a2408b1c49c8864f7d9b16cf4ee2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.332851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b0a2408b1c49c8864f7d9b16cf4ee2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:24.337046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:24.338272 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1184/2356] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:24.341660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:24.341964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899cc99-2f67-4e05-94f1-be6eeeac964c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.343247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899cc99-2f67-4e05-94f1-be6eeeac964c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.343247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899cc99-2f67-4e05-94f1-be6eeeac964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.428757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1899cc99-2f67-4e05-94f1-be6eeeac964c None None] MFA Rules not processed for user `4360a08eed56405b99333776285fef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:24.431976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1899cc99-2f67-4e05-94f1-be6eeeac964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.509861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:24.660845 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1185/2357] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:24.660845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:24.660845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:24.661210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:24.727433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:24.729829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.741763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b0a2408b1c49c8864f7d9b16cf4ee2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.765711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1186/2358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:24.767583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:24.770183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:24.904298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b0a2408b1c49c8864f7d9b16cf4ee2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.935358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b0a2408b1c49c8864f7d9b16cf4ee2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.988043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b0a2408b1c49c8864f7d9b16cf4ee2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:24.990454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b0a2408b1c49c8864f7d9b16cf4ee2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:25.003696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0689f-d81f-4ea7-83fb-667e88c51c25 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.016787 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1173/2359] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:24 2022] DELETE /identity/v3/users/b9b0a2408b1c49c8864f7d9b16cf4ee2 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:25.018516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:25.023784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.024922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.025408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.025900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.027639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.037303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.095325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.120410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:25.137522 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1187/2360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:25.140118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:25.146062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.264200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406f6d-179b-4bfc-b08a-38df0268c48b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.277222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.281790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.298761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.299374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.306360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.375826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca0c7-0843-4a50-b916-a122808b4ba5 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.529248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.534794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.539659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6366474-d1e6-40c1-9122-f7cc6df20573 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:25.557609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.558778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.559599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.560325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.565622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.567979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1174/2361] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:25.571706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a210d7-a4e7-4412-834f-e097019eb5ae None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.572531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a210d7-a4e7-4412-834f-e097019eb5ae None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.574880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a210d7-a4e7-4412-834f-e097019eb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.641095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f8a210d7-a4e7-4412-834f-e097019eb5ae None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:25.643611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8a210d7-a4e7-4412-834f-e097019eb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.691782 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1175/2362] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:25.695012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.695637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.696146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.745742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:25.750129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.766050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.771464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:25.774763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1176/2363] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:25.776418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:25.782138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:25.800835 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1188/2364] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:25.802976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:25.826963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cf74-f21a-4442-bf63-7ffa84d49941 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.836143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5be60-b476-4c54-a941-b4a75752cbd7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.838212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.840120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.840853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.841310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.842641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:25.843445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.847769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:25.858922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.862798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.863168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.863473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] PATH_INFO: `/v3/projects/78cc8c254abc490e8197521c24609c7a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.869246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cc8c254abc490e8197521c24609c7a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.877512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:25.881794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1189/2365] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:25.885487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:25.912898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331b69-d149-477a-96c3-bb62f5f3970d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:25.922335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.924775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:25.926638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:25.927637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:25.930068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:25.960676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:25.964933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.002900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1190/2366] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:26.003410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.028024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cb39-f42e-4242-aa9a-e0f266353a00 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.045190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.048188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.049883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.050770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.052580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.060114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.117584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cc8c254abc490e8197521c24609c7a', 'request_id': 'req-9140ce41-17db-4abf-8cd3-f7bc301d789c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:26.134522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cc8c254abc490e8197521c24609c7a', 'request_id': 'req-9140ce41-17db-4abf-8cd3-f7bc301d789c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:26.147347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cc8c254abc490e8197521c24609c7a', 'request_id': 'req-9140ce41-17db-4abf-8cd3-f7bc301d789c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:26.268209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] The token cache is being invalidate because project 78cc8c254abc490e8197521c24609c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:26.270431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:26.272213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9140ce41-17db-4abf-8cd3-f7bc301d789c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:26.279377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1191/2368] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:26 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:26.283790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.284608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1177/2368] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:25 2022] DELETE /identity/v3/projects/78cc8c254abc490e8197521c24609c7a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:26.288730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6621-2d24-4365-aadc-937ea390c211 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.289511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6621-2d24-4365-aadc-937ea390c211 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.290537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6621-2d24-4365-aadc-937ea390c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.293048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:26.362013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6e0c6621-2d24-4365-aadc-937ea390c211 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:26.367762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6e0c6621-2d24-4365-aadc-937ea390c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:26.488069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e824-3d2c-44a9-8a28-ef06d73bc95b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.510586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.511695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.512208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.513990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.515206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.525602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.631081 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1178/2369] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:26.649167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.649746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.657688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.704394 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1192/2370] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:26 2022] POST /identity/v3/users => generated 291 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:26.706672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.721888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:26.723581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:26.750917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ad29f-9e4e-4311-9ec2-78296a21adc0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.762368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1179/2371] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:33:26.766163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.773306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.774364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.774855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.775367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.784388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.788799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.804205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006b74-1919-40e1-9a06-ab9c3a7b595a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.813244 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1193/2372] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:26.823439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.823439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.823439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.823439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.825774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:26.826700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.828382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.830447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.864179 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1180/2373] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:33:26.867862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bceab-3857-4bcf-8242-fc33a50c9a5e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.874089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:26.894556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.898143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.898143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.898143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.898632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3097324-0cda-42e5-8413-bcde9b1e0a44 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:26.901206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.909313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:26.910901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:26.911116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.912114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:26.914139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:26.915988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:26.922341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:26.967703 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1194/2374] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:26.970414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:27.013086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2882b-2b5e-40a7-88c6-90620979f3ac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:27.032684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:27.033770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:27.034972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:27.036316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] PATH_INFO: `/v3/projects/70436b8b504e43dc882f5ee434ecf443/users/5bda0ce3a36747c69b4a78e558a03b1b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:27.075901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70436b8b504e43dc882f5ee434ecf443, user_id=5bda0ce3a36747c69b4a78e558a03b1b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:27.081062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada6943-00cf-4433-9edd-424716a115d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:27.089269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.135622 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1181/2375] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:26 2022] POST /identity/v3/projects => generated 393 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:27.139930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:27.236077 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1195/2376] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:26 2022] PUT /identity/v3/projects/70436b8b504e43dc882f5ee434ecf443/users/5bda0ce3a36747c69b4a78e558a03b1b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:33:27.267109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:27.268119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:27.270075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:27.451463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:27.460778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:27.492373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d2e71-e81c-4785-8fd9-3fb475575097 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:27.508791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.764380 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1196/2377] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:33:27.768486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:27.777305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:27.791255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:27.813571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:27.814040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:27.820959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:27.828192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:27.843374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:27.903811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1788768-7d85-4a2c-86d2-92a7452586ff None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:27.956589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:27.957992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:27.963915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:27.964494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] PATH_INFO: `/v3/projects/92914d55af6f49398edc52da69b55cd8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:27.971389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92914d55af6f49398edc52da69b55cd8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:27.975423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:28.059119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1182/2378] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:27 2022] POST /identity/v3/users => generated 297 bytes in 921 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:28.061709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:28.122746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a0302-3e0d-43a3-8b98-df847362dc9d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:28.165929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:28.167021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:28.167583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:28.168102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:28.170091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:28.179272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:28.322803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92914d55af6f49398edc52da69b55cd8', 'request_id': 'req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:28.423110 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1183/2379] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:28 2022] POST /identity/v3/projects => generated 381 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:28.425099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:28.430179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92914d55af6f49398edc52da69b55cd8', 'request_id': 'req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:28.433695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:28.451242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92914d55af6f49398edc52da69b55cd8', 'request_id': 'req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:28.491028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] The token cache is being invalidate because project 92914d55af6f49398edc52da69b55cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:28.492188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:28.496619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:28.504475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1197/2380] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:27 2022] DELETE /identity/v3/projects/92914d55af6f49398edc52da69b55cd8 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:28.515907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:28.517655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:28.649314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba64e0-465d-419e-a209-eab74f604b92 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:28.670925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:28.672940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:28.673550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:28.674229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] PATH_INFO: `/v3/projects/9a03ec3d503847aaa0570841395555a9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:28.677133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a03ec3d503847aaa0570841395555a9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:28.682386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:28.863194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6e16c-d10b-4ba3-a275-6e08f2bc377c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:28.874374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:28.876654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:28.877898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:28.878735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:28.892265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:28.892265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:28.915854 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1198/2381] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:28.918860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:28.939203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:28.969125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:28.998486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d174-3689-417d-b707-a47dbec469f3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:29.000876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a03ec3d503847aaa0570841395555a9', 'request_id': 'req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.021648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a03ec3d503847aaa0570841395555a9', 'request_id': 'req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.040542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a03ec3d503847aaa0570841395555a9', 'request_id': 'req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.149820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:29.150773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:29.151320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:29.151820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:29.153111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:29.157208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:29.199662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] The token cache is being invalidate because project 9a03ec3d503847aaa0570841395555a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:29.200550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.203848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.217104 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1184/2382] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:28 2022] DELETE /identity/v3/projects/9a03ec3d503847aaa0570841395555a9 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:29.219902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:29.221709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:29.270441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:29.286125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae357ae-db3b-4c76-bd94-8d7b63e18b5f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:29.306259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:29.309494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:29.312729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:29.320867 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1199/2383] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:28 2022] POST /identity/v3/users => generated 297 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:29.320867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:29.321257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] PATH_INFO: `/v3/users/02f14af16e13444ea605ddf1ee15c207` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:29.324526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f14af16e13444ea605ddf1ee15c207)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:29.325818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:29.333027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:29.394670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b2dc-c169-41b8-8684-7946aa50c178 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:29.420904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:29.422932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:29.423744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:29.424262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] PATH_INFO: `/v3/projects/05dbcecc14b940fba8ddb3c509444055` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:29.432017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dbcecc14b940fba8ddb3c509444055)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:29.437362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:29.709053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dbcecc14b940fba8ddb3c509444055', 'request_id': 'req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.851916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dbcecc14b940fba8ddb3c509444055', 'request_id': 'req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.876211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dbcecc14b940fba8ddb3c509444055', 'request_id': 'req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.911607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f14af16e13444ea605ddf1ee15c207'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.938241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] The token cache is being invalidate because project 05dbcecc14b940fba8ddb3c509444055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:29.944734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.947521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:29.951846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1200/2384] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:29 2022] DELETE /identity/v3/projects/05dbcecc14b940fba8ddb3c509444055 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:29.955665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:29.958961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:30.054122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f14af16e13444ea605ddf1ee15c207'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:30.084190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f14af16e13444ea605ddf1ee15c207'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:30.145841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f14af16e13444ea605ddf1ee15c207'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:30.151395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f14af16e13444ea605ddf1ee15c207'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:30.171894 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1185/2385] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:29 2022] DELETE /identity/v3/users/02f14af16e13444ea605ddf1ee15c207 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:30.173700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:30.187262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:30.196264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189f2d-d2cd-47e2-b7e5-40e17deb800e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:30.306843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:30.495246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb0b5-5cfb-4bf6-9948-829e28116989 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:30.516353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:30.517551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:30.517991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:30.518466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] PATH_INFO: `/v3/users/0bc251e547014c93a5ee3318e0849166` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:30.530852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc251e547014c93a5ee3318e0849166)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:30.536384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:30.536960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:30.539177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:30.540029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:30.540815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:30.542824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:30.547236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:30.583352 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1201/2386] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:30.587307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:30.612192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:30.716649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05746-bf3a-48a6-b1ff-8eb724829247 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:30.756006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:30.757137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:30.757999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:30.758517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:30.764745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:30.775653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:30.829729 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1202/2387] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:30.838851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:30.844982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:30.867524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856affd7-afae-4ce7-b87c-bc229358df78 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:30.877656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:30.880457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:30.900204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:30.900204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] PATH_INFO: `/v3/users/e7a7c9b1dc664392b8a2a9f10ad94b07` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:30.900204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a7c9b1dc664392b8a2a9f10ad94b07)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:30.900204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:31.021761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc251e547014c93a5ee3318e0849166'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.126212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc251e547014c93a5ee3318e0849166'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.162341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc251e547014c93a5ee3318e0849166'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.224304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:31.228432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a7c9b1dc664392b8a2a9f10ad94b07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.230725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc251e547014c93a5ee3318e0849166'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.232003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a7c9b1dc664392b8a2a9f10ad94b07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.236579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc251e547014c93a5ee3318e0849166'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.287874 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1186/2388] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:30 2022] DELETE /identity/v3/users/0bc251e547014c93a5ee3318e0849166 => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:31.289646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:31.299249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:31.412574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a7c9b1dc664392b8a2a9f10ad94b07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.464074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a7c9b1dc664392b8a2a9f10ad94b07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.510893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a7c9b1dc664392b8a2a9f10ad94b07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:31.533690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1203/2389] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:30 2022] DELETE /identity/v3/users/e7a7c9b1dc664392b8a2a9f10ad94b07 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:31.546049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:31.559944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:31.704228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0929-4073-4a40-bd1e-01066fedf063 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:31.970313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3db746-e0ee-4d9c-b69c-8641e34fccaa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:32.000274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:32.001564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:32.001938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:32.002448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] PATH_INFO: `/v3/projects/9edf8377dc0f438692440aeae37efb30/users/9df54aab74014696a7519cb428b994b5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:32.057627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edf8377dc0f438692440aeae37efb30, user_id=9df54aab74014696a7519cb428b994b5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:32.064006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a2e7b-086f-40cc-a0a9-8df4da369193 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:32.387341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:32.387341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:32.387341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:32.387341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] PATH_INFO: `/v3/projects/78c640291eab426784b1a3104044d278/users/6c10af61f60e469299f8f39d3fcb3cf8/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:32.391010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c640291eab426784b1a3104044d278, user_id=6c10af61f60e469299f8f39d3fcb3cf8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:32.391010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:32.632178 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1187/2391] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:31 2022] PUT /identity/v3/projects/78c640291eab426784b1a3104044d278/users/6c10af61f60e469299f8f39d3fcb3cf8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 1344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:32.639957 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1204/2391] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:31 2022] PUT /identity/v3/projects/9edf8377dc0f438692440aeae37efb30/users/9df54aab74014696a7519cb428b994b5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:32.654578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:32.656809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:32.657847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:32.667616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:32.713744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:32.815053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] MFA Rules not processed for user `6c10af61f60e469299f8f39d3fcb3cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:32.817777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:33.027528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e973b0-b342-42fb-b90c-9b19248175a8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:33.170441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:33.180739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1205/2392] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:33.184105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:33.187507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:33.273210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0d72-5763-4859-a315-da61837456df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:33.276972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0d72-5763-4859-a315-da61837456df admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:33.278152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0d72-5763-4859-a315-da61837456df admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:33.279068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0d72-5763-4859-a315-da61837456df admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:33.280990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0d72-5763-4859-a315-da61837456df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:33.286420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0d72-5763-4859-a315-da61837456df admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:33.341750 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1188/2393] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 689 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:33.343960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0d72-5763-4859-a315-da61837456df admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:33.350840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-130d0d72-5763-4859-a315-da61837456df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:33.392817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0d72-5763-4859-a315-da61837456df admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:33.416848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:33.416848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:33.416848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:33.416848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:33.418527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:33.428433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:33.495184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dda05-c5b1-46ba-af07-aa0978592a75 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:33.509520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:33.510792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:33.512260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:33.524742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] PATH_INFO: `/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:33.534581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4847fb61a84bb9bf3c65ef62ad31bd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:33.546730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:33.651206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1189/2394] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:33 2022] POST /identity/v3/projects => generated 391 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:33.651206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:33.898026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'request_id': 'req-7cf3dfbe-9d30-403b-86fe-3e0653959d28'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:34.019062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'request_id': 'req-7cf3dfbe-9d30-403b-86fe-3e0653959d28'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:34.047367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4847fb61a84bb9bf3c65ef62ad31bd', 'request_id': 'req-7cf3dfbe-9d30-403b-86fe-3e0653959d28'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:34.047701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028006a-6fa8-4e7a-b38a-8acd0b297655 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:34.103309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] The token cache is being invalidate because project ba4847fb61a84bb9bf3c65ef62ad31bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:34.103854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:34.118806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:34.128637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1206/2395] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:33 2022] DELETE /identity/v3/projects/ba4847fb61a84bb9bf3c65ef62ad31bd => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:34.136948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:34.156186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:34.306358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:34.323781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:34.325294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:34.326083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:34.326414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] PATH_INFO: `/v3/projects/9edf8377dc0f438692440aeae37efb30/users/9df54aab74014696a7519cb428b994b5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:34.335714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edf8377dc0f438692440aeae37efb30, user_id=9df54aab74014696a7519cb428b994b5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:34.349030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:34.420963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3dfbe-9d30-403b-86fe-3e0653959d28 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:34.439182 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1190/2396] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:33 2022] PUT /identity/v3/projects/9edf8377dc0f438692440aeae37efb30/users/9df54aab74014696a7519cb428b994b5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:34.439182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:34.443428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:34.652346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:34.657099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:34.657099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:34.657099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:34.657099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:34.661272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054626e5-ff16-48e3-8170-3aa5a524ff5d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:34.673387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:34.780976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaf7a-388e-4f5f-96d9-bd5c8cfd1ae1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:34.794267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:34.795696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:34.796189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:34.796771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] PATH_INFO: `/v3/users/189426fe824e454384a818a7d8fdb8ff` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:34.799588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189426fe824e454384a818a7d8fdb8ff)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:34.806428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:34.867421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1207/2397] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:34 2022] POST /identity/v3/users => generated 302 bytes in 738 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:34.877874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:34.878517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:34.883292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:34.985266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:34.992412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:35.032946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1208/2398] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:35.037152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:35.044744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:35.106010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a02bc-4dff-4725-815e-7a69248db6fc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:35.117828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189426fe824e454384a818a7d8fdb8ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.131472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:35.135064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:35.136434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:35.137426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] PATH_INFO: `/v3/projects/d6394102a5a741b8a3620d2044de1329` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:35.140263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6394102a5a741b8a3620d2044de1329)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:35.146890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:35.299987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189426fe824e454384a818a7d8fdb8ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.331069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189426fe824e454384a818a7d8fdb8ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.397982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189426fe824e454384a818a7d8fdb8ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.403784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc730567-a3e9-4f8d-b927-a61c27191735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189426fe824e454384a818a7d8fdb8ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.438196 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1191/2399] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:34 2022] DELETE /identity/v3/users/189426fe824e454384a818a7d8fdb8ff => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:35.438196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22813b0-090f-4ce7-873d-fdbd8e910a87 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:35.438196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22813b0-090f-4ce7-873d-fdbd8e910a87 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:35.438196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22813b0-090f-4ce7-873d-fdbd8e910a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:35.528415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6394102a5a741b8a3620d2044de1329', 'request_id': 'req-d505a5a4-a202-45a2-bcfe-3d137c33af23'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.558122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a22813b0-090f-4ce7-873d-fdbd8e910a87 None None] MFA Rules not processed for user `9df54aab74014696a7519cb428b994b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:35.560822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a22813b0-090f-4ce7-873d-fdbd8e910a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:35.635878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6394102a5a741b8a3620d2044de1329', 'request_id': 'req-d505a5a4-a202-45a2-bcfe-3d137c33af23'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.669736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6394102a5a741b8a3620d2044de1329', 'request_id': 'req-d505a5a4-a202-45a2-bcfe-3d137c33af23'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.726058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] The token cache is being invalidate because project d6394102a5a741b8a3620d2044de1329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:35.729616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.732365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:35.738144 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1209/2400] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:35 2022] DELETE /identity/v3/projects/d6394102a5a741b8a3620d2044de1329 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:35.743751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:35.750522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:35.881023 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1192/2401] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:35.885776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587f9a5-a09f-4264-a031-6c6a34f38ccc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:35.886875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587f9a5-a09f-4264-a031-6c6a34f38ccc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:35.889380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587f9a5-a09f-4264-a031-6c6a34f38ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:35.939857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4587f9a5-a09f-4264-a031-6c6a34f38ccc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:35.945138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4587f9a5-a09f-4264-a031-6c6a34f38ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:35.947894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:36.050870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505a5a4-a202-45a2-bcfe-3d137c33af23 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:36.068398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:36.071065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.072099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.076499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.078677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:36.085274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9425-f35b-4ec3-8f71-ec0d3b69fe89 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:36.119749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1210/2402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:36.123487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.124561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.125386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.139466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:36.166451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1193/2403] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:36.169479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.169974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.170547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.179475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:36.185584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:36.211039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1211/2404] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:36.212999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:36.214171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:36.217044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:36.234138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7b24-3e37-495f-a98d-0f3ebc27d006 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:36.248062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:36.249365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.251196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.252341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] PATH_INFO: `/v3/projects/9ba5cfda031f413884ab07a66efff361/users/5d0f97d002b3421cb6df1e0b9ec13319/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.317169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba5cfda031f413884ab07a66efff361, user_id=5d0f97d002b3421cb6df1e0b9ec13319, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:36.323292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:36.441014 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1194/2405] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:36.442624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:36.446636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:36.486189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b6166-50eb-4a14-9e04-b2527a0d1148 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:36.496541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:36.500842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.500842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.500842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] PATH_INFO: `/v3/projects/07aec6f307a245169888f093a68bcca9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.504599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07aec6f307a245169888f093a68bcca9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:36.509720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:36.541785 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1212/2406] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:36 2022] PUT /identity/v3/projects/9ba5cfda031f413884ab07a66efff361/users/5d0f97d002b3421cb6df1e0b9ec13319/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:36.543658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:36.768498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07aec6f307a245169888f093a68bcca9', 'request_id': 'req-2e43ab10-e83c-42ee-8a6c-d667df0e646c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:36.775698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9073013-be35-42ad-86eb-8875578f0698 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:36.795447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07aec6f307a245169888f093a68bcca9', 'request_id': 'req-2e43ab10-e83c-42ee-8a6c-d667df0e646c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:36.814601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07aec6f307a245169888f093a68bcca9', 'request_id': 'req-2e43ab10-e83c-42ee-8a6c-d667df0e646c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:36.925472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:36.926505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.927209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.927827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:36.929954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:36.930732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:36.934471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be895-0bc6-48ae-811c-c1bb097f712d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:36.970734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] The token cache is being invalidate because project 07aec6f307a245169888f093a68bcca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:36.971227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:36.972150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:36.976041 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1195/2407] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:36 2022] DELETE /identity/v3/projects/07aec6f307a245169888f093a68bcca9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:36.978243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:36.983501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1213/2408] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:36.983895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:36.984088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284470d-6a52-4c54-9412-665946361038 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:36.984088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284470d-6a52-4c54-9412-665946361038 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:36.984088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284470d-6a52-4c54-9412-665946361038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.016244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43ab10-e83c-42ee-8a6c-d667df0e646c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.027023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:37.029214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.035048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.035048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] PATH_INFO: `/v3/projects/d46af312da444babba7e71a9891196b0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.035048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46af312da444babba7e71a9891196b0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:37.036492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a284470d-6a52-4c54-9412-665946361038 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:37.036809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:37.041910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a284470d-6a52-4c54-9412-665946361038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.060171 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1214/2409] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:37.062741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284470d-6a52-4c54-9412-665946361038 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:37.065846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a284470d-6a52-4c54-9412-665946361038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.162312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:37.257264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284470d-6a52-4c54-9412-665946361038 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.284580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46af312da444babba7e71a9891196b0', 'request_id': 'req-b8034899-e439-4f78-8c3f-7936f3949eed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:37.308617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46af312da444babba7e71a9891196b0', 'request_id': 'req-b8034899-e439-4f78-8c3f-7936f3949eed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:37.327264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46af312da444babba7e71a9891196b0', 'request_id': 'req-b8034899-e439-4f78-8c3f-7936f3949eed'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:37.440018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] The token cache is being invalidate because project d46af312da444babba7e71a9891196b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:37.440620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:37.441819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:37.444409 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1196/2410] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:36 2022] DELETE /identity/v3/projects/d46af312da444babba7e71a9891196b0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:37.446021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:37.448243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.451616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:37.452945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.453434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.453938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.457672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.528793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:37.605983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8034899-e439-4f78-8c3f-7936f3949eed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.614581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:37.617894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:37.622678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:37.626792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.627540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.628160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.630421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:37.634392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ef79c-b3f0-45b3-b446-2ed3814e3887 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:37.650639 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1215/2411] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:37.650639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:37.650639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.659177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1197/2412] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:37.662995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.662995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.662995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.671265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5362ad-258f-42f5-be66-0d6f4ba81791 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.696255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:37.697277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.697779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.699806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.701569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:37.707441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1b45-56ef-4e6b-aa7e-4fbda6096761 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:37.718099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:37.722773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.752350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1198/2413] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:37.755500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:37.757487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:37.831923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b8d1-8d69-42fd-a905-9e6a9226b025 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.843444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:37.845852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.846501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.847048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.849313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:37.849961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:37.854470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:37.874763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1216/2414] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:37 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:37.879735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:37.880170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:37.883515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:37.892287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1199/2415] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:37.892287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:37.911064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2267-dfd9-4337-90ad-a15b8754e82e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:37.945631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:37.948099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:38.063734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:38.065747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.066238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.066740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] PATH_INFO: `/v3/projects/9ba5cfda031f413884ab07a66efff361/users/5d0f97d002b3421cb6df1e0b9ec13319/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.070975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:38.071547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba5cfda031f413884ab07a66efff361, user_id=5d0f97d002b3421cb6df1e0b9ec13319, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:38.077298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9417869-d98d-49eb-a5ff-c42d54b47528 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:38.101182 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1200/2416] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:37 2022] PUT /identity/v3/projects/9ba5cfda031f413884ab07a66efff361/users/5d0f97d002b3421cb6df1e0b9ec13319/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:38.103780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.104278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.104768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.110616 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1217/2417] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:38.112369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:38.138454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248b044-721e-4eb5-a156-468eecf0bce1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:38.179332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:38.182747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:38.280646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:38.281445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.281733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.282530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.283872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:38.287871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aefa6-ca8c-4f2e-8859-7ce77e1c886b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:38.346938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1201/2418] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:38.355603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:38.372510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f004c5-d7c4-4ef4-af61-1f6ad484c60a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:38.382017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:38.383067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.383574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.384009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.384762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:38.387503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd02b6-9a56-46d8-96bb-9fbeee683160 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:38.416925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:38.482663 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1218/2419] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/users => generated 296 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:38.484886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.485504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.485886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.561496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1202/2420] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:38.561496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.561496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.561496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.571180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:38.579776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:38.670708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] MFA Rules not processed for user `5d0f97d002b3421cb6df1e0b9ec13319`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:38.681727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:38.868954 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1219/2421] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:38.871180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:38.908273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee8934-efea-4873-8a44-c5769fdebdbe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:38.927982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:38.931797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:38.933749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:38.940237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:38.941739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:38.942339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:38.946591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:38.954033 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1203/2422] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:38.956543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:38.996848 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1220/2423] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:38.999277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:39.011748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd4e3-446d-413c-bef1-e48bd4409425 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:39.023709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccd47c-0b07-433c-a208-5b795ef2ce9b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:39.034325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:39.038155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:39.038919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:39.039591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:39.044587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:39.051366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:39.053086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:39.054428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:39.055108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:39.055879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:39.057855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:39.071359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:39.084066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1204/2424] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:39.086166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:39.122993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c3bbe-ff0b-4b48-80c2-8c2ab864e91b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:39.143039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:39.143039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:39.143039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:39.143039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:39.144349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:39.144749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:39.159834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:39.211921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1205/2425] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:39.213928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:39.245145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5ec9-a1d2-4af0-b9f7-9c92b577b707 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:39.265045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:39.267599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:39.270995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:39.270995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] PATH_INFO: `/v3/users/6c10af61f60e469299f8f39d3fcb3cf8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:39.274880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c10af61f60e469299f8f39d3fcb3cf8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:39.279259 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1221/2426] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:38 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:39.280983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:39.286056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:39.341096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc6817-8f5d-41ac-b1b5-d6e6bbe951ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:39.373376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:39.375044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:39.376482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:39.380107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:39.385657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:39.405625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:39.733193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c10af61f60e469299f8f39d3fcb3cf8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:39.747579 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1222/2427] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:39 2022] POST /identity/v3/projects => generated 375 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:39.753591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:39.856227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c10af61f60e469299f8f39d3fcb3cf8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:39.878991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c10af61f60e469299f8f39d3fcb3cf8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:39.927402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:39.932758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c10af61f60e469299f8f39d3fcb3cf8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:39.935960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c10af61f60e469299f8f39d3fcb3cf8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:39.988469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1206/2428] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:39 2022] DELETE /identity/v3/users/6c10af61f60e469299f8f39d3fcb3cf8 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:39.995041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:40.005836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:40.081598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fad61-749a-4bee-bbac-e0986be4ad9e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:40.119657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:40.244460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7707dc-70c1-4e5f-9172-9f17bd59c06f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:40.255820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:40.257783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:40.259653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:40.260126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:40.261493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:40.267323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c93a83-ac16-47fe-aba3-c3b8adfbfc50 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:40.340773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:40.342069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:40.342563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:40.343044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:40.345557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:40.348890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:40.382952 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1223/2429] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 630 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:40.382952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:40.387274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:40.424252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325962b-5b1a-428e-8036-65442552279f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:40.435249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:40.436433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:40.436917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:40.437403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:40.438686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:40.442020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:40.467861 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1224/2430] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:40.469961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:40.473783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:40.510564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1abd0-0d95-4764-84eb-62e98e7bcd0a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:40.543356 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1207/2431] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:39 2022] POST /identity/v3/projects => generated 409 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:40.554592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:40.555761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:40.556184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:40.557868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:40.558312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:40.559980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:40.560197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:40.561545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:40.565562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:40.647705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:40.650136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:40.711878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1225/2432] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:40 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:40.719252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:40.727497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:40.776304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4cd8-7ec5-41fd-a5ed-ea9c2774bb15 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:40.940144 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1208/2433] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:40.949248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:40.998350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead946d7-1c2b-4139-9520-2d52cf8e00b4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:41.015329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.016492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.017121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.017457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.018945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.021815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.078807 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1209/2434] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:41.081105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:41.094258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.100769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.105706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.116536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] PATH_INFO: `/v3/projects/7e024c248dfa402e9aa19677dd749c9f/users/7caebe70d8da45aebdeeae629801512c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.117097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c68bdd-04ca-4e2e-8f82-3a3b91d0bdef admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:41.128076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.129603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.130869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.131001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.133589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.138714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.165203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e024c248dfa402e9aa19677dd749c9f, user_id=7caebe70d8da45aebdeeae629801512c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.176609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.383942 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1210/2435] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:41 2022] POST /identity/v3/users => generated 305 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:41.385745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:41.414585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0276ca-8d8b-4044-9ea4-7ab50958a831 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:41.426747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.427745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.428893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.429472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.431315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.433169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.459738 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1211/2436] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:41.459738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:41.463314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:41.535212 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1226/2437] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:40 2022] PUT /identity/v3/projects/7e024c248dfa402e9aa19677dd749c9f/users/7caebe70d8da45aebdeeae629801512c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:41.535212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:41.710663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:41.733000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3b15-df15-4050-b57c-0b145fd7ba43 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:41.833852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:41.879383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab329cb-d6f0-4639-bc91-154a49a77e33 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:41.910160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.916194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.917139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:41.917902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.918450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:41.918938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:41.919793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] PATH_INFO: `/v3/projects/19852e5be0134b85b65b3f01c020394c/users/d93088e254a74036bec6235eaa3ed535/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.920630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:41.962282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.964340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19852e5be0134b85b65b3f01c020394c, user_id=d93088e254a74036bec6235eaa3ed535, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:41.965648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.972738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621e25-3bf9-4a06-9b49-822efae368e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:41.989974 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1212/2438] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:41.993005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.024218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0455-3eb1-435e-8e94-9dab38abc8fb service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:42.035728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:42.036866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.037425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.039419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.040747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:42.045744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:42.073832 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1213/2439] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:42.075789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.099624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90f78a-1857-4a67-a00d-66061dd25817 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:42.103690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1227/2440] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:41 2022] PUT /identity/v3/projects/19852e5be0134b85b65b3f01c020394c/users/d93088e254a74036bec6235eaa3ed535/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:42.111314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.113582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.114494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.249426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] MFA Rules not processed for user `7caebe70d8da45aebdeeae629801512c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:42.257926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:42.313900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:42.314600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.314877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.315390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.316687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:42.320558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:42.345946 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1214/2441] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:42.349680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.376885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f3691-b3c9-4495-a67d-1f7d838b5782 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:42.389838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:42.400747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.400747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.400747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.400747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:42.400747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf148a61-3b5c-44df-a6a2-359a4e4d8793 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:42.446645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1215/2442] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:42.450026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.451018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.451637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.514433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] MFA Rules not processed for user `d93088e254a74036bec6235eaa3ed535`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:42.516641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:42.532088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1228/2443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:42.533527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.559576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5e820-19fa-4cca-a2fb-7618ba951f04 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:42.571640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:42.572942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.573429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.573973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] PATH_INFO: `/v3/projects/72fd3d8d5fca4e68bec5464c85a0acbc/users/44d6e033a13c4724a8c5827cc65861f4/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.626848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fd3d8d5fca4e68bec5464c85a0acbc, user_id=44d6e033a13c4724a8c5827cc65861f4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:42.655958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:42.748740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1216/2444] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:42.750409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.789902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da02a3e-6799-4b62-9674-31f6949017b4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:42.824818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:42.830674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:42.831571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:42.833524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] PATH_INFO: `/v3/projects/2b0c9c6a4aa448cca9a86ffe7484ec99/users/18c239f3dc7642d68104932b9e740c40/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:42.840679 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1229/2445] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:42 2022] PUT /identity/v3/projects/72fd3d8d5fca4e68bec5464c85a0acbc/users/44d6e033a13c4724a8c5827cc65861f4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:42.842133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:42.906223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c9c6a4aa448cca9a86ffe7484ec99, user_id=18c239f3dc7642d68104932b9e740c40, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:42.918818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:43.119881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1217/2446] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:42 2022] PUT /identity/v3/projects/2b0c9c6a4aa448cca9a86ffe7484ec99/users/18c239f3dc7642d68104932b9e740c40/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:43.124294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:43.160010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9cdd-22d7-4955-8f0f-746da8a79318 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:43.210675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:43.264072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:43.425865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1566-533f-473a-ac5a-f39c9f0fbf19 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:43.440006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:43.441249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:43.441738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:43.442370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:43.443014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:43.445492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:43.449290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:43.449731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:43.450220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d14140-b7c4-49df-ad70-d10ca18e1f8f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:43.450395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:43.451370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:43.463780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959211ed-cd44-4bb5-8f26-b9ecfb61893f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:43.621159 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1218/2447] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:43 2022] POST /identity/v3/projects => generated 383 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:43.623746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:43.624233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:43.624734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:43.638809 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1230/2448] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:42 2022] POST /identity/v3/projects => generated 391 bytes in 793 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:43.642328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:43.644375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:43.644987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:43.718891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] MFA Rules not processed for user `44d6e033a13c4724a8c5827cc65861f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:43.719525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:43.721586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:43.724506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:43.941580 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1219/2449] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:43.943836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:43.965251 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1231/2450] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:43.965251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:43.972801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d048a-2b6c-4696-83dc-ab456d8ac461 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:43.989737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:43.992473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:43.993364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:43.995343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:44.000569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:44.001648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4a24-afcc-4ece-ad68-6b682ad609ac None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:44.005243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:44.022542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:44.024015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:44.024530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:44.025038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:44.032724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:44.037720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:44.208290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1232/2451] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:43 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:44.212809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:44.216272 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1220/2452] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:43 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:44.219088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:44.220869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:44.265579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d30e-2127-403c-a978-d1fd9b4a3aa9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:44.292820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:44.292820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:44.292820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:44.292820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:44.294051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:44.300361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:44.550686 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1221/2453] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:44 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:44.552295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:44.575117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:44.728315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5add-da08-4282-aee3-b9f53b63aee0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:44.871103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:44.883850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:44.908645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab16a-a263-493f-a8da-e88c04fc8fe7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:44.947220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:44.948401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:44.948907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:44.949402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.001001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:45.008328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.008328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.008328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.008328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:45.044820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.049652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.082957 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1233/2454] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:45.085505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.189874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.207762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.246346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1222/2455] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:45.247932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.278133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c71c-8fa6-4e12-8f6f-ad8bde958897 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:45.300159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:45.301708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.302503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.303513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.305486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.320062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.326486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d78261-6495-4033-98f8-96ffb4730a98 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:45.349816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:45.356880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.357552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.358680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.359924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.363757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.385717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1223/2456] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:45.387537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.390860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:45.411881 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1234/2457] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:45.414515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.444194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb806-fb79-4f82-8e4b-8871063f6051 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:45.448516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aa504-4c4a-47c7-a0b2-5f93b337c782 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:45.458341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:45.464389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:45.465892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.467754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.468967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] PATH_INFO: `/v3/projects/78c640291eab426784b1a3104044d278` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.470101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.470615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.471123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.472431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c640291eab426784b1a3104044d278)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.472644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:45.476616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865e741-9be0-48a1-84b6-86065f2afbc1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.478121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:45.625511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1235/2458] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:45 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:45.628244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:45.629018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:45.629330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:45.708274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] MFA Rules not processed for user `e8c306ba0e2a4e2e8f2ca22d3cef384c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:45.710608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:45.741569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c640291eab426784b1a3104044d278', 'request_id': 'req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:45.771864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c640291eab426784b1a3104044d278', 'request_id': 'req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:45.798269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c640291eab426784b1a3104044d278', 'request_id': 'req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:45.918560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1236/2459] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:45.919542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.938558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] The token cache is being invalidate because project 78c640291eab426784b1a3104044d278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:45.939193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:45.940516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:45.948390 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1224/2460] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:45 2022] DELETE /identity/v3/projects/78c640291eab426784b1a3104044d278 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:45.948390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:45.955027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:46.019407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:46.183389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77ceb-edfb-4285-bb59-01fcd0f58ed1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:46.203504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:46.205143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.207869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.208859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] PATH_INFO: `/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2/users/aa74dd7fba5a467eb147229e77a0f25a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.217318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b49a-ce5d-4751-9c63-c2c9f64cc764 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:46.241651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:46.242239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.242751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.243298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] PATH_INFO: `/v3/projects/c54487ab9dcb489f9747eacc705b1f80/users/b9bd70c087d24d63b46bea8069f076b5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.262360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:46.275449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102b4fb7ac5e4cfdb2affbecc59ecbb2, user_id=aa74dd7fba5a467eb147229e77a0f25a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:46.290812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:46.320870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54487ab9dcb489f9747eacc705b1f80, user_id=b9bd70c087d24d63b46bea8069f076b5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:46.327091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743632-7698-4748-a23c-1ca9b411ac7e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:46.470965 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1225/2461] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:45 2022] PUT /identity/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2/users/aa74dd7fba5a467eb147229e77a0f25a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:46.477009 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1237/2462] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:45 2022] PUT /identity/v3/projects/c54487ab9dcb489f9747eacc705b1f80/users/b9bd70c087d24d63b46bea8069f076b5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:46.477545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:46.477757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.480490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.480490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.486254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:46.563537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] MFA Rules not processed for user `6a310d2bd16e4d52841042364253a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:46.565872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:46.753858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6be98c-abb2-4570-9f4f-2bbc936185f4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:46.768002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:46.769942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.770918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.772305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.774177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:46.778012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:46.799902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1238/2463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:46.806097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:46.808502 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1226/2464] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:46.812276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:46.814795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:46.837544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334587-a029-4530-9fda-82b09a72ab03 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:46.850789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:46.852809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.854700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.854700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.855972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:46.860933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:46.869521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bbf43-542a-47df-92f9-3cb44f81076e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:46.900839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:46.902811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:46.902811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:46.903256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] PATH_INFO: `/v3/users/5d0f97d002b3421cb6df1e0b9ec13319` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:46.916582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0f97d002b3421cb6df1e0b9ec13319)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:46.922858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:46.926253 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1227/2465] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:46.928832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:46.940011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:46.986521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634079-b17e-4988-b757-59cfa7d22ac5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:47.009517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:47.010912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:47.012506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:47.012506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:47.013278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:47.017771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:47.046598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1228/2466] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:47.048130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:47.070223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ab91-8a0d-4fc1-837c-941f8af0aa6b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:47.079631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:47.081289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:47.081784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:47.082271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] PATH_INFO: `/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0/users/189fbf9e29d543b4b6bd4054e8528e21/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:47.120480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ea20dea7ca43c8bbcbaf31de72a4f0, user_id=189fbf9e29d543b4b6bd4054e8528e21, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:47.137195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:47.307205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1229/2467] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:47 2022] PUT /identity/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0/users/189fbf9e29d543b4b6bd4054e8528e21/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:47.310213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:47.314647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:47.352289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0f97d002b3421cb6df1e0b9ec13319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:47.354089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0f97d002b3421cb6df1e0b9ec13319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:47.498557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0f97d002b3421cb6df1e0b9ec13319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:47.568261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0f97d002b3421cb6df1e0b9ec13319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:47.600083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0f97d002b3421cb6df1e0b9ec13319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:47.616196 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1239/2468] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:46 2022] DELETE /identity/v3/users/5d0f97d002b3421cb6df1e0b9ec13319 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:47.623219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:47.626570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:47.634384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b195-bf08-41f2-aa74-c5d1ce93b0f7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:47.701033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:47.775011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:47.800009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5df29-4b72-4b21-a4bc-371f03e5b4a0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:47.809757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:47.810576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:47.810886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:47.811646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] PATH_INFO: `/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2/users/aa74dd7fba5a467eb147229e77a0f25a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:47.815703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102b4fb7ac5e4cfdb2affbecc59ecbb2, user_id=aa74dd7fba5a467eb147229e77a0f25a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:47.822573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:47.883178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1240/2469] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:47 2022] PUT /identity/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2/users/aa74dd7fba5a467eb147229e77a0f25a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:47.883178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:47.883178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:47.920923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:47.922469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:47.923010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:47.923570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:47.927100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:48.106291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58dc69-4377-4558-a26e-60c039de9539 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:48.118184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:48.121524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:48.124090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:48.126216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.127024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.130572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] PATH_INFO: `/v3/projects/c54487ab9dcb489f9747eacc705b1f80/users/b9bd70c087d24d63b46bea8069f076b5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.140800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54487ab9dcb489f9747eacc705b1f80, user_id=b9bd70c087d24d63b46bea8069f076b5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:48.146503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1230/2470] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 837 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:48.150073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:48.154685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:48.160511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7b90f-833a-4825-a7e7-7192d371b1c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:48.197473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d35cba-189b-4adf-9cc0-bb571bad44e9 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:48.233684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1241/2471] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:47 2022] PUT /identity/v3/projects/c54487ab9dcb489f9747eacc705b1f80/users/b9bd70c087d24d63b46bea8069f076b5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:48.238171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.239013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.240517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.372583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] MFA Rules not processed for user `aa74dd7fba5a467eb147229e77a0f25a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:48.375657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:48.382668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:48.384079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.384543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.385295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.387045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:48.411639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d938-d519-4558-aad0-1da90568a8c1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:48.454637 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1231/2472] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:48.457766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4af7-9254-4dcf-9424-a9516b31c3cb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.458441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4af7-9254-4dcf-9424-a9516b31c3cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.459318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4af7-9254-4dcf-9424-a9516b31c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.546731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c15b4af7-9254-4dcf-9424-a9516b31c3cb None None] MFA Rules not processed for user `b9bd70c087d24d63b46bea8069f076b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:48.550537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c15b4af7-9254-4dcf-9424-a9516b31c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:48.709313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1242/2473] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:48.709313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:48.736025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee87907-051c-42f5-847e-a87f736dcdfa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:48.755600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:48.758112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.759069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.759935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] PATH_INFO: `/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0/users/189fbf9e29d543b4b6bd4054e8528e21/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.765579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ea20dea7ca43c8bbcbaf31de72a4f0, user_id=189fbf9e29d543b4b6bd4054e8528e21, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:48.772022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b893b52-c3ab-434a-a19d-b19ec28f480b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:48.819721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1243/2474] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:48 2022] PUT /identity/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0/users/189fbf9e29d543b4b6bd4054e8528e21/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:48.822385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589175db-d060-4c2e-8c2e-c390859f01e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.826736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589175db-d060-4c2e-8c2e-c390859f01e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.838434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589175db-d060-4c2e-8c2e-c390859f01e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.885585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:48.918697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-589175db-d060-4c2e-8c2e-c390859f01e3 None None] MFA Rules not processed for user `7caebe70d8da45aebdeeae629801512c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:48.918969 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1232/2475] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:48.923381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:48.924298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:48.924815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:48.925312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-589175db-d060-4c2e-8c2e-c390859f01e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.019834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:49.047109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] MFA Rules not processed for user `189fbf9e29d543b4b6bd4054e8528e21`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:49.049476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.187218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1244/2476] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:49.189630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.190697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.192859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:33:49.221431 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:33:49.223193 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:33:49.227638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1245/2477] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:33:49 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:33:49.263574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1233/2478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:49.282087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:49.306014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:49.309321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.345751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955696-a075-4e0f-8e0b-147aba61af5a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:49.355487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:49.357061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.357350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.357891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.359323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:49.360109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:49.363599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305a804-1b44-40fb-9884-6b88e05e3ec2 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:49.430100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1246/2479] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:49.433583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.434158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.434638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.471024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] MFA Rules not processed for user `6a310d2bd16e4d52841042364253a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:49.473603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.576210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231763-2c6e-41b8-b398-eecfe7099dc0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:49.613135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:49.613135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.613135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.618806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.637711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1247/2480] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:49.637711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:49.644715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.696201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3796b-dc79-4975-9660-1863b410a2ca None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:49.715333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:49.726722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.726722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.726722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.726722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:49.757797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:49.770553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:49.827189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1248/2481] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:49.828824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:49.868478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:49.870483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e108d9-146d-41a5-a80a-e50565f34e7e service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:49.874425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:49.903638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:49.905217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:49.907109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:49.908017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:49.910886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:49.917350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:49.925060 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1234/2482] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:33:49.967091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:49.980193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:50.065794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:50.150425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1249/2483] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:49 2022] POST /identity/v3/projects => generated 369 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:50.159031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:50.290137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcabd2c-821c-40a3-bc95-9441271f1f77 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:50.366724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f988d7-0243-4d47-9f7e-1f2374fc79bd tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:50.381047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:50.383440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:50.387500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:50.388727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:50.390583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:50.391004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:50.400672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ab90b-39bc-4c01-98a4-a80018af55df tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:50.472623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1250/2484] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:33:50.511483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:50.515958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:50.519901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:50.520543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] PATH_INFO: `/v3/projects/9ba5cfda031f413884ab07a66efff361` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:50.525563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba5cfda031f413884ab07a66efff361)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:50.536249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:50.774882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba5cfda031f413884ab07a66efff361', 'request_id': 'req-dcef6b6c-7b02-4e42-8396-86940ef50c34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:50.793600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba5cfda031f413884ab07a66efff361', 'request_id': 'req-dcef6b6c-7b02-4e42-8396-86940ef50c34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:50.808690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba5cfda031f413884ab07a66efff361', 'request_id': 'req-dcef6b6c-7b02-4e42-8396-86940ef50c34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:50.980567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] The token cache is being invalidate because project 9ba5cfda031f413884ab07a66efff361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:50.981367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:50.982861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcef6b6c-7b02-4e42-8396-86940ef50c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:51.010536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1235/2485] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:49 2022] DELETE /identity/v3/projects/9ba5cfda031f413884ab07a66efff361 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:51.020491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.031406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.031817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.088632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:51.101671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:51.149805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:51.370126 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1251/2486] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:51.378895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.379396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.379841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.445752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:51.448777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:51.478198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:51.483005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:51.489770 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1236/2487] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:51.492279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:51.524957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271b37-648d-4ddb-80e5-a43131ab7f41 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:51.542151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbf208-54d8-46c2-bf15-0f255aabf4fd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:51.552050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:51.553675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.554377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.555216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.556674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:51.557436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:51.565276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:51.568745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:51.573531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.574393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.574912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] PATH_INFO: `/v3/users/d93088e254a74036bec6235eaa3ed535` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.581260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93088e254a74036bec6235eaa3ed535)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:51.586785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:51.618327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1237/2488] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:51.624927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:51.657915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabd3be-702f-469c-90d3-a116e84c61a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:51.677038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:51.678442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.679103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.679750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.681096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:51.689673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c4a95-dfe9-4927-bc01-18c03a99a221 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:51.942492 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1238/2489] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:51 2022] POST /identity/v3/projects => generated 389 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:51.944971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:51.945823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:51.946425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:33:51.978152 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:33:51.980165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:33:51.993892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1239/2490] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:33:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:33:51.999171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:52.092140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93088e254a74036bec6235eaa3ed535'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:52.095980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93088e254a74036bec6235eaa3ed535'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:52.109865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:52.206286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93088e254a74036bec6235eaa3ed535'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:52.288831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93088e254a74036bec6235eaa3ed535'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:52.335979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93088e254a74036bec6235eaa3ed535'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:52.360202 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1252/2491] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:51 2022] DELETE /identity/v3/users/d93088e254a74036bec6235eaa3ed535 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:52.362266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:52.369459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:52.409969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d845b-45e5-46f0-9168-4cbe4de7ff29 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:52.655380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:52.656464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:52.656973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:52.657453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:52.658764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:52.662723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105fe41-322c-432f-8d25-323700ba3bb0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:52.729994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ec9b-6c3e-4674-b524-557856028c1d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:52.745365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:52.747119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:52.753451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:52.757659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:52.768046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:52.908426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:52.934364 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1240/2492] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:51 2022] POST /identity/v3/users => generated 295 bytes in 939 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:52.945655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:52.949681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:52.950866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.024515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:53.029335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:53.054819 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1241/2493] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:53.062131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:53.067330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:53.162657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.162657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:53.164386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2f7a-a2a1-48b7-8316-967a59a7860f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:53.188315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:53.189860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.191003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.191991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.192334 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1253/2494] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:53.193463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.196869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8f0f-8733-4854-979a-5927a861081e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:53.200352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:53.208510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:53.260532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1242/2495] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:53.263423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9779d-2eb7-4473-9133-3ec461e98a70 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.264007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9779d-2eb7-4473-9133-3ec461e98a70 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.264764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9779d-2eb7-4473-9133-3ec461e98a70 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.270754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1243/2496] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:53.273227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9779d-2eb7-4473-9133-3ec461e98a70 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:53.321029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9779d-2eb7-4473-9133-3ec461e98a70 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:53.334512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:53.334512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.334512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.334512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.335203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.338769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:53.372519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1244/2497] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:53.372519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:53.421193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:53.454557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614dee6-8f1a-4735-91b6-d40c1927f216 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:53.484163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190acae-f645-4ff9-a27c-fa13414a47bf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:53.500522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:53.501724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.502246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.502765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.524665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:53.525877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.526395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.526908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects/918e21966ac14f409e5c6c6e45e50df4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.536658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:get_project(project_id=918e21966ac14f409e5c6c6e45e50df4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.552675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:53.581575 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1245/2498] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:53 2022] GET /identity/v3/projects/918e21966ac14f409e5c6c6e45e50df4 => generated 369 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:53.591674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.594701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85095191-9928-44b1-b881-fa3dab4bf9c7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:53.596641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:53.683485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a26c4-76dd-40df-a857-84cb54afe4ad tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:53.690820 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1254/2499] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:53.711509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:53.713459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:53.713964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:53.714465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] PATH_INFO: `/v3/projects/0ce28e97c59642e2b8a1ca1739dd77e9/users/7a6bea26a6a64bd5b6b87b2e87249f65/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:53.783218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce28e97c59642e2b8a1ca1739dd77e9, user_id=7a6bea26a6a64bd5b6b87b2e87249f65, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:53.793928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:54.012162 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1246/2500] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:53 2022] PUT /identity/v3/projects/0ce28e97c59642e2b8a1ca1739dd77e9/users/7a6bea26a6a64bd5b6b87b2e87249f65/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:54.013453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7f30-d6d7-40a6-b945-e7adf6e3f93c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:54.014189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7f30-d6d7-40a6-b945-e7adf6e3f93c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:54.014693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a7f30-d6d7-40a6-b945-e7adf6e3f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:54.134942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-200a7f30-d6d7-40a6-b945-e7adf6e3f93c None None] MFA Rules not processed for user `7a6bea26a6a64bd5b6b87b2e87249f65`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:54.138572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-200a7f30-d6d7-40a6-b945-e7adf6e3f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:54.479201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1255/2501] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:54.482163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:54.591259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:54.591776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:54.593225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:54.596182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1256/2502] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:33:54.624689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:54.858663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35369c-f657-4bdd-9728-a08b7419a804 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:54.884118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:54.885893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:54.886392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:54.886778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:54.887955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:54.901739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:55.048385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:55.149737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1247/2503] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:33:54 2022] POST /identity/v3/projects => generated 389 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:55.157709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:55.164755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:55.207672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:55.276034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156f37-31d7-46a5-a60a-7ba8c3a0cea5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:55.498452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223404-80a6-4d15-af6c-245d2f04e689 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:55.523737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:55.525687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:55.526473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:55.527807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:55.534054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:55.534401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:55.535953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:55.536485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:55.536856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects/918e21966ac14f409e5c6c6e45e50df4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:55.544796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:get_project(project_id=918e21966ac14f409e5c6c6e45e50df4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:55.549249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:55.565080 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1257/2504] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:54 2022] GET /identity/v3/projects/918e21966ac14f409e5c6c6e45e50df4 => generated 369 bytes in 941 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:33:55.583401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:55.624405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:55.636575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:55.706071 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1248/2505] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:55.782192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:55.822234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d52cfd-986d-440a-80dd-85da3538e0f0 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:55.864598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:55.867672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:55.870533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:55.872628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:55.874232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:55.878432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:55.888305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:55.911119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026895af-c8e8-4875-8446-7b45df784cb8 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:55.934731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:55.936228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:55.936570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:55.955414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:55.957727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:55.973493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:55.992990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1249/2506] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:33:56.004858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:56.034225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c99-43a9-45ce-a9fa-053cd7877aab tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:56.061065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:56.062490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:56.063093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:56.063745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:56.065074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:56.086898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:56.189550 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1258/2507] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:55 2022] POST /identity/v3/users => generated 301 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:33:56.197107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:56.228292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de67b3e-3fc9-4874-90d9-249a2691ed6a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:56.266508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:56.269761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:56.274421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:56.276747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:56.280990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:56.290408 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1250/2508] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:33:55 2022] POST /identity/v3/users => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:33:56.310473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:56.310843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:56.345681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:56.376256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1259/2509] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:33:56.378354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:56.387630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de19e-99dc-4395-af86-e24bdfb09264 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:56.400492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cd2a4-3a53-4c24-95f9-906be5a473a7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:56.411011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:56.412836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:56.414209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:56.414719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] PATH_INFO: `/v3/projects/49bdc59ee521478a9991fc5270782eaf/users/154021a8f0104c57acc0299921057fa5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:56.445196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:56.450690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:56.451331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:56.451842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:56.453168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:33:56.453716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:56.458509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:56.486088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bdc59ee521478a9991fc5270782eaf, user_id=154021a8f0104c57acc0299921057fa5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:56.495803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bc788-8eaf-4ab7-8b7b-652dceb0e3fb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:56.500410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1251/2510] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:56.670030 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1260/2511] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:56 2022] PUT /identity/v3/projects/49bdc59ee521478a9991fc5270782eaf/users/154021a8f0104c57acc0299921057fa5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:56.671549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:56.735713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70433de7-681f-497b-94cb-f3b08d730aa0 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:56.790095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:56.791268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:56.791268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:56.795220 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1261/2512] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:33:56.822501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:57.122383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:57.123526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:57.124034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:57.124540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:57.125816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:57.129180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:57.215758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1252/2513] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:33:57.216026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:57.218590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:57.241158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:57.285978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d659b7-e08f-486b-967d-800392a75319 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:57.322708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:57.335807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:57.336296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:57.336761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] PATH_INFO: `/v3/projects/19852e5be0134b85b65b3f01c020394c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:57.343349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19852e5be0134b85b65b3f01c020394c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:57.349012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:57.350334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:57.395354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:57.566433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd888-2384-4614-86b1-abfc8546198e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:57.594690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:57.601192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:57.601746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:57.602272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects/918e21966ac14f409e5c6c6e45e50df4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:57.619463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:get_project(project_id=918e21966ac14f409e5c6c6e45e50df4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:57.627983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:57.639638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1262/2514] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:56 2022] GET /identity/v3/projects/918e21966ac14f409e5c6c6e45e50df4 => generated 369 bytes in 821 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:57.643508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:57.662853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19852e5be0134b85b65b3f01c020394c', 'request_id': 'req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:57.683062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19852e5be0134b85b65b3f01c020394c', 'request_id': 'req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:57.699928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19852e5be0134b85b65b3f01c020394c', 'request_id': 'req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:57.702874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97d0c-c9e5-49ac-96f1-76a2ed9deb63 tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:57.843438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] The token cache is being invalidate because project 19852e5be0134b85b65b3f01c020394c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:33:57.843879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:57.846652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:57.867247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1253/2515] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:57 2022] DELETE /identity/v3/projects/19852e5be0134b85b65b3f01c020394c => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:57.869802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:57.874196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:57.981887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:57.983186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:57.983737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:57.984263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] PATH_INFO: `/v3/projects/49bdc59ee521478a9991fc5270782eaf/users/154021a8f0104c57acc0299921057fa5/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:57.994833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bdc59ee521478a9991fc5270782eaf, user_id=154021a8f0104c57acc0299921057fa5, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:58.001806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae1c9-95a4-41a4-b529-0aea88e53f12 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:58.053841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1263/2516] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:33:57 2022] PUT /identity/v3/projects/49bdc59ee521478a9991fc5270782eaf/users/154021a8f0104c57acc0299921057fa5/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:58.061517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421489-5f19-4185-9602-c9e4527d25c6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:58.061950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421489-5f19-4185-9602-c9e4527d25c6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:58.062449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421489-5f19-4185-9602-c9e4527d25c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:58.190258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc963e-7afc-4b82-b33e-6ff25e1266b6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:58.208208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fa421489-5f19-4185-9602-c9e4527d25c6 None None] MFA Rules not processed for user `154021a8f0104c57acc0299921057fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:33:58.218558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa421489-5f19-4185-9602-c9e4527d25c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:58.283893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:58.494999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1264/2517] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:33:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:33:58.495981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:58.498508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:58.499395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:58.500224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] PATH_INFO: `/v3/users/b9bd70c087d24d63b46bea8069f076b5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:58.502699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:58.503499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:58.504120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:58.510124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bd70c087d24d63b46bea8069f076b5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:58.515251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:58.518877 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1265/2518] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:33:58 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:33:58.520828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:33:58.524121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:58.804244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:58.809908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:58.928444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:58.933218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bd70c087d24d63b46bea8069f076b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.045440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e221a9-8e7d-46c8-8278-4cfccc7f8e50 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:59.056350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:59.058077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:59.059523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:59.060233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects/918e21966ac14f409e5c6c6e45e50df4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:59.062524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:get_project(project_id=918e21966ac14f409e5c6c6e45e50df4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:59.067326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:59.085996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1266/2519] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:33:58 2022] GET /identity/v3/projects/918e21966ac14f409e5c6c6e45e50df4 => generated 369 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:33:59.137852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bd70c087d24d63b46bea8069f076b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.173673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:59.187326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bd70c087d24d63b46bea8069f076b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.244636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee356cc-5a4a-4f88-89af-6632d7f1f8cc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:59.260575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:59.261897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:59.263380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:59.263380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/users/6b6dc84b26264f21a51252eb86d099a0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:59.268406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bd70c087d24d63b46bea8069f076b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.276352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bd70c087d24d63b46bea8069f076b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.306567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1254/2520] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:57 2022] DELETE /identity/v3/users/b9bd70c087d24d63b46bea8069f076b5 => generated 0 bytes in 1438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:33:59.310037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:33:59.318513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:33:59.399107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6b6dc84b26264f21a51252eb86d099a0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:33:59.404931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:33:59.656617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:59.741409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6dc84b26264f21a51252eb86d099a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.747951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6dc84b26264f21a51252eb86d099a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:33:59.797069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1836-372d-4c2c-aed6-ba3bd0258192 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:33:59.814124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:33:59.815525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:33:59.816035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:33:59.816500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:33:59.821892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:00.008768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6dc84b26264f21a51252eb86d099a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:00.071193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:00.072381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6dc84b26264f21a51252eb86d099a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:00.087579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:00.127298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6dc84b26264f21a51252eb86d099a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:00.152220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1255/2521] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:33:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:00.154713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1267/2522] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:33:59 2022] DELETE /identity/v3/users/6b6dc84b26264f21a51252eb86d099a0 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:00.161371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:00.166060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:00.538439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b92ad-e01b-435c-a389-049372947a57 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:00.748703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189fbf9e29d543b4b6bd4054e8528e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:00.749882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:00.750301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:00.750884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] PATH_INFO: `/v3/projects/918e21966ac14f409e5c6c6e45e50df4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:00.763815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=918e21966ac14f409e5c6c6e45e50df4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:00.767455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:00.786348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:00.986853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918e21966ac14f409e5c6c6e45e50df4', 'request_id': 'req-b32350f4-ade6-4063-aaba-87d5c490b6dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.008289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918e21966ac14f409e5c6c6e45e50df4', 'request_id': 'req-b32350f4-ade6-4063-aaba-87d5c490b6dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.025154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918e21966ac14f409e5c6c6e45e50df4', 'request_id': 'req-b32350f4-ade6-4063-aaba-87d5c490b6dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.193250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] The token cache is being invalidate because project 918e21966ac14f409e5c6c6e45e50df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:01.193601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.194787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.206224 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1256/2523] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:00 2022] DELETE /identity/v3/projects/918e21966ac14f409e5c6c6e45e50df4 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:01.207964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:01.212221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:01.320270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:01.323243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:01.439239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec91295-9d21-4385-81b4-de0af00cf00a tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:01.570908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32350f4-ade6-4063-aaba-87d5c490b6dc tempest-QuotasAdminTestV257-674894266 tempest-QuotasAdminTestV257-674894266-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:01.582709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:01.584118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:01.584713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:01.585212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] PATH_INFO: `/v3/projects/c54487ab9dcb489f9747eacc705b1f80` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:01.596241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54487ab9dcb489f9747eacc705b1f80)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:01.603987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:01.692829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:01.694190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:01.694701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:01.696065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] PATH_INFO: `/v3/users/44d6e033a13c4724a8c5827cc65861f4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:01.697850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d6e033a13c4724a8c5827cc65861f4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:01.702061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:01.814725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54487ab9dcb489f9747eacc705b1f80', 'request_id': 'req-67f12826-21ad-4c5f-8eab-3a015f437a18'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.829012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54487ab9dcb489f9747eacc705b1f80', 'request_id': 'req-67f12826-21ad-4c5f-8eab-3a015f437a18'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.843115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54487ab9dcb489f9747eacc705b1f80', 'request_id': 'req-67f12826-21ad-4c5f-8eab-3a015f437a18'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.994562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] The token cache is being invalidate because project c54487ab9dcb489f9747eacc705b1f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:01.996340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:01.997878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67f12826-21ad-4c5f-8eab-3a015f437a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.002428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1257/2524] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:01 2022] DELETE /identity/v3/projects/c54487ab9dcb489f9747eacc705b1f80 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:02.010811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:02.011715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:02.016284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:02.050222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d6e033a13c4724a8c5827cc65861f4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.051522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d6e033a13c4724a8c5827cc65861f4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.101539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:02.105079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:02.284581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d6e033a13c4724a8c5827cc65861f4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.308931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:02.353034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d6e033a13c4724a8c5827cc65861f4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.382434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:02.393144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7bf61e44-257a-4f7b-8404-6694b6b15d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d6e033a13c4724a8c5827cc65861f4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:02.403036 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1258/2525] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:02.416021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:02.417959 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1268/2526] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:01 2022] DELETE /identity/v3/users/44d6e033a13c4724a8c5827cc65861f4 => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:02.420476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:02.422948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a7d9-38b9-4ad9-98ce-147660c6c55f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:02.423754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a7d9-38b9-4ad9-98ce-147660c6c55f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:02.424273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a7d9-38b9-4ad9-98ce-147660c6c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:02.479409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-52c2a7d9-38b9-4ad9-98ce-147660c6c55f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:02.481840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-52c2a7d9-38b9-4ad9-98ce-147660c6c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:02.695952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12218fcb-7382-4050-afce-ddafd8368ede None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:02.764843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1269/2527] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:02.771564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:02.775652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:02.780167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:02.901302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:02.905041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:02.940464 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1270/2528] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:02.941943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:02.945062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:02.973432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc8cb4-1040-43f6-9b60-900686a5140a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:02.984745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:02.985214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:02.985518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:02.986046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] PATH_INFO: `/v3/users/7a6bea26a6a64bd5b6b87b2e87249f65` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:02.989386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6bea26a6a64bd5b6b87b2e87249f65)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:02.995189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:03.010311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:03.016501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:03.016973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:03.017455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:03.026978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:03.289393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:03.294169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:03.327891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1259/2529] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 925 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:03.330917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:03.358187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf506-a94d-449c-9030-a2f9b749d76b service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:03.370176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:03.371433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:03.372131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:03.372638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:03.373943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:34:03.374543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:03.378637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:03.413397 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1260/2530] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:34:03.414966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:03.418158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:03.583453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af3d7-970e-4859-b117-1a8642986d42 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:03.597902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:03.599187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:03.599902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:03.605629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:03.642777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:03.646069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:03.671965 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1261/2531] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:03.682948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:03.701069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab7269-3c28-48cf-a820-7b886385429c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:03.719422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:03.720665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:03.721189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:03.721689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:03.725533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:03.737096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:03.746138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6bea26a6a64bd5b6b87b2e87249f65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:03.746138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6bea26a6a64bd5b6b87b2e87249f65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:03.893809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6bea26a6a64bd5b6b87b2e87249f65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:03.961596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6bea26a6a64bd5b6b87b2e87249f65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:03.981482 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1262/2532] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:03 2022] POST /identity/v3/projects => generated 391 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:03.987885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:04.003380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-41f3af46-0ead-4fc8-ad46-ccadbb971b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6bea26a6a64bd5b6b87b2e87249f65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:04.022692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1271/2533] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:02 2022] DELETE /identity/v3/users/7a6bea26a6a64bd5b6b87b2e87249f65 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:04.025377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:04.025988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:04.027046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:04.084762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:04.088296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:04.198885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e142f-9433-4454-975a-f7231b79a9f2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:04.365178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1272/2534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:04.397035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:04.399711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:04.473011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:04.528218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:04.531418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:04.532739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:04.533249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:04.538587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:04.548563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:04.647594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc8494-8d06-4e2f-9b69-5055896bfd45 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:04.669264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:04.680092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:04.680092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:04.680092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:04.713087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:04.719174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:04.747441 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1273/2535] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:34:04.781721 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1263/2536] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:03 2022] POST /identity/v3/users => generated 296 bytes in 797 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:04.789288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:04.797798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:04.802846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:04.815863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:04.832447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:04.856123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2527-d1a9-48f2-87e4-40cf6c4a2905 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:04.870220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:04.874569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:04.876652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:04.881875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:04.881875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:04.883442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217798-e4ad-4f28-9829-1e1cfc99c20d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:04.885182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:04.922056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1274/2537] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:34:04.930343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:04.931012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:04.934567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:04.935247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:04.936287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] PATH_INFO: `/v3/projects/72fd3d8d5fca4e68bec5464c85a0acbc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:04.940067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fd3d8d5fca4e68bec5464c85a0acbc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:04.943776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:04.976854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387007-fa09-4b4a-8124-1570e196c6b7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:04.995722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:05.000401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:05.002560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:05.003167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:05.007394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:05.011233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:05.055196 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1275/2538] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:05.063727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:05.108655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdec17-95ec-4a2b-bba7-482e59f591d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:05.130556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:05.134093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:05.144962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:05.146638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] PATH_INFO: `/v3/projects/707eb331f0794935b9cff88e7d1b9960/users/fd8f582bad9b49a2a4fbfbb6bfde30ff/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:05.219385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=707eb331f0794935b9cff88e7d1b9960, user_id=fd8f582bad9b49a2a4fbfbb6bfde30ff, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:05.233349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9308b-ea58-4470-8c22-99562726d78c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:05.329100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fd3d8d5fca4e68bec5464c85a0acbc', 'request_id': 'req-c9ae9edb-5e70-4484-801d-6f9a081c75af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:05.347985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fd3d8d5fca4e68bec5464c85a0acbc', 'request_id': 'req-c9ae9edb-5e70-4484-801d-6f9a081c75af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:05.365846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fd3d8d5fca4e68bec5464c85a0acbc', 'request_id': 'req-c9ae9edb-5e70-4484-801d-6f9a081c75af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:05.382635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1276/2539] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:05 2022] PUT /identity/v3/projects/707eb331f0794935b9cff88e7d1b9960/users/fd8f582bad9b49a2a4fbfbb6bfde30ff/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:05.413412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:05.414112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:05.416522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:05.539490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] The token cache is being invalidate because project 72fd3d8d5fca4e68bec5464c85a0acbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:05.539931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:05.542054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:05.548118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] MFA Rules not processed for user `fd8f582bad9b49a2a4fbfbb6bfde30ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:05.559702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:05.561766 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1264/2540] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:04 2022] DELETE /identity/v3/projects/72fd3d8d5fca4e68bec5464c85a0acbc => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:05.565236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:05.571412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:05.887671 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1277/2541] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:05.891412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:05.898586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:05.956928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9edb-5e70-4484-801d-6f9a081c75af admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:06.136491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462254bb-4a6a-4e72-b7bb-14c993f271d9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:06.180831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:06.182112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:06.182643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:06.183167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:06.184425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:06.200325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:06.214724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:06.217079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:06.218177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:06.219024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] PATH_INFO: `/v3/users/189fbf9e29d543b4b6bd4054e8528e21` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:06.224912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189fbf9e29d543b4b6bd4054e8528e21)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:06.229787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:06.470320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1278/2542] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:05 2022] POST /identity/v3/projects => generated 391 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:06.475597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:06.479914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:06.673347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1916edc-3978-47f8-96c9-8b3af9445cf7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:06.684655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:06.688127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:06.688127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:06.688127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] PATH_INFO: `/v3/projects/0ce28e97c59642e2b8a1ca1739dd77e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:06.690839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce28e97c59642e2b8a1ca1739dd77e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:06.697232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:06.745160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189fbf9e29d543b4b6bd4054e8528e21'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.869594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189fbf9e29d543b4b6bd4054e8528e21'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.906060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189fbf9e29d543b4b6bd4054e8528e21'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.955865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189fbf9e29d543b4b6bd4054e8528e21'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.963039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189fbf9e29d543b4b6bd4054e8528e21'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.975550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1265/2543] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:05 2022] DELETE /identity/v3/users/189fbf9e29d543b4b6bd4054e8528e21 => generated 0 bytes in 1411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:06.977265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce28e97c59642e2b8a1ca1739dd77e9', 'request_id': 'req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:06.978886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:06.982276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:07.091441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce28e97c59642e2b8a1ca1739dd77e9', 'request_id': 'req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.120709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce28e97c59642e2b8a1ca1739dd77e9', 'request_id': 'req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.187247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] The token cache is being invalidate because project 0ce28e97c59642e2b8a1ca1739dd77e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:07.191802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.196693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f1767c3-8d5c-45d5-8cba-e589d336c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.200149 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1279/2544] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:06 2022] DELETE /identity/v3/projects/0ce28e97c59642e2b8a1ca1739dd77e9 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:07.211675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.212476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.213161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.216156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2bb5-f97a-44db-969e-9c02c91c7e38 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:07.237408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:07.240201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.241452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.242346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.245002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:07.252242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:34:07.259341 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:07.261304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:34:07.264485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1280/2545] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:34:07 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:34:07.269138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:07.290204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:07.364431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba71188-eb88-4e2f-993e-57e3cfb0b930 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:07.380533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:07.381970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.382726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.384125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] PATH_INFO: `/v3/users/154021a8f0104c57acc0299921057fa5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.387439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154021a8f0104c57acc0299921057fa5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:07.391404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:07.434657 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1266/2546] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:06 2022] POST /identity/v3/users => generated 302 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:07.460959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:07.463955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:07.512118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4168a-bb6b-492d-9bde-dc5d512a8d9b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:07.525978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:07.527043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.527602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.528027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.537952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:07.542859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:07.574204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1267/2547] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:07.582343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:07.606895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4883b5-6232-4c6f-9c3e-d5c3e2c80e5e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:07.618014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:07.621304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.634040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.635875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] PATH_INFO: `/v3/projects/58981ada7897444a8e277d491b2cc6b7/users/49075c5165d74971938b393dadaecedc/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.707509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58981ada7897444a8e277d491b2cc6b7, user_id=49075c5165d74971938b393dadaecedc, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:07.718575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f43278-5966-4050-a596-d69f332f30c9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:07.844901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154021a8f0104c57acc0299921057fa5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.854391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154021a8f0104c57acc0299921057fa5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:07.889945 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1268/2548] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:07 2022] PUT /identity/v3/projects/58981ada7897444a8e277d491b2cc6b7/users/49075c5165d74971938b393dadaecedc/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:07.897399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:07.898199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:07.898850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:07.994677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154021a8f0104c57acc0299921057fa5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.018785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] MFA Rules not processed for user `4360a08eed56405b99333776285fef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:08.021521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:08.073821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154021a8f0104c57acc0299921057fa5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.109170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154021a8f0104c57acc0299921057fa5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.140905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1281/2549] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:07 2022] DELETE /identity/v3/users/154021a8f0104c57acc0299921057fa5 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:08.145332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:08.151255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:08.154240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:08.211808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1269/2550] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:08.213411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:08.216053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:08.428960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:08.453561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a99e4a-0a12-4cf6-9195-264d45cbf994 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:08.497564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:08.498754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:08.499310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:08.499869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:08.501293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:08.512288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:08.526069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f28ca-1e73-44f6-acc8-44cf50aeabf7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:08.534091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:08.534632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:08.535075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:08.535604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] PATH_INFO: `/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:08.538087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ea20dea7ca43c8bbcbaf31de72a4f0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:08.542096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:08.547082 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1282/2551] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:08.554501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:08.578694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6d0d-9c47-44fe-a5b8-620f3cbc336c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:08.588925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:08.590047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:08.590644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:08.590944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] PATH_INFO: `/v3/projects/58981ada7897444a8e277d491b2cc6b7/users/49075c5165d74971938b393dadaecedc/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:08.600758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58981ada7897444a8e277d491b2cc6b7, user_id=49075c5165d74971938b393dadaecedc, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:08.606192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c1cac-f6c8-4031-a040-d6f77163ca29 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:08.642717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1283/2552] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:08 2022] PUT /identity/v3/projects/58981ada7897444a8e277d491b2cc6b7/users/49075c5165d74971938b393dadaecedc/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:08.653029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a4fb-43e4-44fa-ad2b-5181c8d2420b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:08.654285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a4fb-43e4-44fa-ad2b-5181c8d2420b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:08.655435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a4fb-43e4-44fa-ad2b-5181c8d2420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:08.712177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cbe1a4fb-43e4-44fa-ad2b-5181c8d2420b None None] MFA Rules not processed for user `49075c5165d74971938b393dadaecedc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:08.715860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cbe1a4fb-43e4-44fa-ad2b-5181c8d2420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:08.819903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'request_id': 'req-fd589ca1-b927-4524-b574-7ccae7c60838'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.846153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'request_id': 'req-fd589ca1-b927-4524-b574-7ccae7c60838'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.874303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ea20dea7ca43c8bbcbaf31de72a4f0', 'request_id': 'req-fd589ca1-b927-4524-b574-7ccae7c60838'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:08.931295 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1284/2553] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:34:08.935197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:08.935197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:08.935197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:08.977365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] MFA Rules not processed for user `6a310d2bd16e4d52841042364253a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:08.979695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.006694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] The token cache is being invalidate because project d8ea20dea7ca43c8bbcbaf31de72a4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:09.007706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.009084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd589ca1-b927-4524-b574-7ccae7c60838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.019763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1270/2554] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:08 2022] DELETE /identity/v3/projects/d8ea20dea7ca43c8bbcbaf31de72a4f0 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:09.023576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4aff4-9143-4097-8a55-d96cf23fe736 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.024074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4aff4-9143-4097-8a55-d96cf23fe736 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.024574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4aff4-9143-4097-8a55-d96cf23fe736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.073269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cbd4aff4-9143-4097-8a55-d96cf23fe736 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:09.075642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cbd4aff4-9143-4097-8a55-d96cf23fe736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.134285 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1285/2555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:09.220500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:09.228571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.238102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1271/2556] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:09.261527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.261933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.263025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.280634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eac73-ab1c-49f2-b1ad-2244bc61edaf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:09.292585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:09.295461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.296906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.297494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] PATH_INFO: `/v3/projects/49bdc59ee521478a9991fc5270782eaf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.302046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bdc59ee521478a9991fc5270782eaf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:09.312602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:09.322544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:09.325871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.344371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1272/2557] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:09.354725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:09.374806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8d97-db6d-401d-aa7d-dc1a72d6c253 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:09.385077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:09.386493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.387159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.387762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.389163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:34:09.389796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:09.393935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:09.420219 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1273/2558] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:34:09.428974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:09.450548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6250-f44c-431f-9afb-cbb7bb47c8cb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:09.460397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:09.461623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.462153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.462649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.464177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:09.468604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:09.535642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bdc59ee521478a9991fc5270782eaf', 'request_id': 'req-be9038ca-a7aa-4cdb-af2c-20dce5273a70'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.719975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1274/2559] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:09 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:34:09.719975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:09.725791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bdc59ee521478a9991fc5270782eaf', 'request_id': 'req-be9038ca-a7aa-4cdb-af2c-20dce5273a70'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.727629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.742366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bdc59ee521478a9991fc5270782eaf', 'request_id': 'req-be9038ca-a7aa-4cdb-af2c-20dce5273a70'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.770129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] The token cache is being invalidate because project 49bdc59ee521478a9991fc5270782eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:09.771152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.772703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:09.776146 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1286/2560] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:09 2022] DELETE /identity/v3/projects/49bdc59ee521478a9991fc5270782eaf => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:09.778074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:09.780540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.929356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db440558-965c-4876-8dab-d2b9b7769712 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:09.949199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:09.951736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:09.953165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:09.954848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:09.959742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:09.985190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9038ca-a7aa-4cdb-af2c-20dce5273a70 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.101555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.102533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.103037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.103514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.104753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.109006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.120541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.124201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcba8c3-3660-4361-8ed8-63e81cd3fded service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.141278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1275/2561] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:10.143497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c36cdd-5c6e-4525-a5a6-352037f4a6b5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.144094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c36cdd-5c6e-4525-a5a6-352037f4a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.144566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c36cdd-5c6e-4525-a5a6-352037f4a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.184292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e9c36cdd-5c6e-4525-a5a6-352037f4a6b5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:10.186629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e9c36cdd-5c6e-4525-a5a6-352037f4a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:10.200546 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1276/2562] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:10.211702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.212670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.213271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.266132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:10.282239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:10.285702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1287/2563] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:09 2022] POST /identity/v3/users => generated 287 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:10.294063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.331993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1277/2564] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:10.337064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.346711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df604c8-9671-4658-a4b2-91a5b188f30c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.370488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.373813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.374996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.375554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.376874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.381792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.384881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea146c-66db-40cb-a77c-230ef10a0298 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.402476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.405683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.406710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.409018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.410910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:34:10.413930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.415646 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1288/2565] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:10.417338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.420280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.439426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cda6d2-774d-4938-8d6f-67b064320898 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.450279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.451607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.452153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.452650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.453884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.459926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1278/2566] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:34:10.464491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.469235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.494461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103316-3712-4c69-a785-9b60fe3f17f0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.498416 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1289/2567] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:10.501813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.512450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.516067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.516665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.517089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.523994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.524281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596676d5-70fa-4890-9745-b275b95f1b13 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:10.532290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.533687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:10.535039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.535761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.536999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] PATH_INFO: `/v3/projects/526ce79b3ad7461eb974329c1e567568/users/386f857786474effa6df298d43738c92/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.543882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:10.577072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526ce79b3ad7461eb974329c1e567568, user_id=386f857786474effa6df298d43738c92, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:10.588122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa0049-9cd4-4503-9707-a9225de3ba68 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:10.631047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:10.684991 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1279/2568] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:10 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:10.692912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:10.719284 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1290/2569] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:10 2022] PUT /identity/v3/projects/526ce79b3ad7461eb974329c1e567568/users/386f857786474effa6df298d43738c92/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:10.740487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:10.741248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:10.742393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:10.858032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] MFA Rules not processed for user `386f857786474effa6df298d43738c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:10.862880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:10.909506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8303d3-3b17-4b1b-8d1b-18328864ac70 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.059000 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1291/2570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:11.066552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.110221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.110221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.110824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.111176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.112775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.117225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:11.221727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901291d4-340e-4d32-840a-78826fc5b085 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.231524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.232717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.233222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.233782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.235091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.240686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:11.258988 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1280/2571] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:10 2022] POST /identity/v3/users => generated 302 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:34:11.260598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.289256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a97b5-0a82-4393-96f9-c68f4de805c3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.299881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.301371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.302522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.303092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.304683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.308130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:11.330992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1281/2572] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:11.337096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.352478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834a83-c8d4-4c41-bf84-54fcc96c05a9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.359598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.360472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.360773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.361235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.362802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.365577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:11.386010 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1282/2573] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:34:11.402249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.421292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53879-43b6-4379-8673-b4b533e33238 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.431905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.433141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.433618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.434096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] PATH_INFO: `/v3/projects/18d77006f3cd4bef9f4de5553efcdb06/users/22ce1622fec047588e98f297df2c487d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.463872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d77006f3cd4bef9f4de5553efcdb06, user_id=22ce1622fec047588e98f297df2c487d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.468319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c334-916c-4325-9b30-a06d58ad5df4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:11.562089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1292/2574] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:11 2022] POST /identity/v3/projects => generated 375 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:11.568726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.585360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1283/2575] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:11 2022] PUT /identity/v3/projects/18d77006f3cd4bef9f4de5553efcdb06/users/22ce1622fec047588e98f297df2c487d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:11.588202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.588712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.589338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.653754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:11.656351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:11.769644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aee433-8a0b-4416-84ed-5a7e25f06c10 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:11.829619 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1284/2576] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:11.846609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:11.849985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:11.940242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:11.944981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:11.944981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:11.944981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:11.944981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:11.951504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:12.013037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9d64-d362-422e-a5d2-3b913d0af7ef None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:12.021005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:12.022106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.022617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.023113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.044274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:12.047312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:12.068118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1285/2577] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:12.130608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1293/2578] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:11 2022] POST /identity/v3/users => generated 294 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:12.133545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:12.154170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cf610-e886-415a-b156-76b90747a39e service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:12.163256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:12.164369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.164855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.165347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.166616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:12.170023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652c2f7-8a37-487b-a970-42b5f76c0b9f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:12.200519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1286/2579] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:12.207169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:12.229342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86531-8793-4bab-bfa3-ad551e89205b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:12.232497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.233336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.233815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.239410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:12.240606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.241121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.241612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] PATH_INFO: `/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5/users/2c14025f47b24a99a0e40d106056a90b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-72703a5a-27b1-4998-8de2-05bdcb2eb3a5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:34:12.249967 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:12.251769 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:34:12.254466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1287/2580] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:34:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:34:12.299590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7533-6560-402d-8c2f-3c1b69765da6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.299590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7533-6560-402d-8c2f-3c1b69765da6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.299590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7533-6560-402d-8c2f-3c1b69765da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.348057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2cf08b78d74cb3b354b9f9669989a5, user_id=2c14025f47b24a99a0e40d106056a90b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:12.366366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:12.376044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4e1e7533-6560-402d-8c2f-3c1b69765da6 None None] MFA Rules not processed for user `6a310d2bd16e4d52841042364253a86b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:12.384625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e1e7533-6560-402d-8c2f-3c1b69765da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:12.515475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1294/2581] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:12 2022] PUT /identity/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5/users/2c14025f47b24a99a0e40d106056a90b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:12.526200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:12.609972 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1288/2582] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:12.634268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.636687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.638598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.749730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211364-331f-4ef3-ab68-230895d94b83 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:12.760269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] MFA Rules not processed for user `18c239f3dc7642d68104932b9e740c40`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:12.760951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:12.762726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.763390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.764016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.765322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:12.765739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:12.770151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:12.814097 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1295/2583] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:34:12.827772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:12.898066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21854be-7bbc-4245-824e-9c5e6ee10dc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:12.938070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:12.939053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:12.942995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:12.942995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] PATH_INFO: `/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5/users/2c14025f47b24a99a0e40d106056a90b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:12.960062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:12.962347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2cf08b78d74cb3b354b9f9669989a5, user_id=2c14025f47b24a99a0e40d106056a90b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:12.977018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b73cd-6716-4cca-b247-f78e9647bd33 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:13.054040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1296/2584] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:12 2022] PUT /identity/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5/users/2c14025f47b24a99a0e40d106056a90b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:13.062428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf407f9-4c44-4888-a6cd-eac6d68d8023 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:13.065565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf407f9-4c44-4888-a6cd-eac6d68d8023 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:13.066587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf407f9-4c44-4888-a6cd-eac6d68d8023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:13.091843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:13.151332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1289/2585] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:12 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:13.151332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:13.159717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:13.255671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1bf407f9-4c44-4888-a6cd-eac6d68d8023 None None] MFA Rules not processed for user `2c14025f47b24a99a0e40d106056a90b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:13.257241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1bf407f9-4c44-4888-a6cd-eac6d68d8023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:13.519028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1297/2586] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:13.533143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49dca2-e893-496d-a048-6c714b60c981 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:13.536979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49dca2-e893-496d-a048-6c714b60c981 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:13.537611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49dca2-e893-496d-a048-6c714b60c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:13.563490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3391bd-4cb6-456d-b7f9-8748858b74d5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:13.616677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0e49dca2-e893-496d-a048-6c714b60c981 None None] MFA Rules not processed for user `18c239f3dc7642d68104932b9e740c40`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:13.618979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0e49dca2-e893-496d-a048-6c714b60c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:13.925256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:13.926410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:13.929036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:13.929603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:13.936803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:13.983715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1298/2587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:14.005902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:14.006409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:14.006889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:14.131443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] MFA Rules not processed for user `386f857786474effa6df298d43738c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:14.133772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:14.309781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:14.315174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:14.345775 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1290/2588] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 1205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:14.387695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1299/2589] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:14.978986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:15.044988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:15.049378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:15.071882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:15.098688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9377d99-85bd-4c65-99fd-1d769e6d07b7 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:15.125929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:15.127263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:15.127782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:15.128796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:15.169841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:15.173276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6fa2-cb92-4c9f-878a-10299052f32e service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:15.202321 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1291/2590] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:15 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:16.005234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:16.034955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b359ab-6e64-4282-b416-6b4604ee2609 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:16.046477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:16.049202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:16.060382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:16.060382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:16.095651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:16.105966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:16.136119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1300/2591] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:16.248525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc961c-5ed7-4049-84dd-63b0fc441f81 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:16.249319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc961c-5ed7-4049-84dd-63b0fc441f81 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:16.249602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc961c-5ed7-4049-84dd-63b0fc441f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-14fc961c-5ed7-4049-84dd-63b0fc441f81 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:34:16.293989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:16.296147 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:34:16.308023 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1292/2592] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:34:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:34:16.834852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:16.885136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab7d91-afec-4011-960f-9a078054fa4a service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:16.913322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:16.913322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:16.913322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:16.913322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:16.916028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:17.261777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:17.271001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:17.322843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1301/2593] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:17.349263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.452077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.715427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ef39-94bd-4039-bc94-9ef5b14a629b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:17.715927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ef39-94bd-4039-bc94-9ef5b14a629b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:17.716424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ef39-94bd-4039-bc94-9ef5b14a629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:17.812410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-40e6ef39-94bd-4039-bc94-9ef5b14a629b None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:17.814152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40e6ef39-94bd-4039-bc94-9ef5b14a629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:18.130172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1293/2594] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:18.943618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:19.132697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:20.255610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:20.744320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:21.389207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:31.114666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=14 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:32.564541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=16 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:34.077780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:34.119458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200435-0f4e-4dbd-be28-7d521b3c3f0c service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:34.139322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:34.141542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:34.142271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:34.142770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:34.147114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:34.495693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:34.499457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94303b95-f92b-4d47-9e39-c35d1babc1ac service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:34.548127 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1302/2595] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:34.713277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7d47-3fb3-4887-9eea-214a509c3a7a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:34.714454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7d47-3fb3-4887-9eea-214a509c3a7a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:34.714454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7d47-3fb3-4887-9eea-214a509c3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:34.805061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-66ff7d47-3fb3-4887-9eea-214a509c3a7a None None] MFA Rules not processed for user `7caebe70d8da45aebdeeae629801512c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:34.821055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66ff7d47-3fb3-4887-9eea-214a509c3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:35.110972 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1294/2596] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:41.860410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:41.861418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:41.861418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:34:41.875701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:34:41.882112 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:34:41.884100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1303/2597] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:34:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:34:43.228417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77052-b107-4171-983e-7f47df708f83 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:43.230307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77052-b107-4171-983e-7f47df708f83 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:43.231207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77052-b107-4171-983e-7f47df708f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:43.320992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ea77052-b107-4171-983e-7f47df708f83 None None] MFA Rules not processed for user `4360a08eed56405b99333776285fef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:43.328887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ea77052-b107-4171-983e-7f47df708f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:43.587473 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1295/2598] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:44.522840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=30 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:45.411764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:45.415447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:45.733667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a19931-0f54-4ae7-a531-7a007541a689 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:45.767876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:45.767876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:45.767876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:45.778519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:45.780435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:45.782986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:45.785008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] PATH_INFO: `/v3/users/18c239f3dc7642d68104932b9e740c40` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:45.788468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c239f3dc7642d68104932b9e740c40)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:45.799749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:45.905907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] MFA Rules not processed for user `22ce1622fec047588e98f297df2c487d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:45.927811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:46.259517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c239f3dc7642d68104932b9e740c40'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:46.265115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c239f3dc7642d68104932b9e740c40'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:46.415658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1296/2599] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:45 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 647 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:46.421498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:46.433855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c239f3dc7642d68104932b9e740c40'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:46.464517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef3fc-ff0d-45c6-ba1e-a3f05c0c4a3e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:46.492350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c239f3dc7642d68104932b9e740c40'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:46.506420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:46.508122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:46.508673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:46.510921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:46.512467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:46.517239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:46.542483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c239f3dc7642d68104932b9e740c40'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:46.583490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1304/2600] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:45 2022] DELETE /identity/v3/users/18c239f3dc7642d68104932b9e740c40 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:46.733539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1297/2601] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:46 2022] POST /identity/v3/projects => generated 403 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:46.745250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:46.751016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:47.194979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d8762-fc14-46b3-a2af-030b939277dc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:47.431934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:47.551826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:47.555891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:47.613361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:47.614407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:47.614898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:47.617382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:47.620304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:47.629954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:47.687166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:47.860991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1305/2602] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:46 2022] POST /identity/v3/users => generated 308 bytes in 1122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:47.863159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:47.888827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd540-04d0-4ee4-9d40-bd6033238d10 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:47.897972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b10e1-5df0-4856-b6c5-5bd78676f6ce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:47.905913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:47.911078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:47.911078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:47.911078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] PATH_INFO: `/v3/projects/2b0c9c6a4aa448cca9a86ffe7484ec99` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:47.911602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:47.911793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0c9c6a4aa448cca9a86ffe7484ec99)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:47.911976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:47.912270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:47.914312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:47.914964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:47.919469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:47.927538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:47.982947 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1306/2603] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:47.993264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:48.037368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a108-a29d-4fa2-a9f2-662c52468e52 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:48.092884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:48.094936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:48.095636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:48.096173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] PATH_INFO: `/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be/users/d8dc9f07bde746a3bf06ab86a75e8d93/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:48.140762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3a47048f7c48f88aa7979a5a9a81be, user_id=d8dc9f07bde746a3bf06ab86a75e8d93, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:48.152359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:48.427286 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1307/2604] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:47 2022] PUT /identity/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be/users/d8dc9f07bde746a3bf06ab86a75e8d93/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:48.428726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:48.477504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0c9c6a4aa448cca9a86ffe7484ec99', 'request_id': 'req-451ad992-1e22-4a90-86f1-98f850adb3a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:48.492332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0c9c6a4aa448cca9a86ffe7484ec99', 'request_id': 'req-451ad992-1e22-4a90-86f1-98f850adb3a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:48.506442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0c9c6a4aa448cca9a86ffe7484ec99', 'request_id': 'req-451ad992-1e22-4a90-86f1-98f850adb3a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:48.629615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded644bf-5e30-4cdd-aa8f-17cb33394778 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:48.709749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] The token cache is being invalidate because project 2b0c9c6a4aa448cca9a86ffe7484ec99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:34:48.714777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:48.721221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-451ad992-1e22-4a90-86f1-98f850adb3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:48.727033 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1298/2605] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:47 2022] DELETE /identity/v3/projects/2b0c9c6a4aa448cca9a86ffe7484ec99 => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:34:48.746783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5005-6d66-4345-ab60-b9b34ffe7334 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:48.747328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5005-6d66-4345-ab60-b9b34ffe7334 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:48.747890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5005-6d66-4345-ab60-b9b34ffe7334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:48.807008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e23b5005-6d66-4345-ab60-b9b34ffe7334 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:48.810718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e23b5005-6d66-4345-ab60-b9b34ffe7334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:48.928911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:48.934718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:48.935848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:48.937065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:48.939485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:48.946308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:48.980857 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1308/2606] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:48.981755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:48.985366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:49.027388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cb5f-6c8c-47b5-900f-b405454cf9ed admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:49.029760 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1299/2607] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:49.054783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:49.056177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:49.056779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:49.098127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:49.099719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:49.100027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:49.100477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] PATH_INFO: `/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be/users/d8dc9f07bde746a3bf06ab86a75e8d93/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:49.119798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3a47048f7c48f88aa7979a5a9a81be, user_id=d8dc9f07bde746a3bf06ab86a75e8d93, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:49.125621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:49.154099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:49.157547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:49.160437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1309/2608] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:48 2022] PUT /identity/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be/users/d8dc9f07bde746a3bf06ab86a75e8d93/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:49.341410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:49.383650 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1300/2609] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:49.392000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:49.411378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c53f-4586-4e31-806a-18d9d2162101 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:49.420197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:49.421164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:49.422120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:49.422669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:49.427069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:34:49.427069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:49.430957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:49.447118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:49.460554 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1310/2610] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:34:49.468806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:49.509296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445e138-2d84-4c0a-94b1-116af0421e46 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:49.543630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:49.550693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:49.551250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:49.551833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:49.555339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:49.560596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:49.783542 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1301/2611] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:34:49 2022] POST /identity/v3/projects => generated 389 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:49.792008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:49.831179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b432c3-2dce-46ba-b404-a19e5bd49bf6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:50.108079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:50.113061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:50.113061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:50.113061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:50.113061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:50.116306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:50.271705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1311/2612] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:34:49 2022] POST /identity/v3/users => generated 295 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:34:50.278438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:50.342723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ce77c-f078-4e63-a9ba-de26c2610ed3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:50.395218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:50.397605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:50.402643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:50.403496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:50.405728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:50.410512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:50.448471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1302/2613] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:34:50.449438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:50.479857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d22675-e2a4-4c3e-854e-1a6c513677d4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:50.503903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:50.505705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:50.506681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:50.507446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:50.515005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:50.518931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b273f-cd2d-4c1f-a4a2-5e0928938ceb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:50.577976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1312/2614] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:34:50.582836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:50.635642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cd233-f51e-4333-b6ba-4526931dc907 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:50.669265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:50.671441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:50.672092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:50.672719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] PATH_INFO: `/v3/projects/1a11d1435a15411dac3494ce54e4a8e5/users/323ba3fc0aa144bf99adcd5c70370ef0/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:50.734469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a11d1435a15411dac3494ce54e4a8e5, user_id=323ba3fc0aa144bf99adcd5c70370ef0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:50.744499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:50.922801 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1303/2615] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:34:50 2022] PUT /identity/v3/projects/1a11d1435a15411dac3494ce54e4a8e5/users/323ba3fc0aa144bf99adcd5c70370ef0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:50.925727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:50.926261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:50.927497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:51.117713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:51.139114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:51.468530 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1313/2616] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:51.521093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:51.524423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:51.794540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b821c1-5a9c-4c9b-9063-69e7f443c935 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:51.823080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257987-ec66-439e-bd68-688af090850d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:51.823970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257987-ec66-439e-bd68-688af090850d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:51.824290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257987-ec66-439e-bd68-688af090850d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:51.824794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257987-ec66-439e-bd68-688af090850d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:51.845743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257987-ec66-439e-bd68-688af090850d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:51.848476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257987-ec66-439e-bd68-688af090850d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:51.883012 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1304/2617] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:54.408557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:54.411860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:54.490677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7713ad9-0007-44ff-9c5a-fd6b73d8b926 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:54.529149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:54.530267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:54.530765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:54.531296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] PATH_INFO: `/v3/users/fd8f582bad9b49a2a4fbfbb6bfde30ff` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:54.535157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8f582bad9b49a2a4fbfbb6bfde30ff)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:54.546204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:55.075861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8f582bad9b49a2a4fbfbb6bfde30ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:55.079443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8f582bad9b49a2a4fbfbb6bfde30ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:55.239728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8f582bad9b49a2a4fbfbb6bfde30ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:55.327541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8f582bad9b49a2a4fbfbb6bfde30ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:55.330962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:55.407663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8f582bad9b49a2a4fbfbb6bfde30ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:34:55.435535 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1314/2618] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:34:54 2022] DELETE /identity/v3/users/fd8f582bad9b49a2a4fbfbb6bfde30ff => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:34:55.438358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:55.439206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:55.439521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:55.525803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:34:55.535792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:55.739733 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1305/2619] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:34:55.798983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:55.802155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:56.047924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5d67-9178-448c-a34a-dbac48b665eb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:56.066331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:56.066331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:56.066331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:56.066331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:56.104330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:56.111590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:34:56.198996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1315/2620] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:34:59.372578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:34:59.372578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:34:59.511085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:59.605879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca89b93-04fa-4d38-8804-029f7bbb7a66 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:34:59.656637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:34:59.657790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:34:59.658415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:34:59.671367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] PATH_INFO: `/v3/projects/707eb331f0794935b9cff88e7d1b9960` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:34:59.676229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=707eb331f0794935b9cff88e7d1b9960)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:34:59.703119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:00.134098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707eb331f0794935b9cff88e7d1b9960', 'request_id': 'req-eee73f87-ec48-47ec-a34e-1efc9468ce7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:00.204234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707eb331f0794935b9cff88e7d1b9960', 'request_id': 'req-eee73f87-ec48-47ec-a34e-1efc9468ce7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:00.261677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707eb331f0794935b9cff88e7d1b9960', 'request_id': 'req-eee73f87-ec48-47ec-a34e-1efc9468ce7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:00.421235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] The token cache is being invalidate because project 707eb331f0794935b9cff88e7d1b9960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:35:00.429460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:00.432386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:00.436838 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1306/2621] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:59 2022] DELETE /identity/v3/projects/707eb331f0794935b9cff88e7d1b9960 => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:00.444622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:01.066136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987242-f73c-4e14-8e46-85499bd14339 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:01.310048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:01.311275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:01.311765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:01.312240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] PATH_INFO: `/v3/users/49075c5165d74971938b393dadaecedc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:01.317394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49075c5165d74971938b393dadaecedc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:01.327446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:01.887499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49075c5165d74971938b393dadaecedc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:01.889772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49075c5165d74971938b393dadaecedc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:02.022004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49075c5165d74971938b393dadaecedc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:02.042578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:02.101580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49075c5165d74971938b393dadaecedc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:02.139174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7fda131-b66e-4f15-b761-6e8d9a50e094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49075c5165d74971938b393dadaecedc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:02.157114 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1316/2622] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:00 2022] DELETE /identity/v3/users/49075c5165d74971938b393dadaecedc => generated 0 bytes in 1713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:03.959731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:03.964039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:04.035032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73f87-ec48-47ec-a34e-1efc9468ce7a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:04.410830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:04.412818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:04.413682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:04.414408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] PATH_INFO: `/v3/projects/58981ada7897444a8e277d491b2cc6b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:04.417619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58981ada7897444a8e277d491b2cc6b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:04.422401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:04.775964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58981ada7897444a8e277d491b2cc6b7', 'request_id': 'req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:04.808879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58981ada7897444a8e277d491b2cc6b7', 'request_id': 'req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:04.819203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:04.829855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58981ada7897444a8e277d491b2cc6b7', 'request_id': 'req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:04.965539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] The token cache is being invalidate because project 58981ada7897444a8e277d491b2cc6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:35:04.966578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:04.967414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb31901-ebb4-4afd-87fa-1738f5cf2f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:04.974848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1307/2623] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:03 2022] DELETE /identity/v3/projects/58981ada7897444a8e277d491b2cc6b7 => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:04.984073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:04.989534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:04.990231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:05.391400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:05.393738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:05.803412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1317/2624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 822 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:05.809539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:05.811649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:05.812628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:05.880102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:05.885787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:05.935690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:05.945480 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1308/2625] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:05.963697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181ea81-8b52-4ad6-85dd-01f8cef8a205 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:05.976116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:05.977233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:05.977755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:05.978249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:05.979584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:35:05.980153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:05.983839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:06.014063 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1318/2626] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:35:06.023593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:06.065963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bf47-eaa7-4d6c-b6d2-264f3f6aeaca None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:06.094856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:06.097070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:06.097602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:06.098079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:06.099342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:06.104077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:06.381352 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1309/2627] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:35:06 2022] POST /identity/v3/projects => generated 401 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:35:06.382120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:06.448206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899663-b05b-494b-8ae1-cb5593b7a32a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:06.702583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:06.702583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:06.702583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:06.703018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:06.704283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:06.708668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:06.915780 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1319/2628] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:35:06 2022] POST /identity/v3/users => generated 301 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:35:06.922176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:06.965873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c450728-8154-4fee-9f0a-b5e6f454c3fa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:07.002713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:07.003900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:07.004403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:07.004892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:07.007181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:07.024828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:07.087011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1310/2629] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:35:07.087298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:07.131785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270b92-06f6-4f13-9dfb-1b89b98c1e85 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:07.160043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:07.161108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:07.167360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:07.167360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:07.167360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:07.172209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47a522-9ba3-4e87-856b-606471ae887c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:07.242758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1320/2630] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:35:07.243791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:07.280627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276399-3026-4d8f-b3c5-063eca76d3b7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:07.302784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:07.304270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:07.304891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:07.305494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] PATH_INFO: `/v3/projects/16052b1f5c824dc0a6fa99ae0bc043c1/users/4949f5e6b26f48cbb78653da0c6bcebb/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:07.368064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16052b1f5c824dc0a6fa99ae0bc043c1, user_id=4949f5e6b26f48cbb78653da0c6bcebb, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:07.381351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:07.559712 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1311/2631] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:35:07 2022] PUT /identity/v3/projects/16052b1f5c824dc0a6fa99ae0bc043c1/users/4949f5e6b26f48cbb78653da0c6bcebb/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:07.570608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:07.571725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:07.572655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:07.715901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:07.729122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] MFA Rules not processed for user `4949f5e6b26f48cbb78653da0c6bcebb`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:07.739318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:08.153584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1321/2632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:08.161660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:08.410634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471e15-3fe1-484c-82ea-f7f043e63b63 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:08.430091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:08.439198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:08.440187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:08.440995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:08.443915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:08.451224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:08.831223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1312/2633] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:35:08 2022] POST /identity/v3/projects => generated 401 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:35:08.837128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:08.857626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e352a-35d0-4547-80fd-91ea68d5c7d9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:09.040117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:09.044215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:09.045761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:09.046522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:09.067077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:09.077387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:09.289391 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1322/2634] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:35:08 2022] POST /identity/v3/users => generated 307 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:35:09.296098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:09.327789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c990-4c56-4c82-ac7f-e97f7d878b82 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:09.335884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:09.337301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:09.337813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:09.338079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:09.338974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:09.341990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:09.364976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1313/2635] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:35:09.373116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:09.394100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d22d1-cf2f-4f9c-9488-263d4948fa90 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:09.403824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:09.421175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:09.421175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:09.421175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] PATH_INFO: `/v3/projects/ecbe677ae0a6436a8605bf95396eea4a/users/03f0d81caac94d1397c021db58207253/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:09.445477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbe677ae0a6436a8605bf95396eea4a, user_id=03f0d81caac94d1397c021db58207253, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:09.451997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:09.640037 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1323/2636] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:35:09 2022] PUT /identity/v3/projects/ecbe677ae0a6436a8605bf95396eea4a/users/03f0d81caac94d1397c021db58207253/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:09.650802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:09.686254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65acb5-20c0-4112-a101-fb9b194f7f58 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:09.873943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:09.923853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:09.925049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:09.925571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:09.926037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:09.927323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:09.930577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904c862-a93a-4b47-83ac-a257ad230aab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:09.977780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1314/2637] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:35:09.979977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:10.006426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e2e2-82b2-4ee3-8451-54d2e3625688 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:10.029632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:10.030568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:10.030855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:10.034602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] PATH_INFO: `/v3/projects/ecbe677ae0a6436a8605bf95396eea4a/users/03f0d81caac94d1397c021db58207253/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:10.047449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbe677ae0a6436a8605bf95396eea4a, user_id=03f0d81caac94d1397c021db58207253, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:10.063905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:10.131588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1324/2638] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:35:09 2022] PUT /identity/v3/projects/ecbe677ae0a6436a8605bf95396eea4a/users/03f0d81caac94d1397c021db58207253/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:10.138822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:10.139375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:10.139898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:10.244853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] MFA Rules not processed for user `03f0d81caac94d1397c021db58207253`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:10.247019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:10.490143 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1315/2639] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:11.453544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:11.460978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:11.653721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:11.808024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2face-6655-4fa1-8c64-6b91e4cd6d44 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:11.840565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:11.841807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:11.842300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:11.842786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:11.868743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:11.872110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901f03-784a-467a-be5e-4cec880d2eb3 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:11.894028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1325/2640] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:12.047789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:12.093686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d182c-2ce7-4739-a6bb-a600e7606ba4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:12.117496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:12.117496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:12.117496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:12.117496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:12.137100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:12.322719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:12.330845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:12.402176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1316/2641] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:15.736805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:15.738561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:15.739360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:15.855493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:15.871981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:16.276853 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1326/2642] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:17.620845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:17.625175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:17.663233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22379d4-853f-4a6a-834e-80de0d468971 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:17.673607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:17.676850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:17.677884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:17.680252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:17.828439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:17.835769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da0e09-483d-404a-a844-68d0f48d4480 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:17.863875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1317/2643] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:17.916475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:18.196482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0272-54aa-4586-8871-cb1974082f8a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:18.206887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:18.209075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:18.209075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:18.209075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] PATH_INFO: `/v3/users/4949f5e6b26f48cbb78653da0c6bcebb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:18.211074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4949f5e6b26f48cbb78653da0c6bcebb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:18.215658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:18.596749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4949f5e6b26f48cbb78653da0c6bcebb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:18.596749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4949f5e6b26f48cbb78653da0c6bcebb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:18.706549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4949f5e6b26f48cbb78653da0c6bcebb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:18.759823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4949f5e6b26f48cbb78653da0c6bcebb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:18.765341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:18.786213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4949f5e6b26f48cbb78653da0c6bcebb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:18.802877 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1327/2644] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:17 2022] DELETE /identity/v3/users/4949f5e6b26f48cbb78653da0c6bcebb => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:35:18.812628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0e59b-59ed-48f7-8f91-fc632f6a6c66 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:18.814092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0e59b-59ed-48f7-8f91-fc632f6a6c66 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:18.816825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0e59b-59ed-48f7-8f91-fc632f6a6c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:18.844238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:18.899353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-89e0e59b-59ed-48f7-8f91-fc632f6a6c66 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:18.906169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89e0e59b-59ed-48f7-8f91-fc632f6a6c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:19.222671 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1318/2645] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:19.301315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:19.304272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:19.630362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dadfe-b187-4a45-a0b2-a309afd7ffdd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:19.639420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:19.640514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:19.641017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:19.641648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:19.670362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:19.704311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:19.708793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1328/2646] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:35:20.473215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:20.474141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:20.474141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:20.612952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] MFA Rules not processed for user `d8dc9f07bde746a3bf06ab86a75e8d93`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:20.615456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:20.889853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1319/2647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:22.278250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:22.281462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:22.358866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d646d2-2dc7-49be-a1b7-47023eb1b4b4 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:22.399071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:22.400277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:22.405263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:22.408767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] PATH_INFO: `/v3/projects/16052b1f5c824dc0a6fa99ae0bc043c1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:22.417863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16052b1f5c824dc0a6fa99ae0bc043c1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:22.431637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:22.870821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16052b1f5c824dc0a6fa99ae0bc043c1', 'request_id': 'req-12e1f19d-39e2-4d9a-b136-1139161e4cf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:23.100415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16052b1f5c824dc0a6fa99ae0bc043c1', 'request_id': 'req-12e1f19d-39e2-4d9a-b136-1139161e4cf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:23.121294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16052b1f5c824dc0a6fa99ae0bc043c1', 'request_id': 'req-12e1f19d-39e2-4d9a-b136-1139161e4cf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:23.170844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] The token cache is being invalidate because project 16052b1f5c824dc0a6fa99ae0bc043c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:35:23.171328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:23.181386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-12e1f19d-39e2-4d9a-b136-1139161e4cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:23.190788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1329/2648] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:22 2022] DELETE /identity/v3/projects/16052b1f5c824dc0a6fa99ae0bc043c1 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:23.197095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:23.235162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a7be-03ff-43b3-9dc1-bb878aba186a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:23.346342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:23.347061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:23.347061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:23.453632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] MFA Rules not processed for user `323ba3fc0aa144bf99adcd5c70370ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:23.463395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:23.485943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:23.492179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:23.493333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:23.496482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] PATH_INFO: `/v3/users/03f0d81caac94d1397c021db58207253` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:23.507072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f0d81caac94d1397c021db58207253)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:23.513328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:23.743573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:23.819673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1330/2649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:23.868589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:23.920436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f0d81caac94d1397c021db58207253'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:24.012665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:24.014549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:24.072722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f0d81caac94d1397c021db58207253'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:24.107891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f0d81caac94d1397c021db58207253'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:24.180658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f0d81caac94d1397c021db58207253'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:24.182376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f0d81caac94d1397c021db58207253'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:24.213573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1320/2650] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:23 2022] DELETE /identity/v3/users/03f0d81caac94d1397c021db58207253 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:24.261829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75dc8-48ca-4343-b945-b6a6eeb67989 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:24.530345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:24.531456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:24.531971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:24.532558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:24.546413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:24.865451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:24.868720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6b56-4b8f-4a72-bbf9-490173bb7f2f service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:24.983605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1331/2651] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 972 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:35:25.559209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:25.565398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:25.901066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7e5a-460b-4222-b89d-a34348192e03 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:25.939234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:25.942921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:25.944953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:25.948579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] PATH_INFO: `/v3/projects/ecbe677ae0a6436a8605bf95396eea4a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:25.953695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbe677ae0a6436a8605bf95396eea4a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:25.994183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:26.395124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbe677ae0a6436a8605bf95396eea4a', 'request_id': 'req-03b0c37d-d038-4130-83bc-45b822cb0aee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:26.528028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbe677ae0a6436a8605bf95396eea4a', 'request_id': 'req-03b0c37d-d038-4130-83bc-45b822cb0aee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:26.603751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbe677ae0a6436a8605bf95396eea4a', 'request_id': 'req-03b0c37d-d038-4130-83bc-45b822cb0aee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:26.857768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] The token cache is being invalidate because project ecbe677ae0a6436a8605bf95396eea4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:35:26.858269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:26.876046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03b0c37d-d038-4130-83bc-45b822cb0aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:26.885721 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1321/2652] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:25 2022] DELETE /identity/v3/projects/ecbe677ae0a6436a8605bf95396eea4a => generated 0 bytes in 1329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:35:26.895553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:26.898228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:26.899274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:27.069070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:27.071521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:27.151616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:27.386202 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1332/2653] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:27.397916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:27.398313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:27.398589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:27.481120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:27.484130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:27.536228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:27.545678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1322/2654] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:27.568910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707ad9-0a07-44b1-98ee-32eed58526c6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:27.590169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:27.591719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:27.592463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:27.593213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:27.596669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:35:27.602370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:27.606608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3636a-92b5-44aa-bcbe-8225f2b0e28a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:27.651085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1333/2655] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:35:27.666151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:27.708161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814c1c4-19a9-4719-be7f-69864b10eea7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:27.745313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:27.745548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:27.746037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:27.746519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:27.748102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:27.759873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:27.896701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:27.897485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:27.897633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:35:27.917311 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:27.918965 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:35:27.928282 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1334/2656] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:35:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:35:27.998893 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1323/2657] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:35:27 2022] POST /identity/v3/projects => generated 383 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:35:28.006119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:28.284565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd6d9f-0d0c-4226-ae0a-f2c9fe5555f7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:28.304418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:28.305945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:28.306721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:28.307528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:28.309504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:28.320115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:28.498366 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1335/2658] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:35:28 2022] POST /identity/v3/users => generated 292 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:35:28.505092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:28.568092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b822a-646e-49a7-a954-13d2718f662e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:28.590458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:28.591502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:28.591948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:28.616150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:28.617890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:28.641855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:28.661908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:28.738641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1324/2659] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:35:28.739357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:28.766114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b63cbc-c1e1-4ba0-a1e1-cd76f8f38017 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:28.801839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:28.804365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:28.805411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:28.806093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:28.807486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:28.810966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f83e98-443a-4ac0-85ac-e3bcb4dd570b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:28.858553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1336/2660] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:35:28.867464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:28.932114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a701-57b4-40cc-bb7d-3b03c09a0dd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:28.968808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:28.973477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:28.976993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:28.981361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] PATH_INFO: `/v3/projects/0184f3fdbd854adf9751ab0ef77bdb2a/users/803f3ac2d73740ad9ab92cef252f07e6/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:29.054285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0184f3fdbd854adf9751ab0ef77bdb2a, user_id=803f3ac2d73740ad9ab92cef252f07e6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:29.060973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:29.193700 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1325/2661] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:35:28 2022] PUT /identity/v3/projects/0184f3fdbd854adf9751ab0ef77bdb2a/users/803f3ac2d73740ad9ab92cef252f07e6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:29.201845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dde4-c8c7-47fa-827b-2b05de8569d2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:29.202761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dde4-c8c7-47fa-827b-2b05de8569d2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:29.202761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dde4-c8c7-47fa-827b-2b05de8569d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:29.319638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e794dde4-c8c7-47fa-827b-2b05de8569d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:29.322165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e794dde4-c8c7-47fa-827b-2b05de8569d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:29.691353 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1337/2662] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:29.730047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:29.733712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:30.117602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ea6a-6dff-48b0-9680-cc3935fa188b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:30.136421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:30.137593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:30.138111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:30.138604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:30.185141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:30.190055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6c59d-aa9a-4670-9013-dc8703894478 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:30.223775 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1326/2663] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:31.168315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:31.169054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:31.169459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0066f3f1-8547-4bb6-8ffa-40dbe4c2695d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:35:31.201653 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:31.203339 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:35:31.205837 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1338/2664] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:35:31 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:35:32.258898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:32.259860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:32.260028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:35:32.295919 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:35:32.297896 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:35:32.302130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1327/2665] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:35:32 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:35:32.437432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2abc-88ab-440e-bb68-36209b7968f1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:32.438089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2abc-88ab-440e-bb68-36209b7968f1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:32.439611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2abc-88ab-440e-bb68-36209b7968f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:32.506071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e0df2abc-88ab-440e-bb68-36209b7968f1 None None] MFA Rules not processed for user `4360a08eed56405b99333776285fef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:32.514463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e0df2abc-88ab-440e-bb68-36209b7968f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:32.603762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:32.752300 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1339/2666] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:35:40.205092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:42.883516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=13 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:52.860433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:52.861880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:52.930017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c724d-00ad-45d9-af4c-254daa177a49 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:52.952847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:52.954141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:52.954427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:52.954709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] PATH_INFO: `/v3/users/7caebe70d8da45aebdeeae629801512c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:52.961749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caebe70d8da45aebdeeae629801512c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:52.964477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:53.362081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caebe70d8da45aebdeeae629801512c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:53.488982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caebe70d8da45aebdeeae629801512c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:53.516695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caebe70d8da45aebdeeae629801512c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:53.552641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caebe70d8da45aebdeeae629801512c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:53.554077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caebe70d8da45aebdeeae629801512c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:53.570174 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1328/2667] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:52 2022] DELETE /identity/v3/users/7caebe70d8da45aebdeeae629801512c => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:53.579781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61495e-598e-4b56-946a-fa1d079b3cca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:53.601172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61495e-598e-4b56-946a-fa1d079b3cca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:53.601172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61495e-598e-4b56-946a-fa1d079b3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:53.633946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8f61495e-598e-4b56-946a-fa1d079b3cca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:53.636855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f61495e-598e-4b56-946a-fa1d079b3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:53.933673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1340/2668] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:53.973916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:53.979514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:54.262986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e29ef-9aef-4264-8224-424050d60de5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:54.278910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:54.280288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:54.280796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:54.281830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:54.318460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:54.322667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7fa09-cd7c-4ba8-ac75-9a93326f2321 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:54.355301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1329/2669] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:55.636519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:55.637493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:55.637493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:55.638927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1341/2670] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 4 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:35:55.676946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:55.678061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:55.678061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:55.791005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:55.793859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:56.078255 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1330/2671] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:56.267788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:56.279947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:56.314172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:56.318421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:56.340920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:56.365892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723636d2-90d6-47ba-9d61-9e2afc0bfa68 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:56.396248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512730-5ad4-4509-8dc7-a1c108ca1889 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:56.398973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:56.398973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:56.398973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:56.398973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:56.427388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:56.428680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:56.430093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:56.430631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:56.431113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] PATH_INFO: `/v3/users/323ba3fc0aa144bf99adcd5c70370ef0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:56.433753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:56.436765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=323ba3fc0aa144bf99adcd5c70370ef0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:56.452723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:56.485737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1331/2672] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:35:56.830723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323ba3fc0aa144bf99adcd5c70370ef0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:56.832140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323ba3fc0aa144bf99adcd5c70370ef0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:56.928620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323ba3fc0aa144bf99adcd5c70370ef0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:56.993642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323ba3fc0aa144bf99adcd5c70370ef0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:57.043605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323ba3fc0aa144bf99adcd5c70370ef0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:57.077416 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1342/2673] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:56 2022] DELETE /identity/v3/users/323ba3fc0aa144bf99adcd5c70370ef0 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:57.573324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:57.576123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:57.664975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac43f0-c2b7-471a-bcf2-a3b66f85f2f6 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:57.785929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:57.785929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:57.982646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:57.984936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:57.986185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:57.986988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] PATH_INFO: `/v3/projects/7e024c248dfa402e9aa19677dd749c9f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:57.992769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e024c248dfa402e9aa19677dd749c9f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:57.997401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:58.027767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eda8c1-e8e5-46b4-a6ec-e4b6dcb90a1a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:58.054606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:58.055435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:58.055901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:58.056357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] PATH_INFO: `/v3/users/386f857786474effa6df298d43738c92` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:58.060497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=386f857786474effa6df298d43738c92)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:58.064462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:58.128664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:58.333062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e024c248dfa402e9aa19677dd749c9f', 'request_id': 'req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.363874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e024c248dfa402e9aa19677dd749c9f', 'request_id': 'req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.394725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e024c248dfa402e9aa19677dd749c9f', 'request_id': 'req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.467983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386f857786474effa6df298d43738c92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.474712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386f857786474effa6df298d43738c92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.523788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] The token cache is being invalidate because project 7e024c248dfa402e9aa19677dd749c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:35:58.524772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.526101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.536015 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1332/2674] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:57 2022] DELETE /identity/v3/projects/7e024c248dfa402e9aa19677dd749c9f => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:58.542816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:58.554675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:58.607662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386f857786474effa6df298d43738c92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.652242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386f857786474effa6df298d43738c92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.724067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-879b5bee-6d0a-466c-913a-8f73ae65ce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386f857786474effa6df298d43738c92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:58.750472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1343/2675] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:57 2022] DELETE /identity/v3/users/386f857786474effa6df298d43738c92 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:58.753103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:58.753596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:58.754100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:58.845782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:35:58.848011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:58.848661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4950fe-deaa-4efb-a8c6-cefa04a390e9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:58.963197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:59.088599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:59.091451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:59.092364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:59.093135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] PATH_INFO: `/v3/users/aa74dd7fba5a467eb147229e77a0f25a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:59.096579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa74dd7fba5a467eb147229e77a0f25a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:59.108224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:59.154256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1344/2676] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:35:59.252444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:59.255965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:59.456176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa74dd7fba5a467eb147229e77a0f25a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:59.574250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa74dd7fba5a467eb147229e77a0f25a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:59.600328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140af0e-9758-4f54-8114-85c8e13cde69 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:59.602554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa74dd7fba5a467eb147229e77a0f25a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:59.620959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:35:59.622590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:35:59.623714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:35:59.624143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:35:59.667249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa74dd7fba5a467eb147229e77a0f25a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:59.671048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:35:59.673763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa74dd7fba5a467eb147229e77a0f25a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:35:59.677030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:35:59.700819 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1333/2677] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:58 2022] DELETE /identity/v3/users/aa74dd7fba5a467eb147229e77a0f25a => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:35:59.702704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:59.710539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:59.730789 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1345/2678] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:59.732358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:35:59.740758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:35:59.785960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447690-487b-4edf-922f-6d29d93392b0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:35:59.946012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:00.008203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78a9e-5fd3-495e-8507-655754ffe48b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:00.015847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:00.017292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:00.017801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:00.018290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:00.022028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:00.035676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:00.037091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:00.038226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:00.038909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] PATH_INFO: `/v3/projects/1a11d1435a15411dac3494ce54e4a8e5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:00.047762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a11d1435a15411dac3494ce54e4a8e5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:00.053763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:00.268722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:00.274112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1612d87-6b15-4dad-b6a0-c487dd076c9a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:00.310936 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1346/2679] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:00.326226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:00.353968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a11d1435a15411dac3494ce54e4a8e5', 'request_id': 'req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:00.412725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a11d1435a15411dac3494ce54e4a8e5', 'request_id': 'req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:00.448637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a11d1435a15411dac3494ce54e4a8e5', 'request_id': 'req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:00.582488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] The token cache is being invalidate because project 1a11d1435a15411dac3494ce54e4a8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:00.583242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:00.589964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2998c47-82fd-48d3-8e38-8cb59b5ae1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:00.619473 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1334/2680] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:59 2022] DELETE /identity/v3/projects/1a11d1435a15411dac3494ce54e4a8e5 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:00.632533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:00.637003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:00.637603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:00.700609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:00.703499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:00.899792 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1347/2681] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:00.921102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:00.924475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:00.925217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:00.957490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:00.958992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:00.987332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:00.999690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1335/2682] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:01.013827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ee1e6-9e58-4c31-ab4b-c980b100e7b9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:01.024924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:01.027552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:01.027552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:01.027552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:01.027552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:01.028386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:01.033250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:01.076405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:01.084847 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1348/2683] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:01.093332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133146ca-dba5-494e-8d93-7f3494fae483 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:01.105842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:01.108670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:01.110322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:01.111225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:01.113047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:01.117890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:01.331488 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1336/2684] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:01 2022] POST /identity/v3/projects => generated 399 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:01.335711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:01.381540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c2b1-0f08-401f-82db-89201fb3f56e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:01.868676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:01.870551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:01.871212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:01.871653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:01.873146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:01.877394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:01.952355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:02.099196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:02.103404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:02.113243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1349/2685] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:01 2022] POST /identity/v3/users => generated 300 bytes in 779 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:36:02.120485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:02.151565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497036f-df00-4b99-a5ca-afd0969c8686 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:02.153290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:02.154526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f3d5e-0380-4e49-bb60-03c157d48016 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:02.154956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.155787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.156866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.158954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:02.163185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:02.181780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:02.183647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.184648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.186539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] PATH_INFO: `/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.190376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] RBAC: Authorizing `identity:delete_project(project_id=102b4fb7ac5e4cfdb2affbecc59ecbb2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:02.195209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:02.214653 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1350/2686] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:02.217030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:02.262309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c095-ae22-40f3-b4d3-6f330f15d7c3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:02.276324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:02.281009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.281009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.281009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.281683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:02.286486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:02.320980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1351/2687] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:36:02.324197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:02.330094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:02.369502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eca00-ae89-4c0c-af2c-1bf8ea46ea99 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:02.409348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102b4fb7ac5e4cfdb2affbecc59ecbb2', 'request_id': 'req-a861a94b-6cac-42bc-868a-f475ee21713c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:02.425689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102b4fb7ac5e4cfdb2affbecc59ecbb2', 'request_id': 'req-a861a94b-6cac-42bc-868a-f475ee21713c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:02.440466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102b4fb7ac5e4cfdb2affbecc59ecbb2', 'request_id': 'req-a861a94b-6cac-42bc-868a-f475ee21713c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:02.577830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:02.580001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.580506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.580923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] PATH_INFO: `/v3/projects/526ce79b3ad7461eb974329c1e567568` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.584939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=526ce79b3ad7461eb974329c1e567568)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:02.591530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:02.628553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] The token cache is being invalidate because project 102b4fb7ac5e4cfdb2affbecc59ecbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:02.629373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:02.631303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:02.636515 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1337/2688] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:02 2022] DELETE /identity/v3/projects/102b4fb7ac5e4cfdb2affbecc59ecbb2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:02.638913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:02.642451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:02.683713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861a94b-6cac-42bc-868a-f475ee21713c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:02.696059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:02.697594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.698460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.699321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] PATH_INFO: `/v3/projects/0f91c2932cc340f485c55568d70fe0b0/users/cc67cd38dc584936b88d4f0185f3e8a0/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.743372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f91c2932cc340f485c55568d70fe0b0, user_id=cc67cd38dc584936b88d4f0185f3e8a0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:02.752499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49471075-adfc-4fba-b267-e5336529cdf4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:02.881240 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1338/2689] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:02 2022] PUT /identity/v3/projects/0f91c2932cc340f485c55568d70fe0b0/users/cc67cd38dc584936b88d4f0185f3e8a0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:02.889476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549569b-afc4-44e4-b1dc-deff78a06eb1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:02.892510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549569b-afc4-44e4-b1dc-deff78a06eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:02.892510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549569b-afc4-44e4-b1dc-deff78a06eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:02.941065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526ce79b3ad7461eb974329c1e567568', 'request_id': 'req-782a75a0-864e-47da-9e05-79328fb3c4ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.018795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7549569b-afc4-44e4-b1dc-deff78a06eb1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:03.023303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7549569b-afc4-44e4-b1dc-deff78a06eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:03.135673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526ce79b3ad7461eb974329c1e567568', 'request_id': 'req-782a75a0-864e-47da-9e05-79328fb3c4ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.191977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526ce79b3ad7461eb974329c1e567568', 'request_id': 'req-782a75a0-864e-47da-9e05-79328fb3c4ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.227263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1339/2690] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:03.227263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.227263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.227263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.228525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] The token cache is being invalidate because project 526ce79b3ad7461eb974329c1e567568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:03.229472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.231805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-782a75a0-864e-47da-9e05-79328fb3c4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.243212 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1352/2691] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:02 2022] DELETE /identity/v3/projects/526ce79b3ad7461eb974329c1e567568 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:03.243212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.245426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.246140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.299569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:03.313559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:03.317013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:03.338876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:03.342434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:03.344608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1340/2692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:03.357941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:03.357941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:03.380569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1353/2693] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:03.382343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:03.391362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92dba-25c8-4cc3-a916-47eb62d6a8ce None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:03.405145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24d05e-af72-493c-a66f-8c1561db5e96 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:03.419558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:03.422589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.423315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.428644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] PATH_INFO: `/v3/users/2c14025f47b24a99a0e40d106056a90b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.428644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c14025f47b24a99a0e40d106056a90b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:03.433471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:03.439067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:03.440233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.440910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.441522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.442980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:03.445416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:03.456564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:03.507279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1354/2694] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:36:03.511608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:03.520605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:03.778497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:03.820118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c965-3ea3-4e97-bd1d-85de9fd60852 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:03.824857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c14025f47b24a99a0e40d106056a90b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.831757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:03.835058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.835631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.842317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.861172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:03.866389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:03.892396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1355/2695] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:03.895491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:03.921367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968fe8-cde2-4951-9b7f-2abf08dabdcf service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:03.945265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c14025f47b24a99a0e40d106056a90b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:03.952425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:03.953505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:03.954136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:03.954679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:03.955827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:03.960971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:03.974291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c14025f47b24a99a0e40d106056a90b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:04.024140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c14025f47b24a99a0e40d106056a90b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:04.027953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c14025f47b24a99a0e40d106056a90b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:04.049342 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1341/2696] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:03 2022] DELETE /identity/v3/users/2c14025f47b24a99a0e40d106056a90b => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:04.054533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:04.060217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:04.170175 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1356/2697] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:03 2022] POST /identity/v3/projects => generated 391 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:04.177361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:04.185076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:04.326252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644946ab-177f-4fd4-854c-1d64d0f16773 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:04.429146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353df-30dd-4b22-92e6-eb4fb32fd2e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:04.450201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:04.451596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:04.452217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:04.458103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:04.458103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:04.462987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:04.584660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:04.586861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:04.587559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:04.588297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:04.598321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:04.650614 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1357/2698] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:04 2022] POST /identity/v3/users => generated 296 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:04.661404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:04.720455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf144-41d7-41fe-9e08-342e7ca161e9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:04.741152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:04.741939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:04.742443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:04.742915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:04.744126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:04.752024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:04.778499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1358/2699] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:04.786061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:04.805836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54498e13-f959-4982-93be-587d7244e5cb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:04.814825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:04.817921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:04.817921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:04.817921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:04.817921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:04.821297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:04.841558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:04.844701 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1359/2700] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:04.861217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:04.882869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a21e23-133b-464a-a2e7-8a60889c6cb5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:04.891853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:04.894108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:04.894897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:04.895664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] PATH_INFO: `/v3/projects/890619f020cf40eb8b6a3ffe4f61d5de/users/0fbd20cf13d042c6a4ff01cd7dbfee13/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:04.929985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890619f020cf40eb8b6a3ffe4f61d5de, user_id=0fbd20cf13d042c6a4ff01cd7dbfee13, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:04.935794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:04.943661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:04.947928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479ff34-8269-4955-bc67-c486fb0feeb3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:04.980208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1342/2701] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:05.129917 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1360/2702] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:04 2022] PUT /identity/v3/projects/890619f020cf40eb8b6a3ffe4f61d5de/users/0fbd20cf13d042c6a4ff01cd7dbfee13/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:05.139775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:05.140560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:05.140859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:05.198375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] MFA Rules not processed for user `0fbd20cf13d042c6a4ff01cd7dbfee13`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:05.200725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:05.384663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:05.396583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:05.477840 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1343/2703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:05.709870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9dced-e892-47f1-8137-4f638fe9e909 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:05.728405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:05.730411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:05.730826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:05.731702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:05.732523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:05.733152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] PATH_INFO: `/v3/users/22ce1622fec047588e98f297df2c487d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:05.736226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ce1622fec047588e98f297df2c487d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:05.741148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:05.755307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:05.975554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0741-7337-4343-91d3-9651a099cfef None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:05.996400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:05.997749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:05.998372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:05.999813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:06.018458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:06.021984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:06.044683 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1344/2704] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:06.058639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:06.085350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:06.129138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ce1622fec047588e98f297df2c487d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.136034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ce1622fec047588e98f297df2c487d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.161401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8a4e-56c5-427d-a6b7-8b678291713c service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:06.171349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:06.172617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:06.173196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:06.173768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] PATH_INFO: `/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:06.176439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2cf08b78d74cb3b354b9f9669989a5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:06.180660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:06.294244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ce1622fec047588e98f297df2c487d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.350542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ce1622fec047588e98f297df2c487d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.375671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ce1622fec047588e98f297df2c487d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.403836 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1361/2705] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:05 2022] DELETE /identity/v3/users/22ce1622fec047588e98f297df2c487d => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:06.462820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:06.501288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2cf08b78d74cb3b354b9f9669989a5', 'request_id': 'req-5eb09a80-fd4e-458b-a9c4-78d2092c6916'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.512888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2cf08b78d74cb3b354b9f9669989a5', 'request_id': 'req-5eb09a80-fd4e-458b-a9c4-78d2092c6916'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.524651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2cf08b78d74cb3b354b9f9669989a5', 'request_id': 'req-5eb09a80-fd4e-458b-a9c4-78d2092c6916'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.558525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:06.562277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:06.706679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] The token cache is being invalidate because project fe2cf08b78d74cb3b354b9f9669989a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:06.709039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.714787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb09a80-fd4e-458b-a9c4-78d2092c6916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:06.720747 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1345/2706] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:06 2022] DELETE /identity/v3/projects/fe2cf08b78d74cb3b354b9f9669989a5 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:06.732154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ddd-db1f-4b6b-ae7c-96485af7703b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:06.735623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ddd-db1f-4b6b-ae7c-96485af7703b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:06.737064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ddd-db1f-4b6b-ae7c-96485af7703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:06.795166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816f123-d58a-484f-96bc-042bdb681977 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:06.853593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-65100ddd-db1f-4b6b-ae7c-96485af7703b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:06.862826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-65100ddd-db1f-4b6b-ae7c-96485af7703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:07.027183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:07.028023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.028521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.028852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] PATH_INFO: `/v3/users/0fbd20cf13d042c6a4ff01cd7dbfee13` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.030575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbd20cf13d042c6a4ff01cd7dbfee13)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:07.034491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:07.119486 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1346/2707] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:07.134466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.135212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.135860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.199011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:07.204000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:07.220906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1347/2708] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:36:07.228997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:07.253598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9f34-e248-409c-b320-08a9e49b58a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:07.268832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:07.270450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.271828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.271828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.273455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:07.274050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:07.277865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:07.338103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1348/2709] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:36:07.339719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:07.343790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:07.361201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:07.375787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a3c6-cde2-43d2-9071-08867408518d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:07.387307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:07.388648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.389066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.389697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] PATH_INFO: `/v3/projects/18d77006f3cd4bef9f4de5553efcdb06` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.392766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d77006f3cd4bef9f4de5553efcdb06)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:07.403193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:07.403540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbd20cf13d042c6a4ff01cd7dbfee13'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.403540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbd20cf13d042c6a4ff01cd7dbfee13'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.524001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbd20cf13d042c6a4ff01cd7dbfee13'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.588427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbd20cf13d042c6a4ff01cd7dbfee13'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.634866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbd20cf13d042c6a4ff01cd7dbfee13'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.656614 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1362/2710] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:06 2022] DELETE /identity/v3/users/0fbd20cf13d042c6a4ff01cd7dbfee13 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:07.658745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:07.664882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:07.666658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d77006f3cd4bef9f4de5553efcdb06', 'request_id': 'req-723abb31-4924-430e-bb50-e9890a1a29fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.696415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d77006f3cd4bef9f4de5553efcdb06', 'request_id': 'req-723abb31-4924-430e-bb50-e9890a1a29fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.713289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d77006f3cd4bef9f4de5553efcdb06', 'request_id': 'req-723abb31-4924-430e-bb50-e9890a1a29fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.857765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] The token cache is being invalidate because project 18d77006f3cd4bef9f4de5553efcdb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:07.858521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.861383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-723abb31-4924-430e-bb50-e9890a1a29fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:07.865877 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1349/2711] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:07 2022] DELETE /identity/v3/projects/18d77006f3cd4bef9f4de5553efcdb06 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:07.876432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.877180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.877976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.898179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c22c-900e-4370-9348-dca391d6dee8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:07.911034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:07.912961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:07.916062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:07.930997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:07.934173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:07.947006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:07.951119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:07.957933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:07.979360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1350/2712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:07.990792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:07.993897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:08.031359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9eb6-9252-4cc1-97f0-7e0b4fc4a26d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.043880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.045069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.045710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.046964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] PATH_INFO: `/v3/users/d8dc9f07bde746a3bf06ab86a75e8d93` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.049769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dc9f07bde746a3bf06ab86a75e8d93)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.054332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:08.122071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1363/2713] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:07 2022] POST /identity/v3/projects => generated 393 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:08.122180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:08.123461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:08.133013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:08.310531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cec3-74db-478b-a006-0586285c336d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.317763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.318480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.318777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.320859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.432860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:08.460542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.462972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:08.486072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1364/2714] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:08.487487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:08.491013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:08.518572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c25f4-7a59-43fc-a5e2-0c9fbe4c399c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.529273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.531683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.531683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.532083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.533263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.538723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:08.676555 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1365/2715] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:08 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:08.678599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:08.698401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dc9f07bde746a3bf06ab86a75e8d93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:08.725232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55619ba-8def-409f-a98f-d2202988f811 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.738790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.739994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.740505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.741007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.742920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.746991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:08.776893 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1366/2716] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:08.784083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:08.819875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2282e1-ab0b-43c5-bf71-ab5874edd8e1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.839384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dc9f07bde746a3bf06ab86a75e8d93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:08.839760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.839760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.839760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.839760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.840338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.840338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:08.862345 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1367/2717] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:08.868658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dc9f07bde746a3bf06ab86a75e8d93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:08.873806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:08.904932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f6339-89ce-4e30-a3df-bc26719c6c93 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:08.912206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dc9f07bde746a3bf06ab86a75e8d93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:08.913573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-05664171-60ad-4ae2-aebe-353e0f7b29c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dc9f07bde746a3bf06ab86a75e8d93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:08.914931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:08.916510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:08.917035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:08.918000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] PATH_INFO: `/v3/projects/3d9a7348e41447b4a6c5faaef16ac431/users/6e4d613ca8ce4da0a9b073f49597a002/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:08.948765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1351/2718] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:07 2022] DELETE /identity/v3/users/d8dc9f07bde746a3bf06ab86a75e8d93 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:08.957748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9a7348e41447b4a6c5faaef16ac431, user_id=6e4d613ca8ce4da0a9b073f49597a002, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:08.971917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:09.083721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1368/2719] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:08 2022] PUT /identity/v3/projects/3d9a7348e41447b4a6c5faaef16ac431/users/6e4d613ca8ce4da0a9b073f49597a002/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:09.102882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d8e9-8dc8-4053-aa6d-2271ed837a39 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:09.103290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d8e9-8dc8-4053-aa6d-2271ed837a39 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:09.103572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d8e9-8dc8-4053-aa6d-2271ed837a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:09.157602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eed6d8e9-8dc8-4053-aa6d-2271ed837a39 None None] MFA Rules not processed for user `6e4d613ca8ce4da0a9b073f49597a002`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:09.159337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eed6d8e9-8dc8-4053-aa6d-2271ed837a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:09.376200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:09.379494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:09.384488 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1352/2720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:09.457916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:09.459273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:09.459907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:09.587507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] MFA Rules not processed for user `803f3ac2d73740ad9ab92cef252f07e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:09.590723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:09.683559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1cfe5-357c-4b9e-857c-7f362191c94e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:09.700143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:09.707433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:09.707433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:09.707433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:09.707433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:09.707433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:09.831236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1353/2721] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:09.837213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:09.842467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:09.891885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a828f-a5d7-41e2-bc06-1ceac128dbdb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:09.901539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:09.905221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:09.905793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:09.906548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:09.908307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:09.913189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:09.958949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:09.996434 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1369/2722] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:09 2022] POST /identity/v3/projects => generated 393 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:10.004312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.113156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1354/2723] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:09 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:10.116062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.274832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507f67c-6be0-4387-9541-207376b5e0a9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:10.338624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:10.423046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a9a2a-55c2-467a-b3fd-37088f71886d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:10.451018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:10.452773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:10.453279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:10.453763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:10.455371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:10.459763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:10.591887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:10.597231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:10.597231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:10.597231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:10.597231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:10.603128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:10.677892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1355/2724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:10 2022] POST /identity/v3/users => generated 299 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:10.687958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.724454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0542e-ae6a-4b5a-8ab4-2d8f4f46df7d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:10.740678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:10.742361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:10.743259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:10.743591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:10.744354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:10.751314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:10.770693 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1370/2725] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:10 2022] POST /identity/v3/users => generated 303 bytes in 767 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:36:10.784110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.812517 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1356/2726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:10.821897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.835710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e624-606e-4809-a9a3-e329fdc5a997 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:10.854722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:10.855833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:10.856308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:10.856844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:10.863322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:10.866659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:10.873902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ab7c5-49bd-4d40-b558-c5587839014e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:10.897879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:10.899059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:10.899496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:10.899914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] PATH_INFO: `/v3/projects/1fa8bded1f7e4799968c21cfde1316b2/users/f76aa48506e048d4b96b94b4198e6b5a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:10.913437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1371/2727] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:10.940334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:10.959422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa8bded1f7e4799968c21cfde1316b2, user_id=f76aa48506e048d4b96b94b4198e6b5a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:10.964911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:10.995745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb66b3-c18b-4269-96f1-ec875aa22ed5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:11.010222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:11.015649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:11.016679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:11.017738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] PATH_INFO: `/v3/projects/de42762f81684f95b592497ddd4e1422/users/7b0506fe672a45bc8bbad160bd09780c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:11.059730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de42762f81684f95b592497ddd4e1422, user_id=7b0506fe672a45bc8bbad160bd09780c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:11.075529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:11.101772 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1357/2728] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:10 2022] PUT /identity/v3/projects/1fa8bded1f7e4799968c21cfde1316b2/users/f76aa48506e048d4b96b94b4198e6b5a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:11.110874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:11.245038 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1372/2729] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:10 2022] PUT /identity/v3/projects/de42762f81684f95b592497ddd4e1422/users/7b0506fe672a45bc8bbad160bd09780c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:11.247068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:11.253555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:11.510250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e01-3d2c-4b1a-acbd-48c68bd4c52d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:11.677751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ed-e4b7-4721-b9f7-9e802945a4b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:11.730362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:11.734674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:11.736159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:11.737534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] PATH_INFO: `/v3/projects/890619f020cf40eb8b6a3ffe4f61d5de` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:11.742412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890619f020cf40eb8b6a3ffe4f61d5de)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:11.747612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:11.930352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:11.966735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:11.969100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:11.971949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:11.975651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:11.981140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:11.989230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:12.025913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890619f020cf40eb8b6a3ffe4f61d5de', 'request_id': 'req-0198a571-84c3-4203-803a-f57cc2547494'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:12.066353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1358/2730] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 957 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:36:12.068374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:12.114585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd3d0-3dd0-4cad-86ab-bc8532a89fcc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:12.135206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890619f020cf40eb8b6a3ffe4f61d5de', 'request_id': 'req-0198a571-84c3-4203-803a-f57cc2547494'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:12.176658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890619f020cf40eb8b6a3ffe4f61d5de', 'request_id': 'req-0198a571-84c3-4203-803a-f57cc2547494'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:12.218853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:12.235411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] The token cache is being invalidate because project 890619f020cf40eb8b6a3ffe4f61d5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:12.236167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:12.239119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:12.254610 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1373/2731] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:11 2022] DELETE /identity/v3/projects/890619f020cf40eb8b6a3ffe4f61d5de => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:12.254610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:12.264116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:12.374955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:12.376295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.378246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.383028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.384982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:12.392238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff2245-56dc-48f5-bd4f-6b33b3f3bc79 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:12.441862 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1359/2732] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:12.444722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.451414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.452928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.539243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:12.541172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:12.578471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1360/2733] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:12.580197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:12.590378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:12.644394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd60a-9492-464c-ba3f-c8c9cfcee7f4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:12.659567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a571-84c3-4203-803a-f57cc2547494 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:12.689192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:12.692395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.692808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.693093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] PATH_INFO: `/v3/projects/1fa8bded1f7e4799968c21cfde1316b2/users/f76aa48506e048d4b96b94b4198e6b5a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.697015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:12.698757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.705383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.705819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa8bded1f7e4799968c21cfde1316b2, user_id=f76aa48506e048d4b96b94b4198e6b5a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:12.706848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] PATH_INFO: `/v3/projects/de42762f81684f95b592497ddd4e1422/users/7b0506fe672a45bc8bbad160bd09780c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.717984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=de42762f81684f95b592497ddd4e1422, user_id=7b0506fe672a45bc8bbad160bd09780c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:12.725849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea48671-fff7-4c4a-a138-7168180558aa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:12.753170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dec1ec-39e3-4307-a660-645770edb4cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:12.776054 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1361/2734] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:12 2022] PUT /identity/v3/projects/de42762f81684f95b592497ddd4e1422/users/7b0506fe672a45bc8bbad160bd09780c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:12.778535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.779168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.779616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.832688 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1374/2735] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:12 2022] PUT /identity/v3/projects/1fa8bded1f7e4799968c21cfde1316b2/users/f76aa48506e048d4b96b94b4198e6b5a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:12.837536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:12.838378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:12.840614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:12.885873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:12.897881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:13.004805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] MFA Rules not processed for user `7b0506fe672a45bc8bbad160bd09780c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:13.007375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:13.264495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1362/2736] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:13.271616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:13.310215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5691-a1d9-44e8-b00b-9d36fbe4304b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:13.332643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:13.336506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:13.337003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:13.337504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:13.342615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:13.343228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:13.346632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:13.412550 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1375/2737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:13.413311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1363/2738] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:13.419188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:13.450507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efaa62-23d5-45f3-98e4-5b8db2dd7f5c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:13.471511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:13.474574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:13.475244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:13.475982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:13.478355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:13.485455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:13.669202 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1376/2739] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:13 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:13.675240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:13.707980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce17f8-9762-4c07-9ff4-a2975bf74635 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:13.860926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:13.867664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:13.877633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:13.907723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:13.912789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:13.913428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:13.916775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:13.927479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:13.932021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:14.114649 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1364/2740] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:13 2022] POST /identity/v3/users => generated 287 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:14.119441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:14.122707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:14.133085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b150-27f3-44ac-b5d4-3b05543c4421 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:14.149868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:14.151494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:14.152259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:14.153984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] PATH_INFO: `/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:14.158283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3a47048f7c48f88aa7979a5a9a81be)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:14.162877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:14.177084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9cb33-390a-4572-9934-deb6e77933fb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:14.200690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:14.209300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:14.210062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:14.210737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:14.213039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:14.216933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:14.257051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1365/2741] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:14.262970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:14.355180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3852d-89f9-452b-8ecf-33e027b0f0db admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:14.380638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:14.383763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:14.384634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:14.385292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:14.387824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:14.396219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:14.434701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3a47048f7c48f88aa7979a5a9a81be', 'request_id': 'req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:14.455213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1366/2742] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:14.456559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:14.459859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:14.605466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3a47048f7c48f88aa7979a5a9a81be', 'request_id': 'req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:14.638224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3a47048f7c48f88aa7979a5a9a81be', 'request_id': 'req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:14.708717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] The token cache is being invalidate because project ff3a47048f7c48f88aa7979a5a9a81be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:14.710071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:14.711771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d7e3b5c-d868-4209-9bd0-02cb795ba2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:14.717818 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1377/2743] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:13 2022] DELETE /identity/v3/projects/ff3a47048f7c48f88aa7979a5a9a81be => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:14.720568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:14.724644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81a91-0889-4dea-981f-23700ec41627 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:14.741172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:14.742577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:14.806552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:14.810310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:15.034893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:15.049005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:15.065394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:15.068414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:15.080104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:15.136819 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1378/2744] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:15.143096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:15.143096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:15.532489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9ab0-66c6-4c54-b9af-7f7b96c328ea None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:15.532489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:15.532489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:15.532489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:15.557619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] PATH_INFO: `/v3/projects/5eab98ddbb994a599add8e65758bb605/users/175f671de1ae4c82959a1d7cda74e70e/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:15.559422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:15.559422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:15.559422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1e5b-f31d-48bd-b6f1-887370f3e532 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:15.560922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eab98ddbb994a599add8e65758bb605, user_id=175f671de1ae4c82959a1d7cda74e70e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:15.560922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c5f6-e969-4031-aa12-07414a2de2df admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:15.562627 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1367/2745] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 1105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:15.562627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:15.562627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:15.562627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:15.625386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:15.625386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:15.666704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1368/2746] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:15.674855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:15.678162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:15.817526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1379/2747] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:15 2022] PUT /identity/v3/projects/5eab98ddbb994a599add8e65758bb605/users/175f671de1ae4c82959a1d7cda74e70e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:15.820285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:15.827478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:15.828005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:15.964649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecca6d-1e55-4902-861b-7e4e85449f79 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:15.976248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:15.982366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:16.022271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:16.167806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:16.169043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:16.169634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:16.170235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:16.174436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:16.215835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:16.223120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c182-0818-4a97-9dfd-1df0da46e8c8 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:16.257715 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1369/2748] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:16.259625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:16.272361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:16.272692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1380/2749] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:16.272862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:16.280072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:16.311246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00991-f5a7-41f6-b3a1-21b4ff79bd4f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:16.325836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:16.327195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:16.328223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:16.328842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:16.330303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:16.332255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:16.342823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:16.368337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] MFA Rules not processed for user `175f671de1ae4c82959a1d7cda74e70e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:16.378230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:16.401209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1381/2750] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:36:16.408124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:16.452271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1e85-15bd-4bd8-8659-42be2996f52d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:16.481817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:16.483158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:16.492436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:16.493565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:16.496743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:16.512506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:16.722280 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1382/2751] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:16 2022] POST /identity/v3/projects => generated 371 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:16.723376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:16.769089 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1370/2752] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:17.027352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf96-d52f-4bc9-9fc3-c9ddf60335b7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:17.038401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:17.040369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:17.041375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:17.044160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:17.046405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:17.051023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:17.206501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1383/2753] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:16 2022] POST /identity/v3/users => generated 286 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:17.208451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:17.253409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507ca1e-ac53-4bb5-96d3-3c0522911e9f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:17.271009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:17.272168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:17.272693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:17.273171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:17.274463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:17.277869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:17.333750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:17.335730 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1371/2754] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:36:17.372385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012d8c-7f61-42d5-b107-490363c65d62 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:17.397325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:17.401062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:17.403769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:17.406157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:17.412063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:17.418888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7666-e274-4021-bf32-fd1ebebf6bf3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:17.473752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1384/2755] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:17.477099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:17.523955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7272-24fb-4468-be51-4e895e2c9c0b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:17.547734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:17.550455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:17.562440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:17.564852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] PATH_INFO: `/v3/projects/10ad510c188c41c5b44cde6ddd2f40e3/users/fe9e839b68de4530b70e6a12fb5d00f1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:17.633483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ad510c188c41c5b44cde6ddd2f40e3, user_id=fe9e839b68de4530b70e6a12fb5d00f1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:17.642507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:17.815958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:17.826254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1372/2756] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:17 2022] PUT /identity/v3/projects/10ad510c188c41c5b44cde6ddd2f40e3/users/fe9e839b68de4530b70e6a12fb5d00f1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:17.836098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:17.836929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:17.837380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:17.905237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:17.908551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:18.103627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:18.120932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1385/2757] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:18.146939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:18.151367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:18.241921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:18.245143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:18.438781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716a8b-4514-4bfb-aa74-458cbd1d42fe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:18.451040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:18.452613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:18.453941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:18.454668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:18.475545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:18.478414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:18.501273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1373/2758] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:18.639248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc08a28-28ac-4514-a3f8-5acef3649314 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:18.662150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:18.666038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:18.666530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:18.666990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:18.690659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:18.998425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:19.001940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:19.030815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1386/2759] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:19.074930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:19.076566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:19.078603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:19.135689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac270d29-38db-4799-b24e-e7208c6975c2 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:19.149046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe631-ec61-49bb-8701-7e33e6c83ef4 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:19.169932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:19.173335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:19.179882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:19.180723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:19.185673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:19.192166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:19.192683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:19.193084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] PATH_INFO: `/v3/users/6e4d613ca8ce4da0a9b073f49597a002` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:19.204605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4d613ca8ce4da0a9b073f49597a002)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:19.207007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:19.468414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:19.473378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:19.538758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1387/2760] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:19.544784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:19.550471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:19.783918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4d613ca8ce4da0a9b073f49597a002'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:19.931393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:19.997102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4d613ca8ce4da0a9b073f49597a002'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:20.052035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4d613ca8ce4da0a9b073f49597a002'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:20.098386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f7c9-0971-4d18-8ddc-b47b3c40544d service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:20.112383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:20.115286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:20.116729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:20.117439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:20.126664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:20.154436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4d613ca8ce4da0a9b073f49597a002'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:20.162608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7de55f84-cc36-4351-81a0-67a3df5127a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4d613ca8ce4da0a9b073f49597a002'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:20.173369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:20.179878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:20.206057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1374/2761] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:19 2022] DELETE /identity/v3/users/6e4d613ca8ce4da0a9b073f49597a002 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:20.207690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1388/2762] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:20.226395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:20.226892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:20.228844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:20.314335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:20.316943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:20.596086 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1375/2763] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:20.870495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:20.892985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d614-5d23-491d-987c-bda5575a5614 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:21.121993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:21.123584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:21.124764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:21.125386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:21.152592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:21.156692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:21.180826 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1389/2764] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:24.097835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:24.100657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:24.177815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f36f5-f02b-433d-8f12-f9e8aadee73a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:24.204576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:24.205955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:24.206953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:24.208582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] PATH_INFO: `/v3/users/175f671de1ae4c82959a1d7cda74e70e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:24.223101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=175f671de1ae4c82959a1d7cda74e70e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:24.228738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:24.296128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:24.370670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:24.374648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:24.402817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161869-64da-4862-91a7-e1a163f6274f service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:24.412390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:24.413533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:24.414172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:24.415002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] PATH_INFO: `/v3/projects/3d9a7348e41447b4a6c5faaef16ac431` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:24.420285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9a7348e41447b4a6c5faaef16ac431)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:24.427578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:24.607033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175f671de1ae4c82959a1d7cda74e70e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.756688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175f671de1ae4c82959a1d7cda74e70e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.796310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175f671de1ae4c82959a1d7cda74e70e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.832357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9a7348e41447b4a6c5faaef16ac431', 'request_id': 'req-72fd2833-d402-4bfd-a805-aa4fa15d542c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.880948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175f671de1ae4c82959a1d7cda74e70e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.882487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ccc2f4b-3d74-455a-95a8-5a9ffd237d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175f671de1ae4c82959a1d7cda74e70e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:24.917051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1376/2765] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:24 2022] DELETE /identity/v3/users/175f671de1ae4c82959a1d7cda74e70e => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:24.924815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:24.925927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:24.928950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:24.973771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9a7348e41447b4a6c5faaef16ac431', 'request_id': 'req-72fd2833-d402-4bfd-a805-aa4fa15d542c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.006169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9a7348e41447b4a6c5faaef16ac431', 'request_id': 'req-72fd2833-d402-4bfd-a805-aa4fa15d542c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.033348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:25.035702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:25.050256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] The token cache is being invalidate because project 3d9a7348e41447b4a6c5faaef16ac431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:25.056848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.056848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.060545 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1390/2766] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:24 2022] DELETE /identity/v3/projects/3d9a7348e41447b4a6c5faaef16ac431 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:25.062493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:25.067034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:25.386395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1377/2767] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:25.419227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:25.474243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:25.474656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd2833-d402-4bfd-a805-aa4fa15d542c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:25.477055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:25.485703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:25.500024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:25.500797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:25.501336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] PATH_INFO: `/v3/users/7b0506fe672a45bc8bbad160bd09780c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:25.503449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0506fe672a45bc8bbad160bd09780c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:25.506611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:25.793267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80691a38-025b-4a29-ae4b-ac9697a8a778 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:25.801829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:25.803622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:25.804654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:25.805524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:25.825118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0506fe672a45bc8bbad160bd09780c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.828012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0506fe672a45bc8bbad160bd09780c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:25.861668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:25.868223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88044187-d994-48c4-ba7c-2d3d95724720 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:25.916441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1378/2768] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:25.922915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762a0-a433-4688-814c-744a375d25ed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:25.930953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762a0-a433-4688-814c-744a375d25ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:25.930953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762a0-a433-4688-814c-744a375d25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-244762a0-a433-4688-814c-744a375d25ed None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:36:25.941486 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:36:25.943772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:36:25.945650 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1379/2769] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:36:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:36:25.963169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0506fe672a45bc8bbad160bd09780c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:26.026252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0506fe672a45bc8bbad160bd09780c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:26.042750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1a6a0fd-56a0-4219-903a-6d5d0140cfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0506fe672a45bc8bbad160bd09780c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:26.057186 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1391/2770] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:25 2022] DELETE /identity/v3/users/7b0506fe672a45bc8bbad160bd09780c => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:28.730722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244762a0-a433-4688-814c-744a375d25ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:28.734843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-244762a0-a433-4688-814c-744a375d25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:28.815094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:28.881820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244762a0-a433-4688-814c-744a375d25ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:28.888849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:28.892723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:28.893302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:28.893778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] PATH_INFO: `/v3/projects/5eab98ddbb994a599add8e65758bb605` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:28.896319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eab98ddbb994a599add8e65758bb605)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:28.900454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:29.189347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e216f0-b988-4204-b8fd-3e3602dbb557 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:29.190096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e216f0-b988-4204-b8fd-3e3602dbb557 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:29.190618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e216f0-b988-4204-b8fd-3e3602dbb557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:29.231269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eab98ddbb994a599add8e65758bb605', 'request_id': 'req-25da725e-c291-4acf-bf27-890d5ebe335c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:29.255349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eab98ddbb994a599add8e65758bb605', 'request_id': 'req-25da725e-c291-4acf-bf27-890d5ebe335c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:29.296057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eab98ddbb994a599add8e65758bb605', 'request_id': 'req-25da725e-c291-4acf-bf27-890d5ebe335c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:29.306937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-08e216f0-b988-4204-b8fd-3e3602dbb557 None None] MFA Rules not processed for user `cc67cd38dc584936b88d4f0185f3e8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:29.310652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-08e216f0-b988-4204-b8fd-3e3602dbb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:29.484864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] The token cache is being invalidate because project 5eab98ddbb994a599add8e65758bb605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:29.488761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:29.492537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-25da725e-c291-4acf-bf27-890d5ebe335c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:29.499761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1380/2771] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:28 2022] DELETE /identity/v3/projects/5eab98ddbb994a599add8e65758bb605 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:29.508149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:29.509184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:29.509952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:29.588034 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1392/2772] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:29.605396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:29.608954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4100b3-6955-4578-9035-652acbfcf09b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:29.609237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4100b3-6955-4578-9035-652acbfcf09b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:29.609569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4100b3-6955-4578-9035-652acbfcf09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:29.611788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:29.677484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ab4100b3-6955-4578-9035-652acbfcf09b None None] MFA Rules not processed for user `cc67cd38dc584936b88d4f0185f3e8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:29.679244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab4100b3-6955-4578-9035-652acbfcf09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:29.734797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1393/2773] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:36:29.882803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1381/2774] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:29.896922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:29.897426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:29.897923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:29.972437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:29.974232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:30.006975 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1394/2775] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:30.012198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:30.047913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b3cb-0863-4059-bf20-095c3c53eef2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:30.065051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:30.066252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:30.067250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:30.071998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:30.073784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:30.074806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:30.082058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:30.140124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1382/2776] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:36:30.147682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:30.174695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c1b8-96df-499a-9bea-00add29cfe7a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:30.198193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:30.200964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:30.202442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:30.202932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:30.207621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:30.213313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:30.243624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:30.247903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:30.324768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18e7cd-8c08-4af5-8981-3ffdd115f559 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:30.348949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:30.352103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:30.353883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:30.358209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] PATH_INFO: `/v3/projects/de42762f81684f95b592497ddd4e1422` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:30.362488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=de42762f81684f95b592497ddd4e1422)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:30.369761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:30.456064 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1395/2777] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:30 2022] POST /identity/v3/projects => generated 403 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:36:30.459698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:30.626427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:30.723581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:30.740503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de42762f81684f95b592497ddd4e1422', 'request_id': 'req-4965484c-068b-4f0f-b024-323264b0b5ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:30.777385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de42762f81684f95b592497ddd4e1422', 'request_id': 'req-4965484c-068b-4f0f-b024-323264b0b5ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:30.787294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e75e-e393-4473-988a-fe6fae79b3ae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:30.803689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de42762f81684f95b592497ddd4e1422', 'request_id': 'req-4965484c-068b-4f0f-b024-323264b0b5ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:30.895129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] The token cache is being invalidate because project de42762f81684f95b592497ddd4e1422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:30.895129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:30.896238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4965484c-068b-4f0f-b024-323264b0b5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:30.898719 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1383/2778] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:30 2022] DELETE /identity/v3/projects/de42762f81684f95b592497ddd4e1422 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:30.910170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e6c1-fa90-47b2-b079-f604005d666d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:30.910758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e6c1-fa90-47b2-b079-f604005d666d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:30.912180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e6c1-fa90-47b2-b079-f604005d666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:30.977850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d164e6c1-fa90-47b2-b079-f604005d666d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:30.980458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d164e6c1-fa90-47b2-b079-f604005d666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:31.022004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:31.023447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.024243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.024953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.030095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:31.037390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:31.262803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1384/2779] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:31.276757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.277099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.277295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.277824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1396/2780] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:30 2022] POST /identity/v3/users => generated 302 bytes in 821 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:36:31.284984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:31.289260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:31.336691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:31.344843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:31.349056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593a9fe-8794-4acd-9559-20badfcd48e1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:31.379548 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1385/2781] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:31.381635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:31.392435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:31.394687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.400150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.404640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.415426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:31.425295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba28061-bc01-463a-88f2-02b60bcb72c4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:31.433260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:31.465541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:31.466927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.468235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.469112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.475223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:31.477699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:31.500088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:31.500613 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1397/2782] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:31.504222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:31.569909 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1386/2783] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:31.572915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea0c5-b732-4e70-96d3-eda11327d658 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:31.574062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:31.599070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:31.607208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.614479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.615121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.616400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:31.621333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d56b-d5f0-4a26-bde5-41e2c54c74df admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:31.627266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:31.649587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:31.685288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:31.688691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:31.696318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:31.700805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:31.714824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1398/2784] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:31.715168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:31.733366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:31.733612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:32.012205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1387/2785] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:31 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:32.031980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:32.150982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25707356-1b08-4aa0-bc49-3a57b56999bf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:32.337394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:32.402840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335527-fc14-467c-a7db-9baae2571958 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:32.413544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:32.415526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:32.416071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:32.416966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] PATH_INFO: `/v3/projects/83f4d8accaf7424cb88d1327e40a1e9e/users/434cd2fc0e8144b1ab676a4bf7605339/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:32.454961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f4d8accaf7424cb88d1327e40a1e9e, user_id=434cd2fc0e8144b1ab676a4bf7605339, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:32.461078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:32.467900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:32.469764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:32.469764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:32.469764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:32.476696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:32.657754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1388/2786] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:32 2022] PUT /identity/v3/projects/83f4d8accaf7424cb88d1327e40a1e9e/users/434cd2fc0e8144b1ab676a4bf7605339/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:32.664359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:32.672627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:32.695364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:32.699056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:32.758136 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1399/2787] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 1044 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:32.777345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:32.779490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:32.849697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243c85-51d4-487a-aa21-0157bf63e0ea service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:33.077977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab9aa0-e59b-4100-b1bf-c87955d22744 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:33.095716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:33.097253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:33.100651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:33.101539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] PATH_INFO: `/v3/users/6a310d2bd16e4d52841042364253a86b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:33.106933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a310d2bd16e4d52841042364253a86b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:33.116852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:33.239582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:33.241121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:33.241644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:33.242138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:33.243464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:33.247926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c884-4fba-4099-9a0d-01f02e32d1f3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:33.648218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1400/2788] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:32 2022] POST /identity/v3/users => generated 293 bytes in 868 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:33.656309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:33.656769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:33.661762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:33.713850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a310d2bd16e4d52841042364253a86b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:33.809806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:33.819369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:33.830624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a310d2bd16e4d52841042364253a86b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:33.875995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a310d2bd16e4d52841042364253a86b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:33.890415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1401/2789] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:33.899485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:33.958629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a310d2bd16e4d52841042364253a86b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:33.961478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de0819-f858-48e5-837a-390b0b81aac7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:33.966711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a310d2bd16e4d52841042364253a86b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:34.023861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:34.027649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:34.029328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:34.032520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:34.033523 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1389/2790] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:32 2022] DELETE /identity/v3/users/6a310d2bd16e4d52841042364253a86b => generated 0 bytes in 1369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:34.039681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:34.046993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:34.096968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:34.098374 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1402/2791] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:34.099815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:34.179455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:34.184329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:34.507869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:34.525421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabd98-898b-46fc-a93f-00e66d22885a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:34.558236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d36d4-8b9d-4e3c-8216-e2ee2d8d0835 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:34.610290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:34.613640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:34.618707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:34.619798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:34.622263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:34.636985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:34.697494 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1390/2792] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:34.703970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:34.741463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:34.745874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:34.746381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:34.751627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:34.764100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c373-5e4d-4f90-bd92-a02979a1d7bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:34.766120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:34.796607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:34.800199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:34.800663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:34.801012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] PATH_INFO: `/v3/projects/278001113cdf41b5b902ac5a620d3f52/users/71b61b8c7fc34b64a4e2e1101f40cd05/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:34.837976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:34.845665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba427-7f71-47ab-a552-316adc44ce58 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:34.847709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278001113cdf41b5b902ac5a620d3f52, user_id=71b61b8c7fc34b64a4e2e1101f40cd05, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:34.864341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:34.918191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1403/2793] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:35.044052 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1391/2794] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:34 2022] PUT /identity/v3/projects/278001113cdf41b5b902ac5a620d3f52/users/71b61b8c7fc34b64a4e2e1101f40cd05/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:35.047835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:35.061621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:35.062461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:35.182542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:35.184979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:35.528961 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1404/2795] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:36:35.649020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:35.655124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:35.680694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:35.851987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1b7a8-62cb-4e5d-bf60-73e8a3ed80e0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:35.864278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:35.866527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:35.875209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:35.875209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:35.930993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:35.935483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3e965-5b74-4ebe-ba9f-f397131301de service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:35.987281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1392/2796] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:36.000331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:36.003903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:36.316619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697aac6-aa05-4313-b8b7-334c3afc3ab3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:36.358987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:36.362380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:36.365744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:36.366516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:36.376362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:36.445232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:36.452989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:36.503857 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1405/2797] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:36.773106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:36.775596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:36.776560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:36:36.833391 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:36:36.835493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:36:36.840325 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1393/2798] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:36:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:36:38.416297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:38.422633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:38.489167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd085b-b794-4a4d-b31b-50915a011195 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:38.529557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:38.533828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:38.536729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:38.537550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] PATH_INFO: `/v3/projects/cf616fd82dd34c7d92f4d8e9e80f89f4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:38.544767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf616fd82dd34c7d92f4d8e9e80f89f4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:38.556378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:38.732994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:38.815910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf616fd82dd34c7d92f4d8e9e80f89f4', 'request_id': 'req-8df2f443-c044-4777-9f75-be0562dcdaf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:38.927364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf616fd82dd34c7d92f4d8e9e80f89f4', 'request_id': 'req-8df2f443-c044-4777-9f75-be0562dcdaf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:38.968420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf616fd82dd34c7d92f4d8e9e80f89f4', 'request_id': 'req-8df2f443-c044-4777-9f75-be0562dcdaf3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.012763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] The token cache is being invalidate because project cf616fd82dd34c7d92f4d8e9e80f89f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:39.012763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.012763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df2f443-c044-4777-9f75-be0562dcdaf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.012763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1406/2799] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:38 2022] DELETE /identity/v3/projects/cf616fd82dd34c7d92f4d8e9e80f89f4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:39.016102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:39.022043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:39.333515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a886f-61f0-46bf-8ad5-f5e959186314 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:39.359783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:39.361107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:39.361646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:39.362095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] PATH_INFO: `/v3/users/e8c306ba0e2a4e2e8f2ca22d3cef384c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:39.364816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c306ba0e2a4e2e8f2ca22d3cef384c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:39.369437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:39.743685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c306ba0e2a4e2e8f2ca22d3cef384c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.874435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c306ba0e2a4e2e8f2ca22d3cef384c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.915542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c306ba0e2a4e2e8f2ca22d3cef384c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.985485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c306ba0e2a4e2e8f2ca22d3cef384c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:39.987517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c306ba0e2a4e2e8f2ca22d3cef384c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:40.015819 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1394/2800] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:36:39 2022] DELETE /identity/v3/users/e8c306ba0e2a4e2e8f2ca22d3cef384c => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:41.679059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:41.679924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:41.680070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:41.761394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] MFA Rules not processed for user `f76aa48506e048d4b96b94b4198e6b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:41.764614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:42.026104 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1407/2801] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:42.049836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:42.052755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:42.167887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:42.397113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afdca6-a543-4a91-9372-3a45492f1ca5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:42.411418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:42.420406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:42.420406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:42.422867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:42.428345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:42.673783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:42.676960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08025ed8-d133-413a-ad83-94a29f3afe03 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:42.713284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:42.714087 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1395/2802] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:42.717079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:42.979493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e7390-312b-47f4-8647-4aec1720c16a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:43.006249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:43.018520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:43.019163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:43.019670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] PATH_INFO: `/v3/projects/d6f013a44999493b83fa035e0bb80cb5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:43.027268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f013a44999493b83fa035e0bb80cb5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:43.059649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:43.461034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:43.521082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f013a44999493b83fa035e0bb80cb5', 'request_id': 'req-36a6d836-a57e-4a38-ad94-38cad990cf20'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:43.659408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f013a44999493b83fa035e0bb80cb5', 'request_id': 'req-36a6d836-a57e-4a38-ad94-38cad990cf20'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:43.684547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f013a44999493b83fa035e0bb80cb5', 'request_id': 'req-36a6d836-a57e-4a38-ad94-38cad990cf20'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:43.728136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] The token cache is being invalidate because project d6f013a44999493b83fa035e0bb80cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:36:43.728136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:43.728136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36a6d836-a57e-4a38-ad94-38cad990cf20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:36:43.735368 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1408/2803] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:36:42 2022] DELETE /identity/v3/projects/d6f013a44999493b83fa035e0bb80cb5 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:43.745245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:43.747267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:43.748355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:43.825429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:43.829779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:44.084185 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1396/2804] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:44.097039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:44.100938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:44.102594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:44.187935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:44.191232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:44.220254 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1409/2805] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:36:44.227301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:44.268023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d69f-a8b2-43bb-a8ac-9ea916ea0709 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:44.321259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:44.322939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:44.324128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:44.325240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:44.334343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:44.338843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:44.350141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:36:44.354190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:44.368202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:44.435689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1397/2806] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:44.471920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:44.528861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609349e5-d113-46ac-aeed-d313817b469a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:44.590094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:44.591659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:44.591659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:44.592201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:44.600049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:44.610247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:44.761288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89c207-7e11-4551-83f7-1e596821f1ca None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:44.821569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:44.827029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:44.827029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:44.827029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:44.835292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:44.852530 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1398/2807] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:44 2022] POST /identity/v3/projects => generated 381 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:44.855355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:44.901967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:44.909515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:44.948979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1410/2808] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:45.005439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:45.180739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89db40-6dd4-44e5-ab25-8eee5430a130 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:45.211807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:45.214245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:45.214808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:45.215340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:45.224734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:45.233803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:45.563122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:45.563503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1399/2809] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:44 2022] POST /identity/v3/users => generated 291 bytes in 704 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:45.635571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a957f-7c83-481b-956c-ee24d97513a3 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:45.669429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:45.684726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:45.685908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:45.686411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:45.687758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:45.691549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:45.758885 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1411/2810] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:45.765632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:45.811718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7e7f-a09f-4838-8558-0d753b58de0d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:45.844182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:45.845279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:45.845745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:45.846186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:45.847336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:45.856851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4bb9-4caf-4f68-bb5c-98acd9f92cce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:45.903369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:45.906478 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1400/2811] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:45.949384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de69ca-b26b-41cf-9b71-5feb4e827908 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:45.963728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:45.964620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:45.964897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:45.965386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb/users/0bbad3c441544962b1397f90d80b6153/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:46.035426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc9b2da40434437a6ce05b82deadbdb, user_id=0bbad3c441544962b1397f90d80b6153, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:46.051074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:46.199174 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1412/2812] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:45 2022] PUT /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb/users/0bbad3c441544962b1397f90d80b6153/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:46.211574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:46.212745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:46.213433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:46.332692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] MFA Rules not processed for user `0bbad3c441544962b1397f90d80b6153`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:46.335219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:46.646028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1401/2813] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:46.653549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:46.982625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c812886-2e64-4fce-8659-9d607b44ffcc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:47.019507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:47.021321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:47.022133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:47.022878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:47.024492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:47.029882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:47.288591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:47.321970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1413/2814] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:46 2022] POST /identity/v3/projects => generated 383 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:47.347186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:47.369427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453a5c-9355-4f22-a93f-05d6bbdd85af None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:47.592204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:47.593437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:47.593954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:47.594392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:47.606847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:47.611014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:48.009001 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1402/2815] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:47 2022] POST /identity/v3/users => generated 298 bytes in 685 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:48.011841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:48.045122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb3a2e-e2fb-4bc1-82f7-d4c02d5fee37 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:48.071390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:48.076302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:48.077313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:48.077698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:48.082470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:48.085056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:48.131084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1414/2816] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:48.138769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:48.232946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d803dc-080f-46e8-999b-80bb0dd3f9ee admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:48.260371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:48.261428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:48.261891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:48.264157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] PATH_INFO: `/v3/projects/aa9e1947d2784737a01746b4777bbf09/users/762c960659dd4f0c8bd6ac7029d00b61/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:48.333036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9e1947d2784737a01746b4777bbf09, user_id=762c960659dd4f0c8bd6ac7029d00b61, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:48.345938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:48.502639 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1403/2817] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:48 2022] PUT /identity/v3/projects/aa9e1947d2784737a01746b4777bbf09/users/762c960659dd4f0c8bd6ac7029d00b61/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:48.509246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:48.544110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a48cd-a5e5-47e7-b2e5-12acb584f184 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:48.894725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:48.895850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:48.896344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:48.896799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:48.898068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:48.901353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d478c4c-a0ca-4133-9206-ed982f323294 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:48.954125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1415/2818] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:48.955870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:48.981164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:49.006267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acea86a-d19b-4f9d-927d-e30409d93b00 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:49.022969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:49.024671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:49.025177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:49.025685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] PATH_INFO: `/v3/projects/aa9e1947d2784737a01746b4777bbf09/users/762c960659dd4f0c8bd6ac7029d00b61/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:49.037870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9e1947d2784737a01746b4777bbf09, user_id=762c960659dd4f0c8bd6ac7029d00b61, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:49.043607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:49.099589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1404/2819] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:48 2022] PUT /identity/v3/projects/aa9e1947d2784737a01746b4777bbf09/users/762c960659dd4f0c8bd6ac7029d00b61/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:49.228360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79fc8-d923-4e33-88b6-ce33c774db6c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:49.229221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79fc8-d923-4e33-88b6-ce33c774db6c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:49.229392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79fc8-d923-4e33-88b6-ce33c774db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:49.344404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d5e79fc8-d923-4e33-88b6-ce33c774db6c None None] MFA Rules not processed for user `762c960659dd4f0c8bd6ac7029d00b61`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:49.344404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5e79fc8-d923-4e33-88b6-ce33c774db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:49.650167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1416/2820] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:36:50.073576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:50.407094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1c7f-ecb3-4920-a2da-d4042a7a8a20 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:50.445302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:50.446443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:50.446912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:50.447411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:50.503539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:50.508565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:50.581755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1405/2821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:50.616391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca3afd-faa4-41eb-8d66-2cc1ab512983 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:50.617244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca3afd-faa4-41eb-8d66-2cc1ab512983 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:50.617577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca3afd-faa4-41eb-8d66-2cc1ab512983 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:50.620483 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1417/2822] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:36:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:36:50.641053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:36:50.686603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:50.730606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc3b5-d1a0-4343-8da2-61315a55315b service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:50.752296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:50.780337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:50.781356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:50.782126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:50.789410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:50.872342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:50.899750 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1406/2823] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:36:50 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:51.171475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abeaa-ae2b-4b43-bf46-a2936960ea1f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:51.171939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abeaa-ae2b-4b43-bf46-a2936960ea1f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:51.174394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abeaa-ae2b-4b43-bf46-a2936960ea1f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:51.177942 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1418/2824] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:36:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:36:51.240430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:36:51.340793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:51.402269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90d8a3-6b55-4185-882e-0f10930dfeed tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:51.420287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:51.421524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:51.422059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:51.422851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:51.428571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:51.439993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf9dd5-b49a-4eac-a5d2-49ece4edc89a tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:51.455464 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1407/2825] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:36:51 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:51.864712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:51.865434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:51.865877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:51.933114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] MFA Rules not processed for user `0bbad3c441544962b1397f90d80b6153`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:51.938871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:52.303461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1419/2826] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:53.633588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:53.634446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:53.635328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:53.758629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] MFA Rules not processed for user `fe9e839b68de4530b70e6a12fb5d00f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:36:53.766071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:53.906405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:53.969605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326404b6-52e6-44a6-889f-f6ecc973c769 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:53.977947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:53.979200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:53.979578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:53.979924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:54.001928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:54.009250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:54.023308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:54.039692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1420/2827] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:36:54.049979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1408/2828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:36:54.051278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:54.056511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:54.353372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04472cc-9532-4b78-b3aa-5d7efe9759eb service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:54.367368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:54.370363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:54.370363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:54.370363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:54.370960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:54.375122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:54.705197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1421/2829] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:36:54 2022] POST /identity/v3/projects => generated 371 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:54.708392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:54.783445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667229-5918-4b0f-9b66-3c32c4cb4e99 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:55.029938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:55.100489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:55.104452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:55.104452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:55.104452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:55.104452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:55.116844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:55.305018 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1409/2830] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:36:54 2022] POST /identity/v3/users => generated 292 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:36:55.310794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:55.349664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07b38-b893-4c2b-a98c-64567dfa4420 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:55.373558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:55.374618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:55.375114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:55.375660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:55.377209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:55.380479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:55.434712 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1422/2831] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:55.442072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:55.500898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecf79-3ced-432b-a09f-4fb5a8b7c0bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:55.532079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:55.538152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:55.538687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:55.539169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] PATH_INFO: `/v3/projects/25520777a4444a30b5310052aba08aa2/users/3bf9d1a16be14b6fa43f6ad95e456342/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:55.632798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25520777a4444a30b5310052aba08aa2, user_id=3bf9d1a16be14b6fa43f6ad95e456342, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:55.653571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:55.822662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1410/2832] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:55 2022] PUT /identity/v3/projects/25520777a4444a30b5310052aba08aa2/users/3bf9d1a16be14b6fa43f6ad95e456342/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:36:55.831655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:55.862119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbdc69-e2f2-4b61-bb60-222ed855e388 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:56.118572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:56.122201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:56.123517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:56.124083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:56.125346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:56.128596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:56.166849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1423/2833] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:36:56.169295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:56.214873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8f73-b5df-42ff-916a-0cc95094dee8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:56.235487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:56.237302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:56.240484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:56.245287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] PATH_INFO: `/v3/projects/25520777a4444a30b5310052aba08aa2/users/3bf9d1a16be14b6fa43f6ad95e456342/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:56.256097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25520777a4444a30b5310052aba08aa2, user_id=3bf9d1a16be14b6fa43f6ad95e456342, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:56.268361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f1f90-e39f-43d2-9cdb-3bee4cf143b1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:56.332406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1411/2834] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:36:56 2022] PUT /identity/v3/projects/25520777a4444a30b5310052aba08aa2/users/3bf9d1a16be14b6fa43f6ad95e456342/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:36:56.922186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:57.278592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b28b5-ef44-48ce-9cbc-422e777c1c97 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:57.303277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:57.584169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:57.586905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:57.587877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:57.591246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:57.600113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:57.652388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:57.656653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:57.709468 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1424/2835] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:36:57.738331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b72fd-370a-4328-92cd-c2194c4fe907 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:57.739292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b72fd-370a-4328-92cd-c2194c4fe907 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:57.739292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b72fd-370a-4328-92cd-c2194c4fe907 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:57.743587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1412/2836] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:36:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:36:57.764835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:36:57.769435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:36:57.862355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:58.137372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468dfef-1e40-4bda-bf72-e3abeda51701 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:58.152567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:58.155201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:58.160772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:58.160772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:58.161604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:58.172063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:58.183453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1425/2837] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:36:57 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:36:58.738463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fdd1-b043-4d03-8ca1-93a14085632f None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:58.739285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fdd1-b043-4d03-8ca1-93a14085632f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:58.739479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fdd1-b043-4d03-8ca1-93a14085632f None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:58.743099 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1413/2838] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:36:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:36:58.754291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:36:58.792555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:36:58.833439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f32c-4033-428b-90bd-42320d5e2891 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:36:58.858942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:36:58.860738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:36:58.861513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:36:58.863669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:36:58.871444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:36:58.885682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:36:58.888829 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1426/2839] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:36:58 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:37:00.064931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba064-b828-4aac-8490-7d93bdb31981 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:00.065795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba064-b828-4aac-8490-7d93bdb31981 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:00.066221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba064-b828-4aac-8490-7d93bdb31981 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:00.075430 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1414/2840] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:37:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:37:00.082439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:37:00.139054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:00.176211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81f78-9c5b-4b15-883d-7647e86cf395 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:00.204477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:00.212669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:00.218850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:00.218850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:00.218850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:00.227459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53270-c1d3-420c-8b90-89f8f16dd4ac tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:00.234107 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1427/2841] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:37:00 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:00.614646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:00.615356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:00.615635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:00.687419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] MFA Rules not processed for user `0bbad3c441544962b1397f90d80b6153`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:00.695900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:00.876127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d45-ea08-47d6-8344-acd157478701 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:00.876728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d45-ea08-47d6-8344-acd157478701 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:00.877206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101d45-ea08-47d6-8344-acd157478701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:00.934646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cf101d45-ea08-47d6-8344-acd157478701 None None] MFA Rules not processed for user `803f3ac2d73740ad9ab92cef252f07e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:00.940491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cf101d45-ea08-47d6-8344-acd157478701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:01.013429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1415/2842] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:01.227509 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1428/2843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:03.606782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:03.614123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:03.888725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c708f-8a35-426a-9b5b-4f65a244c03a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:03.891176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c708f-8a35-426a-9b5b-4f65a244c03a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:03.892043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c708f-8a35-426a-9b5b-4f65a244c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:03.897350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4fbc-a706-4481-a2c3-ee94b7404323 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-957c708f-8a35-426a-9b5b-4f65a244c03a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:03.905369 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:03.907375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:37:03.921997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:03.923475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:03.925794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:03.926471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:03.930403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:03.944323 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1429/2844] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:37:03.988478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:03.992557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:04.018754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1416/2845] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:04.056749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8766f-566c-48b6-a86b-df0a07b86cde None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:04.057165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8766f-566c-48b6-a86b-df0a07b86cde None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:04.058123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8766f-566c-48b6-a86b-df0a07b86cde None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:04.061229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1430/2846] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:37:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:37:04.079266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:37:04.113580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3278c-2c8e-4c05-ba64-84cc54beb0a8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:04.114134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3278c-2c8e-4c05-ba64-84cc54beb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:04.114719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3278c-2c8e-4c05-ba64-84cc54beb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:04.192205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:04.217380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e2b3278c-2c8e-4c05-ba64-84cc54beb0a8 None None] MFA Rules not processed for user `803f3ac2d73740ad9ab92cef252f07e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:04.229673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e2b3278c-2c8e-4c05-ba64-84cc54beb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:04.236485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885786b4-9e73-4235-bd1f-717f12852f81 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:04.257218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:04.261962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:04.262783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:04.263429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:04.267901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:04.283526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:04.287072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1417/2847] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:37:04 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:04.288901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:04.295112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:04.299220 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1431/2848] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:04.494709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:04.745742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44793-c5c3-4cd3-a0e2-6fa3a1c6cc79 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:04.800521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:04.805873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:04.812481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:04.812481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] PATH_INFO: `/v3/users/cc67cd38dc584936b88d4f0185f3e8a0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:04.822863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc67cd38dc584936b88d4f0185f3e8a0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:04.827929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:05.203085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc67cd38dc584936b88d4f0185f3e8a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:05.351535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc67cd38dc584936b88d4f0185f3e8a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:05.397888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc67cd38dc584936b88d4f0185f3e8a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:05.540480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc67cd38dc584936b88d4f0185f3e8a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:05.546014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc67cd38dc584936b88d4f0185f3e8a0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:05.577078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1418/2849] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:04 2022] DELETE /identity/v3/users/cc67cd38dc584936b88d4f0185f3e8a0 => generated 0 bytes in 1289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:05.733023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404093b3-58fc-4cf3-ac56-fb3714ffa874 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:05.734922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404093b3-58fc-4cf3-ac56-fb3714ffa874 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:05.734922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404093b3-58fc-4cf3-ac56-fb3714ffa874 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:05.736608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1432/2850] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:37:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:37:05.749899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:37:05.769138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:06.031252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:06.031992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:06.032646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:06.048605 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:06.049943 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:37:06.069488 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1433/2851] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:37:06.117756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:06.122583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:06.249686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:06.337894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5183f-b54a-4436-afbc-077c7efb6840 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:06.360025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:06.361365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:06.361983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:06.368789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:06.370827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:06.374902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c0c44-4fa0-4f01-8f6f-cd2f31f5746e tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:06.395868 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1419/2852] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:37:05 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:07.175222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:07.179198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:07.240274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:07.480120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3162c-8f8f-4fe9-bc70-b447b18961b8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:07.499769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:07.500756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:07.501204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:07.501654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] PATH_INFO: `/v3/projects/0f91c2932cc340f485c55568d70fe0b0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:07.510133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f91c2932cc340f485c55568d70fe0b0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:07.514404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:07.651203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:07.651901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:07.652207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:07.656164 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1420/2853] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:37:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:37:07.690999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:37:07.762880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:07.808421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e24f8-0af2-48da-85d1-f9b06b6fc4ab None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:07.816645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f91c2932cc340f485c55568d70fe0b0', 'request_id': 'req-e69ca73d-67c6-424d-8cbe-a110fb895c4d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:07.906355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f91c2932cc340f485c55568d70fe0b0', 'request_id': 'req-e69ca73d-67c6-424d-8cbe-a110fb895c4d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:07.940921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f91c2932cc340f485c55568d70fe0b0', 'request_id': 'req-e69ca73d-67c6-424d-8cbe-a110fb895c4d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:07.999943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] The token cache is being invalidate because project 0f91c2932cc340f485c55568d70fe0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:08.005195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:08.005195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e69ca73d-67c6-424d-8cbe-a110fb895c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:08.008604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1434/2854] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:07 2022] DELETE /identity/v3/projects/0f91c2932cc340f485c55568d70fe0b0 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:08.021612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d865-2f95-4530-bd16-6a3e3a56b9f8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.022082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d865-2f95-4530-bd16-6a3e3a56b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.022693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894d865-2f95-4530-bd16-6a3e3a56b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.059438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:08.060458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.060944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.061522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.065369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:08.070042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0994733-4df7-422f-badd-661b84344953 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:08.089350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1421/2855] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:37:07 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:08.094464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6894d865-2f95-4530-bd16-6a3e3a56b9f8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:08.100141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6894d865-2f95-4530-bd16-6a3e3a56b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:08.358532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1435/2856] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:08.377378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.377894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.378399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.436542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.437213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.437912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.489435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:08.491807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:08.507346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] MFA Rules not processed for user `0bbad3c441544962b1397f90d80b6153`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:08.514413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:08.531445 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1422/2857] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:08.538422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:08.576068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6d1c9-d45e-4ffb-82ff-596a2086b644 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:08.593253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:08.594358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.594852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.595392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.596680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:08.597223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:08.600475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:08.698446 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1423/2858] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:08.698446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:08.749144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebcf79-24c1-4c81-b382-dbffd1cfa440 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:08.772732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:08.774035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:08.778479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:08.784475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:08.787741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:08.796653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:08.800880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:08.845790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1436/2859] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:09.026952 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1424/2860] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:08 2022] POST /identity/v3/projects => generated 383 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:09.036650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:09.071918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff6038-ca73-467e-97f0-178bff9f589f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:09.274063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:09.276441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:09.277116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:09.277792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:09.279866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:09.285593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:09.489744 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1437/2861] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:09 2022] POST /identity/v3/users => generated 292 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:37:09.501401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:09.530557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9ded-a42e-458b-98c9-04460bf45970 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:09.570756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:09.572069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:09.572560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:09.573067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:09.574379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:09.585672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:09.644845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1425/2862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:09.647821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:09.707120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5636ad8-3345-4e4b-a13c-db552ecdec8d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:09.735966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:09.739634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:09.740183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:09.740776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:09.742346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:09.761697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592cba2-e1c2-4ed8-ba45-8957ef1fc483 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:09.816948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1438/2863] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:09.820460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:09.863670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853895d9-96a0-4ac9-84e4-9a80924a9a16 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:09.882298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:09.882298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:09.882298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:09.882298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] PATH_INFO: `/v3/projects/36b7984e889d41e1a0c1b377eee8f8c8/users/ae75884a70da45e582cee8258d1f2a7a/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:09.940330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b7984e889d41e1a0c1b377eee8f8c8, user_id=ae75884a70da45e582cee8258d1f2a7a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:09.953025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:10.140695 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1426/2864] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:09 2022] PUT /identity/v3/projects/36b7984e889d41e1a0c1b377eee8f8c8/users/ae75884a70da45e582cee8258d1f2a7a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:10.159734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666864-1161-405d-9e62-b206179705ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:10.160570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666864-1161-405d-9e62-b206179705ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:10.161429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666864-1161-405d-9e62-b206179705ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:10.270656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a7666864-1161-405d-9e62-b206179705ec None None] MFA Rules not processed for user `ae75884a70da45e582cee8258d1f2a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:10.275811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7666864-1161-405d-9e62-b206179705ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:10.552604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1439/2865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:11.050873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:11.056127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:11.288658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:11.381584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b896cd-9f48-48fa-a26c-468da1632b08 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:11.416090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:11.417761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:11.419119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:11.419890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:11.466995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:11.472073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eb426-6f1a-40d4-b85d-21e2eaaa6f21 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:11.515573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1427/2866] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:12.998177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:12.999036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:12.999263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:13.118589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] MFA Rules not processed for user `71b61b8c7fc34b64a4e2e1101f40cd05`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:13.121868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:13.317060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:13.378386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1440/2867] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:14.168448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:14.169076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:14.169521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:14.230561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:14.233568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:14.293312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:14.297497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:14.383327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9ed42-a4b2-4e35-a413-47d57183274a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:14.400292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:14.402303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:14.404304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:14.406040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:14.433374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:14.444961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe4801-ed3d-4400-808f-7bf005ef4549 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:14.493191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1441/2868] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:14.510280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1428/2869] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:14.745129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41866-d0cd-4824-ba26-710928d0e728 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:14.745440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41866-d0cd-4824-ba26-710928d0e728 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:14.745852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41866-d0cd-4824-ba26-710928d0e728 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:14.747430 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1442/2870] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:37:14.770809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:37:14.804740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:14.807953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:15.000172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:15.000172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:15.000172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:15.061697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be2ec-e0e8-4882-9f0b-dcbb32e938e0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:15.074172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762c960659dd4f0c8bd6ac7029d00b61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9e1947d2784737a01746b4777bbf09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:15.076258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:15.076732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:15.077211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:15.079824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorizing `identity:get_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:15.085638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:15.105510 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1429/2871] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:37:14 2022] GET /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 381 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:37:15.130060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] MFA Rules not processed for user `434cd2fc0e8144b1ab676a4bf7605339`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:15.132714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:15.520283 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1443/2872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:18.761911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:18.799238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d692-bf27-445e-add3-9f64c9795489 tempest-QuotasAdminNegativeTest-2021081641 tempest-QuotasAdminNegativeTest-2021081641-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:18.817986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:18.820871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:18.821784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:18.822605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:18.851265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:18.854778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:18.882691 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1430/2873] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:21.378601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:21.387502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:21.562326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:21.566547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:21.932284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411935d9-88a8-432c-8ffb-07857f637c7c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:21.956795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:21.958108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:21.958595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:21.960521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] PATH_INFO: `/v3/users/4360a08eed56405b99333776285fef3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:21.966313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4360a08eed56405b99333776285fef3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:21.977132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:22.051547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cef536-4b32-45ef-b623-0e4888b21a98 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:22.077085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:22.077085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:22.077085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:22.077085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] PATH_INFO: `/v3/users/0bbad3c441544962b1397f90d80b6153` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:22.100527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbad3c441544962b1397f90d80b6153)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:22.127006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:22.242258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:22.775081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbad3c441544962b1397f90d80b6153'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:22.822937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4360a08eed56405b99333776285fef3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:22.829314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4360a08eed56405b99333776285fef3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:22.960530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbad3c441544962b1397f90d80b6153'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.026806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbad3c441544962b1397f90d80b6153'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.070457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4360a08eed56405b99333776285fef3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.104845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:23.130064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbad3c441544962b1397f90d80b6153'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.133458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4360a08eed56405b99333776285fef3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.141592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d46207a-8cc1-41bb-8045-8df00b60faca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbad3c441544962b1397f90d80b6153'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.161704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1431/2874] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:21 2022] DELETE /identity/v3/users/0bbad3c441544962b1397f90d80b6153 => generated 0 bytes in 1599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:23.177640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:23.178140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:23.178641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:23.216643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2669ada0-a845-4642-93e5-569d902fe67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4360a08eed56405b99333776285fef3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:23.260623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1444/2875] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:21 2022] DELETE /identity/v3/users/4360a08eed56405b99333776285fef3a => generated 0 bytes in 1875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:23.263549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a053025-35b4-4380-92df-f179c7190556 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:23.263993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a053025-35b4-4380-92df-f179c7190556 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:23.275306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a053025-35b4-4380-92df-f179c7190556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:23.315769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:23.326874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:23.374569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1a053025-35b4-4380-92df-f179c7190556 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:23.380013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a053025-35b4-4380-92df-f179c7190556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:23.673346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1432/2876] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:23.709746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:23.713489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:23.721110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1445/2877] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:23.793470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a053025-35b4-4380-92df-f179c7190556 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:23.800703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a053025-35b4-4380-92df-f179c7190556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:24.124562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42908874-2f93-437e-b539-615d1cc5f2ea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:24.148114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a053025-35b4-4380-92df-f179c7190556 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:24.151584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:24.153582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:24.158979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:24.162741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:24.168216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:24.169335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:24.178053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:24.178053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:24.217104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:24.221694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:24.228765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:24.235061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:24.268148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1433/2878] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:37:24.310322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1446/2879] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:37:26.925571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:26.930927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:27.014961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464a221-6c03-44b8-846f-71a2668bdcb3 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:27.063242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:27.067661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:27.077339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:27.079106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] PATH_INFO: `/v3/projects/74eef3bf938c491d8a2f5192ba598c19` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:27.113089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74eef3bf938c491d8a2f5192ba598c19)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:27.124629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:27.362411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:27.396267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74eef3bf938c491d8a2f5192ba598c19', 'request_id': 'req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:27.430325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74eef3bf938c491d8a2f5192ba598c19', 'request_id': 'req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:27.452839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74eef3bf938c491d8a2f5192ba598c19', 'request_id': 'req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:27.709003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] The token cache is being invalidate because project 74eef3bf938c491d8a2f5192ba598c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:27.709003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:27.709003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:27.712617 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1434/2880] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:26 2022] DELETE /identity/v3/projects/74eef3bf938c491d8a2f5192ba598c19 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:27.715035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:27.759792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c44-c2e8-4da4-b24a-642737b3cbff service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:28.035320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:28.038680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:28.039219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:28.039922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] PATH_INFO: `/v3/users/2e3ada01045e4d4b9295b266315e2cd1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:28.044635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3ada01045e4d4b9295b266315e2cd1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:28.052096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:28.139306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:28.142311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:28.198641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed35d1-4f56-4a2f-aed3-427aa8a1f063 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:28.222717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:28.223439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:28.223716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:28.223983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] PATH_INFO: `/v3/projects/bbc9b2da40434437a6ce05b82deadbdb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:28.229065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc9b2da40434437a6ce05b82deadbdb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:28.243796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:28.290479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:28.460299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3ada01045e4d4b9295b266315e2cd1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.462240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3ada01045e4d4b9295b266315e2cd1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.551024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc9b2da40434437a6ce05b82deadbdb', 'request_id': 'req-50025211-e31e-4425-979c-a05686f693dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.578465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc9b2da40434437a6ce05b82deadbdb', 'request_id': 'req-50025211-e31e-4425-979c-a05686f693dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.616531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc9b2da40434437a6ce05b82deadbdb', 'request_id': 'req-50025211-e31e-4425-979c-a05686f693dc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.676214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3ada01045e4d4b9295b266315e2cd1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.754498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3ada01045e4d4b9295b266315e2cd1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.787284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3ada01045e4d4b9295b266315e2cd1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.816016 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1447/2881] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:27 2022] DELETE /identity/v3/users/2e3ada01045e4d4b9295b266315e2cd1 => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:28.866960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] The token cache is being invalidate because project bbc9b2da40434437a6ce05b82deadbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:28.866960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.866960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-50025211-e31e-4425-979c-a05686f693dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:28.874343 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1435/2882] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:28 2022] DELETE /identity/v3/projects/bbc9b2da40434437a6ce05b82deadbdb => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:28.875307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:28.880811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:29.094553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786adf-d66f-40a5-b6a1-b008c98322a8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:29.103317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:29.106360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:29.106580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:29.107082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] PATH_INFO: `/v3/users/762c960659dd4f0c8bd6ac7029d00b61` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:29.110530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762c960659dd4f0c8bd6ac7029d00b61)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:29.118437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:29.405000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:29.406416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:29.407365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:29.429086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762c960659dd4f0c8bd6ac7029d00b61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:29.431348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762c960659dd4f0c8bd6ac7029d00b61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:29.489690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] MFA Rules not processed for user `3bf9d1a16be14b6fa43f6ad95e456342`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:29.491854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:29.562580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762c960659dd4f0c8bd6ac7029d00b61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:29.619173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762c960659dd4f0c8bd6ac7029d00b61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:29.640277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f389847-49f0-4ed5-93f3-33f637986633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762c960659dd4f0c8bd6ac7029d00b61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:29.655758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1448/2883] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:28 2022] DELETE /identity/v3/users/762c960659dd4f0c8bd6ac7029d00b61 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:29.746444 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1436/2884] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:29.767833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:29.768597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:29.769161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:29.817233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] MFA Rules not processed for user `fe9e839b68de4530b70e6a12fb5d00f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:29.821259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:29.899481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:29.978924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:29.982200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:29.993180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1449/2885] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:30.022326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c400ab-9ace-4c95-bd6f-a662c8161073 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:30.092787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:30.170187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:30.171745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:30.172163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:30.172543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] PATH_INFO: `/v3/projects/7c51aa34a4434d0a931063ba18400be8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:30.177141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c51aa34a4434d0a931063ba18400be8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:30.182557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:30.481496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c51aa34a4434d0a931063ba18400be8', 'request_id': 'req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:30.500691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c51aa34a4434d0a931063ba18400be8', 'request_id': 'req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:30.531976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c51aa34a4434d0a931063ba18400be8', 'request_id': 'req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:30.753379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:30.753379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:30.755100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] The token cache is being invalidate because project 7c51aa34a4434d0a931063ba18400be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:30.756016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:30.759714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3ac61b0-d6ed-4330-9e76-c16ddc7c1b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:30.765148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1437/2886] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:29 2022] DELETE /identity/v3/projects/7c51aa34a4434d0a931063ba18400be8 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:30.773745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9cb88-3e4d-44ac-8517-3116a826750e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:30.774250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9cb88-3e4d-44ac-8517-3116a826750e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:30.778429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9cb88-3e4d-44ac-8517-3116a826750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:30.812080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27228a03-f1be-4eda-963e-e63937588f85 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:30.901498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c9f9cb88-3e4d-44ac-8517-3116a826750e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:30.907910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c9f9cb88-3e4d-44ac-8517-3116a826750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:31.044949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:31.046123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.049512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.049512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] PATH_INFO: `/v3/projects/aa9e1947d2784737a01746b4777bbf09` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.070631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9e1947d2784737a01746b4777bbf09)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:31.115927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:31.161130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1438/2887] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:31.176676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.177007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.177461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.256169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:31.258558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:31.310986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1439/2888] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:31.313900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:31.341619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803e4b5-8f0e-40e0-959b-266d625a5851 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:31.352867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:31.355493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.356107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.356715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.358057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:31.358697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:31.365919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:31.436132 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1440/2889] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:31.438526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:31.468688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9e1947d2784737a01746b4777bbf09', 'request_id': 'req-fade99c6-0c9c-4b54-aa4d-72010b3c6182'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:31.489287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fce98-9228-4357-a4a2-88886eba8079 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:31.583950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9e1947d2784737a01746b4777bbf09', 'request_id': 'req-fade99c6-0c9c-4b54-aa4d-72010b3c6182'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:31.613947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9e1947d2784737a01746b4777bbf09', 'request_id': 'req-fade99c6-0c9c-4b54-aa4d-72010b3c6182'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:31.652490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] The token cache is being invalidate because project aa9e1947d2784737a01746b4777bbf09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:31.653294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:31.657731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fade99c6-0c9c-4b54-aa4d-72010b3c6182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:31.670892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1450/2890] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:30 2022] DELETE /identity/v3/projects/aa9e1947d2784737a01746b4777bbf09 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:31.681537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ac89-009a-4928-9765-ad5b7de0860b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.682724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ac89-009a-4928-9765-ad5b7de0860b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.684216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ac89-009a-4928-9765-ad5b7de0860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.695776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:31.745863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b3d9ac89-009a-4928-9765-ad5b7de0860b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:31.749177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b3d9ac89-009a-4928-9765-ad5b7de0860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:31.754748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:31.755438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.755723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.755995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.756824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:31.765593 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1451/2891] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:31.773734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:31.778003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.778610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.779551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.825876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:31.830278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:31.847419 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1452/2892] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:31.849893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:31.875454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361651-31b6-4daa-8b87-77cba044a0e1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:31.885332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:31.886094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:31.887088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:31.887624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:31.888972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:31.889544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:31.892862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:31.931299 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1453/2893] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:31.934836 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1441/2894] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/projects => generated 383 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:31.941195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:31.942055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:31.949136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:31.989480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c6b3-24c6-47a4-a3ee-a482dd25ef16 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.092914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:32.182033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.191706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.191706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.191706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.191706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.194476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.199270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb691-6fe3-4c61-b012-f3f4695245d8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.211816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.213469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.213846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.215081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.216530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.222627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.404180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1454/2895] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/users => generated 292 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:32.411945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.417765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1442/2896] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:31 2022] POST /identity/v3/projects => generated 395 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:32.424961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.453418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924b0c8-8a32-4730-ab9f-8f87c18f965f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.614698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1726e-3227-4f16-aa57-bbcbf2084a66 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.625622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.626842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.627790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.628160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.629449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.632119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.657023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.658815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.658815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.659720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.661725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.665786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.699378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1455/2897] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:32.699378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.699378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:32.776804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1443/2898] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:32 2022] POST /identity/v3/users => generated 298 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:32.778660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.810635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d55e7e-2189-46ea-9f24-89461f74dddb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.824115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.825422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.826149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.826653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.829299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.835058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.893581 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1444/2899] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:32.895913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.928330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a005c05-3ef3-40b5-80a5-ec2ffa08d1e9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.938582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.939359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.939906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.940476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:32.941828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:32.945590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:32.956133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc965a-9c8e-4d30-adc8-b826c88d2bee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:32.975323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1445/2900] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:32.982083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:32.991163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:32.994614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:32.995548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:32.997060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.004662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c624b3a-270f-4134-b213-bc149b0006d2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:33.006966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:33.021944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:33.023436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.024917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.024917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] PATH_INFO: `/v3/projects/bd4ff55c86c14c6fbd1a64cdd9102cf7/users/34eb66754d3d4cc7afc2ea8d69e0e502/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.070348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4ff55c86c14c6fbd1a64cdd9102cf7, user_id=34eb66754d3d4cc7afc2ea8d69e0e502, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:33.078434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:33.086017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:33.173525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1446/2901] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:32 2022] PUT /identity/v3/projects/bd4ff55c86c14c6fbd1a64cdd9102cf7/users/34eb66754d3d4cc7afc2ea8d69e0e502/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:33.185512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:33.239676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:33.255886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:33.262323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3064f-2f18-45fe-8816-c63567b756f2 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:33.296172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1456/2902] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:33.300438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.307669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.308821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.349950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bd2-9190-4ebe-acae-0b9f86381dd9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:33.365776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:33.367492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.368261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.369155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.371340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:33.377102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:33.429469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1447/2903] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:33.437456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:33.440355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] MFA Rules not processed for user `34eb66754d3d4cc7afc2ea8d69e0e502`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:33.447780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:33.485393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98f0da-6f16-4362-9f20-152e6c6d6403 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:33.496418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:33.499599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.500425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.501144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] PATH_INFO: `/v3/projects/86fb412093454da0af42e1473196145f/users/af8669a819704f2b9762bce6752b8e7d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.545520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fb412093454da0af42e1473196145f, user_id=af8669a819704f2b9762bce6752b8e7d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:33.552304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5eb4e-7c49-4879-8440-0ce231f5b81f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:33.678650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1457/2904] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:33.686436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:33.719560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1448/2905] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:33 2022] PUT /identity/v3/projects/86fb412093454da0af42e1473196145f/users/af8669a819704f2b9762bce6752b8e7d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:33.731711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6fbdb-2574-4b7f-ba3f-b03de253efd1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:33.747184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.747518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.747991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.855450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] MFA Rules not processed for user `af8669a819704f2b9762bce6752b8e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:33.859906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:33.979209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:33.980684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:33.981014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:33.981314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:33.982416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:33.992401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:34.128249 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1449/2906] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:34.133640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:34.157140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e174f22-551d-495c-a9f5-a6cae558afd4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:34.188641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:34.189453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:34.189786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:34.190075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:34.190963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:34.193906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:34.320900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1458/2907] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:33 2022] POST /identity/v3/projects => generated 383 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:37:34.326501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:34.390291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1450/2908] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:34 2022] POST /identity/v3/projects => generated 393 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:34.394438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:34.647778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:34.649863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcefe5-bfd2-4251-bf2c-ad31dd1df76c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:34.692246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:34.716949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8612-64bf-4c07-a2e7-b6e7d8ed049c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:34.752617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:34.753680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:34.754089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:34.754580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:34.755844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:34.759442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:34.820688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:34.821562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:34.823307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:34.823909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:34.825289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:34.831349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:34.994720 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1459/2909] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:34 2022] POST /identity/v3/users => generated 298 bytes in 670 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:35.001119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1451/2910] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:34 2022] POST /identity/v3/users => generated 303 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:35.002897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.005125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.029858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc37-0774-495a-8cd9-499a6e0ddcc6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.036301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512c9f-05f6-49b2-a1f0-3255d9695310 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.041635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.043598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.044303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.044913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.046891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.049776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.050937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.051486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.051965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.052139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.053475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.056968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.104488 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1460/2911] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:35.121731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.127639 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1452/2912] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:35.135070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.164044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbae4-da75-4bef-8b8d-5e5b15d3ebcd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.164540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d62-45a6-4366-8a85-e38f58ed7290 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.180127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.181369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.181980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.182695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] PATH_INFO: `/v3/projects/680a366207fd4e58b27ea5300fb767b5/users/630f110ef3a74a75a14c5cfdb3fb3934/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.188217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.208157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.208157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.208157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] PATH_INFO: `/v3/projects/251527138b524d1498b8dce7357ad619/users/3dc51a579a8d4af2bf58bc30da2cf172/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.244889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680a366207fd4e58b27ea5300fb767b5, user_id=630f110ef3a74a75a14c5cfdb3fb3934, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.251300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.270996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251527138b524d1498b8dce7357ad619, user_id=3dc51a579a8d4af2bf58bc30da2cf172, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.276638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17239761-b6a3-4a9e-9289-cff04d6f2392 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.397984 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1453/2913] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:35 2022] PUT /identity/v3/projects/680a366207fd4e58b27ea5300fb767b5/users/630f110ef3a74a75a14c5cfdb3fb3934/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:35.397984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.409391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:35.430303 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1461/2914] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:35 2022] PUT /identity/v3/projects/251527138b524d1498b8dce7357ad619/users/3dc51a579a8d4af2bf58bc30da2cf172/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:35.430303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.432540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.433105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:35.468304 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:35.470447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:37:35.528597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1462/2915] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 102 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:37:35.558178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.629219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f13a4-1772-4388-819d-2a94c4457328 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.812217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.813722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.813901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.814397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] PATH_INFO: `/v3/users/ae75884a70da45e582cee8258d1f2a7a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.819519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae75884a70da45e582cee8258d1f2a7a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.831876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.840708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310527-ce7c-4935-9f50-921993d53d66 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.851868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.853315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.854026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.854731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.856209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.859945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.888879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1463/2916] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:35.891283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:35.920767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ac7d-a0fc-4c20-b6b1-1ad5446d010a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:35.932373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:35.934172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.942023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.942023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:35.942023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:35.942023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305a1b5-190f-4064-8e77-2dcbe5abcb70 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:35.970393 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1464/2917] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:35.973817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:35.974813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:35.976063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:36.020452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] MFA Rules not processed for user `fe9e839b68de4530b70e6a12fb5d00f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:36.025007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:36.154383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:36.172717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae75884a70da45e582cee8258d1f2a7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:36.270450 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1465/2918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:36.272732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:36.288490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:36.300741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49e77-7b55-4b9a-89e5-1db84943def1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:36.310913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae75884a70da45e582cee8258d1f2a7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:36.313736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:36.315545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:36.316280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:36.317767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] PATH_INFO: `/v3/projects/680a366207fd4e58b27ea5300fb767b5/users/630f110ef3a74a75a14c5cfdb3fb3934/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:36.321686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=680a366207fd4e58b27ea5300fb767b5, user_id=630f110ef3a74a75a14c5cfdb3fb3934, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:36.329757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:36.337702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae75884a70da45e582cee8258d1f2a7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:36.383361 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1466/2919] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:36 2022] PUT /identity/v3/projects/680a366207fd4e58b27ea5300fb767b5/users/630f110ef3a74a75a14c5cfdb3fb3934/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:36.395908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae75884a70da45e582cee8258d1f2a7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:36.395908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-66356eaa-4a63-475b-a941-2fd764611a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae75884a70da45e582cee8258d1f2a7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:36.406446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:36.408891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1454/2920] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:35 2022] DELETE /identity/v3/users/ae75884a70da45e582cee8258d1f2a7a => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:36.412359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b304-8292-4d28-8228-638049af0021 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:36.413013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b304-8292-4d28-8228-638049af0021 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:36.413935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b304-8292-4d28-8228-638049af0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:36.415489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:36.559447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a000b304-8292-4d28-8228-638049af0021 None None] MFA Rules not processed for user `630f110ef3a74a75a14c5cfdb3fb3934`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:36.572180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a000b304-8292-4d28-8228-638049af0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:36.732194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927367-e658-4e69-b4a3-f1cf8215c07d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:36.987491 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1455/2921] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 578 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:36.991546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:36.992530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:36.993179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:36.993904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:36.994456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:36.995112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:36.996752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] PATH_INFO: `/v3/projects/251527138b524d1498b8dce7357ad619/users/3dc51a579a8d4af2bf58bc30da2cf172/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:37.002713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251527138b524d1498b8dce7357ad619, user_id=3dc51a579a8d4af2bf58bc30da2cf172, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:37.022004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7b241-a622-473d-b36e-beeeb3698b33 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:37.086947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:37.092963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:37.126098 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1467/2922] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:36 2022] PUT /identity/v3/projects/251527138b524d1498b8dce7357ad619/users/3dc51a579a8d4af2bf58bc30da2cf172/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:37.130781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6cd5b-c230-4d61-aec8-e27a234733d6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:37.132053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6cd5b-c230-4d61-aec8-e27a234733d6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:37.132626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6cd5b-c230-4d61-aec8-e27a234733d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:37.223325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6ce6cd5b-c230-4d61-aec8-e27a234733d6 None None] MFA Rules not processed for user `3dc51a579a8d4af2bf58bc30da2cf172`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:37.226522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ce6cd5b-c230-4d61-aec8-e27a234733d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:37.345901 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1456/2923] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:37.365197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:37.368744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:37.416309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1468/2924] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:37.500607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:37.536092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f7af-4b9a-4579-a0eb-3ebb13c5acb0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:37.548282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:37.549416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:37.549963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:37.550495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:37.575317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:37.580202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:37.605847 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1457/2925] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:38.081218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:38.082080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:38.082589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0cddd242-a857-4f8f-8f57-29d3ecbfbd7c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:38.093200 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:38.095049 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:37:38.121288 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1469/2926] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:37:38.837513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:38.841379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:38.900535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc0bd6-23b1-47ab-8e17-a7b85072fbf6 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:38.912912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:38.914157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:38.914866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:38.915452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] PATH_INFO: `/v3/projects/36b7984e889d41e1a0c1b377eee8f8c8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:38.919358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b7984e889d41e1a0c1b377eee8f8c8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:38.924727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:39.296575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b7984e889d41e1a0c1b377eee8f8c8', 'request_id': 'req-919c3e85-b9d4-42a2-9949-10e34442a7d1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:39.317478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b7984e889d41e1a0c1b377eee8f8c8', 'request_id': 'req-919c3e85-b9d4-42a2-9949-10e34442a7d1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:39.333988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b7984e889d41e1a0c1b377eee8f8c8', 'request_id': 'req-919c3e85-b9d4-42a2-9949-10e34442a7d1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:39.501747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] The token cache is being invalidate because project 36b7984e889d41e1a0c1b377eee8f8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:39.503391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:39.505806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:39.518976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aca92-a0f2-4e0d-aaa6-2ef18fc2f879 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:39.519977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1458/2927] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:38 2022] DELETE /identity/v3/projects/36b7984e889d41e1a0c1b377eee8f8c8 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:39.521104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aca92-a0f2-4e0d-aaa6-2ef18fc2f879 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:39.521500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aca92-a0f2-4e0d-aaa6-2ef18fc2f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:39.552727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:39.557285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:39.649218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-940aca92-a0f2-4e0d-aaa6-2ef18fc2f879 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:39.651709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-940aca92-a0f2-4e0d-aaa6-2ef18fc2f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:39.678133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:39.818575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3e85-b9d4-42a2-9949-10e34442a7d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:39.850799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:39.852436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:39.852945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:39.853694 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1470/2928] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:39.859835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:39.860457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:39.863104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:39.869603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:39.870241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:39.970468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:39.974302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:40.005524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1471/2929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:40.013717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.077298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fa569-4272-4ea0-9855-692d4bc2323e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.099078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.103327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.109694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.111347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.120834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.120834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.121776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:40.123255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:40.123701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.129484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.174561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1459/2930] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:40.187088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1472/2931] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:40.188273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.259705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b888827-08b3-4b84-9367-03ada1b91010 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.265016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.266110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.266568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.267158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.268330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.279563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.282486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.315491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93089e6-9597-4c66-aac0-fc90fc003387 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.327275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.328375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.328837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.330475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.333073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:40.427348 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1460/2932] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:40 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:40.430359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.509961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.513176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.554496 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1473/2933] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:40.634478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e87f-afe4-4702-87b0-5bea64f07e30 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.666040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.670043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.670475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.671034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.672624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.700517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.853926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1461/2934] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:40 2022] POST /identity/v3/users => generated 291 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:40.857264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.883112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7de15-0de3-4866-907e-6e6833b8782d service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.893616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.896004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.896308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.897182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.898503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.902901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:40.930949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1474/2935] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:40.937341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:40.959067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749b15d-e9fd-4ec4-9594-8d5e43133ce4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:40.969467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:40.970699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:40.971226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:40.972044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:40.973080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:40.976422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a8d2-b8f6-455a-85fd-1a23a7eb33b9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:41.002791 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1462/2936] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:41.008215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:41.032914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5aeec-9c80-4a86-a2da-d8605b82f8ae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:41.054868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:41.054868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:41.054868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:41.054868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] PATH_INFO: `/v3/projects/961c34a3a54c4da28eab0ed8bea6855e/users/f35d50770e254674aabcfd291466e126/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:41.099521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961c34a3a54c4da28eab0ed8bea6855e, user_id=f35d50770e254674aabcfd291466e126, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:41.105787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:41.269505 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1475/2937] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:41 2022] PUT /identity/v3/projects/961c34a3a54c4da28eab0ed8bea6855e/users/f35d50770e254674aabcfd291466e126/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:41.382747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:41.383275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:41.383764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:41.453120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] MFA Rules not processed for user `f35d50770e254674aabcfd291466e126`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:41.455796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:41.641906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1463/2938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:42.343231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:42.347188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:42.544069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:42.597909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a8c3-8334-4279-a1ed-f174e8824d21 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:42.617985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:42.619500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:42.620296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:42.620786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:42.660160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:42.664921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:42.687627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1476/2939] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:42.722224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:42.725989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:42.827167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:42.931542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:42.968174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973eb1-8164-47d1-89e3-f41bbe19a035 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:42.968174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:42.968174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:42.968174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:42.968889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:42.975202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:43.023115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c78377-74f1-46df-89c5-4db19307137c service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:43.024047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:43.032162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a99e6b-6ef4-44f1-85ff-5869b41f51d1 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:43.032713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:43.033896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:43.034412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:43.034924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] PATH_INFO: `/v3/users/f35d50770e254674aabcfd291466e126` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:43.038421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35d50770e254674aabcfd291466e126)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:43.043396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:43.058600 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1464/2940] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:43.424655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35d50770e254674aabcfd291466e126'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:43.426653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35d50770e254674aabcfd291466e126'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:43.498353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35d50770e254674aabcfd291466e126'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:43.534160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35d50770e254674aabcfd291466e126'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:43.560062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35d50770e254674aabcfd291466e126'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:43.574192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1477/2941] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:42 2022] DELETE /identity/v3/users/f35d50770e254674aabcfd291466e126 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:43.582269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:43.588194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:43.588194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:43.629720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:43.632023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:43.788186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1465/2942] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:43.805028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:43.807127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:43.958889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33961ed-fa74-420b-8b27-8408dc7239c0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:43.966345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:43.967477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:43.967941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:43.968450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:43.991335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:43.994294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:44.023627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1478/2943] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:37:44.259076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:44.262939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:44.295535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187428eb-3c50-4d78-a654-116cd089f1aa None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:44.304087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:44.305093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:44.305613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:44.306403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] PATH_INFO: `/v3/users/803f3ac2d73740ad9ab92cef252f07e6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:44.309371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=803f3ac2d73740ad9ab92cef252f07e6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:44.313714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:44.828024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803f3ac2d73740ad9ab92cef252f07e6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:44.932016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803f3ac2d73740ad9ab92cef252f07e6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:44.951465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803f3ac2d73740ad9ab92cef252f07e6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:44.984628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803f3ac2d73740ad9ab92cef252f07e6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:44.986288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803f3ac2d73740ad9ab92cef252f07e6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:45.001766 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1466/2944] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:44 2022] DELETE /identity/v3/users/803f3ac2d73740ad9ab92cef252f07e6 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:45.747566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:45.751750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:45.828426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:45.847219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f031-2daf-44c5-ade3-edc78db807b8 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:45.999288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:46.000523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.003780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.003780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] PATH_INFO: `/v3/projects/961c34a3a54c4da28eab0ed8bea6855e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.007181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961c34a3a54c4da28eab0ed8bea6855e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:46.012098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:46.014454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:46.015052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:46.052747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6755b7-5d5c-4a8e-8220-bf61ee695c9c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:46.067428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:46.072133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.073665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.077901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] PATH_INFO: `/v3/projects/0184f3fdbd854adf9751ab0ef77bdb2a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.099826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0184f3fdbd854adf9751ab0ef77bdb2a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:46.109952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:46.258369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961c34a3a54c4da28eab0ed8bea6855e', 'request_id': 'req-821d2131-a515-42be-bd2e-e5cf425c0f29'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.363265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961c34a3a54c4da28eab0ed8bea6855e', 'request_id': 'req-821d2131-a515-42be-bd2e-e5cf425c0f29'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.383750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961c34a3a54c4da28eab0ed8bea6855e', 'request_id': 'req-821d2131-a515-42be-bd2e-e5cf425c0f29'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.426399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] The token cache is being invalidate because project 961c34a3a54c4da28eab0ed8bea6855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:46.426713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.437200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-821d2131-a515-42be-bd2e-e5cf425c0f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.440379 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1479/2945] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:45 2022] DELETE /identity/v3/projects/961c34a3a54c4da28eab0ed8bea6855e => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:46.450083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e6e-22a8-4ab3-9c0f-d415c0c1accd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.450679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e6e-22a8-4ab3-9c0f-d415c0c1accd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.451012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e6e6e-22a8-4ab3-9c0f-d415c0c1accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.462361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0184f3fdbd854adf9751ab0ef77bdb2a', 'request_id': 'req-aa731d54-75bb-46c1-a6a0-0db36ff1c280'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.490082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0184f3fdbd854adf9751ab0ef77bdb2a', 'request_id': 'req-aa731d54-75bb-46c1-a6a0-0db36ff1c280'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.498887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:46.503618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b39e6e6e-22a8-4ab3-9c0f-d415c0c1accd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:46.505771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b39e6e6e-22a8-4ab3-9c0f-d415c0c1accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:46.546080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0184f3fdbd854adf9751ab0ef77bdb2a', 'request_id': 'req-aa731d54-75bb-46c1-a6a0-0db36ff1c280'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.650559 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1480/2946] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:46.665858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.668157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.668652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.725326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:46.727340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:46.739600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] The token cache is being invalidate because project 0184f3fdbd854adf9751ab0ef77bdb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:46.740286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.748469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:46.748689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1481/2947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:46.749449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1467/2948] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:46 2022] DELETE /identity/v3/projects/0184f3fdbd854adf9751ab0ef77bdb2a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:46.751734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:46.752041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:46.753874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:46.754115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:46.778333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225fb52-4e59-47ca-8f75-53edb59c1172 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:46.781537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa731d54-75bb-46c1-a6a0-0db36ff1c280 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:46.788442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:46.789793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:46.790022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.790022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.790641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.790884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] PATH_INFO: `/v3/users/f76aa48506e048d4b96b94b4198e6b5a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.791125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.791581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.794213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:46.794712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:46.796688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:46.799764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76aa48506e048d4b96b94b4198e6b5a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:46.804682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:46.831607 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1468/2949] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:46.840650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:46.862057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75f743-f363-4f54-9ee2-b900ff69aab8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:46.871233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:46.875817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:46.876332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:46.876875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:46.878167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:46.882262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:46.961346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:47.074886 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1469/2950] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:46 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:37:47.081778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:47.254950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76aa48506e048d4b96b94b4198e6b5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:47.257859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76aa48506e048d4b96b94b4198e6b5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:47.293303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2259d9-6a8f-4ef4-b9e6-1a51534b4812 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:47.302353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:47.303984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.308273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.308273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:47.308273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:47.309364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:47.359724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76aa48506e048d4b96b94b4198e6b5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:47.388332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76aa48506e048d4b96b94b4198e6b5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:47.404512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7ac00982-fbea-4936-b8dd-024fdcc0e266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76aa48506e048d4b96b94b4198e6b5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:47.415256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1482/2951] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:46 2022] DELETE /identity/v3/users/f76aa48506e048d4b96b94b4198e6b5a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:47.418708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.425509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.426545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:47.452020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1470/2952] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:47 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:47.459695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:47.464869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:47.469255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] MFA Rules not processed for user `fe9e839b68de4530b70e6a12fb5d00f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:47.471542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:47.493871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33862038-d5da-4beb-94f2-dd1bb867ddfa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:47.614519 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1483/2953] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:47.637520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:47.638731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.639267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.639847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:47.641095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:47.644490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:47.668714 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1471/2954] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:47.673941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:47.710918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7660f91-e1ff-4b05-b78d-43b1b9174a12 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:47.720975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:47.722739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.722739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.723362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:47.724498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:47.728168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312978-cc7f-482e-8876-df04e1827edd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:47.754797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1484/2955] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:37:47.761360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:47.781058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0595e-f370-46fc-ae94-4907da6a314a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:47.788948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:47.790515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.790992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.791493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] PATH_INFO: `/v3/projects/c3c72a0ce1094ac2a3af43b076abac75/users/251a6ad03ee24285aa5f7f0efd74c7ac/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:47.821999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c72a0ce1094ac2a3af43b076abac75, user_id=251a6ad03ee24285aa5f7f0efd74c7ac, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:47.838305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:47.983345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1472/2956] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:47 2022] PUT /identity/v3/projects/c3c72a0ce1094ac2a3af43b076abac75/users/251a6ad03ee24285aa5f7f0efd74c7ac/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:47.991572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:47.992109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:47.992496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:48.017172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:48.018630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:48.122327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:48.125478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:48.201493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1485/2957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:48.203397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:48.205998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:48.270466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:48.341311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a719-fca3-4a3b-961a-d6f6d19e09e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:48.354274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:48.356325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:48.356884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:48.357673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] PATH_INFO: `/v3/projects/1fa8bded1f7e4799968c21cfde1316b2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:48.361310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa8bded1f7e4799968c21cfde1316b2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:48.368597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:48.405923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032aca0-d95d-49bb-81ab-6465a5c8eb4e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:48.414000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:48.415507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:48.416408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:48.418754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:48.438986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:48.448188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:48.451261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:48.473564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1486/2958] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:48.474976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:48.477515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:48.502255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5934c18-7c0b-41d5-b31c-2e280d334860 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:48.511861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:48.513063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:48.513406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:48.513899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] PATH_INFO: `/v3/users/34eb66754d3d4cc7afc2ea8d69e0e502` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:48.516397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34eb66754d3d4cc7afc2ea8d69e0e502)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:48.520413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:48.660458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa8bded1f7e4799968c21cfde1316b2', 'request_id': 'req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.669725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa8bded1f7e4799968c21cfde1316b2', 'request_id': 'req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.678620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa8bded1f7e4799968c21cfde1316b2', 'request_id': 'req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.829391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] The token cache is being invalidate because project 1fa8bded1f7e4799968c21cfde1316b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:48.829910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.831325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a3e3dc8-ab91-4f47-bf96-323d7f78d904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.834281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1473/2959] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:48 2022] DELETE /identity/v3/projects/1fa8bded1f7e4799968c21cfde1316b2 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:48.842787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf5496-3232-4145-9ac2-ce1558ac21fb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:48.843345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf5496-3232-4145-9ac2-ce1558ac21fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:48.843909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf5496-3232-4145-9ac2-ce1558ac21fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:48.851958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34eb66754d3d4cc7afc2ea8d69e0e502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.855364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34eb66754d3d4cc7afc2ea8d69e0e502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.881817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d1cf5496-3232-4145-9ac2-ce1558ac21fb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:48.884064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d1cf5496-3232-4145-9ac2-ce1558ac21fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:48.953850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34eb66754d3d4cc7afc2ea8d69e0e502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:48.987978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34eb66754d3d4cc7afc2ea8d69e0e502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:49.007283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2d8b7abd-8258-467c-9748-1460d1053c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34eb66754d3d4cc7afc2ea8d69e0e502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:49.022207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1474/2960] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:49.023063 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1487/2961] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:48 2022] DELETE /identity/v3/users/34eb66754d3d4cc7afc2ea8d69e0e502 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:49.030678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.031229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.031696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.037255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.038717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.038717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.068872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:49.071593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:49.099017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:49.100623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:49.244169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1475/2962] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:49.277805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:49.283117 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1488/2963] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:37:49.285191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:49.285816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:49.319224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a494-02ac-4274-b75b-9bb6070bd50a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:49.337457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:49.338610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.339086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.339592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.340993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:49.341611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:49.345996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:49.381460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1489/2964] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:49.390418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:49.413854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b703-4864-4336-a074-21e0094d32e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:49.421322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:49.421322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.421322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.421322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.425077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:49.426398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:49.437897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202324b-fe53-44df-ae98-3b8abc7fb1d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:49.445152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:49.446364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.449522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.449522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.468702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:49.475825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:49.528330 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1476/2965] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:49.642859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1490/2966] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:49 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:49.656275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:49.701649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a82b3-7cb0-4e2c-8979-32f4c346df74 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:49.904932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:49.906777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:49.907479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:49.907972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:49.909422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:49.917682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:50.125480 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1477/2967] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:49 2022] POST /identity/v3/users => generated 283 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:50.132035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:50.184980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8959-7238-430f-abe5-595d817cb1fb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:50.205920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:50.207260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.208662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.210914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:50.212415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:50.216155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:50.221084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:50.259902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1491/2968] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:37:50.266984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:50.297401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5e73e-8a21-4d53-b1b6-84fae6cb5917 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:50.310800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:50.312356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.313134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.313623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:50.314853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:50.319237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88692-0eb9-4f16-aca3-fd405bcbbc2b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:50.361669 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1478/2969] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:50.368986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:50.400374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3273a-ec1e-41e3-9c38-e40c7b00e2f3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:50.408846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:50.409918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.410354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.410775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] PATH_INFO: `/v3/projects/1d50f961abf54801bd03d5551f45b8be/users/682727ddf79c4a27a28ce32301564d34/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:50.441952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d50f961abf54801bd03d5551f45b8be, user_id=682727ddf79c4a27a28ce32301564d34, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:50.446888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:50.495537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:50.559993 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1492/2970] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:50 2022] PUT /identity/v3/projects/1d50f961abf54801bd03d5551f45b8be/users/682727ddf79c4a27a28ce32301564d34/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:50.562788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.563665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.564384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:50.622152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:50.625496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:50.796002 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1479/2971] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:50.814537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:50.827458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:50.831040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:50.861747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf6e1e-fa2a-4bdd-a8ab-dc5ac50a0fd8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:50.874444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:50.874444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.875394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.876070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] PATH_INFO: `/v3/projects/bd4ff55c86c14c6fbd1a64cdd9102cf7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:50.879076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4ff55c86c14c6fbd1a64cdd9102cf7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:50.882246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:50.978682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172c9eb-ecc0-4c20-961e-5e7cc33c42fd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:50.988274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:50.989751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:50.990386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:50.991020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:51.014500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:51.018193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a9f76-7bdf-4720-a6bf-b426f517eb25 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:51.043730 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1493/2972] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:51.046458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680fc70-b23e-4436-ae27-c9e6972d7a93 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:51.047438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680fc70-b23e-4436-ae27-c9e6972d7a93 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:51.048213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680fc70-b23e-4436-ae27-c9e6972d7a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7680fc70-b23e-4436-ae27-c9e6972d7a93 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:51.070192 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:51.072343 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:37:51.074109 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1494/2973] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:37:51.108122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:51.134312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:51.134312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:51.141194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4ff55c86c14c6fbd1a64cdd9102cf7', 'request_id': 'req-c0fef799-a3e4-48fe-b216-32c8151cdd0c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:51.177680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4ff55c86c14c6fbd1a64cdd9102cf7', 'request_id': 'req-c0fef799-a3e4-48fe-b216-32c8151cdd0c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:51.196529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4ff55c86c14c6fbd1a64cdd9102cf7', 'request_id': 'req-c0fef799-a3e4-48fe-b216-32c8151cdd0c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:51.228686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] MFA Rules not processed for user `251a6ad03ee24285aa5f7f0efd74c7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:51.232250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:51.387211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] The token cache is being invalidate because project bd4ff55c86c14c6fbd1a64cdd9102cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:51.389471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:51.391608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0fef799-a3e4-48fe-b216-32c8151cdd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:51.412922 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1480/2974] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:50 2022] DELETE /identity/v3/projects/bd4ff55c86c14c6fbd1a64cdd9102cf7 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:51.423280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:51.423757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:51.424241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:51.512796 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1495/2975] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:51.514687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:51.515273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] MFA Rules not processed for user `fe9e839b68de4530b70e6a12fb5d00f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:51.522955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:51.524060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:51.751280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1481/2976] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:51.756473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:51.766354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:51.805143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849a6ec-8cb6-4da3-b671-59fe1c8be342 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:51.834704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:51.840786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:51.844114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:51.844642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:51.856243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:52.108237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:52.123716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf53c-133e-46b2-b071-518e25d88293 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:52.135805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:52.141000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed4df-34ec-4d9c-8ac6-1281f477789e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:52.143417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:52.144911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:52.145370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:52.145822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] PATH_INFO: `/v3/users/630f110ef3a74a75a14c5cfdb3fb3934` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:52.155921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630f110ef3a74a75a14c5cfdb3fb3934)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:52.164778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:52.207881 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1496/2977] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:52.219893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:52.221327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:52.222293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:52.223293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:52.345193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] MFA Rules not processed for user `251a6ad03ee24285aa5f7f0efd74c7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:52.355218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:52.391082 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1497/2978] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:52.393427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:52.397103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:52.429371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb3d68-831c-4fc8-81f9-e49321e78a40 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:52.447824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:52.447824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:52.447824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:52.449022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] PATH_INFO: `/v3/users/af8669a819704f2b9762bce6752b8e7d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:52.452596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8669a819704f2b9762bce6752b8e7d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:52.458598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:52.615533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:52.618836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630f110ef3a74a75a14c5cfdb3fb3934'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.743784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630f110ef3a74a75a14c5cfdb3fb3934'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.769154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630f110ef3a74a75a14c5cfdb3fb3934'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.794925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8669a819704f2b9762bce6752b8e7d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.797486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8669a819704f2b9762bce6752b8e7d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.821240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630f110ef3a74a75a14c5cfdb3fb3934'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.822908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f26da4cc-3079-47f6-aeaa-b677ea199769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630f110ef3a74a75a14c5cfdb3fb3934'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:52.855238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1482/2979] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:51 2022] DELETE /identity/v3/users/630f110ef3a74a75a14c5cfdb3fb3934 => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:52.856919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:52.857868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:52.860674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:52.904201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] MFA Rules not processed for user `251a6ad03ee24285aa5f7f0efd74c7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:52.907305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:52.977231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8669a819704f2b9762bce6752b8e7d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8669a819704f2b9762bce6752b8e7d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-04a5f2a3-2963-4c95-bfd4-455aaf9cce7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8669a819704f2b9762bce6752b8e7d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1498/2980] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:52 2022] DELETE /identity/v3/users/af8669a819704f2b9762bce6752b8e7d => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:53.099490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:53.102693 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1483/2981] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:53.136262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:53.139060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:53.338311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1499/2982] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:53.365246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:53.374762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:53.584130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa834ed-08fd-4a61-ab18-a619d4516f40 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:53.798194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:53.800135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:53.800730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:53.801780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:53.833928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:53.838181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:53.861800 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1484/2983] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:54.514563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:54.514563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:54.579469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:54.618637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:54.623109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:54.665741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d31d-ff0f-4b90-a4a0-ef8a5f4a0eac service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:54.677134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:54.679086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:54.679619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:54.680198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] PATH_INFO: `/v3/projects/680a366207fd4e58b27ea5300fb767b5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:54.689989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680a366207fd4e58b27ea5300fb767b5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:54.701770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:54.861485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2b1d-f2d4-421f-b320-9ae754c19feb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:54.877775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:54.879642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:54.880893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:54.881657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:54.886013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:55.082129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680a366207fd4e58b27ea5300fb767b5', 'request_id': 'req-60b6bf73-91e2-4380-8f75-6b053eea4a95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:55.096744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:55.134321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680a366207fd4e58b27ea5300fb767b5', 'request_id': 'req-60b6bf73-91e2-4380-8f75-6b053eea4a95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:55.180389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680a366207fd4e58b27ea5300fb767b5', 'request_id': 'req-60b6bf73-91e2-4380-8f75-6b053eea4a95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:55.252373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:55.253740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bf4be-2333-418e-ac17-a4117344d6c9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:55.284331 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1500/2984] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:37:55.342770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] The token cache is being invalidate because project 680a366207fd4e58b27ea5300fb767b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:55.342770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:55.342770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60b6bf73-91e2-4380-8f75-6b053eea4a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:55.344775 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1485/2985] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:54 2022] DELETE /identity/v3/projects/680a366207fd4e58b27ea5300fb767b5 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:55.356944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:55.357569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:55.358153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:55.424871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:55.431945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:55.714878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1501/2986] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:55.728072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:55.728890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:55.729903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:55.806592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:55.810311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:55.834934 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1486/2987] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:55.843577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:55.875086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710132-deb8-4a97-a41b-50c681c5fc40 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:55.906595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:55.908571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:55.909074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:55.910010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:55.911630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:37:55.912452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:55.914980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:55.956364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1502/2988] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:37:55.963993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:55.988711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89dcb-53d2-4558-9934-dfcce08bc4ef None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:56.000819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:56.003045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.004149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.004908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.008519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:56.015425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de4a2-b952-49a6-a2c3-b6a53198bf54 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:56.174936 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1487/2989] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:56.176385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:56.212196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9aa7-f65f-429d-aa54-2fa43790c595 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:56.238086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.238579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.239096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:37:56.259453 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:37:56.261621 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:37:56.267287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1488/2990] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:37:56 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:37:56.427462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:56.431417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.433024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.433882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.436404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:56.441541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:56.577250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:56.582473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:56.630798 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1503/2991] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:56 2022] POST /identity/v3/users => generated 293 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:37:56.636099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:56.668456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaa28f-9adc-4146-9fde-f3949b685ccc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:56.697009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:56.701572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.703277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.703902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] PATH_INFO: `/v3/projects/86fb412093454da0af42e1473196145f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.705657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43819e-5489-4507-9cd7-7923ac1670ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:56.719488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fb412093454da0af42e1473196145f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:56.719488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:56.764190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:56.768526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.776614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.778219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.779957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:56.785838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:56.831985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:56.858422 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1504/2992] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:37:56.860870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:56.911125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3bceb-abe8-4d88-b4c9-60b1c1bfaf58 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:56.944962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:56.949685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:56.950265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:56.950736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:56.958978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:56.967495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:57.032231 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1505/2993] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:57.039039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:57.093877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e50d4-5a73-4b91-a031-671d477a8f9f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:57.123943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fb412093454da0af42e1473196145f', 'request_id': 'req-5ac3fa06-994d-49e5-a836-6bc305a073ca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:57.156759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fb412093454da0af42e1473196145f', 'request_id': 'req-5ac3fa06-994d-49e5-a836-6bc305a073ca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:57.189127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fb412093454da0af42e1473196145f', 'request_id': 'req-5ac3fa06-994d-49e5-a836-6bc305a073ca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:57.340627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] The token cache is being invalidate because project 86fb412093454da0af42e1473196145f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:37:57.344040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:57.344332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:57.345731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:57.346269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:57.346832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] PATH_INFO: `/v3/projects/cb206df79bad40a3a8605b6468023166/users/265ebb329a6445358c20a3c7384faa86/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:57.353245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:57.372256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1489/2994] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:56 2022] DELETE /identity/v3/projects/86fb412093454da0af42e1473196145f => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:57.379488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:57.387291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:57.464362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb206df79bad40a3a8605b6468023166, user_id=265ebb329a6445358c20a3c7384faa86, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:57.466873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3fa06-994d-49e5-a836-6bc305a073ca admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:57.488103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab12d5-d613-4a84-b1f5-de827258cb92 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:57.490911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:57.494929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:57.495682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:57.496188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] PATH_INFO: `/v3/users/3dc51a579a8d4af2bf58bc30da2cf172` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:57.504603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc51a579a8d4af2bf58bc30da2cf172)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:57.510882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:57.750092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1506/2995] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:57 2022] PUT /identity/v3/projects/cb206df79bad40a3a8605b6468023166/users/265ebb329a6445358c20a3c7384faa86/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:37:57.893687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe45-42fb-41e1-b9e3-1db401aa3606 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:57.894759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe45-42fb-41e1-b9e3-1db401aa3606 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:57.894759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbe45-42fb-41e1-b9e3-1db401aa3606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:58.024994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc51a579a8d4af2bf58bc30da2cf172'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:58.033263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:58.059563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-90ffbe45-42fb-41e1-b9e3-1db401aa3606 None None] MFA Rules not processed for user `265ebb329a6445358c20a3c7384faa86`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:58.062399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90ffbe45-42fb-41e1-b9e3-1db401aa3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:58.143037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc51a579a8d4af2bf58bc30da2cf172'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:58.187642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc51a579a8d4af2bf58bc30da2cf172'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:58.273225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc51a579a8d4af2bf58bc30da2cf172'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:58.277080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc51a579a8d4af2bf58bc30da2cf172'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:37:58.288925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1507/2996] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:58.292142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:58.292662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:58.293177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:58.323434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1490/2997] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:37:57 2022] DELETE /identity/v3/users/3dc51a579a8d4af2bf58bc30da2cf172 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:37:58.323434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:58.331365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:58.414773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] MFA Rules not processed for user `5bda0ce3a36747c69b4a78e558a03b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:37:58.424608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:37:58.492749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:58.817124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d952f4-39b9-4cca-98ca-6f082a35ad49 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:58.825125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1508/2998] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:37:58.833709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:58.834955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:58.835505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:58.835998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:58.838061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:58.844055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:59.063831 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1491/2999] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:37:58 2022] POST /identity/v3/projects => generated 387 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:59.065962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:59.136944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d9eb0-cea3-4a04-9ad4-a986bb52481e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:59.471957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:59.475858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:59.477880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:59.481011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:59.488768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:59.495913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:59.683255 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1509/3000] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:37:59 2022] POST /identity/v3/users => generated 300 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:37:59.691379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:59.727240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077d152-37a3-4a6e-9cd3-d56cbb010da3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:59.735843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:59.737060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:59.738023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:59.738611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:37:59.739978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:37:59.743708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:37:59.779426 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1492/3001] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:37:59.786681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:37:59.861011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37f48-9cfd-46d7-b6e6-2e4d51fc7c2d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:37:59.898151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:37:59.908217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:37:59.924101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:37:59.924101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] PATH_INFO: `/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4/users/5a08b4872d28487ab25636505840f54d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:00.029092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b55e5ae7c8a4f06bcbbf2d3258a41e4, user_id=5a08b4872d28487ab25636505840f54d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:00.029092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:00.196793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1510/3002] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:37:59 2022] PUT /identity/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4/users/5a08b4872d28487ab25636505840f54d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:00.204699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:00.255015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546a3a-ae06-4f69-83e1-a6c97c502a51 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:00.594084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:00.595113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:00.596047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:00.597794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:00.600591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:00.604997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d1db-2da9-44c6-8461-456c5dca42a5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:00.641345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1493/3003] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:00.643873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:00.701563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523f64-4d92-4b4f-bb6b-a302427174e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:00.721209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:00.723181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:00.725951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:00.726786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] PATH_INFO: `/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4/users/5a08b4872d28487ab25636505840f54d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:00.733319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b55e5ae7c8a4f06bcbbf2d3258a41e4, user_id=5a08b4872d28487ab25636505840f54d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:00.741020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:00.796734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1511/3004] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:00 2022] PUT /identity/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4/users/5a08b4872d28487ab25636505840f54d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:00.820490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe04126-c9b5-472a-8f4c-853ec04b33a2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:00.822277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe04126-c9b5-472a-8f4c-853ec04b33a2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:00.825790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe04126-c9b5-472a-8f4c-853ec04b33a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:00.931543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bbe04126-c9b5-472a-8f4c-853ec04b33a2 None None] MFA Rules not processed for user `5a08b4872d28487ab25636505840f54d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:00.939287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bbe04126-c9b5-472a-8f4c-853ec04b33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:01.027648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:01.032860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:01.053515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:01.335205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1494/3005] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:01.387304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a2f1-5081-43cc-9831-7eb757b39088 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:01.408921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:01.408921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:01.408921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:01.409923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] PATH_INFO: `/v3/projects/251527138b524d1498b8dce7357ad619` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:01.418925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=251527138b524d1498b8dce7357ad619)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:01.430068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:01.495364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:01.757328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251527138b524d1498b8dce7357ad619', 'request_id': 'req-1737fbd8-6917-4c64-9c24-d506b9ac569a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:01.864552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251527138b524d1498b8dce7357ad619', 'request_id': 'req-1737fbd8-6917-4c64-9c24-d506b9ac569a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:01.898153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251527138b524d1498b8dce7357ad619', 'request_id': 'req-1737fbd8-6917-4c64-9c24-d506b9ac569a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:01.938623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] The token cache is being invalidate because project 251527138b524d1498b8dce7357ad619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:01.938942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:01.953770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1737fbd8-6917-4c64-9c24-d506b9ac569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:01.959979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1512/3006] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:01 2022] DELETE /identity/v3/projects/251527138b524d1498b8dce7357ad619 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:38:01.980174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:01.981920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:01.983424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:02.165649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:02.181822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:02.470915 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1495/3007] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:02.486199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:02.487088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:02.488041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:02.568129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:02.570680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:02.619167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1513/3008] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:02.622473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:02.661055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8b48-402c-483b-aca0-0b42dbe834c9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:02.672922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:02.674485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:02.675524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:02.676368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:02.678756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:38:02.680808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:02.685096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:02.749319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:02.751012 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1496/3009] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:38:02.776263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24da300-e32a-4f0c-9be2-e7fedb61c155 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:02.795967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:02.800530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:02.801478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:02.803526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:02.808117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:02.811192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:02.995678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1514/3010] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:02 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:38:03.004329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:03.032911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5eea9-6b0a-4f9d-8b0d-246ceff63a19 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:03.303627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:03.308422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:03.321767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:03.325667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:03.334541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:03.341450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:03.489652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1497/3011] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:03 2022] POST /identity/v3/users => generated 293 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:03.497400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:03.542383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60144ef-65e1-4406-afd9-399a98d178fe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:03.575791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:03.577792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:03.580458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:03.582533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:03.590632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:03.610497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:03.682777 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1515/3012] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:03.690062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:03.716056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88831e-4423-4585-994f-cdff91bed5f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:03.734683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:03.737509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:03.742601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:03.750179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:03.751365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:03.774769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:03.781196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:03.789890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:03.842573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1498/3013] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:38:03.849614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:03.875592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6631-b142-4660-a232-e3ef2c99ed86 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:03.899474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:03.901198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:03.904252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:03.904252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] PATH_INFO: `/v3/projects/b46055f08aae47a99a59e1192db71b8e/users/5e0144899b8946309d4524a4cf515d98/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:03.990137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46055f08aae47a99a59e1192db71b8e, user_id=5e0144899b8946309d4524a4cf515d98, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:04.025089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:04.063580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711af1-37b5-47d3-9e45-540e1be64dc8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:04.078814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:04.080031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:04.080589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:04.080995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:04.084738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:04.220190 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1499/3014] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:03 2022] PUT /identity/v3/projects/b46055f08aae47a99a59e1192db71b8e/users/5e0144899b8946309d4524a4cf515d98/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:38:04.226606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:04.234845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:04.260523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:04.282489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:04.288536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0c8a-98f9-4b51-8011-3017bb3b05a5 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:04.325596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:04.367991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1516/3015] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:04.371381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:04.371866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:04.372513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:04.441712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] MFA Rules not processed for user `5e0144899b8946309d4524a4cf515d98`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:04.444348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:04.646604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c174399-5403-485c-85c0-1e08a9d0d6b5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:04.670998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:04.678925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:04.679817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:04.686011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] PATH_INFO: `/v3/users/251a6ad03ee24285aa5f7f0efd74c7ac` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:04.692997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251a6ad03ee24285aa5f7f0efd74c7ac)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:04.702499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1517/3016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:04.706974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:04.725115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:04.728090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:05.004593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fca27-f97d-416a-87cd-e93cdfb941fa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:05.030069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:05.031458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:05.031991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:05.032703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:05.063444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:05.073633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:05.138823 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1518/3017] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:05.261089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251a6ad03ee24285aa5f7f0efd74c7ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:05.417973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251a6ad03ee24285aa5f7f0efd74c7ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:05.440818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251a6ad03ee24285aa5f7f0efd74c7ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:05.500016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251a6ad03ee24285aa5f7f0efd74c7ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:05.501716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b260978-8e54-46ad-8715-03140a968d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251a6ad03ee24285aa5f7f0efd74c7ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:05.522366 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1500/3018] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:04 2022] DELETE /identity/v3/users/251a6ad03ee24285aa5f7f0efd74c7ac => generated 0 bytes in 1301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:06.410581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:06.488820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b261dd3-47c2-4fde-b9ea-826e2871b844 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:06.824085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:06.827796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:06.828770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:06.829458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] PATH_INFO: `/v3/projects/c3c72a0ce1094ac2a3af43b076abac75` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:06.836168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c72a0ce1094ac2a3af43b076abac75)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:06.862571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:07.163556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:07.185209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:07.186104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:07.186734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:07.247364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c72a0ce1094ac2a3af43b076abac75', 'request_id': 'req-c647f356-b58c-41ef-9304-269b7d02e51e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:07.315501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:07.324570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:07.371564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c72a0ce1094ac2a3af43b076abac75', 'request_id': 'req-c647f356-b58c-41ef-9304-269b7d02e51e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:07.393737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c72a0ce1094ac2a3af43b076abac75', 'request_id': 'req-c647f356-b58c-41ef-9304-269b7d02e51e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:07.473249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] The token cache is being invalidate because project c3c72a0ce1094ac2a3af43b076abac75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:07.474309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:07.477192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c647f356-b58c-41ef-9304-269b7d02e51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:07.485050 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1519/3019] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:06 2022] DELETE /identity/v3/projects/c3c72a0ce1094ac2a3af43b076abac75 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:07.520222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff455f-8515-452e-99fd-aa71c557b53b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:07.522576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff455f-8515-452e-99fd-aa71c557b53b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:07.523698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff455f-8515-452e-99fd-aa71c557b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:07.577432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73ff455f-8515-452e-99fd-aa71c557b53b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:07.579809 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1501/3020] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:07.580112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73ff455f-8515-452e-99fd-aa71c557b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:07.811169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:07.813864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:07.960374 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1520/3021] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:07.967328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:07.971189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:07.972052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:07.973698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:08.027817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:08.031174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:08.066135 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1521/3022] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:08.068163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:08.089762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb29e9-2a9e-4e2d-9737-d2f208e46f05 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:08.107397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:08.112079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:08.112567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:08.115032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:08.116634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:38:08.117190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:08.127450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:08.230366 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1522/3023] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:38:08.238085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:08.245845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff4079-ce5d-45c4-9e9e-e7c9c3f15bda None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:08.280469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:08.286147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:08.286147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:08.286147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:08.305331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a7dc-c7ba-45f7-bc02-27fd7ab8aa9f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:08.323013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:08.331646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:08.348184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:08.351939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:08.357041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:08.359121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:08.375226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:08.376355 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1502/3024] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:38:08.376889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:08.745547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1523/3025] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:08 2022] POST /identity/v3/projects => generated 377 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:38:08.748612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:08.791908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855529-1dc7-401e-baa5-8cadfafa8781 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:09.145394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:09.145689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:09.146308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:09.146953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:09.148471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:09.153585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48e30-cf49-4c6a-a79a-daed05b55d9c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:09.486567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1503/3026] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:08 2022] POST /identity/v3/users => generated 289 bytes in 734 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:09.488200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:09.550818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1083-aea6-4150-a7b1-b4b5c1ecaa95 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:09.597707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:09.597707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:09.597707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:09.597707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:09.598362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:09.598362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:09.608662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c5ad3-ac41-4582-97d8-5881948ab4ae None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:09.609422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c5ad3-ac41-4582-97d8-5881948ab4ae None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:09.609929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c5ad3-ac41-4582-97d8-5881948ab4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:09.689608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1524/3027] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:38:09.691811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:09.720008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826f82-3c35-45f1-872b-12967c38986e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:09.733143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:09.736381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:09.738001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:09.738776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:09.740975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:09.747166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:09.774759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1525/3028] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:09.777197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:09.784116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ca1c5ad3-ac41-4582-97d8-5881948ab4ae None None] MFA Rules not processed for user `682727ddf79c4a27a28ce32301564d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:09.788716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca1c5ad3-ac41-4582-97d8-5881948ab4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:09.813333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd9a4-d35e-44fe-920c-5fb8a3d404b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:09.824253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:09.825919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:09.827095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:09.827918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] PATH_INFO: `/v3/projects/f37d0edcedec45449d139180e2fec383/users/c35904ae44544c128474584457e43cca/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:09.901169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37d0edcedec45449d139180e2fec383, user_id=c35904ae44544c128474584457e43cca, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:09.923749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42665-023b-4cfd-9666-797d3fbdba6c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:10.031039 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1504/3029] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:10.058445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:10.059331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:10.060031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:10.080838 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1526/3030] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:09 2022] PUT /identity/v3/projects/f37d0edcedec45449d139180e2fec383/users/c35904ae44544c128474584457e43cca/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:10.092010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:10.093111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:10.094334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:10.121734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] MFA Rules not processed for user `682727ddf79c4a27a28ce32301564d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:10.124240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:10.172325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:10.174960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:10.242569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:10.287611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:10.395646 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1505/3031] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:10.433513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:10.436025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:10.599220 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1527/3032] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:10.614537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:10.617718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:10.730359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14659f-555d-4fcc-ae27-b83a677800ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:10.754342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:10.755664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:10.756282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:10.756801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] PATH_INFO: `/v3/users/265ebb329a6445358c20a3c7384faa86` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:10.762902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265ebb329a6445358c20a3c7384faa86)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:10.769914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:10.804156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308db9f-3bd9-4227-872b-3d35bcb52bda None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:10.821212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:10.826951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:10.832266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:10.835233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:10.873615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:10.877336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:10.910929 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1528/3033] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:11.124906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:11.129373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:11.141291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265ebb329a6445358c20a3c7384faa86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:11.282088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265ebb329a6445358c20a3c7384faa86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:11.313743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265ebb329a6445358c20a3c7384faa86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:11.382444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265ebb329a6445358c20a3c7384faa86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:11.385291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5444ff21-bc5e-493e-939e-94cde8a491f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265ebb329a6445358c20a3c7384faa86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:11.418180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1506/3034] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:10 2022] DELETE /identity/v3/users/265ebb329a6445358c20a3c7384faa86 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:11.429447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:11.431610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:11.432176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:11.489799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:11.492676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:11.508234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b17b-73db-4dd4-a067-8afe7da1d027 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:11.792534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:11.813861 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1507/3035] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:11.831127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:11.835427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:11.839592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:11.840664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:11.841249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:11.841767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:11.845849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:11.894355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:12.151594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:12.157821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2905b-c751-4b58-9e62-8123d062c6ef service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:12.166323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f21c2-5e09-4986-a81b-d321fac53c83 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:12.189207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:12.194423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:12.194920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:12.195461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:12.222025 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1529/3036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 1099 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:12.253287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:12.259923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b819f-231a-4dc3-a6cb-a34fc8d6ff1c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:12.300022 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1508/3037] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:13.567636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:13.573577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:13.573577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:38:13.614818 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:13.616681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:38:13.643021 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1530/3038] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:38:13.691613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd30ec-fa0e-4fa3-992d-634a58be4e29 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:13.693330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd30ec-fa0e-4fa3-992d-634a58be4e29 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:13.694208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd30ec-fa0e-4fa3-992d-634a58be4e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:13.800484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-77cd30ec-fa0e-4fa3-992d-634a58be4e29 None None] MFA Rules not processed for user `682727ddf79c4a27a28ce32301564d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:13.809054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77cd30ec-fa0e-4fa3-992d-634a58be4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:13.872844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1509/3039] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:15.126243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:15.126243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:15.285687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bf86d-cd8d-4ccf-a6b8-56b2ad77ce7b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:15.306635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:15.308273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:15.316780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:15.316780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] PATH_INFO: `/v3/projects/cb206df79bad40a3a8605b6468023166` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:15.316780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb206df79bad40a3a8605b6468023166)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:15.321608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:15.861009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb206df79bad40a3a8605b6468023166', 'request_id': 'req-db57cec1-c56b-4972-bb63-3da6af0bc968'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:15.904436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:15.905325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:15.905325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:15.953424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:15.956335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:15.994539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb206df79bad40a3a8605b6468023166', 'request_id': 'req-db57cec1-c56b-4972-bb63-3da6af0bc968'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.015929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb206df79bad40a3a8605b6468023166', 'request_id': 'req-db57cec1-c56b-4972-bb63-3da6af0bc968'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.064928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] The token cache is being invalidate because project cb206df79bad40a3a8605b6468023166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:16.065713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.072127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.078203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1531/3040] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:15 2022] DELETE /identity/v3/projects/cb206df79bad40a3a8605b6468023166 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:16.084906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:16.091821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:16.292074 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1510/3041] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:16.320674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:16.324689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:16.417138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57cec1-c56b-4972-bb63-3da6af0bc968 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:16.432926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:16.435810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:16.448530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:16.448530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] PATH_INFO: `/v3/users/5a08b4872d28487ab25636505840f54d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:16.448530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a08b4872d28487ab25636505840f54d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:16.448530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:16.764299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d02a-5cee-4482-b08f-7511079adfd0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:16.785757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:16.789020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:16.790150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:16.791210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:16.791890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:16.832608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:16.836666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e178c-0ede-4e7a-a640-8e06dd61adb6 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:16.838293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a08b4872d28487ab25636505840f54d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.839698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a08b4872d28487ab25636505840f54d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:16.894939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1511/3042] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:38:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:17.011836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a08b4872d28487ab25636505840f54d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:17.154708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a08b4872d28487ab25636505840f54d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:17.247408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a29d7bb-55ea-402e-b4df-31de1cdde1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a08b4872d28487ab25636505840f54d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:17.298396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1532/3043] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:16 2022] DELETE /identity/v3/users/5a08b4872d28487ab25636505840f54d => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:18.620533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:18.621395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:18.621591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:38:18.647189 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:18.648989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:38:18.664715 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1512/3044] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:38:18.727778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea7-50f7-43cc-8023-daad242777ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:18.737310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea7-50f7-43cc-8023-daad242777ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:18.740135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea7-50f7-43cc-8023-daad242777ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:18.843516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e6049ea7-50f7-43cc-8023-daad242777ca None None] MFA Rules not processed for user `682727ddf79c4a27a28ce32301564d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:18.851038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6049ea7-50f7-43cc-8023-daad242777ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:19.130239 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1533/3045] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:19.340015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:19.344445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:19.518027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:19.717784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f7886-9d26-450f-a710-85c8e214edd5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:19.732541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:19.738419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:19.740160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:19.741225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] PATH_INFO: `/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:19.745548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b55e5ae7c8a4f06bcbbf2d3258a41e4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:19.753817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:20.150237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b55e5ae7c8a4f06bcbbf2d3258a41e4', 'request_id': 'req-67667e56-ecba-4998-a592-e0a890a487e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:20.184193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b55e5ae7c8a4f06bcbbf2d3258a41e4', 'request_id': 'req-67667e56-ecba-4998-a592-e0a890a487e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:20.202217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b55e5ae7c8a4f06bcbbf2d3258a41e4', 'request_id': 'req-67667e56-ecba-4998-a592-e0a890a487e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:20.359545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] The token cache is being invalidate because project 7b55e5ae7c8a4f06bcbbf2d3258a41e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:20.360054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:20.364896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67667e56-ecba-4998-a592-e0a890a487e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:20.368022 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1513/3046] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:19 2022] DELETE /identity/v3/projects/7b55e5ae7c8a4f06bcbbf2d3258a41e4 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:20.385719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:20.387736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:20.388900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:20.496445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:20.505519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:20.756178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1534/3047] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:20.769846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:20.773032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:20.773902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:20.843998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:20.849969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:20.907813 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1514/3048] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:20.909827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:20.945794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82abf-323b-43c8-904f-ea1a7643e70e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:20.998587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:21.000208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:21.000965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:21.001695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:21.012825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:38:21.018562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:21.032699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:21.071801 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1535/3049] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:38:21.079390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:21.116309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff294a2-20cc-49c0-82e6-6db2065b7d18 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:21.154058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:21.156414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:21.156978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:21.157421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:21.166572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:21.176775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:21.484003 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1515/3050] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:21 2022] POST /identity/v3/projects => generated 393 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:21.502473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:21.544662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba8c3-18e8-41aa-a154-4f9286c88d5c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:21.764757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:21.846829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:21.848259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:21.848677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:21.849617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:21.857197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:21.865015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:22.042593 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1536/3051] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:21 2022] POST /identity/v3/users => generated 297 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:22.049529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:22.084680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fe91-2380-47af-b6e4-273709fee300 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:22.108088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:22.109637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:22.110439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:22.111220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:22.113586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:22.129120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:22.180113 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1516/3052] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:22.185609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:22.211353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fce0-1533-4844-b315-7ae41acfe139 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:22.222816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:22.226045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:22.226923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:22.228204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:22.229638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:22.234197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fac6e-1bfe-4ba7-94c9-87092d040f8e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:22.285870 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1537/3053] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:38:22.286064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:22.321378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688f4b8-9399-4d67-85c8-154f89936146 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:22.340123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:22.342057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:22.342972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:22.349401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] PATH_INFO: `/v3/projects/7129909d365645369fbe27a2fd00fc88/users/96f056a5a16e449385f1b503e1d2231a/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:22.451775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7129909d365645369fbe27a2fd00fc88, user_id=96f056a5a16e449385f1b503e1d2231a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:22.470962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e17cd-f6fd-4f67-9f71-8ea0bbb0a56b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:22.667704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1517/3054] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:22 2022] PUT /identity/v3/projects/7129909d365645369fbe27a2fd00fc88/users/96f056a5a16e449385f1b503e1d2231a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:22.678484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:22.680468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:22.681303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:22.885238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] MFA Rules not processed for user `96f056a5a16e449385f1b503e1d2231a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:22.897459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:23.108052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf4a9-1547-468e-9a71-4081fad8f704 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:23.108807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf4a9-1547-468e-9a71-4081fad8f704 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:23.109140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf4a9-1547-468e-9a71-4081fad8f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8afcf4a9-1547-468e-9a71-4081fad8f704 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:38:23.144874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:23.146813 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:38:23.165754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1518/3055] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:38:23.226624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:23.227084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:23.229016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:23.286627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1538/3056] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:23.288936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:23.371183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] MFA Rules not processed for user `682727ddf79c4a27a28ce32301564d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:23.379723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:23.672024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1519/3057] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:23.692212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1693a2-941a-4329-8289-eb4620fa4b00 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:23.723076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:23.728918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:23.729830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:23.730571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:23.733987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:23.749477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:23.998695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1539/3058] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:23 2022] POST /identity/v3/projects => generated 395 bytes in 711 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:24.005045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:24.017031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:24.054905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be42b4a-a0ba-4e9a-8cf4-97961b7858a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:24.317414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:24.318847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:24.318847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:24.319849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:24.330858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:24.334360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:24.584199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1520/3059] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:24 2022] POST /identity/v3/users => generated 304 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:24.592300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:24.636675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bc79-0389-451b-8310-9463ba794de5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:24.655252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:24.658388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:24.658744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:24.659277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:24.664423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:24.667951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:24.725469 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1540/3060] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:24.732696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:24.780273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b08cf-9dfe-4d70-9f3b-7b441b4cdf7a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:24.814257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:24.816901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:24.816901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:24.817411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] PATH_INFO: `/v3/projects/fdfe6ab98672483babf78ee536878b8d/users/2a6bbe34fcdc41da9499d3f701e58b7f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:24.882280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfe6ab98672483babf78ee536878b8d, user_id=2a6bbe34fcdc41da9499d3f701e58b7f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:24.891581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:25.023706 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1521/3061] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:24 2022] PUT /identity/v3/projects/fdfe6ab98672483babf78ee536878b8d/users/2a6bbe34fcdc41da9499d3f701e58b7f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:25.046540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:25.109339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7c0c-a2e0-45c0-bae6-e07c772ad470 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:25.336797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:25.457799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:25.459102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:25.459934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:25.460513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:25.462585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:25.466352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80f1d1-4959-4c67-bb6b-27cb199c67e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:25.494830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1541/3062] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:25.496683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:25.526966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951632e4-66bd-463f-8113-e6e1c07c5b3c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:25.535976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:25.596152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:25.596152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:25.596152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] PATH_INFO: `/v3/projects/fdfe6ab98672483babf78ee536878b8d/users/2a6bbe34fcdc41da9499d3f701e58b7f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:25.596152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfe6ab98672483babf78ee536878b8d, user_id=2a6bbe34fcdc41da9499d3f701e58b7f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:25.596152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c74e0-e38d-426d-9e24-2e9c147a9365 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:25.597722 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1522/3063] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:25 2022] PUT /identity/v3/projects/fdfe6ab98672483babf78ee536878b8d/users/2a6bbe34fcdc41da9499d3f701e58b7f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:25.641794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a36c-fe91-4d38-b26a-423f1bbff92f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:25.642785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a36c-fe91-4d38-b26a-423f1bbff92f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:25.643344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a36c-fe91-4d38-b26a-423f1bbff92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:25.799978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bc18a36c-fe91-4d38-b26a-423f1bbff92f None None] MFA Rules not processed for user `2a6bbe34fcdc41da9499d3f701e58b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:25.804880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc18a36c-fe91-4d38-b26a-423f1bbff92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:26.043172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1542/3064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:26.058591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:26.059232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:26.060227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:26.127071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] MFA Rules not processed for user `96f056a5a16e449385f1b503e1d2231a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:26.134852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:26.180565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:26.181087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:26.181571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ff12bd93-5a6b-400a-ad73-1ef718dcfaa1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:38:26.199052 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:26.206811 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:38:26.222465 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1543/3065] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:26 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:38:26.349257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:26.350191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:26.351509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:26.414462 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1523/3066] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:26.420720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:26.426312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:26.455022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:26.460556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:26.666473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:26.707539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b5ba-18f5-4816-b5ae-e4f62bfea362 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:26.726447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:26.728763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:26.729672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:26.730460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:26.754998 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1544/3067] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:26.810064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:26.811419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:26.815169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:26.817659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087dbd-c406-45b2-aff4-0722b101d5a7 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:26.869189 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1524/3068] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:27.116287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:27.178292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ea7b-1ea2-4adf-a064-0638786b22b5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:27.222259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:27.226560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:27.229057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:27.229739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:27.269417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:27.269417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c35856-2dac-42eb-a014-5d09cbc3ae5e service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:27.330331 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1545/3069] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:38:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:28.529890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fea08-8cad-4dc4-8731-c0553919bbf3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:28.535042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fea08-8cad-4dc4-8731-c0553919bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:28.535042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fea08-8cad-4dc4-8731-c0553919bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:28.584034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-362fea08-8cad-4dc4-8731-c0553919bbf3 None None] MFA Rules not processed for user `5e0144899b8946309d4524a4cf515d98`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:28.587090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-362fea08-8cad-4dc4-8731-c0553919bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:28.813059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1525/3070] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:31.873638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:31.875570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:31.876325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:32.033168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] MFA Rules not processed for user `c35904ae44544c128474584457e43cca`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:32.039195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:32.292563 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1546/3071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:32.316389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb5ed-6863-4a65-9714-578b0a1bd2ce None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:32.317511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb5ed-6863-4a65-9714-578b0a1bd2ce None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:32.317511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb5ed-6863-4a65-9714-578b0a1bd2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:32.408037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f25fb5ed-6863-4a65-9714-578b0a1bd2ce None None] MFA Rules not processed for user `c35904ae44544c128474584457e43cca`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:32.415459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f25fb5ed-6863-4a65-9714-578b0a1bd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:32.442128 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1526/3072] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:33.244129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:33.251840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:33.353296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25febf5-dbfc-4a4f-8688-143929dd14a4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:33.383025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:33.395688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:33.396251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:33.396757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:33.444337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:33.455778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3108f09-0a80-4e51-a7ab-652830395062 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:33.508013 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1547/3073] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:33.582044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:33.583524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:33.584272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:33.756839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] MFA Rules not processed for user `5e0144899b8946309d4524a4cf515d98`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:33.759875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:33.817678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1527/3074] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:38.280932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:38.282057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:38.282551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:38:38.307946 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:38:38.309785 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:38:38.313444 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1548/3075] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:38:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:38:38.384026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:38.425794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72eb6-0d37-48c0-84af-415a37f158ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:38.455975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:38.457397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:38.458064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:38.458882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:38.468327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:38.740464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:38.748088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:38.803215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1528/3076] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:39.760453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:39.766782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:40.050449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465c8d-8ff1-4c96-8517-3b7055c34c2d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:40.076048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:40.077759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:40.078628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:40.079477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] PATH_INFO: `/v3/users/434cd2fc0e8144b1ab676a4bf7605339` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:40.082244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434cd2fc0e8144b1ab676a4bf7605339)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:40.090774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:40.503767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434cd2fc0e8144b1ab676a4bf7605339'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:40.510198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434cd2fc0e8144b1ab676a4bf7605339'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:40.764987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434cd2fc0e8144b1ab676a4bf7605339'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:40.796916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:40.824745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434cd2fc0e8144b1ab676a4bf7605339'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:40.857320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83a1e17-5c38-420c-a35b-0820c2e88a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434cd2fc0e8144b1ab676a4bf7605339'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:40.887776 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1549/3077] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:39 2022] DELETE /identity/v3/users/434cd2fc0e8144b1ab676a4bf7605339 => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:45.005419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:45.038694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a042ab-eda7-4947-8809-b23e5673491d service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:45.316396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:45.317762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:45.318032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:45.329689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] PATH_INFO: `/v3/projects/83f4d8accaf7424cb88d1327e40a1e9e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:45.338905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f4d8accaf7424cb88d1327e40a1e9e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:45.345562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:45.425466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:45.718703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f4d8accaf7424cb88d1327e40a1e9e', 'request_id': 'req-bb553482-2273-4bca-8fb9-c5bcc024873a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:45.737301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f4d8accaf7424cb88d1327e40a1e9e', 'request_id': 'req-bb553482-2273-4bca-8fb9-c5bcc024873a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:45.759293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f4d8accaf7424cb88d1327e40a1e9e', 'request_id': 'req-bb553482-2273-4bca-8fb9-c5bcc024873a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:45.961728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] The token cache is being invalidate because project 83f4d8accaf7424cb88d1327e40a1e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:45.962748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:45.964990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb553482-2273-4bca-8fb9-c5bcc024873a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:45.974629 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1529/3078] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:45 2022] DELETE /identity/v3/projects/83f4d8accaf7424cb88d1327e40a1e9e => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:38:45.980561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:45.982155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:45.982899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:46.063722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:46.065882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:46.373665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1550/3079] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:46.386388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:46.387115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:46.387325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:46.455452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:46.457743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:46.498452 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1530/3080] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:46.501221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:46.531827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf56e9-4ed2-4f64-8fd4-c4d27d31305c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:46.549367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:46.551046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:46.551888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:46.552601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:46.554123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:38:46.555536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:46.560818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:46.636620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:46.637406 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1551/3081] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:38:46.662514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b538-f95c-43b1-ba91-3f8ef814be3b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:46.687533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:46.689071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:46.689989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:46.692744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:46.694638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:46.699217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:46.813023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:46.817408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:46.902342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6210ef-d222-4164-bdff-a6ba3fef58a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:46.923165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:46.924991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:46.925750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:46.926496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] PATH_INFO: `/v3/users/71b61b8c7fc34b64a4e2e1101f40cd05` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:46.933270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b61b8c7fc34b64a4e2e1101f40cd05)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:46.939045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:47.000258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1531/3082] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:46 2022] POST /identity/v3/projects => generated 397 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:38:47.010754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:47.383059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb376cc-18fb-4963-8ce6-7f3ad371568a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:47.405504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:47.406787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:47.407304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:47.407825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:47.411556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:47.417907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:47.460007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b61b8c7fc34b64a4e2e1101f40cd05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:47.465567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b61b8c7fc34b64a4e2e1101f40cd05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:47.729790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b61b8c7fc34b64a4e2e1101f40cd05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:47.763550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1532/3083] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:47 2022] POST /identity/v3/users => generated 299 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:47.772704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:47.792911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b61b8c7fc34b64a4e2e1101f40cd05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:47.805334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8d2e-9f7a-4fc1-a93b-c83c82b38e19 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:47.825699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:47.830060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:47.830574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:47.831076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:47.835490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:47.842723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:47.849518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b61b8c7fc34b64a4e2e1101f40cd05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:47.924207 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1552/3084] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:46 2022] DELETE /identity/v3/users/71b61b8c7fc34b64a4e2e1101f40cd05 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:47.952366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:47.954908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:47.963027 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1533/3085] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:38:48.162586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:48.224641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac25cc2-a18b-4a61-8385-117bc0293e17 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:48.234508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:48.235563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:48.236075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:48.236728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:48.238753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:48.242887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e247-54a2-4886-9091-d936e397eaf0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:48.267748 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1553/3086] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:48.276755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:48.301183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e431-1f87-4385-838e-eb466690cb86 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:48.312967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:48.314414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:48.316862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:48.318529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] PATH_INFO: `/v3/projects/8fe6727c071748399777eac51fd08556/users/cc2baf41db034b27a7799f37999b1a9e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:48.373495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe6727c071748399777eac51fd08556, user_id=cc2baf41db034b27a7799f37999b1a9e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:48.382283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:48.607483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1534/3087] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:48 2022] PUT /identity/v3/projects/8fe6727c071748399777eac51fd08556/users/cc2baf41db034b27a7799f37999b1a9e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:48.608225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:48.608225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:48.608847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:48.639052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:48.641298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:48.792963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1554/3088] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:48.815034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:48.821655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:48.953125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.015759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6a4a-1fcf-4bac-8965-4be037de4d60 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:49.026072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:49.027240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:49.028306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:49.029188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:49.052683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:49.057059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b829-8531-46d3-9fb6-d5521865896f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:49.081426 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1535/3089] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:49.143511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:49.149791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:49.282805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b517a4-4c44-4f8a-830e-da8c0eb7c72b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:49.301347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:49.302478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:49.303230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:49.306631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] PATH_INFO: `/v3/projects/278001113cdf41b5b902ac5a620d3f52` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:49.312838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] RBAC: Authorizing `identity:delete_project(project_id=278001113cdf41b5b902ac5a620d3f52)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:49.318777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:49.713390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278001113cdf41b5b902ac5a620d3f52', 'request_id': 'req-df19f4db-44dd-4436-a8c7-276ca27f277c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:49.857908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278001113cdf41b5b902ac5a620d3f52', 'request_id': 'req-df19f4db-44dd-4436-a8c7-276ca27f277c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:49.889750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278001113cdf41b5b902ac5a620d3f52', 'request_id': 'req-df19f4db-44dd-4436-a8c7-276ca27f277c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:49.924880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] The token cache is being invalidate because project 278001113cdf41b5b902ac5a620d3f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:38:49.926003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:49.928057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df19f4db-44dd-4436-a8c7-276ca27f277c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:49.933167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1555/3090] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:49 2022] DELETE /identity/v3/projects/278001113cdf41b5b902ac5a620d3f52 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:49.949933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a3c6-583c-4912-8178-81420a301853 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:49.952057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a3c6-583c-4912-8178-81420a301853 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:49.953076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a3c6-583c-4912-8178-81420a301853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:50.011395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4566a3c6-583c-4912-8178-81420a301853 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:50.015227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4566a3c6-583c-4912-8178-81420a301853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:50.211914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:50.213400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:50.214440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:50.221300 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1536/3091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:50.294648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:50.294648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:50.315040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1556/3092] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:38:50.322822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a3c6-583c-4912-8178-81420a301853 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:50.365499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a3c6-583c-4912-8178-81420a301853 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:50.387227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:50.391409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:50.394629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:50.395335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:50.400234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:38:50.402124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:50.410758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:50.474250 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1537/3093] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:38:50.482237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:50.507765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a5826-e7ea-4941-a44d-9ed81d1fb5ad None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:50.517705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:50.519536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:50.520375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:50.520760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:50.522481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:50.531017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:50.812024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1557/3094] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:38:50 2022] POST /identity/v3/projects => generated 403 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:50.819602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:50.868837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec117-db63-4664-851b-fd47231de5e7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:51.103244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:51.105835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:51.106652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:51.107485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:51.108767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:51.114842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:51.403959 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1538/3095] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:38:50 2022] POST /identity/v3/users => generated 302 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:38:51.412257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:51.445497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5cf3c-6cf6-4bd4-9ef1-9ea75d71515e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:51.470468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:51.475872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:51.475872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:51.478352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:51.483006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:51.489452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:51.530679 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1558/3096] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:51.543725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:51.566412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450cb6-3ddf-4e3f-acea-aafa78674986 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:51.616013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:51.617443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:51.617823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:51.618375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:51.619827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:51.624184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:51.676194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1539/3097] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:38:51.688782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:51.716887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9846-5af2-4f0f-910b-62fda336cd8f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:51.740501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:51.741953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:51.742838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:51.743581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] PATH_INFO: `/v3/projects/ab7f55d3f0d44d26b00ae52218511449/users/aba032bf12f24d9eb0aeef133ba7b10c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:51.787277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7f55d3f0d44d26b00ae52218511449, user_id=aba032bf12f24d9eb0aeef133ba7b10c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:51.794429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0599d7-7e73-4d20-a04f-b7e7e2c87b9e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:51.802265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:51.912870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:51.915952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:52.028610 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1559/3098] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:38:51 2022] PUT /identity/v3/projects/ab7f55d3f0d44d26b00ae52218511449/users/aba032bf12f24d9eb0aeef133ba7b10c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:38:52.037736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:52.038327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:52.039025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:52.091479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:52.099797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:38:52.099797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:52.233618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366087-b975-4888-822a-575618d63d4e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:52.253257 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1560/3099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:38:52.311102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:52.315965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:52.446369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:52.448084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:52.448961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:52.450030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:52.457236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:52.495472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:52.500012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:52.555637 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1540/3100] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:52.584997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e185e4-c23f-4642-a9fa-5cb394d7aa27 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:52.598636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:52.600151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:52.601919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:52.602658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:52.636955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:52.642785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:52.689174 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1561/3101] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:38:58.327873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:38:58.330745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:38:58.407711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414a65e-320e-44ca-aba2-f2d6b196bab0 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:38:58.448363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:38:58.448363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:38:58.448363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:38:58.448363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] PATH_INFO: `/v3/users/682727ddf79c4a27a28ce32301564d34` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:38:58.453860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682727ddf79c4a27a28ce32301564d34)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:38:58.460934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:38:59.118452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682727ddf79c4a27a28ce32301564d34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:59.356172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682727ddf79c4a27a28ce32301564d34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:59.409225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682727ddf79c4a27a28ce32301564d34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:59.452703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682727ddf79c4a27a28ce32301564d34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:59.454244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db205a50-2a50-4963-ad39-04b6cddb2277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682727ddf79c4a27a28ce32301564d34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:38:59.470936 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1541/3102] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:38:58 2022] DELETE /identity/v3/users/682727ddf79c4a27a28ce32301564d34 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:02.058804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:02.109348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04752a6-1d00-49fa-8aba-526f640b3dc7 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:02.341651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:02.343699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:02.344587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:02.345778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] PATH_INFO: `/v3/projects/1d50f961abf54801bd03d5551f45b8be` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:02.349461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d50f961abf54801bd03d5551f45b8be)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:02.355262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:02.591742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:02.625034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d50f961abf54801bd03d5551f45b8be', 'request_id': 'req-4feda0b2-4c5c-44a4-bc16-e0f86a691576'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:02.800234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d50f961abf54801bd03d5551f45b8be', 'request_id': 'req-4feda0b2-4c5c-44a4-bc16-e0f86a691576'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:02.835625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d50f961abf54801bd03d5551f45b8be', 'request_id': 'req-4feda0b2-4c5c-44a4-bc16-e0f86a691576'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:02.908679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] The token cache is being invalidate because project 1d50f961abf54801bd03d5551f45b8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:39:02.915871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:02.921421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4feda0b2-4c5c-44a4-bc16-e0f86a691576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:02.929302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1562/3103] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:02 2022] DELETE /identity/v3/projects/1d50f961abf54801bd03d5551f45b8be => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:02.931826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:02.932695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:02.933215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:03.011590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:03.014064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:03.182044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:03.458943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1542/3104] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:39:03.478208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:03.478208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:03.478208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:03.545766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:03.557388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:03.595223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1563/3105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:03.607045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:03.658022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c64b-369f-44d8-a230-7ae2da0cf1f1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:03.692367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:03.693900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:03.696422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:03.702186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:03.724139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:39:03.725012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:03.730138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:03.818170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1543/3106] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:39:03.825626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:03.872146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42184637-b7ad-4e06-b53d-4ff2631f0654 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:03.885538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:03.887589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:03.888763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:03.892665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:03.895019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:03.904586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:04.274289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1564/3107] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:39:03 2022] POST /identity/v3/projects => generated 371 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:04.281362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:04.342179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457445be-15b9-46b2-aa7b-e65c9ebe39f8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:04.679523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:04.680696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:04.681891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:04.682426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:04.688291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:04.700731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:04.921570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:04.930476 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1544/3108] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:39:04 2022] POST /identity/v3/users => generated 286 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:04.992367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea2d16-fb07-49ce-8265-40a008e590da admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:05.025683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:05.030302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:05.034867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:05.037794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:05.040022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:05.052135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:05.117890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1565/3109] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:39:05.124500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:05.160453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44e214-4ea8-42f1-b379-7358312d903e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:05.182191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:05.183397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:05.183905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:05.184484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:05.189922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:05.199976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a508387-9391-4004-a7da-481a44402276 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:05.254689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:05.273007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1545/3110] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:05.280770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f333f1-a5e3-4331-beb9-8b6a08eac338 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:05.312841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:05.314409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:05.319220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:05.320819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] PATH_INFO: `/v3/projects/bc18d419c8b249ff89f56a0302023295/users/f686c468c229481da57cfa962ba00435/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:05.393661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc18d419c8b249ff89f56a0302023295, user_id=f686c468c229481da57cfa962ba00435, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:05.420400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:05.624487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1566/3111] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:39:05 2022] PUT /identity/v3/projects/bc18d419c8b249ff89f56a0302023295/users/f686c468c229481da57cfa962ba00435/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:05.642012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:05.644274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:05.645069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:05.790037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] MFA Rules not processed for user `f686c468c229481da57cfa962ba00435`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:05.803414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:06.171725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1546/3112] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:39:06.217065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:06.220854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:06.518835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14936f36-5326-497c-91fc-893e14135e39 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:06.532616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:06.534309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:06.535001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:06.535634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:06.555730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:06.560418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d1edd-0d6e-407e-a917-f4bf3ce29870 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:06.585926 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1567/3113] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:08.154098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:08.156795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:08.260931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:08.502369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9191-e775-4101-a86f-070d5e6c9b1d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:08.545452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:08.554372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:08.554932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:08.556989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] PATH_INFO: `/v3/users/c35904ae44544c128474584457e43cca` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:08.582146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35904ae44544c128474584457e43cca)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:08.594567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:08.961574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35904ae44544c128474584457e43cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:09.106636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35904ae44544c128474584457e43cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:09.123881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35904ae44544c128474584457e43cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:09.153346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35904ae44544c128474584457e43cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:09.154619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35904ae44544c128474584457e43cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:09.174978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1547/3114] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:39:08 2022] DELETE /identity/v3/users/c35904ae44544c128474584457e43cca => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:39:09.832620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:09.833444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:09.833618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:39:09.853882 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:39:09.856080 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:39:09.866687 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1568/3115] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:39:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:39:10.159768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:10.162256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:10.463687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe6ad-5870-41e1-8503-79c7e6f2c240 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:10.499511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:10.501952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:10.503318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:10.504202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] PATH_INFO: `/v3/users/f686c468c229481da57cfa962ba00435` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:10.508113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f686c468c229481da57cfa962ba00435)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:10.513411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:10.618844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:10.622281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:10.659195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbab80e-6597-4752-a4b5-084def7052a1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:10.669555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:10.671493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:10.672633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:10.673597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] PATH_INFO: `/v3/projects/f37d0edcedec45449d139180e2fec383` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:10.676637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37d0edcedec45449d139180e2fec383)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:10.681263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:10.766995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:10.831848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:10.854962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f686c468c229481da57cfa962ba00435'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:10.963397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37d0edcedec45449d139180e2fec383', 'request_id': 'req-331459da-6598-4cc0-8940-35cacd5639aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.011776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f686c468c229481da57cfa962ba00435'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.038649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f686c468c229481da57cfa962ba00435'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.081879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f686c468c229481da57cfa962ba00435'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.084126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f686c468c229481da57cfa962ba00435'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.103555 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1548/3116] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:39:10 2022] DELETE /identity/v3/users/f686c468c229481da57cfa962ba00435 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:11.105375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:11.107903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:11.135696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37d0edcedec45449d139180e2fec383', 'request_id': 'req-331459da-6598-4cc0-8940-35cacd5639aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.156299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37d0edcedec45449d139180e2fec383', 'request_id': 'req-331459da-6598-4cc0-8940-35cacd5639aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.209510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] The token cache is being invalidate because project f37d0edcedec45449d139180e2fec383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:39:11.211979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.225462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-331459da-6598-4cc0-8940-35cacd5639aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:11.236228 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1569/3117] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:10 2022] DELETE /identity/v3/projects/f37d0edcedec45449d139180e2fec383 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:11.244990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:11.246804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:11.249331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:11.347801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:11.353718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:11.471276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99adb-f275-4b4e-b11a-680f379ef6b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:11.497761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:11.500598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:11.501126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:11.501605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:11.515794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:11.570974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:11.580861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459a4e-2a50-4ca7-9110-c03b70af3a33 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:11.652921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1549/3118] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:11.666215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b5dd-afbc-4d96-aab3-200e1e2c25c0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:11.666713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b5dd-afbc-4d96-aab3-200e1e2c25c0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:11.667487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b5dd-afbc-4d96-aab3-200e1e2c25c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:11.670616 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1570/3119] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:11.773492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7774b5dd-afbc-4d96-aab3-200e1e2c25c0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:11.775893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7774b5dd-afbc-4d96-aab3-200e1e2c25c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:11.791471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:11.794471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:11.847066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1550/3120] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:11.852910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:11.853420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:11.853927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:12.035553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:12.042488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:12.090852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1551/3121] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:12.096443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:12.139731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f453b3-be89-4a43-854a-ac2daf21da91 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:12.162521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:12.168747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:12.171431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:12.175921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:12.178016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:39:12.178737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:12.188787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:12.258800 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1552/3122] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:39:12.265111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:12.266137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d7d7-d962-4ba1-9bae-dd5c9ed7c161 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:12.274939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:12.277429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:12.277988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:12.279070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:12.299926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:12.303739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:12.324100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2087f-ab5b-495d-a1c1-6d2fef562fbd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:12.332410 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1571/3123] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:12.356667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:12.358690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:12.359393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:12.360174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:12.361544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:12.369234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:12.556652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1553/3124] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:39:12 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:39:12.564275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:12.612085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d826-0afb-4921-ad2d-a237cc73d921 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:12.763938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:12.794294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:12.795916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:12.796739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:12.798133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:12.799958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:12.805136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:13.000810 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1572/3125] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:39:12 2022] POST /identity/v3/users => generated 286 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:13.008588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:13.068258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7219e8-7825-4bd8-8ad0-83eace57c49d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:13.097954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:13.099947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:13.101868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:13.102402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:13.107517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:13.118388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:13.168708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1554/3126] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:13.181090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:13.201411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ddd00-1407-4cb3-8176-51a1b0771721 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:13.215019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:13.216272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:13.216818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:13.217306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:13.218706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:13.220695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684e66-d342-4d9f-ace2-a30a3d3bd6f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:13.250354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1573/3127] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:13.257636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:13.278418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306dcb1-9af5-47f2-84f3-991e37d2eec8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:13.291111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:13.292884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:13.293675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:13.294412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] PATH_INFO: `/v3/projects/8e0f9649604d45b996d238ad4395b51a/users/7a0e1e2323354582a27e3aa9a4355da0/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:13.332036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0f9649604d45b996d238ad4395b51a, user_id=7a0e1e2323354582a27e3aa9a4355da0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:13.339743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:13.631024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1555/3128] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:39:13 2022] PUT /identity/v3/projects/8e0f9649604d45b996d238ad4395b51a/users/7a0e1e2323354582a27e3aa9a4355da0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:13.639417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bb7-7f05-4ee6-862b-66eb3b052d54 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:13.640323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bb7-7f05-4ee6-862b-66eb3b052d54 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:13.640916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc88bb7-7f05-4ee6-862b-66eb3b052d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:13.738160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0bc88bb7-7f05-4ee6-862b-66eb3b052d54 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:13.746846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0bc88bb7-7f05-4ee6-862b-66eb3b052d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:13.943739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1574/3129] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:39:14.206728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:14.354920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:14.470907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a37f8f-c5b6-4dc9-9710-c91926d2989d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:14.508477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:14.510204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:14.510982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:14.511798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:14.565178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:14.569399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:14.619588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1556/3130] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:15.687496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1120-b5e7-407c-be2f-5a5537d612a2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:15.688254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1120-b5e7-407c-be2f-5a5537d612a2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:15.688423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1120-b5e7-407c-be2f-5a5537d612a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:15.761387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:15.765031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:15.781462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5a3e1120-b5e7-407c-be2f-5a5537d612a2 None None] MFA Rules not processed for user `cc2baf41db034b27a7799f37999b1a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:15.789564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5a3e1120-b5e7-407c-be2f-5a5537d612a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:15.814485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4d06-febf-4546-ae3b-6159b8f79d17 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:15.838860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:15.840820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:15.843343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:15.846732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] PATH_INFO: `/v3/projects/bc18d419c8b249ff89f56a0302023295` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:15.871826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc18d419c8b249ff89f56a0302023295)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:15.888224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:16.022026 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1575/3131] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:16.176519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc18d419c8b249ff89f56a0302023295', 'request_id': 'req-284b176c-5d2b-4a76-8f89-163c8fe56595'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:16.193271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc18d419c8b249ff89f56a0302023295', 'request_id': 'req-284b176c-5d2b-4a76-8f89-163c8fe56595'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:16.209801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc18d419c8b249ff89f56a0302023295', 'request_id': 'req-284b176c-5d2b-4a76-8f89-163c8fe56595'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:16.352404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] The token cache is being invalidate because project bc18d419c8b249ff89f56a0302023295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:39:16.352858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:16.354152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:16.363721 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1557/3132] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:15 2022] DELETE /identity/v3/projects/bc18d419c8b249ff89f56a0302023295 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:16.369351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6968-2798-409f-bc1e-8e2448d75ead None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:16.370081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6968-2798-409f-bc1e-8e2448d75ead None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:16.370924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6968-2798-409f-bc1e-8e2448d75ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:16.435854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f29b6968-2798-409f-bc1e-8e2448d75ead None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:16.439669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f29b6968-2798-409f-bc1e-8e2448d75ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:16.710185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:16.711318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:16.712931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:16.746949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1576/3133] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:16.803273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:16.803841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:16.804245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:16.864412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:16.867368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:16.910197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1577/3134] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:16.923542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:16.953492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a5446-9fc9-4810-a388-dbcf9323ebb6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:16.971578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:16.976016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:16.977806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:16.978849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:16.980706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:39:16.984351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:16.989861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.033211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1578/3135] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:39:17.035702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:17.059801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b176c-5d2b-4a76-8f89-163c8fe56595 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:17.069867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8f7f-8501-47a7-97f2-8e081b79c525 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:17.083938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:17.086305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:17.087452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:17.088493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:17.092602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:17.094573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:17.098209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:17.099228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:17.099589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:17.101711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:17.121587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.235641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:17.269065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:17.275693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.309963 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1558/3136] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:39:17.323628 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1579/3137] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:39:17 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:17.331750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:17.359603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76503-19be-4a1b-aa11-ac236c4e8694 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:17.543337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:17.545337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:17.546368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:17.546976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:17.548599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:17.554363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.738217 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1559/3138] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:39:17 2022] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:17.745252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:17.824247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d264f-cccd-4050-b8b9-0ed24bd01e26 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:17.824247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:17.824247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:17.824247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:17.824850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:17.825007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:17.843428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.893797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1580/3139] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:17.895967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:17.935605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e36fcd-ee12-44cf-8824-89637133ac3b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:17.949565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:17.950688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:17.951228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:17.951727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:17.955366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:17.959968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083adefd-451f-41cb-a3f7-4e30dfe7b4a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:17.994031 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1560/3140] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:17.996142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:18.031820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134307-e993-4cf6-911e-87b07a8200a9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:18.044039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:18.045388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:18.045946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:18.046510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] PATH_INFO: `/v3/projects/44dddbee054f49f3ac862994488fc147/users/65eee15492da4c449b3238e50e987bd5/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:18.120026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44dddbee054f49f3ac862994488fc147, user_id=65eee15492da4c449b3238e50e987bd5, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:18.128095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:18.275218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1581/3141] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:39:17 2022] PUT /identity/v3/projects/44dddbee054f49f3ac862994488fc147/users/65eee15492da4c449b3238e50e987bd5/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:18.283111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e313dc-bbb9-4687-80d3-b1c2fab2561f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:18.283974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e313dc-bbb9-4687-80d3-b1c2fab2561f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:18.284172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e313dc-bbb9-4687-80d3-b1c2fab2561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:18.341704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-81e313dc-bbb9-4687-80d3-b1c2fab2561f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:18.343942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81e313dc-bbb9-4687-80d3-b1c2fab2561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:18.555912 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1561/3142] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:18.589500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:18.593243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:18.827500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a807e-9f50-46e3-8b65-696cfd6fcf49 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:18.837496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:18.839201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:18.840114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:18.845331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:18.870710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:18.875361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:18.904181 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1582/3143] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:39:28.716777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:28.894324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:33.345193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:33.346931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:33.347846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:33.441368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] MFA Rules not processed for user `aba032bf12f24d9eb0aeef133ba7b10c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:33.446171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:33.738088 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1562/3144] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:35.740392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:35.744268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:36.141984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc3398-9fa0-4c93-b725-79da538af2ae service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:36.173068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:36.174233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:36.175103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:36.175895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:36.215567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:36.218908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43eb73-a539-4291-bd67-6159315548f6 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:36.334133 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1583/3145] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:35 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:42.946346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:42.949765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:43.020807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d545-3d33-425c-9613-acfcca6572a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:43.034885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:43.036615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:43.037353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:43.038142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] PATH_INFO: `/v3/users/96f056a5a16e449385f1b503e1d2231a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:43.041092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f056a5a16e449385f1b503e1d2231a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:43.048034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:43.435461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f056a5a16e449385f1b503e1d2231a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:43.618271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f056a5a16e449385f1b503e1d2231a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:43.649420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f056a5a16e449385f1b503e1d2231a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:43.750214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f056a5a16e449385f1b503e1d2231a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:43.751956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f056a5a16e449385f1b503e1d2231a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:43.782164 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1563/3146] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:39:42 2022] DELETE /identity/v3/users/96f056a5a16e449385f1b503e1d2231a => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:43.790836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:43.791742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:43.798004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:43.866297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:43.868778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:44.061771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1584/3147] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:44.129118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:44.133942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:44.403281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed53b6-0ddb-4a8c-84ba-902a75b3ba36 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:44.413194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:44.419884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:44.419884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:44.419884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:44.478075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:44.482263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:44.511374 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1564/3148] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:48.810410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:48.815539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:48.849201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2983b0-53cb-478e-89ef-7c4ddbeacaae None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:48.858869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:48.860115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:48.860619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:48.861258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] PATH_INFO: `/v3/projects/7129909d365645369fbe27a2fd00fc88` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:48.863894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7129909d365645369fbe27a2fd00fc88)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:48.870834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:49.166401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7129909d365645369fbe27a2fd00fc88', 'request_id': 'req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:49.294239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7129909d365645369fbe27a2fd00fc88', 'request_id': 'req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:49.329348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7129909d365645369fbe27a2fd00fc88', 'request_id': 'req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:49.417478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] The token cache is being invalidate because project 7129909d365645369fbe27a2fd00fc88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:39:49.421390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:49.427388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aea31a76-f0d7-4c98-8f57-bdeb43f789c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:49.448539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1585/3149] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:48 2022] DELETE /identity/v3/projects/7129909d365645369fbe27a2fd00fc88 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:39:49.449714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:49.471079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:49.510882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2366b2-b942-46e3-843a-c0bbe5791485 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:49.925349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:49.929054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:49.943226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:49.945535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] PATH_INFO: `/v3/users/2a6bbe34fcdc41da9499d3f701e58b7f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:49.947395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6bbe34fcdc41da9499d3f701e58b7f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:49.951691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:50.376009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6bbe34fcdc41da9499d3f701e58b7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:50.956069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6bbe34fcdc41da9499d3f701e58b7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:51.021083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6bbe34fcdc41da9499d3f701e58b7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:51.082599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6bbe34fcdc41da9499d3f701e58b7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:51.087045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bb04597c-85e6-4fa5-af7c-cd9537144868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6bbe34fcdc41da9499d3f701e58b7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:51.115528 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1565/3150] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:39:49 2022] DELETE /identity/v3/users/2a6bbe34fcdc41da9499d3f701e58b7f => generated 0 bytes in 1667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:39:51.841948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:51.842776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:51.842952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:51.950016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:51.961123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:51.966704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:52.268200 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1586/3151] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:39:52.466195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697f0c-a7c5-4357-9a37-9fbc0fefe50b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:52.466195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697f0c-a7c5-4357-9a37-9fbc0fefe50b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:52.467290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697f0c-a7c5-4357-9a37-9fbc0fefe50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:52.535435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:52.537813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:52.638737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8c697f0c-a7c5-4357-9a37-9fbc0fefe50b None None] MFA Rules not processed for user `7a0e1e2323354582a27e3aa9a4355da0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:52.650307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c697f0c-a7c5-4357-9a37-9fbc0fefe50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:52.917152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16666797-a375-44a0-9a94-c6b73bfcdd13 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:52.949541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:52.950627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:52.951114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:52.951635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:53.019389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:53.023086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:53.028985 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1566/3152] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:53.042261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:53.042962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:53.043480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:53.057991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1587/3153] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:53.144138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] MFA Rules not processed for user `7a0e1e2323354582a27e3aa9a4355da0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:53.147185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:53.211834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1567/3154] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:39:53.370830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:53.375599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:53.699087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7f15-cd2c-45ba-b662-0e7dee154b28 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:53.731429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:53.733938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:53.737554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:53.740141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:53.794836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:53.798702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f88251-2245-4ad8-babf-4501dd8141f8 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:53.820203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1588/3155] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:39:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:39:55.104323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:55.107213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:55.153943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:55.546135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6731cf-c9e5-41ae-8584-1d81b34ed616 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:55.570839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:55.572534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:55.573441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:55.574192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] PATH_INFO: `/v3/projects/fdfe6ab98672483babf78ee536878b8d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:55.580884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfe6ab98672483babf78ee536878b8d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:55.587177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:55.603435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705261-45b6-4128-aa7f-722a0c4b9f6b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:55.605192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705261-45b6-4128-aa7f-722a0c4b9f6b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:55.606196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705261-45b6-4128-aa7f-722a0c4b9f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d7705261-45b6-4128-aa7f-722a0c4b9f6b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:39:55.620060 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:39:55.622160 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:39:55.647547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1589/3156] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:39:55 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:39:55.992278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfe6ab98672483babf78ee536878b8d', 'request_id': 'req-a17249aa-9bff-436a-8e0a-616c08095794'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:56.038863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfe6ab98672483babf78ee536878b8d', 'request_id': 'req-a17249aa-9bff-436a-8e0a-616c08095794'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:56.079595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfe6ab98672483babf78ee536878b8d', 'request_id': 'req-a17249aa-9bff-436a-8e0a-616c08095794'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:56.243992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] The token cache is being invalidate because project fdfe6ab98672483babf78ee536878b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:39:56.245035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:56.247962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a17249aa-9bff-436a-8e0a-616c08095794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:39:56.253429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1568/3157] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:55 2022] DELETE /identity/v3/projects/fdfe6ab98672483babf78ee536878b8d => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:56.271876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:56.272431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:56.273157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:56.367819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:56.370201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:56.531500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:56.705892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1590/3158] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:56.719454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:56.720064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:56.720671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:56.797994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:56.800930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:56.826332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1569/3159] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:56.834350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:56.894055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacdb8e-46c6-4fa9-8476-bd4704b64b4d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:56.912941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:56.914774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:56.915605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:56.916238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:56.917929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:39:56.918762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:56.928050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:56.981258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1591/3160] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:39:56.991863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:57.028763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200545-a096-423a-9bbd-6e54aab070ea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:57.061359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:57.078642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:57.079676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:57.080341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:57.082549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:57.087242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:57.297094 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1570/3161] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:39:56 2022] POST /identity/v3/projects => generated 393 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:57.305037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:57.351534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf181-45d8-491f-a531-0653fbcafae1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:57.800347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:57.803568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:57.804474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:57.805245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:57.806750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:57.816715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:57.967037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:57.967749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1592/3162] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:39:57 2022] POST /identity/v3/users => generated 297 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:39:58.009820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cf45-1db4-4926-8e09-3bdee6adbc7f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:58.034985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:58.036421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:58.037070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:58.037555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:58.038861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:58.047585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:58.110957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:58.111478 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1571/3163] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:58.154497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f69e5-d4bb-4ceb-932f-e3fb871efe11 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:58.175297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:58.177148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:58.177633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:58.185070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:58.186341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:58.205194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179efce-877a-48a1-b501-f7725df9a640 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:58.265996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1593/3164] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:39:58.271484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:58.311473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e760ce8-efb3-4702-a8c5-e7f23119fde9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:39:58.372307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:39:58.374048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:58.376522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:58.377309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] PATH_INFO: `/v3/projects/060a53e4fead4141a343b3e54bb09eff/users/a9990d76e7b941ee9dcedb1cb7974d3e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:58.471288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] RBAC: Authorizing `identity:create_grant(project_id=060a53e4fead4141a343b3e54bb09eff, user_id=a9990d76e7b941ee9dcedb1cb7974d3e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:39:58.501785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:39:58.980276 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1572/3165] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:39:58 2022] PUT /identity/v3/projects/060a53e4fead4141a343b3e54bb09eff/users/a9990d76e7b941ee9dcedb1cb7974d3e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:39:59.003579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:39:59.010675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:39:59.013950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:39:59.150670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] MFA Rules not processed for user `a9990d76e7b941ee9dcedb1cb7974d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:39:59.155800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:39:59.699118 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1594/3166] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:39:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 692 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:39:59.701837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:39:59.852697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:59.979170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32cd3-669c-4b08-bb7b-cf651842259c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:00.000795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:00.002870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:00.008204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:00.009130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:00.011070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:00.022531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:00.271864 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1573/3167] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:39:59 2022] POST /identity/v3/projects => generated 391 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:00.278697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:00.341422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec36e-be3e-4bf4-9021-0951d22ec6b7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:00.438238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:00.617754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:00.626286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:00.626286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:00.626286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:00.630874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:00.638947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:00.799522 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1595/3168] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:00 2022] POST /identity/v3/users => generated 302 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:00.806510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:00.843840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba304-83a0-43da-ba97-05a344ac55e9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:00.872387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:00.873546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:00.878784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:00.878784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:00.878784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:00.887431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:00.935613 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1574/3169] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:00.938942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:00.972795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b57c-db10-4220-8dac-0721f230a928 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:00.995924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:01.000758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:01.001494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:01.010388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] PATH_INFO: `/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d/users/c1045a518d614edc8b50d1d9db769d45/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:01.073565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0105ef8ad80b42049b4f3cf0f9428a8d, user_id=c1045a518d614edc8b50d1d9db769d45, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:01.081410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:01.260481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1596/3170] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:00 2022] PUT /identity/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d/users/c1045a518d614edc8b50d1d9db769d45/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:01.267429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:01.311960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429aeb4-0730-4138-96ec-ceadffbe0e5a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:01.552516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:01.554172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:01.557847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:01.558831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:01.561748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:01.565995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2919-e7ca-473f-b270-2871086192e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:01.606189 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1575/3171] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:01.608931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:01.648113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5919f-087f-4777-9086-a0d492388d51 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:01.711810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:01.713136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:01.713622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:01.714051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] PATH_INFO: `/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d/users/c1045a518d614edc8b50d1d9db769d45/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:01.742759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0105ef8ad80b42049b4f3cf0f9428a8d, user_id=c1045a518d614edc8b50d1d9db769d45, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:01.789438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8ab8e-806a-4965-b5f6-831c4bd9a88d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:01.940565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eae8e-7fca-4bfc-8756-69fc10b2be8b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:01.946506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eae8e-7fca-4bfc-8756-69fc10b2be8b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:01.946506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eae8e-7fca-4bfc-8756-69fc10b2be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:01.965437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1597/3172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:01 2022] PUT /identity/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d/users/c1045a518d614edc8b50d1d9db769d45/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:02.083910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f75eae8e-7fca-4bfc-8756-69fc10b2be8b None None] MFA Rules not processed for user `c1045a518d614edc8b50d1d9db769d45`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:02.087483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f75eae8e-7fca-4bfc-8756-69fc10b2be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:02.550493 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1576/3173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 614 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:02.575429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:02.575921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:02.576434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:02.688350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] MFA Rules not processed for user `a9990d76e7b941ee9dcedb1cb7974d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:02.711415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:02.816044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:02.820498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:02.820498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:02.992757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] MFA Rules not processed for user `65eee15492da4c449b3238e50e987bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:03.008200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:03.165880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:03.204881 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1598/3174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:03.242116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:03.246375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:03.371163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1577/3175] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:03.383332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:03.388348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:03.747091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79070195-e3c9-41db-a803-fc77510b91b2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:03.795345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:03.802916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:03.805967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:03.806300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:03.866486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:03.869990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:03.917355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43b21c-d86c-47ee-a519-87a0b1412c32 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:03.943546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:03.944979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:03.945910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:03.946496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:03.981611 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1599/3176] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:40:03.986525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:03.991315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:04.037544 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1578/3177] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:40:05.308268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:05.310879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:05.356447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:05.771041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35d92-bece-433b-84a5-2c3015d3d762 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:05.794499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:05.796200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:05.796200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:05.803070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] PATH_INFO: `/v3/users/5bda0ce3a36747c69b4a78e558a03b1b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:05.805068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bda0ce3a36747c69b4a78e558a03b1b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:05.809122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:06.683004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bda0ce3a36747c69b4a78e558a03b1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:06.684689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bda0ce3a36747c69b4a78e558a03b1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:06.822657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:06.825516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:06.866398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bda0ce3a36747c69b4a78e558a03b1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:06.886292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060743a9-28b3-4a03-b773-9d183d2eb760 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:06.918181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:06.923726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:06.925483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:06.928438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] PATH_INFO: `/v3/users/cc2baf41db034b27a7799f37999b1a9e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:06.929939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bda0ce3a36747c69b4a78e558a03b1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:06.936838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2baf41db034b27a7799f37999b1a9e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:06.949465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:06.977274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0f5058d0-52a5-4683-bddd-eb5bfe6e1d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bda0ce3a36747c69b4a78e558a03b1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.023557 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1600/3178] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:05 2022] DELETE /identity/v3/users/5bda0ce3a36747c69b4a78e558a03b1b => generated 0 bytes in 1716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:07.031074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:07.031636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:07.032141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:07.142085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:07.149469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:07.479629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2baf41db034b27a7799f37999b1a9e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.485593 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1601/3179] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:07.539283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:07.542476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:07.630550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2baf41db034b27a7799f37999b1a9e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.658577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2baf41db034b27a7799f37999b1a9e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.787543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2baf41db034b27a7799f37999b1a9e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.803720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69ecbfda-7e79-4c70-bda2-818aaa351b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2baf41db034b27a7799f37999b1a9e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:07.838166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:07.865097 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1579/3180] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:06 2022] DELETE /identity/v3/users/cc2baf41db034b27a7799f37999b1a9e => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:07.964669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88202c-d0dd-45d4-a12e-bdef759e8dbe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:08.192314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:08.193510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:08.194301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:08.194751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:08.204164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:08.541551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:08.542709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:08.543826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:08.683613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] MFA Rules not processed for user `65eee15492da4c449b3238e50e987bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:08.693302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:08.770648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:08.803032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:08.812414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4636e-05cc-441c-981e-a624050d36e8 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:08.901585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1602/3181] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:40:09.056715 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1580/3182] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:10.452814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667eaa-e215-4b16-911b-5b7829c8576c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:10.453707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667eaa-e215-4b16-911b-5b7829c8576c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:10.455519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667eaa-e215-4b16-911b-5b7829c8576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c1667eaa-e215-4b16-911b-5b7829c8576c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:40:10.491721 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:40:10.493997 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:40:10.542718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1603/3183] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:40:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 67 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:40:10.790484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:10.793686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:10.876528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2e38-421f-4092-ac25-78a9f104456e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:10.899959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:10.904887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:10.905471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:10.906016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] PATH_INFO: `/v3/projects/8fe6727c071748399777eac51fd08556` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:10.912413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe6727c071748399777eac51fd08556)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:10.916097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:11.223229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe6727c071748399777eac51fd08556', 'request_id': 'req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:11.301449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe6727c071748399777eac51fd08556', 'request_id': 'req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:11.350266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe6727c071748399777eac51fd08556', 'request_id': 'req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:11.513682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] The token cache is being invalidate because project 8fe6727c071748399777eac51fd08556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:11.515806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:11.518673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5f12bc5-748b-4ffb-9a9d-d4d7b2e52c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:11.528402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1581/3184] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:10 2022] DELETE /identity/v3/projects/8fe6727c071748399777eac51fd08556 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:11.539898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:11.541534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:11.542352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:11.731647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:11.764725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:12.199223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1604/3185] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:12.211652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:12.212490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:12.213102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:12.361083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:12.366428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:12.415444 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1582/3186] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:12.421483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:12.452738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:12.455638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:12.479395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf09e29-8412-4316-9b61-8e8d38d15f02 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:12.519355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:12.522045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:12.522570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:12.522858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:12.524386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:12.524847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:12.538990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:12.553196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e19b6-4142-4f15-8067-821bb726bf8e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:12.623420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:12.625103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:12.625346 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1605/3187] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:40:12.627470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:12.631191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] PATH_INFO: `/v3/projects/70436b8b504e43dc882f5ee434ecf443` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:12.633693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:12.646371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70436b8b504e43dc882f5ee434ecf443)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:12.665237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:12.678184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cbbd-2879-4d0b-b0f9-0939131552cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:12.705604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:12.707289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:12.713316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:12.714928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:12.716922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:12.722010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:12.995837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:13.041195 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1606/3188] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:12 2022] POST /identity/v3/projects => generated 387 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:13.048996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:13.082471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70436b8b504e43dc882f5ee434ecf443', 'request_id': 'req-626b20a4-0160-4336-9116-31fe656756c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:13.108357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70436b8b504e43dc882f5ee434ecf443', 'request_id': 'req-626b20a4-0160-4336-9116-31fe656756c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:13.141481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70436b8b504e43dc882f5ee434ecf443', 'request_id': 'req-626b20a4-0160-4336-9116-31fe656756c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:13.295235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] The token cache is being invalidate because project 70436b8b504e43dc882f5ee434ecf443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:13.296252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:13.300073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:13.311228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1583/3189] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:12 2022] DELETE /identity/v3/projects/70436b8b504e43dc882f5ee434ecf443 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:13.318771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:13.322785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:13.588349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:13.626101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0071b9-e879-419b-8257-fb7c02d9e0a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:13.667475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:13.668683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:13.669225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:13.669752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:13.671020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:13.679156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:13.826988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b20a4-0160-4336-9116-31fe656756c7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:13.844126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:13.845603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:13.849031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:13.849795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] PATH_INFO: `/v3/users/9df54aab74014696a7519cb428b994b5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:13.860217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df54aab74014696a7519cb428b994b5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:13.882043 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1607/3190] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:13 2022] POST /identity/v3/users => generated 294 bytes in 832 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:40:13.882364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:13.894945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:13.894945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:13.928113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55edb-7124-4809-a256-294c659c08b6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:13.962814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:13.964537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:13.965429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:13.969808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] PATH_INFO: `/v3/users/aba032bf12f24d9eb0aeef133ba7b10c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:13.980881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba032bf12f24d9eb0aeef133ba7b10c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:13.996357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:14.274462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df54aab74014696a7519cb428b994b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.427226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df54aab74014696a7519cb428b994b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.454142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df54aab74014696a7519cb428b994b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.458131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba032bf12f24d9eb0aeef133ba7b10c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.462205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba032bf12f24d9eb0aeef133ba7b10c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.559926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df54aab74014696a7519cb428b994b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.564358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df54aab74014696a7519cb428b994b5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.608961 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1584/3191] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:13 2022] DELETE /identity/v3/users/9df54aab74014696a7519cb428b994b5 => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:14.620364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:14.624188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:14.674617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba032bf12f24d9eb0aeef133ba7b10c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.752543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba032bf12f24d9eb0aeef133ba7b10c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.827425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba032bf12f24d9eb0aeef133ba7b10c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:14.872265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1608/3192] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:13 2022] DELETE /identity/v3/users/aba032bf12f24d9eb0aeef133ba7b10c => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:14.938059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecd17-303f-497e-b9ca-1f9d7901d40b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:15.201582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:15.314525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:15.314525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:15.314525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:15.322653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:15.334933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:15.346856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:15.420083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:15.422576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:15.429579 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1585/3193] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 820 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:15.504923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844e14b-adaf-4d41-a5d7-0dbf1b4088a7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:15.532772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:15.534531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:15.535630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:15.536129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:15.537688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:15.549255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec827e1e-3e7f-4f7a-a6ee-7dd02486258f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:15.600915 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1609/3194] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:15.602058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:15.661874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab3f3f-a4e4-46bb-bac6-a165618d5b8a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:15.688132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:15.689248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:15.689745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:15.690232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] PATH_INFO: `/v3/projects/6c5aaa2031d8481ebc5a7b3b9a0522dc/users/f641a595a9e242da9564a483717f3b48/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:15.810615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5aaa2031d8481ebc5a7b3b9a0522dc, user_id=f641a595a9e242da9564a483717f3b48, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:15.822173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:16.025384 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1586/3195] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:15 2022] PUT /identity/v3/projects/6c5aaa2031d8481ebc5a7b3b9a0522dc/users/f641a595a9e242da9564a483717f3b48/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:16.029632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:16.029632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:16.031108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:16.105132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:16.108125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:16.290588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:16.370090 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1610/3196] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:16.453336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:16.456233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:16.772691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7767c5-0402-479d-ba3f-9b9f8af1cdf3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:16.790988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:16.793876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:16.794441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:16.794854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:16.839913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:16.843960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:16.901547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1587/3197] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:40:17.978741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:17.982204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:18.036972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624c41e-7317-4d1a-be89-cf87408ae4b5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:18.061982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:18.064746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:18.065411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:18.066577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] PATH_INFO: `/v3/projects/9edf8377dc0f438692440aeae37efb30` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:18.074443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edf8377dc0f438692440aeae37efb30)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:18.083155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:18.283874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:18.287994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:18.424284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edf8377dc0f438692440aeae37efb30', 'request_id': 'req-9e0c4a85-0085-4491-908c-573a7f8b1cc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:18.596092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af089c5-0cf0-4ca7-9dc9-324f9e7fd061 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:18.630025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edf8377dc0f438692440aeae37efb30', 'request_id': 'req-9e0c4a85-0085-4491-908c-573a7f8b1cc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:18.668865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edf8377dc0f438692440aeae37efb30', 'request_id': 'req-9e0c4a85-0085-4491-908c-573a7f8b1cc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:18.709701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] The token cache is being invalidate because project 9edf8377dc0f438692440aeae37efb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:18.710593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:18.712308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:18.719509 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1611/3198] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:17 2022] DELETE /identity/v3/projects/9edf8377dc0f438692440aeae37efb30 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:18.719509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:18.728456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:18.766482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:18.839926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:18.846757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:18.848254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:18.849807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:18.860866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:19.028859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c4a85-0085-4491-908c-573a7f8b1cc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:19.057759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:19.061636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:19.063599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:19.063837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:19.063837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:19.064778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] PATH_INFO: `/v3/projects/ab7f55d3f0d44d26b00ae52218511449` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:19.069005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7f55d3f0d44d26b00ae52218511449)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:19.078154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:19.089446 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1588/3199] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:40:19.092692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:19.095862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:19.152933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b9bb-97ee-4e1a-810f-60fdc9eb148a service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:19.181989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:19.183099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:19.183593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:19.184050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] PATH_INFO: `/v3/users/fe9e839b68de4530b70e6a12fb5d00f1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:19.193577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9e839b68de4530b70e6a12fb5d00f1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:19.204859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:19.438114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7f55d3f0d44d26b00ae52218511449', 'request_id': 'req-8bc8d721-4365-4495-8f69-d06b034fb3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.568246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9e839b68de4530b70e6a12fb5d00f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.585841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7f55d3f0d44d26b00ae52218511449', 'request_id': 'req-8bc8d721-4365-4495-8f69-d06b034fb3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.620287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7f55d3f0d44d26b00ae52218511449', 'request_id': 'req-8bc8d721-4365-4495-8f69-d06b034fb3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.664430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] The token cache is being invalidate because project ab7f55d3f0d44d26b00ae52218511449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:19.665144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.666707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8bc8d721-4365-4495-8f69-d06b034fb3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.678231 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1612/3200] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:18 2022] DELETE /identity/v3/projects/ab7f55d3f0d44d26b00ae52218511449 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:19.678231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a3d3-fab1-4f52-a645-e777aa1087fd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:19.678231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a3d3-fab1-4f52-a645-e777aa1087fd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:19.678231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292a3d3-fab1-4f52-a645-e777aa1087fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:19.694847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:19.721777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0292a3d3-fab1-4f52-a645-e777aa1087fd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:19.725418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0292a3d3-fab1-4f52-a645-e777aa1087fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:19.734172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9e839b68de4530b70e6a12fb5d00f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.763773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9e839b68de4530b70e6a12fb5d00f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.812924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9e839b68de4530b70e6a12fb5d00f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.814758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0d5a545-57c4-4419-956b-10638e90247e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9e839b68de4530b70e6a12fb5d00f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:19.842587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1589/3201] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:19 2022] DELETE /identity/v3/users/fe9e839b68de4530b70e6a12fb5d00f1 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:19.842587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a936f7-d653-4277-ae57-cc85ca24f246 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:19.847648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a936f7-d653-4277-ae57-cc85ca24f246 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:19.848453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a936f7-d653-4277-ae57-cc85ca24f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:19.974401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e7a936f7-d653-4277-ae57-cc85ca24f246 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:19.988649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7a936f7-d653-4277-ae57-cc85ca24f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:20.104014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1613/3202] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:20.131786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.132401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.133228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.216524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:20.220394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:20.358002 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1590/3203] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:20.373811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.375180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.378212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.489242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:20.525193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:20.529054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:20.570332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1591/3204] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:20.574109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:20.579940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:20.624904 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1614/3205] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:40:20.626982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:20.660742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e41e4-b99a-458e-b35f-3290f333d431 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:20.676937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416e44-78f6-4faf-87b4-da13605c8d44 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:20.679318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:20.681881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.682842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.684240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] PATH_INFO: `/v3/users/7a0e1e2323354582a27e3aa9a4355da0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.694914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0e1e2323354582a27e3aa9a4355da0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:20.699893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:20.701315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:20.702979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.704348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.705363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.706976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:20.714255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:20.714255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:20.763454 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1615/3206] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:20.769392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:20.790962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33157d-9f94-4ccb-a515-198011c922c9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:20.812276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:20.814357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.815844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.819160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.821633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:20.822830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:20.827634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:20.896059 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1616/3207] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:20.901809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:20.925437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506bd2d-f140-4b5b-9871-934615ee6183 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:20.938759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:20.939897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:20.940368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:20.941550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:20.943287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:20.948002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:21.061149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0e1e2323354582a27e3aa9a4355da0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:21.120481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1617/3208] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:21.123424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:21.192152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0e1e2323354582a27e3aa9a4355da0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:21.225291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0e1e2323354582a27e3aa9a4355da0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:21.286107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0e1e2323354582a27e3aa9a4355da0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:21.287720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0e1e2323354582a27e3aa9a4355da0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:21.318207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1592/3209] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:20 2022] DELETE /identity/v3/users/7a0e1e2323354582a27e3aa9a4355da0 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:21.320375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:21.328957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:21.361436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9750ea9-a0b2-43b7-9e37-78e28ef27d54 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:21.602096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0241c-4934-4a0c-afa8-24456d008046 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:21.611658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:21.613647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:21.614462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:21.615326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:21.616820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:21.621075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:21.653603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:21.654993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:21.655566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:21.656058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:21.657312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:21.661195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:21.835635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1593/3210] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:21 2022] POST /identity/v3/users => generated 289 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:21.838414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:21.845567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:21.916379 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1618/3211] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:21 2022] POST /identity/v3/projects => generated 377 bytes in 795 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:21.918400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:21.925591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2f71e-98d5-4700-b803-30ffaa421abb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:22.176977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:22.176977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:22.176977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:22.176977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] PATH_INFO: `/v3/projects/10ad510c188c41c5b44cde6ddd2f40e3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:22.181342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ad510c188c41c5b44cde6ddd2f40e3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:22.189117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:22.227384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:22.270361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4974-a3f3-444b-9594-0a978c7b2106 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:22.281627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:22.282987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:22.283553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:22.284222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:22.286274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:22.290198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:22.316391 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1619/3212] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:22.332926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:22.349619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:22.410911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d66c-6d34-4672-9bf8-801ef0adb595 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:22.460396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ad510c188c41c5b44cde6ddd2f40e3', 'request_id': 'req-bf0c7d0e-62b6-46f7-8a6a-49080716de81'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:22.476930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ad510c188c41c5b44cde6ddd2f40e3', 'request_id': 'req-bf0c7d0e-62b6-46f7-8a6a-49080716de81'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:22.492996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ad510c188c41c5b44cde6ddd2f40e3', 'request_id': 'req-bf0c7d0e-62b6-46f7-8a6a-49080716de81'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:22.499339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:22.588710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:22.590638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:22.591321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:22.592222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:22.593843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:22.598127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:22.651445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] The token cache is being invalidate because project 10ad510c188c41c5b44cde6ddd2f40e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:22.651445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:22.652666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:22.668085 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1594/3213] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:21 2022] DELETE /identity/v3/projects/10ad510c188c41c5b44cde6ddd2f40e3 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:22.696929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:22.705686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:22.754571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c7d0e-62b6-46f7-8a6a-49080716de81 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:22.763463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:22.765322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:22.766174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:22.766952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] PATH_INFO: `/v3/projects/8e0f9649604d45b996d238ad4395b51a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:22.770253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0f9649604d45b996d238ad4395b51a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:22.774754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:22.802788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1620/3214] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:22 2022] POST /identity/v3/users => generated 289 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:22.802788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:22.808466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:22.870358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d608-dea3-4eb9-8dd1-de96fcd6392f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:22.897273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:22.898593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:22.899270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:22.899908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:22.901235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:22.913988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:22.948925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1621/3215] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:22.950676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:22.971366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:23.000959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf9fc-f88b-4614-97ac-858bbe4cd126 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:23.041890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0f9649604d45b996d238ad4395b51a', 'request_id': 'req-efbd4151-096c-40e7-a14b-58ddb90a0f27'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.083080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0f9649604d45b996d238ad4395b51a', 'request_id': 'req-efbd4151-096c-40e7-a14b-58ddb90a0f27'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.104105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0f9649604d45b996d238ad4395b51a', 'request_id': 'req-efbd4151-096c-40e7-a14b-58ddb90a0f27'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.260771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] The token cache is being invalidate because project 8e0f9649604d45b996d238ad4395b51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:23.266456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.272510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.277048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1595/3216] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:22 2022] DELETE /identity/v3/projects/8e0f9649604d45b996d238ad4395b51a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:23.285839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:23.287283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:23.287788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:23.287963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:23.288279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] PATH_INFO: `/v3/users/3bf9d1a16be14b6fa43f6ad95e456342` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:23.291032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:23.298671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf9d1a16be14b6fa43f6ad95e456342)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:23.308984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:23.334033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4151-096c-40e7-a14b-58ddb90a0f27 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:23.350455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:23.351773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:23.352280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:23.352781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:23.354755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:23.360140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:23.398195 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1596/3217] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:23.398195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:23.398195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:23.477284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc165-0c53-4cc2-8954-07e3a936f6d2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:23.530002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:23.530002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:23.530002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:23.530002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] PATH_INFO: `/v3/projects/b0dba749bcef41eabaa078e2e36d0f97/users/11b6296bc2fb4ca6b2f02bf06c3f6602/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:23.530798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:23.614338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0dba749bcef41eabaa078e2e36d0f97, user_id=11b6296bc2fb4ca6b2f02bf06c3f6602, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:23.620806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51fd5-f318-4bfc-afe4-326a5ffc6221 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:23.787047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1597/3218] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:23 2022] PUT /identity/v3/projects/b0dba749bcef41eabaa078e2e36d0f97/users/11b6296bc2fb4ca6b2f02bf06c3f6602/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:23.791317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:23.792205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:23.792979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:23.816005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf9d1a16be14b6fa43f6ad95e456342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.817705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf9d1a16be14b6fa43f6ad95e456342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:23.893550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:23.897209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.102431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1598/3219] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:24.102431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:24.102431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e678a7-6f61-4c7a-ad8c-87c507d43dbf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:24.102431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:24.103619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.103619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.103619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.103619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:24.103619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28605692-0d55-4e65-b5c7-a501d6c89587 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:24.124974 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1599/3220] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:24.129476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2d3d-1146-4b5c-8b9b-4c4a05389e2c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.130134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2d3d-1146-4b5c-8b9b-4c4a05389e2c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.130648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef2d3d-1146-4b5c-8b9b-4c4a05389e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.169165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-30ef2d3d-1146-4b5c-8b9b-4c4a05389e2c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:24.172022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30ef2d3d-1146-4b5c-8b9b-4c4a05389e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.191261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1600/3221] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:24.193730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.194360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.195694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.197297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf9d1a16be14b6fa43f6ad95e456342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:24.238812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:24.241992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf9d1a16be14b6fa43f6ad95e456342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:24.243127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.262382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf9d1a16be14b6fa43f6ad95e456342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:24.284296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1601/3222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:24.284296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:24.303399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e85ad-b356-4c5a-b3ca-fa8efc38b777 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:24.331824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1622/3223] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:22 2022] DELETE /identity/v3/users/3bf9d1a16be14b6fa43f6ad95e456342 => generated 0 bytes in 1371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:24.331824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:24.331824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.359554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:24.359554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.359554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.359554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] PATH_INFO: `/v3/projects/f4fa3c2885ec48db880029d93907789d/users/ca528ff45435455aa4fce16549993ab5/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.433037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fa3c2885ec48db880029d93907789d, user_id=ca528ff45435455aa4fce16549993ab5, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:24.452417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:24.630237 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1602/3224] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:24 2022] PUT /identity/v3/projects/f4fa3c2885ec48db880029d93907789d/users/ca528ff45435455aa4fce16549993ab5/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:24.637174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:24.648875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.653761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c50c3-c4ca-4d9b-9744-d98009b6f2b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:24.770345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:24.854629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:24.903056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed061b-40e4-4a86-89ee-0013bc8d6855 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:24.915033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:24.917371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.918353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.919397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.921665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:24.922687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:24.926381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2890abc-64d3-4ea6-a75a-9a6b27b49daa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:24.930288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:24.931480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.932033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.932539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:24.936145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:24.985035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:24.987611 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1603/3225] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:24.988756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:24.989446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:24.990666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:24.991685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:25.055853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] MFA Rules not processed for user `ca528ff45435455aa4fce16549993ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:25.058972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:25.093684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1623/3226] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:40:25.100307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:25.144375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674acef-4c1b-46c9-bf73-43b36fc706d8 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:25.188866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:25.192328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:25.193276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:25.194156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:25.202252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:25.212419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:25.244564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1604/3227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:25.246797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:25.249492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:25.290327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f0218-4da2-4dad-bad8-9a7937267489 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:25.310198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:25.311875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:25.312654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:25.313216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:25.315357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:25.331264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:25.450594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1624/3228] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:25 2022] POST /identity/v3/projects => generated 367 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:25.456037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:25.595186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:25.622946 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1605/3229] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:25 2022] POST /identity/v3/projects => generated 377 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:25.633785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:25.877856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cad4c-4804-454a-98dc-00810f6adc7e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:26.122185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae4719-4ab9-4835-93a1-a400cfb8c041 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:26.142372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:26.144421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:26.145079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:26.145848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:26.150781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:26.154138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:26.291583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:26.292888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:26.296047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:26.297037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:26.302640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:26.313519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:26.417588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1606/3230] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:25 2022] POST /identity/v3/users => generated 295 bytes in 791 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:26.420501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:26.423886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:26.454916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df286-297f-4a15-b3cb-b694066768a2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:26.517022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:26.517022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:26.517022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:26.517022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] PATH_INFO: `/v3/projects/25520777a4444a30b5310052aba08aa2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:26.519372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25520777a4444a30b5310052aba08aa2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:26.519372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:26.627988 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1625/3231] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:25 2022] POST /identity/v3/users => generated 284 bytes in 1173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:40:26.630493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:26.707600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d94fb-35cc-4bf3-a92f-7c6538e550fb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:26.743013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:26.744535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:26.745168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:26.745813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:26.747306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:26.753599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:26.813803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1626/3232] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:26.825634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:26.859386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25520777a4444a30b5310052aba08aa2', 'request_id': 'req-1d6f58e1-d36c-4329-b65d-702e615b8269'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:26.878947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25520777a4444a30b5310052aba08aa2', 'request_id': 'req-1d6f58e1-d36c-4329-b65d-702e615b8269'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:26.879185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbf40f-1eae-4ba7-a0c8-d1841af4e7d7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:26.895519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25520777a4444a30b5310052aba08aa2', 'request_id': 'req-1d6f58e1-d36c-4329-b65d-702e615b8269'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:27.022750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:27.029067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] The token cache is being invalidate because project 25520777a4444a30b5310052aba08aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:27.035931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:27.051164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:27.054762 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1607/3233] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:26 2022] DELETE /identity/v3/projects/25520777a4444a30b5310052aba08aa2 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:27.056815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:27.062868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:27.090152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:27.091467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.092131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.093629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:27.095700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:27.100714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dcc2a-efd7-4dbd-857c-db0bee95462e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:27.136163 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1627/3234] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:27.139289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f58e1-d36c-4329-b65d-702e615b8269 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:27.140839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.142122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.142999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:27.180302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:27.181572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.182241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.182813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] PATH_INFO: `/v3/projects/850f175b575b4a44954ceb0e0312ed6a/users/783ff8a8fbb84990a1344f1fd103cd65/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:27.192867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:27.195601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:27.239625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1628/3235] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:27.239625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:27.244305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:27.360907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850f175b575b4a44954ceb0e0312ed6a, user_id=783ff8a8fbb84990a1344f1fd103cd65, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:27.371469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:27.371739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd193d-6df4-4a44-a054-c193adddffe8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:27.410073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:27.415041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.415041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.415586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:27.416777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:27.437420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2227fa8-3888-4bbb-8040-3b64fe9d8e69 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:27.516985 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1629/3236] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:27.516985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.525870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.531024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:27.548360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1608/3237] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:27 2022] PUT /identity/v3/projects/850f175b575b4a44954ceb0e0312ed6a/users/783ff8a8fbb84990a1344f1fd103cd65/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:27.550538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:27.644481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:27.649445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:27.814957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:27.927777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adadc2-02b2-434c-ad10-a0a40ae2a827 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:27.949819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:27.951721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:27.952221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:27.953258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] PATH_INFO: `/v3/projects/74d829c1899f478e9a95a0402c0dc87e/users/b0933e4def614f928c0415b7de888e24/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.005300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d829c1899f478e9a95a0402c0dc87e, user_id=b0933e4def614f928c0415b7de888e24, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:28.011873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:28.031716 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1630/3238] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:28.034287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:28.061110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ef2a-1a05-4ad1-9a60-fabe21722a0a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:28.075009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:28.077583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:28.078090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:28.078585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.080264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:28.085025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:28.138940 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1631/3239] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:28.141741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:28.148779 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1609/3240] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:27 2022] PUT /identity/v3/projects/74d829c1899f478e9a95a0402c0dc87e/users/b0933e4def614f928c0415b7de888e24/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:28.150512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:28.225854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af401-7f1b-40ec-887a-2ab442c7264c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:28.563647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61ed11-398e-4910-9d47-a6253b85aa20 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:28.585679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:28.588477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:28.605976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:28.606313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:28.606914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:28.607851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:28.608843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.609906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] PATH_INFO: `/v3/projects/850f175b575b4a44954ceb0e0312ed6a/users/783ff8a8fbb84990a1344f1fd103cd65/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.611584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:28.614531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:28.619128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c140b-4f39-4d11-bb2e-1b3c852295f6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:28.621100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] RBAC: Authorizing `identity:create_grant(project_id=850f175b575b4a44954ceb0e0312ed6a, user_id=783ff8a8fbb84990a1344f1fd103cd65, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:28.627321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:28.686576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1632/3241] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:28.689200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b3d2-858e-4216-973c-8f716d287d8f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:28.689717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b3d2-858e-4216-973c-8f716d287d8f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:28.703456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b3d2-858e-4216-973c-8f716d287d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.705455 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1610/3242] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:28 2022] PUT /identity/v3/projects/850f175b575b4a44954ceb0e0312ed6a/users/783ff8a8fbb84990a1344f1fd103cd65/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:28.719200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:28.796215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0836b3d2-858e-4216-973c-8f716d287d8f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:28.804004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0836b3d2-858e-4216-973c-8f716d287d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:28.911733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f548da1-5bf0-440b-8875-8e631d1256da admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:28.958917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:28.960513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:28.960961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:28.961425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:28.977106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:28.981555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef2701-06e7-4e1d-8980-671d644421c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:29.038485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:29.124080 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1611/3243] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:28 2022] POST /identity/v3/projects => generated 375 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:29.124915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:29.127968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:29.129921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:29.208218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1633/3244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:29.211595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:29.212112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:29.213086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:29.250811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] MFA Rules not processed for user `783ff8a8fbb84990a1344f1fd103cd65`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:29.255805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:29.296699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] MFA Rules not processed for user `65eee15492da4c449b3238e50e987bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:29.298455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:29.374312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:29.500001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1634/3245] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:29.501677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:29.548679 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1612/3246] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:29.583690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:29.583690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:29.849949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3636a2-09e0-49a2-9285-8091c4866ba2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:29.852822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19cc67-45df-4fd9-b104-57118e6260dd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:29.863643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:29.864947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:29.865429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:29.865984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:29.874862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:29.876014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:29.876506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:29.876994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:29.878699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:29.886849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:29.928205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:29.931819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ff278-33b8-431e-bb7a-42fc5290feba service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:29.960358 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1613/3247] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:40:29.963625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:29.964581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:29.965494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:30.008101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] MFA Rules not processed for user `ca528ff45435455aa4fce16549993ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:30.010810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:30.023024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1635/3248] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:29 2022] POST /identity/v3/users => generated 288 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:30.030570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:30.079110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2b92a-b388-460d-98fb-1537e0b50e33 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:30.104503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:30.106248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:30.106745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:30.107282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:30.113852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:30.117116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:30.161466 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1636/3249] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:30.168779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:30.213016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac714fcb-82fa-46ee-be77-5daf8b2dc306 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:30.223097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:30.226906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:30.226906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:30.226906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:30.238483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:30.238483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374e5c-cf8e-402e-ac8d-4b96103bbaed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:30.257073 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1614/3250] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:30.265083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1637/3251] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:40:30.270897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:30.302514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1799-c2d8-445c-909c-f6ad26eaab7f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:30.329780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:30.331532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:30.332121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:30.332688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] PATH_INFO: `/v3/projects/fe6ebdf7b5e14f91aa23391fe29c5ec4/users/3ae74d558a81489fbce4f0365f60d92d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:30.404811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6ebdf7b5e14f91aa23391fe29c5ec4, user_id=3ae74d558a81489fbce4f0365f60d92d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:30.418309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:30.599592 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1615/3252] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:30 2022] PUT /identity/v3/projects/fe6ebdf7b5e14f91aa23391fe29c5ec4/users/3ae74d558a81489fbce4f0365f60d92d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:30.623187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498952-cc26-4dc1-8ce5-feb967fee35d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:30.623775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498952-cc26-4dc1-8ce5-feb967fee35d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:30.624289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498952-cc26-4dc1-8ce5-feb967fee35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:30.741873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3e498952-cc26-4dc1-8ce5-feb967fee35d None None] MFA Rules not processed for user `3ae74d558a81489fbce4f0365f60d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:30.742932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e498952-cc26-4dc1-8ce5-feb967fee35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:30.902967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:30.907629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:30.982810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:31.056614 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1638/3253] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:31.058896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:31.059409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:31.060187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:40:31.091830 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:40:31.094433 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:40:31.163578 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1639/3254] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:40:31 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:40:31.163578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:31.173073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:31.259990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342973fc-4f05-4b11-9e21-1ec82c827406 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:31.278890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:31.280180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:31.280660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:31.281044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:31.288802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:31.452279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4708ae-4dfe-4f69-9227-9575ac9c78fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:31.473289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:31.474363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:31.474857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:31.485096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:31.486726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:31.498196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:31.593806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:31.602901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:31.645472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1616/3255] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:40:31.868960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1640/3256] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:31 2022] POST /identity/v3/projects => generated 373 bytes in 745 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:31.879354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:31.914473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02dd0-bea8-4387-8e1e-65311b68dcf8 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:32.181319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:32.183040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:32.183882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:32.185835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:32.189484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:32.199543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:32.402936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:32.403885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1617/3257] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:31 2022] POST /identity/v3/users => generated 293 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:32.486508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b87ba-0f94-4115-9a92-4b5fc6c74da7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:32.508947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:32.510720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:32.513613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:32.514403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:32.520112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:32.556095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:32.629918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1641/3258] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:40:32.640937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:32.692868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308706b-8917-4e25-addd-3a71fbef6b83 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:32.714347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:32.716217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:32.716737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:32.717243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] PATH_INFO: `/v3/projects/606d93aa23ec47d19d944d4d5945f9c0/users/0e0fcea0f4eb4800b5676011b451ad3f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:32.799405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=606d93aa23ec47d19d944d4d5945f9c0, user_id=0e0fcea0f4eb4800b5676011b451ad3f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:32.806531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:32.968233 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1618/3259] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:32 2022] PUT /identity/v3/projects/606d93aa23ec47d19d944d4d5945f9c0/users/0e0fcea0f4eb4800b5676011b451ad3f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:32.970096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:33.075955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ad258-a5b4-4085-8df2-43b7477b994d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:33.477929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:33.479087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:33.485467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:33.489675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:33.493870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:33.504438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23dc8c-4e51-4c92-a1bb-438e10e77ab4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:33.563668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1642/3260] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 593 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:33.569319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:33.604368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c383c6-5283-4961-83d1-0367b726578f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:33.647413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:33.657879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:33.661339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:33.661339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] PATH_INFO: `/v3/projects/606d93aa23ec47d19d944d4d5945f9c0/users/0e0fcea0f4eb4800b5676011b451ad3f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:33.685649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606d93aa23ec47d19d944d4d5945f9c0, user_id=0e0fcea0f4eb4800b5676011b451ad3f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:33.696250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:33.750046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1619/3261] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:33 2022] PUT /identity/v3/projects/606d93aa23ec47d19d944d4d5945f9c0/users/0e0fcea0f4eb4800b5676011b451ad3f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:33.774038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737495-6950-4449-90db-590f400c4346 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:33.775094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737495-6950-4449-90db-590f400c4346 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:33.775808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737495-6950-4449-90db-590f400c4346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:33.930273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-91737495-6950-4449-90db-590f400c4346 None None] MFA Rules not processed for user `0e0fcea0f4eb4800b5676011b451ad3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:33.938908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91737495-6950-4449-90db-590f400c4346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:34.207053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:34.372748 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1643/3262] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 601 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:34.384225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:34.465683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0666da-54ce-4496-846e-3feaab0e2fa2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:34.491500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:34.492747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:34.496735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:34.498156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:34.499768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:34.503951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:34.507613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:34.609513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1620/3263] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:34.617460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737495-6950-4449-90db-590f400c4346 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:34.683341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737495-6950-4449-90db-590f400c4346 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:34.735993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:34.737686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:34.743752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:34.744307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:34.745661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:34.766452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:35.056467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:35.063959 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1644/3264] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:34 2022] POST /identity/v3/projects => generated 371 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:40:35.104457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281db1e1-422b-4f36-9dd9-05858e5c8a50 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:35.238443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:35.400920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:35.402828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:35.410633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:35.412869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:35.414781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:35.419162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:35.429580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4eab0-8180-4050-b0e7-6dff13ddc8cc tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:35.491353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1621/3265] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:35.977333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:36.391969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92078b9c-32b2-4ef6-8342-74c19333402c tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:36.447183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:36.451983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:36.453942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:36.454290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:36.543760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:36.552123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:36.594984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1645/3266] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:40:36.650389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc43a-a74d-4d80-8d67-4a51eb128bc4 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:36.651606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc43a-a74d-4d80-8d67-4a51eb128bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:36.651798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dc43a-a74d-4d80-8d67-4a51eb128bc4 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:36.655180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1622/3267] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:40:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 20:40:36.670077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:40:36.730108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:36.831580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59141e7-10e0-420f-94dd-9036a4da234a service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:36.861712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:36.863710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:36.865083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:36.865779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:36.868919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eb02b29a6a14cc1ac936a2ee2f7c9e6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:36.873829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:36.879371 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1646/3268] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:40:36 2022] GET /identity/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 371 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:40:38.381284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719544-cb70-421c-be16-64d4adb41a7a None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:38.382927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719544-cb70-421c-be16-64d4adb41a7a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:38.383814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719544-cb70-421c-be16-64d4adb41a7a None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:38.388739 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1623/3269] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:40:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:40:38.407124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:40:38.469813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:38.541849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d294-3cce-4796-b0f1-5cee630d77e0 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:38.569047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:38.570178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:38.570680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:38.571208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:38.579896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eb02b29a6a14cc1ac936a2ee2f7c9e6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:38.582526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:38.622267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1647/3270] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:40:38 2022] GET /identity/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 371 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:39.096807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719544-cb70-421c-be16-64d4adb41a7a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:39.173811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719544-cb70-421c-be16-64d4adb41a7a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:39.194588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:39.196512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:39.197602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:39.199617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:39.201366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:39.202329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:39.206999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:39.265054 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1624/3271] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:40:39.275879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:39.347909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdd017-b44f-4564-9562-1f671280409f tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:39.388096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:39.392390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:39.392989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:39.393471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:39.396652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:39.410270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5afd-38a1-447c-a60f-f160c9b2e561 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:39.723790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:39.760969 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1648/3272] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:39 2022] POST /identity/v3/users => generated 377 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:39.766279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce685bc9-cbd2-4fcc-91c4-f8252c7176e4 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:39.855471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:39.862102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:39.869642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:39.877205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:39.882628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:39.890904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:39.900827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:40.004725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1625/3273] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:40:40.517616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7b8b-781d-486b-8b9b-be10fe7d36e6 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:40.525238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7b8b-781d-486b-8b9b-be10fe7d36e6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:40.525238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7b8b-781d-486b-8b9b-be10fe7d36e6 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:40.525238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1649/3274] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:40:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:40:40.547592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:40:40.649133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:40.686509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446d26-e8e6-40d9-aae1-a04d98f223f1 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:40.711115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:40.712816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:40.715351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:40.721574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:40.726803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eb02b29a6a14cc1ac936a2ee2f7c9e6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:40.743218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:40.754546 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1626/3275] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:40:40 2022] GET /identity/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 371 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:43.468050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aab1-4c6f-4705-b74d-fcc13a8d0b2f None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:43.468840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aab1-4c6f-4705-b74d-fcc13a8d0b2f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:43.469467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aab1-4c6f-4705-b74d-fcc13a8d0b2f None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:43.472439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1650/3276] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:40:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:40:43.484336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:40:43.492184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:43.640081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:43.671583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596a56-3c3f-4f26-a063-afa2fabdd051 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:43.702257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:43.716768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:43.717167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:43.717680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:43.725004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eb02b29a6a14cc1ac936a2ee2f7c9e6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:43.728864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:43.740724 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1627/3277] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:40:43 2022] GET /identity/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 371 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:43.851345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005aab1-4c6f-4705-b74d-fcc13a8d0b2f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:43.895950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005aab1-4c6f-4705-b74d-fcc13a8d0b2f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:43.906558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:43.916111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:43.916111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:43.916111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/users/0961c921d6454ab9b67c118b145fa2d0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:43.956481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0961c921d6454ab9b67c118b145fa2d0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:43.962858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:44.259955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0961c921d6454ab9b67c118b145fa2d0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:44.262004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0961c921d6454ab9b67c118b145fa2d0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:44.412852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0961c921d6454ab9b67c118b145fa2d0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:44.422217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:44.538385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0961c921d6454ab9b67c118b145fa2d0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:44.553466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0961c921d6454ab9b67c118b145fa2d0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:44.595032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1651/3278] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:43 2022] DELETE /identity/v3/users/0961c921d6454ab9b67c118b145fa2d0 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:44.602772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:44.612171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:44.665178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097b4-6f4c-4fcb-b82f-831ec1a64aae tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:44.986463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e0fcea0f4eb4800b5676011b451ad3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '606d93aa23ec47d19d944d4d5945f9c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:44.988910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:44.993495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:44.998440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] PATH_INFO: `/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:44.998440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8eb02b29a6a14cc1ac936a2ee2f7c9e6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:45.003631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:45.241778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb02b29a6a14cc1ac936a2ee2f7c9e6', 'request_id': 'req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:45.256553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb02b29a6a14cc1ac936a2ee2f7c9e6', 'request_id': 'req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:45.269362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb02b29a6a14cc1ac936a2ee2f7c9e6', 'request_id': 'req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:45.403487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] The token cache is being invalidate because project 8eb02b29a6a14cc1ac936a2ee2f7c9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:45.407621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:45.411912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6790ef06-1e0b-45cc-91a7-dd8ecbd6d0b9 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:45.418016 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1628/3279] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:44 2022] DELETE /identity/v3/projects/8eb02b29a6a14cc1ac936a2ee2f7c9e6 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:45.430172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:45.433516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:45.716899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a052-62d4-42c2-b12f-682624e85407 tempest-QuotasAdminTestV236-378143857 tempest-QuotasAdminTestV236-378143857-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:46.109703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:46.110937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:46.111622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:46.112194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] PATH_INFO: `/v3/users/3ae74d558a81489fbce4f0365f60d92d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:46.114715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae74d558a81489fbce4f0365f60d92d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:46.120460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:46.464395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae74d558a81489fbce4f0365f60d92d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:46.465934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae74d558a81489fbce4f0365f60d92d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:46.772719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae74d558a81489fbce4f0365f60d92d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:46.772719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae74d558a81489fbce4f0365f60d92d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:46.787713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae74d558a81489fbce4f0365f60d92d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:46.799931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:46.829659 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1652/3280] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:45 2022] DELETE /identity/v3/users/3ae74d558a81489fbce4f0365f60d92d => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:46.834702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35062d-42fe-463e-a566-e709a3ad4f8f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:46.835598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35062d-42fe-463e-a566-e709a3ad4f8f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:46.835598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35062d-42fe-463e-a566-e709a3ad4f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:46.873515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:46.897541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6c35062d-42fe-463e-a566-e709a3ad4f8f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:46.897541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c35062d-42fe-463e-a566-e709a3ad4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:47.077051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1629/3281] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:40:47.110783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:47.115743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:47.384515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a9589-3a17-4d65-97f6-bb15b8f7738c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:47.408620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:47.408620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:47.408620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:47.408620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:47.421108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:47.422879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:47.506931 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1653/3282] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:40:47.817357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:47.818270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:47.819065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:47.939601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] MFA Rules not processed for user `f641a595a9e242da9564a483717f3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:47.946597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:48.265725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1630/3283] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:48.273844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:48.277197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:48.312626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53cb70-3ece-4f18-a2c7-4a12ec612c0f service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:48.322543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:48.323914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:48.324495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:48.330882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:48.330882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:48.334073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:48.524229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1654/3284] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:48 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:40:48.531804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:48.563391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec23a-e2c7-45c5-8f1b-e733cbb5b3e0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:48.810815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:48.812016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:48.812473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:48.813063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:48.814340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:48.818312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:49.028073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:49.034805 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1631/3285] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:48 2022] POST /identity/v3/users => generated 300 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:49.051945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364c908-e800-47f9-b54a-0562a25040f5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:49.062606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:49.065809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:49.066660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:49.067502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:49.069277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:49.074434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:49.106034 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1655/3286] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:40:49.110685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:49.141470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab0b52-5f4e-4b6b-a0d7-dd06f3394acd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:49.154101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:49.156308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:49.156896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:49.157381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] PATH_INFO: `/v3/projects/24e71aeef8ae451d8e152abb19afe23b/users/dc09d7571a634563a26c01daf57f3947/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:49.267358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e71aeef8ae451d8e152abb19afe23b, user_id=dc09d7571a634563a26c01daf57f3947, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:49.290485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:49.415746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1632/3287] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:49 2022] PUT /identity/v3/projects/24e71aeef8ae451d8e152abb19afe23b/users/dc09d7571a634563a26c01daf57f3947/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:49.420287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:49.446463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044819db-25f3-4ab1-9d65-902877a384f8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:49.591619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:49.592709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:49.593112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:49.593531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:49.594885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:49.597548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:49.633804 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1656/3288] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:49.638861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:49.652401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:49.679511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59ee-abb9-4277-8b33-b9aa2a407866 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:49.720469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:49.724869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:49.724869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:49.724869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] PATH_INFO: `/v3/projects/24e71aeef8ae451d8e152abb19afe23b/users/dc09d7571a634563a26c01daf57f3947/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:49.739129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e71aeef8ae451d8e152abb19afe23b, user_id=dc09d7571a634563a26c01daf57f3947, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:49.757205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:49.869185 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1633/3289] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:49 2022] PUT /identity/v3/projects/24e71aeef8ae451d8e152abb19afe23b/users/dc09d7571a634563a26c01daf57f3947/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:50.737125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:50.740840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:50.765911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc82e2-a6a0-41e7-a5d5-739c85eafdf9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:51.039283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:51.044340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:51.045104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:51.045711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] PATH_INFO: `/v3/projects/fe6ebdf7b5e14f91aa23391fe29c5ec4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:51.053012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6ebdf7b5e14f91aa23391fe29c5ec4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:51.066636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:51.119808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:51.390199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6ebdf7b5e14f91aa23391fe29c5ec4', 'request_id': 'req-b0890e2f-a48f-4169-9e7b-b441975ed15c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:51.519967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6ebdf7b5e14f91aa23391fe29c5ec4', 'request_id': 'req-b0890e2f-a48f-4169-9e7b-b441975ed15c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:51.565072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6ebdf7b5e14f91aa23391fe29c5ec4', 'request_id': 'req-b0890e2f-a48f-4169-9e7b-b441975ed15c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:51.638657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] The token cache is being invalidate because project fe6ebdf7b5e14f91aa23391fe29c5ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:51.638991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:51.639948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0890e2f-a48f-4169-9e7b-b441975ed15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:51.642081 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1657/3290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:50 2022] DELETE /identity/v3/projects/fe6ebdf7b5e14f91aa23391fe29c5ec4 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:51.649308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:51.652337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:51.742576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad99f-92e3-4d2b-be1f-2e96addac4f2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:52.041622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:52.045148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:52.045148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:52.045148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] PATH_INFO: `/v3/users/0e0fcea0f4eb4800b5676011b451ad3f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:52.053459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0fcea0f4eb4800b5676011b451ad3f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:52.057406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:52.518993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0fcea0f4eb4800b5676011b451ad3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:52.613883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0fcea0f4eb4800b5676011b451ad3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:52.656614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0fcea0f4eb4800b5676011b451ad3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:52.713738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0fcea0f4eb4800b5676011b451ad3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:52.715528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0fcea0f4eb4800b5676011b451ad3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:52.740567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1634/3291] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:40:51 2022] DELETE /identity/v3/users/0e0fcea0f4eb4800b5676011b451ad3f => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:54.686709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:54.687610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:54.687993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:54.817098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:54.821444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:55.022029 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1658/3292] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:55.373884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:55.376390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:55.633110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c33ca-13f1-415e-9070-98b87b8cc417 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:55.641301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:55.642397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:55.642632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:55.642934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:55.667277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:55.672665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0fa20-a22c-4c8e-9dc1-ed8fad563782 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:55.697629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:55.719238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1635/3293] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:56.409246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:56.412125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:56.742690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001e51-dd79-4bff-a704-53d8dc926037 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:56.764552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:56.765948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:56.766476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:56.766957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] PATH_INFO: `/v3/projects/606d93aa23ec47d19d944d4d5945f9c0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:56.779033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=606d93aa23ec47d19d944d4d5945f9c0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:56.783279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:57.079329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:57.094013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606d93aa23ec47d19d944d4d5945f9c0', 'request_id': 'req-17487340-f53b-4f3e-994e-92ed82beec1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:57.253215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606d93aa23ec47d19d944d4d5945f9c0', 'request_id': 'req-17487340-f53b-4f3e-994e-92ed82beec1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:57.276452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606d93aa23ec47d19d944d4d5945f9c0', 'request_id': 'req-17487340-f53b-4f3e-994e-92ed82beec1b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:57.321257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] The token cache is being invalidate because project 606d93aa23ec47d19d944d4d5945f9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:40:57.321763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:57.324464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-17487340-f53b-4f3e-994e-92ed82beec1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:40:57.341150 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1659/3294] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:56 2022] DELETE /identity/v3/projects/606d93aa23ec47d19d944d4d5945f9c0 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:40:57.344817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:57.347274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:57.348074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:57.415842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:57.419768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:57.896350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1636/3295] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:57.902373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:57.903288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:57.903288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:57.982556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:57.984992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:58.013261 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1660/3296] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:40:58.020047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:58.044142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb435be5-5f56-46bc-a559-ab273ee47925 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:58.053975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:58.055660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:58.056589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:58.057446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:58.059038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:40:58.059940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:58.065978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6bfa6-d588-4f6e-8b4e-ce053204675b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:58.102946 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1637/3297] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:40:58.111510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:58.133929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ff51-9a6a-4f61-81f1-9521dcd981de None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:58.163871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:58.166775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:58.174028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:58.174028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:58.174028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:58.179697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:58.301280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:58.302218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:58.302992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:58.358295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:58.364832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:58.447795 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1661/3298] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:40:58 2022] POST /identity/v3/projects => generated 375 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:40:58.450173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:58.674207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1638/3299] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:40:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:40:58.703259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:58.709651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:40:58.864849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d192-548f-4e4e-997f-f2472b607be1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:58.895852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:58.903741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:58.904659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:58.905058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:58.906462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:58.919822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:59.038966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d121eb-afea-412f-96ac-8f3402ad80b4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:59.131635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1662/3300] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:40:58 2022] POST /identity/v3/users => generated 288 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:40:59.136069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:59.150266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:59.195563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883882c-9a29-4ac2-9c62-9fb49538dd05 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:59.217645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:59.224920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:59.226028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:59.229298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:59.235057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:59.243371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:59.265254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:59.266297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:59.266844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:59.279336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:59.321040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1663/3301] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:59.322839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:59.371386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300808ce-7fdb-4a32-b4a8-2b2ab55272dd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:59.399200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:59.400298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:59.403504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:59.404075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:59.414322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:59.420550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:59.486763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1664/3302] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:40:59.499416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:40:59.537506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fd3c-0787-4bf3-8f14-42135dc96486 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:40:59.548788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:40:59.550436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:59.551121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:59.551834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] PATH_INFO: `/v3/projects/e9fae788056d4b8e9d45e8988fc6920f/users/edcdbeebe55e41cb9072a7561e0988f8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:59.579609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:59.582439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc142-047b-4ee8-bde5-c0e076104e3e service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:59.616831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9fae788056d4b8e9d45e8988fc6920f, user_id=edcdbeebe55e41cb9072a7561e0988f8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:40:59.623479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:40:59.644005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1639/3303] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 944 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:59.779043 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1665/3304] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:40:59 2022] PUT /identity/v3/projects/e9fae788056d4b8e9d45e8988fc6920f/users/edcdbeebe55e41cb9072a7561e0988f8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:40:59.810364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:40:59.810816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:40:59.811372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:40:59.928352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] MFA Rules not processed for user `edcdbeebe55e41cb9072a7561e0988f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:40:59.930798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:00.234584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1640/3305] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:00.238503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:00.624217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:00.679422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949ea5-4b19-47fd-ad6a-ae8934ac6d36 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:00.695760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:00.698404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:00.699098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:00.699896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:00.701075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:00.705381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:00.913494 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1666/3306] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:41:00 2022] POST /identity/v3/projects => generated 377 bytes in 673 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:41:00.915978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:00.956927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e125e-93d7-436e-a2fa-d9d3e6316730 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:01.266194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:01.272155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:01.273095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:01.274047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:01.278624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:01.286781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:01.340521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:01.544970 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1641/3307] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:41:00 2022] POST /identity/v3/users => generated 295 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:41:01.547445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:01.578228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da649d8-368f-4cfb-bed1-2d9c93d5b961 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:01.602822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:01.605567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:01.606599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:01.607281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:01.609203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:01.613266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:01.643395 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1667/3308] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:41:01.649575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:01.692733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b45d-d3c0-4102-b6b1-d3f0c69da705 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:01.732602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:01.733757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:01.734262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:01.734745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] PATH_INFO: `/v3/projects/76ebb788e0674a7b99f294cb37a30f46/users/8e202e88de9d4a468fe52feb39d1dd47/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:01.784681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ebb788e0674a7b99f294cb37a30f46, user_id=8e202e88de9d4a468fe52feb39d1dd47, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:01.790133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cdb23-f51d-4dc3-bff8-0536cc4b3976 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:01.932785 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1642/3309] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:41:01 2022] PUT /identity/v3/projects/76ebb788e0674a7b99f294cb37a30f46/users/8e202e88de9d4a468fe52feb39d1dd47/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:01.940497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:01.977000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de30ca-c3bc-4cb5-ab8f-cd34217e1c71 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:02.232200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b9f8-b277-4f8a-9c1d-59e53c67d939 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:02.233060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b9f8-b277-4f8a-9c1d-59e53c67d939 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:02.233804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b9f8-b277-4f8a-9c1d-59e53c67d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:02.258362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:02.264517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:02.264517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:02.264517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:02.264517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:02.280647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:02.331673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1668/3310] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:41:02.336504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:02.402585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb37b90-8bd0-4566-a5f9-36f8ffc45cf5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:02.436272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:02.442392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:02.442392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:02.442392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] PATH_INFO: `/v3/projects/76ebb788e0674a7b99f294cb37a30f46/users/8e202e88de9d4a468fe52feb39d1dd47/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:02.447946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1c50b9f8-b277-4f8a-9c1d-59e53c67d939 None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:02.464788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1c50b9f8-b277-4f8a-9c1d-59e53c67d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:02.472108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ebb788e0674a7b99f294cb37a30f46, user_id=8e202e88de9d4a468fe52feb39d1dd47, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:02.483359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900f53e-f457-486c-a5ad-60a49decc2b2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:02.585094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1669/3311] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:41:02 2022] PUT /identity/v3/projects/76ebb788e0674a7b99f294cb37a30f46/users/8e202e88de9d4a468fe52feb39d1dd47/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:02.607474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d037-cc8c-4be1-b7bd-ffdabab1a727 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:02.612127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d037-cc8c-4be1-b7bd-ffdabab1a727 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:02.613516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d037-cc8c-4be1-b7bd-ffdabab1a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:02.820052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a198d037-cc8c-4be1-b7bd-ffdabab1a727 None None] MFA Rules not processed for user `8e202e88de9d4a468fe52feb39d1dd47`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:02.826980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a198d037-cc8c-4be1-b7bd-ffdabab1a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:02.971456 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1643/3312] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 742 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:41:03.000119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:03.001117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:03.001953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:03.162746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:03.172957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:03.447953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1670/3313] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 842 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:03.463378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acabb0-999c-48b7-a3b7-3a07cf639594 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:03.463889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acabb0-999c-48b7-a3b7-3a07cf639594 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:03.467342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acabb0-999c-48b7-a3b7-3a07cf639594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:03.701743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-81acabb0-999c-48b7-a3b7-3a07cf639594 None None] MFA Rules not processed for user `edcdbeebe55e41cb9072a7561e0988f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:03.712945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-81acabb0-999c-48b7-a3b7-3a07cf639594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:03.781181 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1644/3314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 783 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:03.882543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:03.944793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:03.947820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:04.038409 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1671/3315] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:04.299698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:04.340858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783353e-468f-4895-a1ff-d96dcd2ce54b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:04.366742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:04.371857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:04.371857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:04.371857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:04.406232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:04.412228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fda5a-8825-44b4-a901-8db31e38fd62 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:04.467032 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1645/3316] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:09.705543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:09.706487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:09.706645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:09.948242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:09.951209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:10.403182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1672/3317] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 694 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:10.423700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:10.427556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:10.429442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:10.551940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:10.562406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:10.629529 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1646/3318] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:12.047553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:12.106522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:12.228440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:12.230914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:12.419739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dcbd6-ff01-4c1f-ba02-1f8b613b94a0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:12.431192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:12.432888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:12.433733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:12.436296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:12.440442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:12.486054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:12.491288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:12.532881 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1673/3319] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:41:12.593828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf5bb9-ed1a-4417-a6b8-03e1e14c1454 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:12.610579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:12.611864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:12.612351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:12.613045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] PATH_INFO: `/v3/users/65eee15492da4c449b3238e50e987bd5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:12.616549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65eee15492da4c449b3238e50e987bd5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:12.620596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:13.129070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65eee15492da4c449b3238e50e987bd5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:13.276620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65eee15492da4c449b3238e50e987bd5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:13.320705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65eee15492da4c449b3238e50e987bd5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:13.433030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65eee15492da4c449b3238e50e987bd5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:13.437824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-acb84b78-5497-40ad-8e29-aec53180a193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65eee15492da4c449b3238e50e987bd5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:13.486561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1647/3320] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:41:12 2022] DELETE /identity/v3/users/65eee15492da4c449b3238e50e987bd5 => generated 0 bytes in 1259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:14.318540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:14.384493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aff59-ba9b-4239-ae7f-a60cfcd4839e service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:14.587043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:14.604031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:14.604950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:14.605243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:14.606879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] PATH_INFO: `/v3/projects/44dddbee054f49f3ac862994488fc147` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:14.608330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44dddbee054f49f3ac862994488fc147)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:14.611455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:14.921296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44dddbee054f49f3ac862994488fc147', 'request_id': 'req-8aab860c-21d4-4edd-a30d-565af204bf89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:15.047325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44dddbee054f49f3ac862994488fc147', 'request_id': 'req-8aab860c-21d4-4edd-a30d-565af204bf89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:15.066854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44dddbee054f49f3ac862994488fc147', 'request_id': 'req-8aab860c-21d4-4edd-a30d-565af204bf89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:15.115264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] The token cache is being invalidate because project 44dddbee054f49f3ac862994488fc147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:41:15.115572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:15.120093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aab860c-21d4-4edd-a30d-565af204bf89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:15.128105 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1674/3321] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:14 2022] DELETE /identity/v3/projects/44dddbee054f49f3ac862994488fc147 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:15.131293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:15.140547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:15.140547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:15.224581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:15.231330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:15.553261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1648/3322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:15.563807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:15.563807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:15.615871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:15.678807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:15.685574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:15.753671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:15.754250 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1675/3323] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:15.769411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:15.815535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6f0e-d4f7-4312-9c9c-203704313546 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:15.855961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:15.861475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:15.866387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:15.867600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:15.873110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:41:15.876468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:15.893520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:15.983762 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1649/3324] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:41:15.992998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:16.073345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb9cf-d60e-44ab-8a8d-bd827701d551 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:16.106549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:16.108284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:16.109220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:16.110519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:16.116814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:16.120754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:16.370328 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1676/3325] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:41:15 2022] POST /identity/v3/projects => generated 383 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:41:16.387197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:16.408009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591598ff-b88d-4627-b2b6-d2c78851cebc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:16.830078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:16.830456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:16.830859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:16.836673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:16.838125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:16.852512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:17.060365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1650/3326] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:41:16 2022] POST /identity/v3/users => generated 292 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:41:17.066154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:17.098051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563261-8dbb-4bf6-8d2e-9faa7d56b5e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:17.119821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:17.120544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:17.120846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:17.121169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:17.121943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:17.124089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:17.174591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:17.179089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1677/3327] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:41:17.220044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7bac3-5318-4e7e-8fe0-7974a47a7716 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:17.266376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:17.270463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:17.279299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:17.281411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:17.291896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:17.294991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe142-36c4-4300-a83c-b62451916b75 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:17.480137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:17.490112 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1651/3328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:41:17.546534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f05c6-046f-493d-802d-971e7831afd4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:17.594960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:17.595855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:17.596175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:17.596468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] PATH_INFO: `/v3/projects/f8f49cc17cdd45cc8278f8d5cf1e7490/users/935f44986e194a1882d095a9b136c6bc/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:17.805224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f49cc17cdd45cc8278f8d5cf1e7490, user_id=935f44986e194a1882d095a9b136c6bc, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:17.809218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:17.983436 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1678/3329] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:41:17 2022] PUT /identity/v3/projects/f8f49cc17cdd45cc8278f8d5cf1e7490/users/935f44986e194a1882d095a9b136c6bc/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:41:17.986690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a824fd-d924-4876-a942-d3dd706662a9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:17.990714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a824fd-d924-4876-a942-d3dd706662a9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:17.992028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a824fd-d924-4876-a942-d3dd706662a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:18.213270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b6a824fd-d924-4876-a942-d3dd706662a9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:18.216350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b6a824fd-d924-4876-a942-d3dd706662a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:18.639928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1652/3330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:18.656858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:18.661966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:18.935835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ed3f5-745c-4848-a908-dd262238ea4c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:18.962234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:18.968693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:18.975543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:18.976271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:19.034019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:19.042732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:19.116878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1679/3331] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:41:23.390494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:23.391452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:23.391452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:23.441957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] MFA Rules not processed for user `dc09d7571a634563a26c01daf57f3947`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:23.444325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:23.821181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:23.857567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1653/3332] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:23.875563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:23.877923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:23.982559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:24.247310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf4dc-6e7c-4583-839a-f0b62179e8bc service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:24.252959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:24.254332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:24.255962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:24.255962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:24.259456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:24.612078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:24.621583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:24.671857 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1680/3333] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:32.208546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:32.211438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:32.654245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14d9ab-2d40-48f0-8e68-33793343a1f8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:32.672973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:32.677265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:32.677625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:32.680849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:32.690400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:32.931061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:32.934985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:32.964688 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1654/3334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:41:33.055228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:33.098364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49720f-2d9d-4958-8c3b-e98610e9f1f2 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:33.127089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:33.130562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:33.135384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:33.137063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:33.142449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:33.192365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:33.198951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679980b1-9a4c-46db-bf4b-6472b2a68deb service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:33.231678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1681/3335] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:34.895834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:34.925289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f78a-195b-4f21-89d2-a040e4de23c8 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:34.947154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:34.948337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:34.948822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:34.949305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:34.954817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:34.994999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:34.997685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862bd94-0973-4ed3-a2c1-213e32af18ab service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:35.043734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:35.044596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:35.044776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:35.056163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1655/3336] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:35.065017 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:35.066978 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:35.079234 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1682/3337] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:35.169957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:35.171198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:35.171733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:35.172227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:35.177765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:35.249245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:35.253136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:35.256882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82fe51-d1fb-4212-bade-d8441335a274 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:35.278685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:35.280377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:35.282109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:35.286899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:35.290583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:35.588795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:35.614192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1656/3338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:35.618237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398138f-eb10-41a7-9dc5-d171ec767127 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:35.638470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1683/3339] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:36.232155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:36.236570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:36.326942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0460-1097-46b1-81a9-8d6fa8811434 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:36.355108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:36.360535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:36.366046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:36.373408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:36.383804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:36.411814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:36.714763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:36.716588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:36.743263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1657/3340] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:37.667215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491263b-6d6b-475e-ac99-cfa21ba608fc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:37.668137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491263b-6d6b-475e-ac99-cfa21ba608fc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:37.668372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491263b-6d6b-475e-ac99-cfa21ba608fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:37.844646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:37.848217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:37.875848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4491263b-6d6b-475e-ac99-cfa21ba608fc None None] MFA Rules not processed for user `edcdbeebe55e41cb9072a7561e0988f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:37.885191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4491263b-6d6b-475e-ac99-cfa21ba608fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:37.945769 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1684/3341] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:38.272522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2c09-7103-49d6-a17c-53cf1c91cffe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:38.273028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2c09-7103-49d6-a17c-53cf1c91cffe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:38.273542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a2c09-7103-49d6-a17c-53cf1c91cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-303a2c09-7103-49d6-a17c-53cf1c91cffe None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:38.317503 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:38.319632 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:38.344623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1685/3342] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 72 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:41:38.402696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d82e53-0579-4906-9c55-804be73c9a70 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:38.405136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade2ea-8c1a-4e5c-b420-0c38b0d311d5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:38.405691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade2ea-8c1a-4e5c-b420-0c38b0d311d5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:38.406882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ade2ea-8c1a-4e5c-b420-0c38b0d311d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:38.424342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:38.425831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:38.426590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:38.428018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:38.433004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:38.476194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:38.486930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18629327-ca23-48fd-b629-099dd095c3f9 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:38.520176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b8ade2ea-8c1a-4e5c-b420-0c38b0d311d5 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:38.523274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8ade2ea-8c1a-4e5c-b420-0c38b0d311d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:38.532000 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1658/3343] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:41:38.565915 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1686/3344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:40.260640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7238-e4bd-42e3-88a6-77c1d5ed523e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:40.262162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7238-e4bd-42e3-88a6-77c1d5ed523e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:40.262923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d7238-e4bd-42e3-88a6-77c1d5ed523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-638d7238-e4bd-42e3-88a6-77c1d5ed523e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:40.275497 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:40.277600 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:40.283343 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1659/3345] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:40.347942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4023-a580-4985-8618-beea78ca514b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:40.348715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4023-a580-4985-8618-beea78ca514b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:40.353344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4023-a580-4985-8618-beea78ca514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:40.441158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e5ec4023-a580-4985-8618-beea78ca514b None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:40.447937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5ec4023-a580-4985-8618-beea78ca514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:40.533717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1687/3346] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:41.612364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a616d-4988-4b03-8163-ac08d3c39576 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:41.614421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a616d-4988-4b03-8163-ac08d3c39576 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:41.624336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a616d-4988-4b03-8163-ac08d3c39576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b79a616d-4988-4b03-8163-ac08d3c39576 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:41.645443 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:41.647587 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:41.650650 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1660/3347] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:41.725260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3113-2641-41e8-8e0b-91358207a090 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:41.726122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3113-2641-41e8-8e0b-91358207a090 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:41.726122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3113-2641-41e8-8e0b-91358207a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:41.837786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc898-7d8d-499f-b0e7-987e6b6e3468 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:41.837786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc898-7d8d-499f-b0e7-987e6b6e3468 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:41.837786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc898-7d8d-499f-b0e7-987e6b6e3468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:41.872088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-03ed3113-2641-41e8-8e0b-91358207a090 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:41.875346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03ed3113-2641-41e8-8e0b-91358207a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:41.927734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1688/3348] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:41.959622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-600cc898-7d8d-499f-b0e7-987e6b6e3468 None None] MFA Rules not processed for user `935f44986e194a1882d095a9b136c6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:41.975781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-600cc898-7d8d-499f-b0e7-987e6b6e3468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:41.997618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771230-adaf-4d96-bec0-573b289d23ef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:42.000122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771230-adaf-4d96-bec0-573b289d23ef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:42.000944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771230-adaf-4d96-bec0-573b289d23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b0771230-adaf-4d96-bec0-573b289d23ef None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:42.034694 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:42.036841 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:42.046924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1689/3349] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:41:42.358295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1661/3350] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:41:42.995984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:42.997526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:42.998886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a4ac18a9-a3cf-4418-a530-a11a12ac58c1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:43.013878 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:43.019799 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:43.022391 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1690/3351] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:43.066132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e870-4fb5-41c4-8241-660ae4daff70 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:43.066132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e870-4fb5-41c4-8241-660ae4daff70 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:43.066132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e870-4fb5-41c4-8241-660ae4daff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:43.147307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2492e870-4fb5-41c4-8241-660ae4daff70 None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:43.153519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2492e870-4fb5-41c4-8241-660ae4daff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:43.212130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1662/3352] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:41:43.896779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:43.897488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:43.898337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:44.020863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:44.078393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:44.091897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:44.128286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:44.128881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:44.128881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:44.141080 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:44.142816 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:44.144882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1663/3353] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:44.209737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:44.254389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f000dd-3a21-4542-8af9-4fca4c4a7501 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:44.266964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:44.268417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:44.268760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:44.269284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:44.296741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:44.298221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:44.329461 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1664/3354] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:41:44.410626 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1691/3355] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:44.415352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:44.415352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:44.428170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:44.735832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890ac7-3cd6-41bd-a354-73995a2fe984 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:44.750547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:44.752078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:44.753232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:44.754566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:44.793629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:44.814621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cec986-2ff3-4b2d-8374-66cdac81c5d4 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:44.884563 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1665/3356] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:41:47.333142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:47.409583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fd69-5d20-4d25-ad83-3babde3db936 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:47.435645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:47.435645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:47.436133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:47.436648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:47.448317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:47.486221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:47.502327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9543d-ac4d-47af-9cd0-b4699ffcb684 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:47.543049 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1692/3357] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:47.727304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:47.728140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:47.728491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:47.771169 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:47.777203 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:47.779806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1666/3358] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:47.865783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789842-e7fb-4358-81c6-3a40ce780131 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:47.867424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789842-e7fb-4358-81c6-3a40ce780131 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:47.874865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789842-e7fb-4358-81c6-3a40ce780131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:48.002802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-48789842-e7fb-4358-81c6-3a40ce780131 None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:48.009480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-48789842-e7fb-4358-81c6-3a40ce780131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:48.032775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1693/3359] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:51.271960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:51.340343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae002-22d7-424c-8680-c4758bc2b256 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:51.370146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:51.374826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:51.379309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:51.380765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:51.389673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:51.429180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:51.431061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:51.431856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a60a56ff-2d6f-4aa4-a0fd-9d8af1993d0f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:51.452872 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:51.455028 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:51.464986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1694/3360] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:51.524750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:51.524750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:51.524750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:51.672024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:51.682159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:51.728077 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1695/3361] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:51.798272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:51.810697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:51.811375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:51.811764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654918-61c0-4e45-807c-fc47a8f4f119 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:51.863318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afd42d-57ef-4d02-b277-6485532b7b3d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:51.865754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1667/3362] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:51.897447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:51.897447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:51.897447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:51.898004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] PATH_INFO: `/v3/users/a9990d76e7b941ee9dcedb1cb7974d3e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:51.908277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9990d76e7b941ee9dcedb1cb7974d3e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:51.921380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:51.926669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02083-86c9-481a-9d08-ab0e631d184a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:51.927681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02083-86c9-481a-9d08-ab0e631d184a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:51.929065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf02083-86c9-481a-9d08-ab0e631d184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:51.972887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fdf02083-86c9-481a-9d08-ab0e631d184a None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:51.996436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fdf02083-86c9-481a-9d08-ab0e631d184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:52.048424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1668/3363] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:41:52.391620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9990d76e7b941ee9dcedb1cb7974d3e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:52.395407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9990d76e7b941ee9dcedb1cb7974d3e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:52.543319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9990d76e7b941ee9dcedb1cb7974d3e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:52.608963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9990d76e7b941ee9dcedb1cb7974d3e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:52.650933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6f07b645-23de-4e7b-bd8b-0333f5e60016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9990d76e7b941ee9dcedb1cb7974d3e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:52.692206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1696/3364] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:41:51 2022] DELETE /identity/v3/users/a9990d76e7b941ee9dcedb1cb7974d3e => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:52.699852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:52.701761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:52.704765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:52.824858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:52.832661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:53.096894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee2b1-8a33-4a8e-981a-b5d36c3cbf4d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:53.097383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee2b1-8a33-4a8e-981a-b5d36c3cbf4d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:53.098304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee2b1-8a33-4a8e-981a-b5d36c3cbf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:53.145813 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1669/3365] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:53.184970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1adee2b1-8a33-4a8e-981a-b5d36c3cbf4d None None] MFA Rules not processed for user `935f44986e194a1882d095a9b136c6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:53.185189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1adee2b1-8a33-4a8e-981a-b5d36c3cbf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:53.286290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:53.298339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:53.302095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:53.328081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:53.481625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1697/3366] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:41:53.642957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf1327-a720-4608-acdc-7f48e9717810 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:53.658961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:53.660122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:53.660620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:53.661106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:53.703775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:53.705775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b04ff-b506-442f-b0f5-ea5d2cb812f0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:53.754510 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1670/3367] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:53.761357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:53.764848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:53.764848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-85c9d529-e39d-4bc1-a9b4-03fac5faa37f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:53.783662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:53.785720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:53.791383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1698/3368] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:53.876886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfcc0-85a7-4264-ae44-c0b72a06104b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:53.877384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfcc0-85a7-4264-ae44-c0b72a06104b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:53.877886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfcc0-85a7-4264-ae44-c0b72a06104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:53.978579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8cacfcc0-85a7-4264-ae44-c0b72a06104b None None] MFA Rules not processed for user `11b6296bc2fb4ca6b2f02bf06c3f6602`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:53.982197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cacfcc0-85a7-4264-ae44-c0b72a06104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:54.291657 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1671/3369] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:55.696000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:55.696901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:55.697199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:55.713849 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:55.715947 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:55.718607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1699/3370] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:55 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:41:56.407409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dac59-9051-4940-bbe5-5b872d25dfeb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:56.408339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dac59-9051-4940-bbe5-5b872d25dfeb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:56.409143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dac59-9051-4940-bbe5-5b872d25dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-274dac59-9051-4940-bbe5-5b872d25dfeb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:56.424853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:56.426772 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:56.432129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1672/3371] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:56 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:41:56.775641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:56.779866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:56.819067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b1b3-5871-4d49-8fae-d494e926f912 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:56.861874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:56.868712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:56.869719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:56.870448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] PATH_INFO: `/v3/projects/060a53e4fead4141a343b3e54bb09eff` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:56.878845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060a53e4fead4141a343b3e54bb09eff)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:56.886528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:57.313078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:57.314136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:57.314644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:57.337964 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:57.340356 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:41:57.345242 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1673/3372] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:57 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:57.405795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:57.413801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060a53e4fead4141a343b3e54bb09eff', 'request_id': 'req-ffa997e6-6e31-4880-9e10-775507603ee6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:57.416585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:57.548414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060a53e4fead4141a343b3e54bb09eff', 'request_id': 'req-ffa997e6-6e31-4880-9e10-775507603ee6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:57.574743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060a53e4fead4141a343b3e54bb09eff', 'request_id': 'req-ffa997e6-6e31-4880-9e10-775507603ee6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:57.617930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] The token cache is being invalidate because project 060a53e4fead4141a343b3e54bb09eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:41:57.618442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:57.619736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffa997e6-6e31-4880-9e10-775507603ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:57.630001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1700/3373] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:41:56 2022] DELETE /identity/v3/projects/060a53e4fead4141a343b3e54bb09eff => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:57.633090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:57.633617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:57.634774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:57.723722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:57.724914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde010-63ac-4d51-9698-4fb06a272b98 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:57.733732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:57.751838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:57.755898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:57.759517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:57.760885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:57.782999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:57.841060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:57.850876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:57.887975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1674/3374] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:57.891861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:57.897712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:57.944163 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1701/3375] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:41:58.005393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:41:58.009298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:58.045230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220bb9b-fe6f-4f22-b915-78c13ea2f219 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:58.051094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:58.057337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:58.058438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:58.059082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:58.059428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:58.062363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:58.086841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:58.089341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d4f74-a15d-4bda-83cf-32f814bf2006 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:58.115446 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1702/3376] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:41:58.127438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97a3eb-8e99-4f06-9321-dd4c932586c5 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:41:58.133242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:41:58.134081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:58.134221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:58.134502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] PATH_INFO: `/v3/users/c1045a518d614edc8b50d1d9db769d45` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:58.137586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1045a518d614edc8b50d1d9db769d45)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:41:58.140275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:41:58.487411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1045a518d614edc8b50d1d9db769d45'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:58.607082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1045a518d614edc8b50d1d9db769d45'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:58.642730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1045a518d614edc8b50d1d9db769d45'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:58.703203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1045a518d614edc8b50d1d9db769d45'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:58.705004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7099582e-10cd-4c0c-8fab-64fa1be9ee3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1045a518d614edc8b50d1d9db769d45'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:41:58.727392 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1675/3377] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:41:57 2022] DELETE /identity/v3/users/c1045a518d614edc8b50d1d9db769d45 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:41:59.429151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7518-24e4-4d49-b826-720171467119 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:59.430237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7518-24e4-4d49-b826-720171467119 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:59.431200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba7518-24e4-4d49-b826-720171467119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-73ba7518-24e4-4d49-b826-720171467119 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:41:59.456875 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:41:59.459793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:41:59.463114 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1703/3378] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:41:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:41:59.518352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840e79-261d-49b4-8919-7fd09fd8bd29 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:41:59.518352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840e79-261d-49b4-8919-7fd09fd8bd29 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:41:59.518352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840e79-261d-49b4-8919-7fd09fd8bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:41:59.589362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-66840e79-261d-49b4-8919-7fd09fd8bd29 None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:41:59.600044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66840e79-261d-49b4-8919-7fd09fd8bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:41:59.793717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1676/3379] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:00.738976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7518-24e4-4d49-b826-720171467119 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:00.744182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73ba7518-24e4-4d49-b826-720171467119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:00.799402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f353d-a97f-443c-9f4b-e10cb8d3c834 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:00.800381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f353d-a97f-443c-9f4b-e10cb8d3c834 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:00.800381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f353d-a97f-443c-9f4b-e10cb8d3c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-879f353d-a97f-443c-9f4b-e10cb8d3c834 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:42:00.827692 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:42:00.829675 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:42:00.840828 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1677/3380] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:42:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:42:00.907999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299b28-544e-471e-9a42-5ca4d54b75cb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:00.907999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299b28-544e-471e-9a42-5ca4d54b75cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:00.907999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299b28-544e-471e-9a42-5ca4d54b75cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:01.021380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0c299b28-544e-471e-9a42-5ca4d54b75cb None None] MFA Rules not processed for user `b0933e4def614f928c0415b7de888e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:01.025189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:01.025790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c299b28-544e-471e-9a42-5ca4d54b75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:01.053483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1678/3381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:01.069978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba7518-24e4-4d49-b826-720171467119 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:01.105496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:01.107894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:01.108341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:01.108733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] PATH_INFO: `/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:01.111252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0105ef8ad80b42049b4f3cf0f9428a8d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:01.117288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:01.364403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0105ef8ad80b42049b4f3cf0f9428a8d', 'request_id': 'req-4e55bea4-0137-4ad2-b531-55079d635cf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:01.468512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0105ef8ad80b42049b4f3cf0f9428a8d', 'request_id': 'req-4e55bea4-0137-4ad2-b531-55079d635cf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:01.496475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0105ef8ad80b42049b4f3cf0f9428a8d', 'request_id': 'req-4e55bea4-0137-4ad2-b531-55079d635cf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:01.527165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] The token cache is being invalidate because project 0105ef8ad80b42049b4f3cf0f9428a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:01.528105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:01.530201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:01.545984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1704/3382] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:00 2022] DELETE /identity/v3/projects/0105ef8ad80b42049b4f3cf0f9428a8d => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:01.546661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb9ed-3127-4142-8224-179792b24254 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:01.547605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb9ed-3127-4142-8224-179792b24254 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:01.548168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb9ed-3127-4142-8224-179792b24254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:01.597635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-72abb9ed-3127-4142-8224-179792b24254 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:01.602363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-72abb9ed-3127-4142-8224-179792b24254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:01.784781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:01.789416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:01.822372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:01.891812 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1679/3383] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:01.908437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156bbb-3908-4908-8af0-3da4c01f06ee None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:01.908941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156bbb-3908-4908-8af0-3da4c01f06ee None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:01.909440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156bbb-3908-4908-8af0-3da4c01f06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:01.964978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b1156bbb-3908-4908-8af0-3da4c01f06ee None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:01.969012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b1156bbb-3908-4908-8af0-3da4c01f06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:02.017969 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1680/3384] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:02.034785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:02.037787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:02.043873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:42:02.052437 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:42:02.054580 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:42:02.057823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55bea4-0137-4ad2-b531-55079d635cf0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:02.060238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1681/3385] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:42:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:42:02.088125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:02.088125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:02.088125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:02.088125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:02.089115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:02.089278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:02.125368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:02.130073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:02.154149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a72d4-d527-444d-94a0-f5c7e921c5fe None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:02.199276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:02.199276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:02.199276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:02.199276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:02.200339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:02.200339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:02.216656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:02.218087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1705/3386] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:02.276708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1682/3387] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:02.282988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:02.335426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bef4-de56-4390-a2f0-e38c14e7ccfb service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:02.408281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:02.409298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:02.409757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:02.410388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:02.411483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:02.421504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:02.643901 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1706/3388] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:02 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:42:02.650099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:02.700547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de65f1-a15a-4864-b180-46e178b008e1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:03.042133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:03.042133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:03.043323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:03.043323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:03.047807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:03.056429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:03.229920 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1683/3389] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:02 2022] POST /identity/v3/users => generated 289 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:42:03.238316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:03.315298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011f02-8c92-4b28-a82c-0ea138cf0ee1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:03.338478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:03.339732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:03.340298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:03.341190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:03.343019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:03.347545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:03.384355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1707/3390] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:03.385280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:03.445050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afebf7-e9f6-430f-8646-a37b0c03affe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:03.467624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:03.479000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:03.484011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:03.486107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:03.489102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:03.500139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0de34-dc9f-49fd-9e80-4a5b09c90df0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:03.551625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1684/3391] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:42:03.558060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:03.585447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db2b2d-a645-4e52-92db-001e11fe9fa3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:03.604677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:03.606646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:03.607861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:03.618718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] PATH_INFO: `/v3/projects/4e5b60991c1a4d15809b1f5f6ed8ad0f/users/9d35d9debcef4a4a87fd0ba0f7e0b648/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:03.649629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5b60991c1a4d15809b1f5f6ed8ad0f, user_id=9d35d9debcef4a4a87fd0ba0f7e0b648, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:03.657328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:03.829318 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1708/3392] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:03 2022] PUT /identity/v3/projects/4e5b60991c1a4d15809b1f5f6ed8ad0f/users/9d35d9debcef4a4a87fd0ba0f7e0b648/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:03.832800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:03.833262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:03.833697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:03.946507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] MFA Rules not processed for user `9d35d9debcef4a4a87fd0ba0f7e0b648`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:03.950234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:04.327997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:04.334398 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1685/3393] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:04.420891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.756547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54881d-3814-42ba-a77a-2a0e675f098a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:04.778819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:04.785310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:04.785935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:04.786531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:04.787491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:04.791210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:05.017523 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1709/3394] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:04 2022] POST /identity/v3/projects => generated 379 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:05.027976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:05.091746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597cff-09a3-4007-bf8c-a5e8ef018ff8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:05.354091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:05.424189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:05.426241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:05.427417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:05.428650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:05.448917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:05.460138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:05.664939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1686/3395] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:05 2022] POST /identity/v3/users => generated 296 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:05.667457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:05.710450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe452a-1714-4ac7-a517-6f6c2bc1877f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:05.735275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:05.736647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:05.746798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:05.749806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:05.751057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:05.761419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:05.806507 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1710/3396] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:05.813798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:05.844157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9a0e-3599-4d44-81ac-bc3d06d081f7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:05.855009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:05.856652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:05.857299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:05.858095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] PATH_INFO: `/v3/projects/04510757e19b410282272b752c22f52f/users/d5bbe90b687443e0942a01f9b83af010/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:05.903719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04510757e19b410282272b752c22f52f, user_id=d5bbe90b687443e0942a01f9b83af010, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:05.911860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:06.172000 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1687/3397] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:05 2022] PUT /identity/v3/projects/04510757e19b410282272b752c22f52f/users/d5bbe90b687443e0942a01f9b83af010/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:06.178482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:06.225166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19d59a-4e05-48a0-ba65-97cb91403248 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:06.593932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:06.595597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:06.596449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:06.597239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:06.600680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:06.610611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268c01d-b9f6-47e9-a404-b11cc66cf15a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:06.662426 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1711/3398] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:06.669826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:06.704580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc019-2cef-4c68-90f7-21437d1656b9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:06.743715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:06.745440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:06.746343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:06.749979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] PATH_INFO: `/v3/projects/04510757e19b410282272b752c22f52f/users/d5bbe90b687443e0942a01f9b83af010/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:06.757822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04510757e19b410282272b752c22f52f, user_id=d5bbe90b687443e0942a01f9b83af010, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:06.767084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d3736-edca-4daa-9015-df4f8c311663 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:06.848885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1688/3399] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:06 2022] PUT /identity/v3/projects/04510757e19b410282272b752c22f52f/users/d5bbe90b687443e0942a01f9b83af010/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:06.874598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:06.875560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:06.875925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:06.885732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:06.887027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:06.888285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:06.989585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] MFA Rules not processed for user `d5bbe90b687443e0942a01f9b83af010`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:06.991078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:06.991478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:06.993931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:07.324717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1712/3400] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:07.325047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1689/3401] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:07.330275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:07.333784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:07.348120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:07.355954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:07.373459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:07.716670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4914b7a-5a71-4909-8089-a9736e4dbe97 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:07.731755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:07.732812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:07.733262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:07.739402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] PATH_INFO: `/v3/users/ca528ff45435455aa4fce16549993ab5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:07.744086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca528ff45435455aa4fce16549993ab5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:07.751931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:07.861906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3324-ed44-4e0b-9894-b2f22844089b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:07.890724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:07.896048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:07.902694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:07.902694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:07.928963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:07.938563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:07.969513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1690/3402] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:07.973454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:07.976009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:08.071652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:08.199859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca528ff45435455aa4fce16549993ab5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:08.203618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca528ff45435455aa4fce16549993ab5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:08.352134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca528ff45435455aa4fce16549993ab5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:08.418463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca528ff45435455aa4fce16549993ab5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:08.452099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fca58bce-c760-4a50-9ead-6dea752a7018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca528ff45435455aa4fce16549993ab5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:08.487429 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1713/3403] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:07 2022] DELETE /identity/v3/users/ca528ff45435455aa4fce16549993ab5 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:08.495201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:08.496381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:08.497297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:08.503340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cec5a-ae79-4520-a743-17be2bdd84d9 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:08.577040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:08.580349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:08.928718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:08.929910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:08.930307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:08.930786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:08.933637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1714/3404] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:08.935252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:08.946581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:08.958123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:08.996162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d90f6-2976-4bc8-a893-67fe29e4221e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:09.024714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:09.026297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:09.027091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:09.027904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] PATH_INFO: `/v3/users/9d35d9debcef4a4a87fd0ba0f7e0b648` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:09.035081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d35d9debcef4a4a87fd0ba0f7e0b648)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:09.039462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:09.131511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:09.213038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:09.218251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:09.243194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1691/3405] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:42:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:09.244634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:09.248027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:09.437158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820134dd-d912-4303-a698-76ee0ec0d370 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:09.461633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:09.465252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:09.465252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:09.466501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:09.507511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:09.511627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d35d9debcef4a4a87fd0ba0f7e0b648'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:09.515943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190411-ceda-46da-8b6f-d0bcdcbb383b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:09.516540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d35d9debcef4a4a87fd0ba0f7e0b648'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:09.570989 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1692/3406] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:09.686664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d35d9debcef4a4a87fd0ba0f7e0b648'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:09.809635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d35d9debcef4a4a87fd0ba0f7e0b648'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:09.846949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d35d9debcef4a4a87fd0ba0f7e0b648'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:09.918034 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1715/3407] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:08 2022] DELETE /identity/v3/users/9d35d9debcef4a4a87fd0ba0f7e0b648 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:09.930414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:09.932288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:09.932288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:10.053108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:10.067397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:10.090575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:10.451654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1693/3408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:10.686841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:10.696134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:11.071592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6145be-0207-4b30-8832-9fefebdc4725 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:11.102176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:11.103583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:11.111410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:11.115220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:11.189117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:11.189117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:11.203293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1716/3409] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:11.759318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:11.761771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:11.849129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a962b2b-0f61-4799-a2ba-424d44f76619 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:11.876675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:11.881324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:11.881861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:11.882279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] PATH_INFO: `/v3/projects/f4fa3c2885ec48db880029d93907789d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:11.884922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fa3c2885ec48db880029d93907789d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:11.895036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:12.271798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fa3c2885ec48db880029d93907789d', 'request_id': 'req-013c72de-48e5-4309-b735-3c2df05f28ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:12.314323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fa3c2885ec48db880029d93907789d', 'request_id': 'req-013c72de-48e5-4309-b735-3c2df05f28ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:12.343108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fa3c2885ec48db880029d93907789d', 'request_id': 'req-013c72de-48e5-4309-b735-3c2df05f28ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:12.480802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] The token cache is being invalidate because project f4fa3c2885ec48db880029d93907789d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:12.481337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:12.483581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:12.494950 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1694/3410] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:11 2022] DELETE /identity/v3/projects/f4fa3c2885ec48db880029d93907789d => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:12.497036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:12.575543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c72-fe5d-4beb-9014-3a82f930474a service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:12.968687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:12.969652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:12.970275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:12.971484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] PATH_INFO: `/v3/users/783ff8a8fbb84990a1344f1fd103cd65` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:12.975102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783ff8a8fbb84990a1344f1fd103cd65)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:12.979081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:13.412386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:13.422100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783ff8a8fbb84990a1344f1fd103cd65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:13.423508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783ff8a8fbb84990a1344f1fd103cd65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:13.566225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783ff8a8fbb84990a1344f1fd103cd65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:13.619383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783ff8a8fbb84990a1344f1fd103cd65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:13.645364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783ff8a8fbb84990a1344f1fd103cd65'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:13.679996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1717/3411] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:12 2022] DELETE /identity/v3/users/783ff8a8fbb84990a1344f1fd103cd65 => generated 0 bytes in 1184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:14.112532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:14.116787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:14.559784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72de-48e5-4309-b735-3c2df05f28ac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:14.571553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:14.573918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:14.788673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:14.907127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd0df-234e-4629-bda9-82c08a504096 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:14.930957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f872a-42ec-4630-a680-77684415c761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:14.932277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f872a-42ec-4630-a680-77684415c761 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:14.939271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:14.940918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:14.943864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f872a-42ec-4630-a680-77684415c761 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:14.944257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f872a-42ec-4630-a680-77684415c761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:14.967497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-460f872a-42ec-4630-a680-77684415c761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:14.972237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:14.973279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] PATH_INFO: `/v3/users/11b6296bc2fb4ca6b2f02bf06c3f6602` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:14.994640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b6296bc2fb4ca6b2f02bf06c3f6602)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:15.004969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f872a-42ec-4630-a680-77684415c761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:15.010393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f872a-42ec-4630-a680-77684415c761 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:15.012767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:15.120354 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1695/3412] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 1009 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:15.122011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f872a-42ec-4630-a680-77684415c761 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:15.144259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-460f872a-42ec-4630-a680-77684415c761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:15.288932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f872a-42ec-4630-a680-77684415c761 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:15.308995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:15.312494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:15.319235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:15.320669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] PATH_INFO: `/v3/projects/4e5b60991c1a4d15809b1f5f6ed8ad0f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:15.323511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5b60991c1a4d15809b1f5f6ed8ad0f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:15.331456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:15.501411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b6296bc2fb4ca6b2f02bf06c3f6602'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.509105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b6296bc2fb4ca6b2f02bf06c3f6602'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.696077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5b60991c1a4d15809b1f5f6ed8ad0f', 'request_id': 'req-0d71a74c-ce9d-4176-b28d-907230e424c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.723646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b6296bc2fb4ca6b2f02bf06c3f6602'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.733711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5b60991c1a4d15809b1f5f6ed8ad0f', 'request_id': 'req-0d71a74c-ce9d-4176-b28d-907230e424c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.776594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5b60991c1a4d15809b1f5f6ed8ad0f', 'request_id': 'req-0d71a74c-ce9d-4176-b28d-907230e424c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.790870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b6296bc2fb4ca6b2f02bf06c3f6602'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.825582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b6296bc2fb4ca6b2f02bf06c3f6602'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.850816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1718/3413] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:14 2022] DELETE /identity/v3/users/11b6296bc2fb4ca6b2f02bf06c3f6602 => generated 0 bytes in 1280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:42:15.932085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] The token cache is being invalidate because project 4e5b60991c1a4d15809b1f5f6ed8ad0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:15.933033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.944089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:15.951255 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1696/3414] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:15 2022] DELETE /identity/v3/projects/4e5b60991c1a4d15809b1f5f6ed8ad0f => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:15.953191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:15.955554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:16.117899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:16.213933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64b4c-de66-443c-8d75-6e3373235c7f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:16.233952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:16.237239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:16.241194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:16.242420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] PATH_INFO: `/v3/users/d5bbe90b687443e0942a01f9b83af010` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:16.246430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bbe90b687443e0942a01f9b83af010)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:16.252894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:16.365447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:16.368906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:16.652239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bbe90b687443e0942a01f9b83af010'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:16.657074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bbe90b687443e0942a01f9b83af010'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:16.695701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71a74c-ce9d-4176-b28d-907230e424c0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:16.709564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:16.710900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:16.711474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:16.711956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] PATH_INFO: `/v3/projects/850f175b575b4a44954ceb0e0312ed6a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:16.716361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=850f175b575b4a44954ceb0e0312ed6a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:16.723386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:16.775599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bbe90b687443e0942a01f9b83af010'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:16.875448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bbe90b687443e0942a01f9b83af010'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:16.902292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9d2743af-6d39-40d6-a4d6-02a9ed8151a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bbe90b687443e0942a01f9b83af010'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:16.933903 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1719/3415] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:15 2022] DELETE /identity/v3/users/d5bbe90b687443e0942a01f9b83af010 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:16.953593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ef4d-2f04-487e-9634-fac475a657aa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:16.959021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ef4d-2f04-487e-9634-fac475a657aa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:16.961319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ef4d-2f04-487e-9634-fac475a657aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:17.106233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9f59ef4d-2f04-487e-9634-fac475a657aa None None] MFA Rules not processed for user `edcdbeebe55e41cb9072a7561e0988f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:17.109104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850f175b575b4a44954ceb0e0312ed6a', 'request_id': 'req-a6cbd506-126f-4590-a794-4743da4a4a0d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:17.112522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f59ef4d-2f04-487e-9634-fac475a657aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:17.135721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:17.175627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850f175b575b4a44954ceb0e0312ed6a', 'request_id': 'req-a6cbd506-126f-4590-a794-4743da4a4a0d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:17.220193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850f175b575b4a44954ceb0e0312ed6a', 'request_id': 'req-a6cbd506-126f-4590-a794-4743da4a4a0d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:17.378485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] The token cache is being invalidate because project 850f175b575b4a44954ceb0e0312ed6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:17.381734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:17.384265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:17.388963 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1697/3416] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:16 2022] DELETE /identity/v3/projects/850f175b575b4a44954ceb0e0312ed6a => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:42:17.391225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:17.407183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:17.474140 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1720/3417] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:17.478458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a96fe-5beb-40d7-a72c-859bacdcb5d5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:17.478458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a96fe-5beb-40d7-a72c-859bacdcb5d5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:17.478458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a96fe-5beb-40d7-a72c-859bacdcb5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:17.574191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c71a96fe-5beb-40d7-a72c-859bacdcb5d5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:17.574191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c71a96fe-5beb-40d7-a72c-859bacdcb5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:17.851729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbd506-126f-4590-a794-4743da4a4a0d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:17.886104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:17.887761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:17.889140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:17.889924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] PATH_INFO: `/v3/projects/b0dba749bcef41eabaa078e2e36d0f97` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:17.893700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0dba749bcef41eabaa078e2e36d0f97)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:17.898361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:17.914973 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1721/3418] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:17.930807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:17.931533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:17.940010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:17.976255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:18.017741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:18.020529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:18.088127 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1722/3419] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:18.095976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:18.161563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a96c6-e198-4d2d-a802-ba550ed5ce4f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:18.218284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0dba749bcef41eabaa078e2e36d0f97', 'request_id': 'req-84a3b893-5ef3-4040-83e9-10a696498085'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:18.236097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0dba749bcef41eabaa078e2e36d0f97', 'request_id': 'req-84a3b893-5ef3-4040-83e9-10a696498085'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:18.287855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0dba749bcef41eabaa078e2e36d0f97', 'request_id': 'req-84a3b893-5ef3-4040-83e9-10a696498085'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:18.425793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] The token cache is being invalidate because project b0dba749bcef41eabaa078e2e36d0f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:18.430654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:18.433654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:18.436246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84a3b893-5ef3-4040-83e9-10a696498085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:18.441659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1698/3420] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:17 2022] DELETE /identity/v3/projects/b0dba749bcef41eabaa078e2e36d0f97 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:18.442547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:18.443514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:18.449085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:18.451534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:18.451977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:18.452384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:18.453449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:18.456101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:18.465889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:18.517654 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1723/3421] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:42:18.524564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:18.540082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:18.582438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11a64-f6b0-4281-a8e0-fa9d808b02c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:18.595359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:18.603450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:18.628412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:18.629853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:18.630483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:18.631041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:18.636263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:18.645075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6080e3-d469-4b91-81b5-148d43d1608d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:18.682553 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1699/3422] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:18.684067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:18.696761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:18.770003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac76d1-d62f-4e80-a812-eb4fd3fd90a4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:18.843591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:18.847801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:18.849197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:18.854266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] PATH_INFO: `/v3/projects/04510757e19b410282272b752c22f52f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:18.871764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04510757e19b410282272b752c22f52f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:18.877822 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1724/3423] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:18 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:42:18.885459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:18.885459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:18.885459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:18.893673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:18.976532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:18.986577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:19.262296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04510757e19b410282272b752c22f52f', 'request_id': 'req-cea2202a-4d4f-4371-ac58-067a3463e63b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:19.296599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04510757e19b410282272b752c22f52f', 'request_id': 'req-cea2202a-4d4f-4371-ac58-067a3463e63b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:19.316355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:19.327917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04510757e19b410282272b752c22f52f', 'request_id': 'req-cea2202a-4d4f-4371-ac58-067a3463e63b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:19.432282 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1725/3424] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:19.441836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:19.485145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] The token cache is being invalidate because project 04510757e19b410282272b752c22f52f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:19.486046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:19.488363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:19.497839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1700/3425] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:18 2022] DELETE /identity/v3/projects/04510757e19b410282272b752c22f52f => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:19.500837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:19.505724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:19.578144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47f227-f498-423f-83f9-1676c4c9c3d2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:19.775365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2202a-4d4f-4371-ac58-067a3463e63b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:19.807162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:19.808717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:19.819727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:19.820787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:19.822317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:19.831304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:19.833906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a9c1-648f-4a91-a5ec-df2bbf7cbfb7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:19.921866 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1701/3426] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:19.926143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:19.926798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:19.927589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:20.013073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:20.015745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:20.051320 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1702/3427] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:20.051320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:20.061725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:20.064667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:20.065549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:20.066401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:20.069658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:20.077113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481e670-ddda-4433-b940-c1bbfc0e6dcd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:20.096654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5b1f-a8d9-43d4-b22b-e642926fb8b8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:20.127978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:20.129331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:20.131714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:20.132354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:20.141551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:20.193257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:20.264889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:20.328794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1726/3428] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:19 2022] POST /identity/v3/users => generated 290 bytes in 884 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:20.339578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:20.339578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:20.339578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:20.448674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1703/3429] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:20 2022] POST /identity/v3/projects => generated 381 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:20.459936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:20.471578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:20.564511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:20.564511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:20.868783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e797ac0-5c30-40f2-a659-6e0a9b803c03 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:20.888349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:20.891032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:20.892641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:20.895465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:20.896920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:20.905254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:20.962351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1704/3430] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:20.969720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.013300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b7381-892e-47c8-9684-6dc773c00bd8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.054055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1727/3431] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 731 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:21.054791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:21.056172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:21.057914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.058212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:21.060128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:21.065581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:21.079056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:21.111899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30958a99-1034-4669-a641-c204eb0930b0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.135619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:21.136989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:21.137333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:21.137774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:21.147033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:21.157341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:21.224589 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1728/3432] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:21.230481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.282627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d42c-e9fa-47bf-8e3d-bd19021df5b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.295263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1705/3433] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:20 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:21.297447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.315208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:21.327618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:21.327618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:21.327618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:21.335897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:21.336611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:21.348549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a80ef6-d3f9-438d-b600-32a2e0790e22 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.368632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:21.370003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:21.370662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:21.371237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:21.371596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] PATH_INFO: `/v3/projects/ba3c3dc4e3f14807b3aad28237f03a4e/users/abc7cb2544cb41e7b900d5f23e4de0ec/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:21.487325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c3dc4e3f14807b3aad28237f03a4e, user_id=abc7cb2544cb41e7b900d5f23e4de0ec, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:21.524053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1729/3434] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:21.524053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.667493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:21.668183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee11eb-ef9f-4086-9faf-5836688b386d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.668183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:21.668183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:21.668183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:21.668924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:21.668924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:21.691528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:21.748422 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1730/3435] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:21.750068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.804462 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1706/3436] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:21 2022] PUT /identity/v3/projects/ba3c3dc4e3f14807b3aad28237f03a4e/users/abc7cb2544cb41e7b900d5f23e4de0ec/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:21.835319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e79c-0194-4894-a07c-925899f9ac98 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:21.850149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:21.901336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:22.195853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc6cc-e83f-42e6-9784-2e30227d385f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:22.206782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:22.208249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:22.208883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:22.209487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:22.211069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:22.220673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:22.234339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:22.239018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:22.241803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:22.243075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:22.252771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:22.260054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0fca-09d3-4c69-9dd7-8f29c43991d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:22.326028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1707/3437] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:22.328888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a35a-55d5-44ed-a78d-b25d371453d0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:22.335676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a35a-55d5-44ed-a78d-b25d371453d0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:22.339042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a35a-55d5-44ed-a78d-b25d371453d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:22.392651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1731/3438] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:21 2022] POST /identity/v3/projects => generated 385 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:22.394778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:22.518730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9ec3a35a-55d5-44ed-a78d-b25d371453d0 None None] MFA Rules not processed for user `abc7cb2544cb41e7b900d5f23e4de0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:22.521882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ec3a35a-55d5-44ed-a78d-b25d371453d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:22.650701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:22.693370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7898-0f43-4203-a505-18b19e92e753 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:22.720787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:22.722505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:22.723531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:22.728121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] PATH_INFO: `/v3/projects/477e43afdaeb4926a8a0ef8560e30980/users/927b3e0f9cb340978e6f3a16107becf0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:22.788581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477e43afdaeb4926a8a0ef8560e30980, user_id=927b3e0f9cb340978e6f3a16107becf0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:22.801073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:22.979908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1732/3439] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:22 2022] PUT /identity/v3/projects/477e43afdaeb4926a8a0ef8560e30980/users/927b3e0f9cb340978e6f3a16107becf0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:22.985644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:22.989216 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1708/3440] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 662 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:23.010056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:23.019377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:23.019377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:23.108292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:23.111453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:23.386588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1709/3441] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:23.387471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:23.390809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:23.395193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c85a7-e0c9-4796-985b-a59e53269800 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:23.420614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:23.421335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:23.421624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:23.422303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:23.424824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:23.434446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:23.516862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:23.793721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1733/3442] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:22 2022] POST /identity/v3/users => generated 293 bytes in 805 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:23.793721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:23.815040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:23.927819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9724d-8130-4e55-a2ae-8e8a946c5766 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:24.017422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:24.018545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:24.018988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:24.023737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:24.168952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1c6c8-c8f3-41d5-bc43-6d31e7bc7817 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:24.199584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:24.208431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:24.208431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:24.208431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:24.305269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:24.308307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:24.382563 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1734/3443] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:24.384598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:24.407383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a91ca-5ad8-4773-8104-589b4c0abbad service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:24.434582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:24.436367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:24.436762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:24.437466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:24.438774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:24.446983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:24.498140 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1735/3444] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:24.505243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:24.543438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef10a-3bd7-4c72-b8d3-28f9a5b87155 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:24.567071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:24.571795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:24.572158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:24.572839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:24.590594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:24.591100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:24.599255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:24.601409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9810-5460-4ff8-8bf8-5abd9c5c4874 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:24.669125 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1710/3445] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:24.719943 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1736/3446] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:24.726405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:24.780271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759c90-c45d-40ce-ba07-d496532bdc31 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:24.791296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:24.793350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:24.794125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:24.796040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] PATH_INFO: `/v3/projects/1181b876697c473ba1d15bbefeea2cf2/users/91627f3584b0402896fd6e64b421b458/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:24.921365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1181b876697c473ba1d15bbefeea2cf2, user_id=91627f3584b0402896fd6e64b421b458, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:24.932329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:25.329331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1711/3447] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:24 2022] PUT /identity/v3/projects/1181b876697c473ba1d15bbefeea2cf2/users/91627f3584b0402896fd6e64b421b458/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:25.337618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c30ef-5532-4eb7-bc31-2c3647cb6604 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:25.338795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c30ef-5532-4eb7-bc31-2c3647cb6604 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:25.339707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c30ef-5532-4eb7-bc31-2c3647cb6604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:25.410600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-268c30ef-5532-4eb7-bc31-2c3647cb6604 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:25.412030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-268c30ef-5532-4eb7-bc31-2c3647cb6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:25.572680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:25.666765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1737/3448] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:25.698095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:26.038029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8a62-4a16-46b6-9942-cb2334d7f128 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:26.059257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:26.065690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:26.069903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:26.071410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:26.124835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:26.128979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:26.171407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1712/3449] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:26.501262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f11d-32d5-42ab-80ec-069a5a8c2246 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:26.502109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f11d-32d5-42ab-80ec-069a5a8c2246 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:26.502315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053f11d-32d5-42ab-80ec-069a5a8c2246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:26.616193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e053f11d-32d5-42ab-80ec-069a5a8c2246 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:26.619947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e053f11d-32d5-42ab-80ec-069a5a8c2246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:26.917249 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1738/3450] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:26.977298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:26.983176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:27.209840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:27.292385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2d60-ed02-4f3b-9836-c5b49d547c56 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:27.316773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:27.318385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:27.319116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:27.319899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:27.352285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:27.361491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:27.399692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1713/3451] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:28.280208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642540-7bd9-4d84-8383-ae3b5835b7c4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:28.280208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642540-7bd9-4d84-8383-ae3b5835b7c4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:28.280208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642540-7bd9-4d84-8383-ae3b5835b7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:28.365629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-37642540-7bd9-4d84-8383-ae3b5835b7c4 None None] MFA Rules not processed for user `abc7cb2544cb41e7b900d5f23e4de0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:28.368853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37642540-7bd9-4d84-8383-ae3b5835b7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:28.602110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1739/3452] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:30.995826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:30.998641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:31.089356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f9a73-54a4-45b9-9147-5c50c11591fc service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:31.112779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:31.114976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:31.115414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:31.115821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] PATH_INFO: `/v3/users/b0933e4def614f928c0415b7de888e24` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:31.118817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0933e4def614f928c0415b7de888e24)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:31.129679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:31.368541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:31.369385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:31.369569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:31.466838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:31.472317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:31.510902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1740/3453] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:31.543513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:31.585870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0933e4def614f928c0415b7de888e24'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:31.590745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bebf9-cff2-418d-8206-352e8e25a786 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:31.619124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:31.622259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:31.624182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:31.631500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:31.671814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:31.679370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:31.729354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1741/3454] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:42:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:31.733871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0933e4def614f928c0415b7de888e24'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:31.771857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0933e4def614f928c0415b7de888e24'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:31.859842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0933e4def614f928c0415b7de888e24'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:31.867646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0933e4def614f928c0415b7de888e24'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:31.921846 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1714/3455] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:30 2022] DELETE /identity/v3/users/b0933e4def614f928c0415b7de888e24 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:32.648585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:32.713987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09659ee-52b5-4f6f-87fe-f24d002e3cea service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:33.022834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:33.027353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:33.097757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:33.098730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:33.099291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:33.099640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] PATH_INFO: `/v3/users/abc7cb2544cb41e7b900d5f23e4de0ec` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:33.109385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc7cb2544cb41e7b900d5f23e4de0ec)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:33.115074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:33.198865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:33.421898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be967-c11d-4a76-9a48-a9b151f133cc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:33.479596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:33.483163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:33.487800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:33.492794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] PATH_INFO: `/v3/users/935f44986e194a1882d095a9b136c6bc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:33.504238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935f44986e194a1882d095a9b136c6bc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:33.510774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:33.604034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc7cb2544cb41e7b900d5f23e4de0ec'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:33.608606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc7cb2544cb41e7b900d5f23e4de0ec'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:33.819616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc7cb2544cb41e7b900d5f23e4de0ec'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:33.913643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc7cb2544cb41e7b900d5f23e4de0ec'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:33.965177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa7176d7-1860-4cd7-9f4e-114ae313889b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc7cb2544cb41e7b900d5f23e4de0ec'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.046803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1742/3456] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:32 2022] DELETE /identity/v3/users/abc7cb2544cb41e7b900d5f23e4de0ec => generated 0 bytes in 1401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:34.054878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:34.061038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:34.067335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:34.104116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935f44986e194a1882d095a9b136c6bc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.115397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:34.118428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:34.135817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:34.273606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935f44986e194a1882d095a9b136c6bc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.333737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935f44986e194a1882d095a9b136c6bc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.459941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935f44986e194a1882d095a9b136c6bc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.469475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935f44986e194a1882d095a9b136c6bc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:34.569273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1715/3457] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:42:33 2022] DELETE /identity/v3/users/935f44986e194a1882d095a9b136c6bc => generated 0 bytes in 1546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:34.733461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1743/3458] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 681 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:35.584342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:35.586994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:35.618273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:35.621286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:35.718586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5abd-888a-47a2-a87e-1f43132ebb17 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:36.029482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385355a-3cb3-4fa4-b7ca-36937b1616b4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:36.063312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:36.064563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:36.065069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:36.065596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:36.159942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:36.161648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:36.165242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:36.173097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] PATH_INFO: `/v3/projects/74d829c1899f478e9a95a0402c0dc87e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:36.176972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d829c1899f478e9a95a0402c0dc87e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:36.191985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:36.477916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:36.507780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:36.584430 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1716/3459] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:36.587774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:36.598381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:36.603584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:36.670333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c98cd-05e5-41d8-bb06-4ad37723cabb service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:36.693582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d829c1899f478e9a95a0402c0dc87e', 'request_id': 'req-e60bc818-854b-4d16-9a5e-a83c3d3472b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:36.909650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d829c1899f478e9a95a0402c0dc87e', 'request_id': 'req-e60bc818-854b-4d16-9a5e-a83c3d3472b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:36.947060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d829c1899f478e9a95a0402c0dc87e', 'request_id': 'req-e60bc818-854b-4d16-9a5e-a83c3d3472b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.027527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] The token cache is being invalidate because project 74d829c1899f478e9a95a0402c0dc87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:37.028190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.034101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e60bc818-854b-4d16-9a5e-a83c3d3472b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.045417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1744/3460] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:35 2022] DELETE /identity/v3/projects/74d829c1899f478e9a95a0402c0dc87e => generated 0 bytes in 1427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:37.055711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406e08-11ae-425a-bf49-0e7b9abf6423 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:37.056163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406e08-11ae-425a-bf49-0e7b9abf6423 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:37.056595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406e08-11ae-425a-bf49-0e7b9abf6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:37.104346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:37.105336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:37.105814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:37.106829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] PATH_INFO: `/v3/projects/f8f49cc17cdd45cc8278f8d5cf1e7490` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:37.130392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f49cc17cdd45cc8278f8d5cf1e7490)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:37.151388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:37.190664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-96406e08-11ae-425a-bf49-0e7b9abf6423 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:37.203847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96406e08-11ae-425a-bf49-0e7b9abf6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:37.269832 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1745/3461] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:37.280273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:37.280784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:37.281321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:37.319898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:37.405675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:37.433893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:37.548521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f49cc17cdd45cc8278f8d5cf1e7490', 'request_id': 'req-0c2ae217-a3ae-47be-92de-a539a23ce41e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.584834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f49cc17cdd45cc8278f8d5cf1e7490', 'request_id': 'req-0c2ae217-a3ae-47be-92de-a539a23ce41e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.670141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f49cc17cdd45cc8278f8d5cf1e7490', 'request_id': 'req-0c2ae217-a3ae-47be-92de-a539a23ce41e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.848095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] The token cache is being invalidate because project f8f49cc17cdd45cc8278f8d5cf1e7490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:37.848655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.863191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c2ae217-a3ae-47be-92de-a539a23ce41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:37.870302 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1717/3462] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:36 2022] DELETE /identity/v3/projects/f8f49cc17cdd45cc8278f8d5cf1e7490 => generated 0 bytes in 1273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:37.923117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582152-3184-4c96-aa04-4e124fac0e85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:37.923758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582152-3184-4c96-aa04-4e124fac0e85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:37.931809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582152-3184-4c96-aa04-4e124fac0e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.038734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1746/3463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:38.038734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:38.109399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5de7-772f-4f3b-af26-4df54d06844f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:38.141099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-47582152-3184-4c96-aa04-4e124fac0e85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:38.143588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47582152-3184-4c96-aa04-4e124fac0e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:38.176331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:38.180021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:38.182280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:38.191742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.193712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:38.200907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:38.212729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:38.251630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1718/3464] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:38.259015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:38.259418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:38.259824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.393247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:38.395706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:38.427623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1747/3465] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:38.428609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:38.478611 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1719/3466] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:38.488987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:38.507099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4cd7-35b2-4cef-8bdb-b8f8fad0c51c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:38.539106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6262a-10cb-4a9b-adf7-9bf9875218cc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:38.547215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:38.548673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:38.551123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:38.551652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.553066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:38.561232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:38.563089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:38.564585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:38.567883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:38.568847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.573257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:38.574181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:38.578622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:38.637136 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1720/3467] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:38.652898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:38.694205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5e8c-ed86-44e8-9d72-631c79f97864 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:38.720058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:38.727296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:38.727296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:38.727296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:38.727296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:38.739676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:38.822153 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1748/3468] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:38 2022] POST /identity/v3/projects => generated 373 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:38.829974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:39.115604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e32f1d-440e-48b6-b510-121c9398c449 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:39.146500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:39.152112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:39.158861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:39.159602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:39.164200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:39.179185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:39.289014 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1721/3469] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:39.304910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:39.510309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1749/3470] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:38 2022] POST /identity/v3/users => generated 287 bytes in 690 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:39.525677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:39.558719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed6-2363-4f2f-8e09-905483a9bf15 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:39.619109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903ad3f-9e1c-4ff7-9c8c-8dd7f36449d3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:39.620980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:39.640423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:39.642258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:39.642258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:39.642736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:39.648391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:39.659492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:39.949757 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1722/3471] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:39 2022] POST /identity/v3/users => generated 293 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:39.951019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:39.952266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:39.952737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:39.953232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:39.955036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:39.956276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:39.966425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.008517 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1750/3472] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:40.015418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:40.050306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2889dd8-b21e-45fc-8898-3625530154ef admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:40.077888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ed31-657e-44a4-8d23-bea83c9533f1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:40.089038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:40.100608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:40.101121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.101524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.101718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.102020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.102213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.102647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.103895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:40.107095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.109116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:40.124336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.170304 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1751/3473] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:40.177253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:40.219496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d82c3-738d-4380-86b6-cfff9d6eed3d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:40.243358 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1723/3474] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:40.245396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:40.251861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.254604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.258267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] PATH_INFO: `/v3/projects/51999a9a01fa4849bcfa3dc9ba2eb870/users/bbc4b124654544f1a4d06f26d291e5a8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.269349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:40.357462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88226f4-ce88-48f1-babb-329fae8d51f1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:40.393176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51999a9a01fa4849bcfa3dc9ba2eb870, user_id=bbc4b124654544f1a4d06f26d291e5a8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:40.410262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:40.413063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748768f-6fb1-4fd9-8221-22f8c255a932 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.419842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.420991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.421967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.429344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:40.442280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.500063 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1724/3475] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:40.514428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:40.596207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33427d-73a1-415e-a04e-5beff4b1b382 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:40.625901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:40.628464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.631827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.632435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] PATH_INFO: `/v3/projects/a9756cde63f04174a293f5b7558d1a96/users/4636896816224423b6f379b160c609ee/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.719199 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1752/3476] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:40 2022] PUT /identity/v3/projects/51999a9a01fa4849bcfa3dc9ba2eb870/users/bbc4b124654544f1a4d06f26d291e5a8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:40.729217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9756cde63f04174a293f5b7558d1a96, user_id=4636896816224423b6f379b160c609ee, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:40.736533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386831da-903b-4b82-81dd-f104ba788903 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:40.737020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386831da-903b-4b82-81dd-f104ba788903 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:40.737791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386831da-903b-4b82-81dd-f104ba788903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:40.774167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f591-8e60-4288-9426-c02a521dce48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:40.853221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-386831da-903b-4b82-81dd-f104ba788903 None None] MFA Rules not processed for user `bbc4b124654544f1a4d06f26d291e5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:40.860117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-386831da-903b-4b82-81dd-f104ba788903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:41.114276 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1725/3477] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:40 2022] PUT /identity/v3/projects/a9756cde63f04174a293f5b7558d1a96/users/4636896816224423b6f379b160c609ee/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:41.128250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:41.130904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:41.132980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:41.204633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:41.240995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:41.246244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:41.254685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1753/3478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:42:41.281309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386831da-903b-4b82-81dd-f104ba788903 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:41.284054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-386831da-903b-4b82-81dd-f104ba788903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:41.489717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1726/3479] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:41.786910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:41.801011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:41.848783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:41.897332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386831da-903b-4b82-81dd-f104ba788903 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:42.188878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab8fe8-7ab9-4dff-8c9a-d2a8e702de4f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:42.232970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:42.234677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:42.235694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:42.236481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:42.298901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:42.302102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:42.373624 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1727/3480] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:42.376091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:42.379031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:42.415254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:42.418383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:42.418383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:42.418383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:42.511069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7d2e-5374-4b60-ac74-5f6459464e5f service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:42.569741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:42.577284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:42.584770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:42.584770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] PATH_INFO: `/v3/projects/ba3c3dc4e3f14807b3aad28237f03a4e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:42.590085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3c3dc4e3f14807b3aad28237f03a4e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:42.595039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:42.876377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:42.888719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b758a6-a0cc-410d-9038-b93b8d7fce61 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:42.942336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1754/3481] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:42:42.999205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3c3dc4e3f14807b3aad28237f03a4e', 'request_id': 'req-6be25586-1429-41c3-849b-7f18fda3aee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:43.038526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3c3dc4e3f14807b3aad28237f03a4e', 'request_id': 'req-6be25586-1429-41c3-849b-7f18fda3aee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:43.085107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3c3dc4e3f14807b3aad28237f03a4e', 'request_id': 'req-6be25586-1429-41c3-849b-7f18fda3aee4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:43.373580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] The token cache is being invalidate because project ba3c3dc4e3f14807b3aad28237f03a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:42:43.380429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:43.394002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6be25586-1429-41c3-849b-7f18fda3aee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:42:43.405586 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1728/3482] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:42 2022] DELETE /identity/v3/projects/ba3c3dc4e3f14807b3aad28237f03a4e => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:43.407995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:43.408370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:43.410523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:43.609649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:43.619499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:44.224921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1755/3483] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 817 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:44.239697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:44.241520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:44.242306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:44.381244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:44.383920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:44.417980 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1729/3484] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:44.426536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:44.517970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634164f-6a43-4242-829f-5c3983fa1924 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:44.569277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:44.575884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:44.576599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:44.577070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:44.583364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:42:44.583981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:44.595264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:44.677425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1756/3485] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:42:44.685389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:44.718463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad227533-abe1-41a9-9f5e-4600f8f1be6b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:44.765608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:44.766795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:44.767342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:44.769436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:44.770926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:44.776986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:45.421074 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1730/3486] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:44 2022] POST /identity/v3/projects => generated 383 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:45.428371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:45.542398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9573-12fb-4e2f-b40b-3ba410b81e95 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:45.768036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:45.890045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:45.897128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:45.897833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:45.911543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:45.918222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:45.935108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:46.251188 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1757/3487] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:45 2022] POST /identity/v3/users => generated 292 bytes in 824 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:46.257856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:46.275233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:46.308399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf4cf3-6fcb-45d9-a273-432dff9151f7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:46.345655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:46.345655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:46.346071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:46.346413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:46.347751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:46.365027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:46.472482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:46.483332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1731/3488] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:46.528230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885cc8d-04db-490f-a5e9-6d316b8dcfb0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:46.553867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:46.556144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:46.563113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:46.566838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:46.575320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:46.580378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac484987-8626-4f36-b599-a7b36b47bf19 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:46.649617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1758/3489] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:46.669606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:46.756119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635e77-2e42-489f-ac89-bad12abc4f25 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:46.841789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:46.843669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:46.845670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:46.846818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] PATH_INFO: `/v3/projects/baa9bc0601f141e48e1b5f001769d221/users/c7677d259d034a68aaba770506475f73/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:46.933310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa9bc0601f141e48e1b5f001769d221, user_id=c7677d259d034a68aaba770506475f73, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:46.955646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee3bb-7401-4644-aa55-dea5c32761f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:47.224004 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1732/3490] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:46 2022] PUT /identity/v3/projects/baa9bc0601f141e48e1b5f001769d221/users/c7677d259d034a68aaba770506475f73/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:47.245709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:47.247850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:47.249886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:47.369990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] MFA Rules not processed for user `c7677d259d034a68aaba770506475f73`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:47.382077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:47.747022 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1759/3491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:47.770000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3639d5-5740-4d87-a1ac-a59e8e706e36 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:47.770999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3639d5-5740-4d87-a1ac-a59e8e706e36 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:47.771875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3639d5-5740-4d87-a1ac-a59e8e706e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:47.849808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4f3639d5-5740-4d87-a1ac-a59e8e706e36 None None] MFA Rules not processed for user `c7677d259d034a68aaba770506475f73`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:47.855635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f3639d5-5740-4d87-a1ac-a59e8e706e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:47.892218 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1733/3492] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:48.129909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:48.142574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:48.782542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44db2-8134-439e-af33-c999f8d9f49b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:48.812866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:48.819470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:48.820154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:48.820838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:48.875739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:48.910231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:48.988861 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1760/3493] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 860 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:42:52.358857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:52.360761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:52.361555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:52.489934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] MFA Rules not processed for user `91627f3584b0402896fd6e64b421b458`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:42:52.505706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:52.874498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1734/3494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:42:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:42:52.875567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:52.878032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:42:53.082086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:53.286706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc7d7-666e-46fc-8b4e-a9664b7f21b8 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:53.319071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:53.319071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:53.326647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:53.327629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:53.329684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:53.336026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:53.561801 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1761/3495] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:42:52 2022] POST /identity/v3/projects => generated 383 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:53.565077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:53.593470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191f33-463f-4315-8f5f-1a0fc43d8173 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:53.842676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:53.848682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:53.849855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:53.853355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:53.856708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:53.872692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:54.324556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1735/3496] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:42:53 2022] POST /identity/v3/users => generated 298 bytes in 760 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:42:54.330455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:54.433426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08082b-b534-48bc-8212-ae5defad50df admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:54.482174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:54.490323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:54.491103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:54.500833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:54.506992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:54.521951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:54.572383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1762/3497] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:54.580554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:54.664130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e634b5-93be-4fc0-bca7-3542b00a63ff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:54.777145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:54.777145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:54.777145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:54.777145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] PATH_INFO: `/v3/projects/210941eb9659422f81b3cd68dcd5e13f/users/00182ff09f2648ffb4f7d1b57f169adf/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:54.813351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] RBAC: Authorizing `identity:create_grant(project_id=210941eb9659422f81b3cd68dcd5e13f, user_id=00182ff09f2648ffb4f7d1b57f169adf, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:54.826888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:55.666519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1736/3498] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:54 2022] PUT /identity/v3/projects/210941eb9659422f81b3cd68dcd5e13f/users/00182ff09f2648ffb4f7d1b57f169adf/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:42:55.673891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:55.731379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6f1c7-ed33-4c5e-9465-edd369729d08 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:56.253565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:56.254769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:56.258631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:56.259294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:56.260646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:56.271314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:56.342560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1763/3499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 669 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:42:56.350391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:42:56.378966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9888aaf-9aee-4182-9ece-d43f4fca496b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:42:56.390076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:42:56.392635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:42:56.393335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:42:56.393937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] PATH_INFO: `/v3/projects/210941eb9659422f81b3cd68dcd5e13f/users/00182ff09f2648ffb4f7d1b57f169adf/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:42:56.398578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=210941eb9659422f81b3cd68dcd5e13f, user_id=00182ff09f2648ffb4f7d1b57f169adf, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:42:56.404960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:42:56.452531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1737/3500] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:42:56 2022] PUT /identity/v3/projects/210941eb9659422f81b3cd68dcd5e13f/users/00182ff09f2648ffb4f7d1b57f169adf/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:05.112151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:05.112151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:05.132341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bd4f2-e4df-4dfd-bc62-091f4cf7e214 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:05.413499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:05.417773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:05.421922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:05.423264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] PATH_INFO: `/v3/users/bbc4b124654544f1a4d06f26d291e5a8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:05.431061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc4b124654544f1a4d06f26d291e5a8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:05.446192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:05.619611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:05.622781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:05.638253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:05.986282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:06.012804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb53d-3c9e-4817-9fd0-ecf9a54c7e1b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:06.052549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:06.054915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:06.064843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc4b124654544f1a4d06f26d291e5a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:06.065941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:06.066604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:06.074226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc4b124654544f1a4d06f26d291e5a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:06.078504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:06.386780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc4b124654544f1a4d06f26d291e5a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:06.403168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:06.418074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5545d-1b57-4663-9c32-9e45065fa88c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:06.466379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc4b124654544f1a4d06f26d291e5a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:06.549509 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1738/3501] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 931 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:43:06.558989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc4b124654544f1a4d06f26d291e5a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:06.604930 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1764/3502] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:43:05 2022] DELETE /identity/v3/users/bbc4b124654544f1a4d06f26d291e5a8 => generated 0 bytes in 1544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:06.610634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:06.621763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:06.622700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:06.756813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:06.765900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:07.077235 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1739/3503] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:07.211382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:07.215946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:07.592447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ee40-0cdf-471a-827a-822a20796223 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:07.630250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:07.630250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:07.630250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:07.630250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:07.702208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:07.711659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:07.797312 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1765/3504] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:43:10.009752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:10.013101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:10.090619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ce3ff-ffe1-4f2b-b569-131ebb06f8aa None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:10.099864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:10.100674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:10.101227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:10.101699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:10.116667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:10.171952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:10.177524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d536-5dbf-4b77-be03-736bb84f6a76 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:10.202326 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1740/3505] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:10.847009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:10.851231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:10.904746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2433-bb32-4881-85df-f9ac990fabfa service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:10.934684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:10.935872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:10.936551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:10.937215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] PATH_INFO: `/v3/projects/51999a9a01fa4849bcfa3dc9ba2eb870` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:10.943657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51999a9a01fa4849bcfa3dc9ba2eb870)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:10.956221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:11.356987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51999a9a01fa4849bcfa3dc9ba2eb870', 'request_id': 'req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:11.482500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51999a9a01fa4849bcfa3dc9ba2eb870', 'request_id': 'req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:11.512525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51999a9a01fa4849bcfa3dc9ba2eb870', 'request_id': 'req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:11.577873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] The token cache is being invalidate because project 51999a9a01fa4849bcfa3dc9ba2eb870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:43:11.579281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:11.584156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b5b0074-2a4b-4354-a0b1-8a9f773883e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:11.593136 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1766/3506] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:10 2022] DELETE /identity/v3/projects/51999a9a01fa4849bcfa3dc9ba2eb870 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:11.601511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:11.603602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:11.603890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:11.766107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:11.776312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:11.881068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:12.129520 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1741/3507] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:43:12.141066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:12.144983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:12.146049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:12.232171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:12.234810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:12.273150 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1767/3508] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:43:12.281928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:12.320356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4280-702b-4bb8-9969-0c022405ac95 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:12.332911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:12.333938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:12.334479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:12.335069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:12.336914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:43:12.338953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:12.348630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:12.405642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1742/3509] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:43:12.405893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:12.426293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafa203-df90-4d1b-bc08-9a0eea2fbdd6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:12.448400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:12.452322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:12.453601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:12.454462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:12.456155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:12.460377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:12.741374 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1768/3510] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:43:12 2022] POST /identity/v3/projects => generated 367 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:43:12.749642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:12.814009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053831e-8777-41f6-b53a-2fed307af0be admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:13.152194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:13.156371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:13.156903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:13.157504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:13.158694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:13.184239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc262f-f39c-4353-9758-eee90bd98132 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:13.436329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1743/3511] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:43:12 2022] POST /identity/v3/users => generated 284 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:43:13.442497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:13.497574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a29fb-a7df-4673-be20-3def84a6d297 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:13.522848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:13.525860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:13.527956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:13.528955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:13.535924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:13.536869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:13.537583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:13.544925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:13.555077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:13.562434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:13.590872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1769/3512] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:43:13.605419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:13.621373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:13.627494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:13.634408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e6b7b-9c98-4852-a845-a605e1e2ba75 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:13.658177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:13.662081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:13.663267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:13.664183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:13.666311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:13.689585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:13.733642 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1770/3513] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:43:13.737201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:13.781636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986ee3e-4a97-4ec1-b7f0-f26d77b1d861 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:13.800303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:13.801626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:13.802087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:13.802612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] PATH_INFO: `/v3/projects/3144071d6ca344e29f2c4e2e52dcdb5a/users/04eb66102ef9437c844192b9bd228f44/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:13.870584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144071d6ca344e29f2c4e2e52dcdb5a, user_id=04eb66102ef9437c844192b9bd228f44, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:13.889843 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1744/3514] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:43:13.900676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f68e8f-bec1-423a-95e6-323019e64650 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:13.960532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:13.963369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:14.072711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1771/3515] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:43:13 2022] PUT /identity/v3/projects/3144071d6ca344e29f2c4e2e52dcdb5a/users/04eb66102ef9437c844192b9bd228f44/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:14.103058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:14.104265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:14.105290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:14.175704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:14.238140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] MFA Rules not processed for user `04eb66102ef9437c844192b9bd228f44`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:14.243637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:14.275475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cbccf-9c75-4d2a-8128-e41b8234b8e9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:14.605217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:14.606264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:14.606761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:14.607312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:14.689879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1772/3516] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:14.725705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:14.729682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:14.863417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:14.872825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5c6c1-9b11-4821-a43b-1aa73970cf65 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:14.947117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1745/3517] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:43:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 988 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:43:14.966806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:14.980484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:14.983765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:15.095405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271d9c-7d86-4de1-998b-540cd71ea6eb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:15.118353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:15.119555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:15.120150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:15.121411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:15.146221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] MFA Rules not processed for user `927b3e0f9cb340978e6f3a16107becf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:15.150677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:15.158508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:15.161592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af929992-e821-45dd-ba9a-7c53f9d21472 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:15.239513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1773/3518] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:43:15.532324 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1746/3519] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:15.555250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:15.556508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:15.558394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:15.653642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] MFA Rules not processed for user `927b3e0f9cb340978e6f3a16107becf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:15.657110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:15.696978 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1774/3520] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:17.704711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:17.721647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:17.816883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:18.053692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4e3e-5f97-4b1a-872c-38c2a1626299 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:18.075896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:18.077637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:18.081504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:18.081504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:18.097764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:18.100891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4469adc-95bf-4c1a-8f94-27343a0052da service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:18.122017 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1747/3521] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:18.909092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:18.913157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:18.984731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a14f-4089-44b4-9949-4737f224320a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:19.012393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:19.018036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:19.018036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:19.020222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:19.029529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:19.245658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:19.323983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:19.343783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3da49-936b-41ff-a926-ef8a8cda85ec service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:19.394523 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1775/3522] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:19.742673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:19.742673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:19.742673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:43:19.750612 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:19.753483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:43:19.768312 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1748/3523] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:43:20.027280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843048cf-9fbf-44a5-bb69-9511d47b8a23 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:20.031495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843048cf-9fbf-44a5-bb69-9511d47b8a23 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:20.031495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843048cf-9fbf-44a5-bb69-9511d47b8a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:20.145198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-843048cf-9fbf-44a5-bb69-9511d47b8a23 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:20.156231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-843048cf-9fbf-44a5-bb69-9511d47b8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:20.203360 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1776/3524] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:20.231420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:20.284379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2756bf-b78d-463b-b562-56a2869932ec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:20.300302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:20.301452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:20.301933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:20.302696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:20.346050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:20.349831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:20.383718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1749/3525] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:24.513204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9860c5-ea8b-4285-92da-2bbabb89c6d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:24.514840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9860c5-ea8b-4285-92da-2bbabb89c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:24.515746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9860c5-ea8b-4285-92da-2bbabb89c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:24.601763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ab9860c5-ea8b-4285-92da-2bbabb89c6d9 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:24.607887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab9860c5-ea8b-4285-92da-2bbabb89c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:24.645168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1777/3526] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:43:24.692419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:24.730754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda42f-8250-4478-a199-d5066aec57cb service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:24.756861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:24.761041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:24.763214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:24.763214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:24.804049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:24.811404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24feb-8739-4a05-98c8-d5b5fbcd3e0b service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:24.905568 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1750/3527] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:43:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:43:25.782819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:25.784671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:25.785526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:25.862350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] MFA Rules not processed for user `4636896816224423b6f379b160c609ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:25.866936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:26.342078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1778/3528] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:26.344728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c980-3119-42ec-aa8e-1ef95223585c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:26.346393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c980-3119-42ec-aa8e-1ef95223585c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:26.349513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55c980-3119-42ec-aa8e-1ef95223585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:26.538234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7e55c980-3119-42ec-aa8e-1ef95223585c None None] MFA Rules not processed for user `4636896816224423b6f379b160c609ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:26.548758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7e55c980-3119-42ec-aa8e-1ef95223585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:26.620536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1751/3529] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:27.765454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:27.825044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83e90b-3fa9-4a59-9dec-f0eadb1c3f0b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:27.860317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:27.861767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:27.862018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:27.862526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:27.912763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:27.921333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431051-be1c-43d5-a3c0-a7d9deff99e9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:27.972102 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1779/3530] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:29.802554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c215-8f8f-40c6-81e0-8ae279f28069 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:29.803618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c215-8f8f-40c6-81e0-8ae279f28069 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:29.804245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c215-8f8f-40c6-81e0-8ae279f28069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-47a9c215-8f8f-40c6-81e0-8ae279f28069 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:43:29.828493 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:29.829989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:43:29.838484 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1752/3531] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:43:29.928688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ae5-5a57-4ac4-befc-844bc1a75e7e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:29.934589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ae5-5a57-4ac4-befc-844bc1a75e7e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:29.934589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ae5-5a57-4ac4-befc-844bc1a75e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:30.027028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-66e46ae5-5a57-4ac4-befc-844bc1a75e7e None None] MFA Rules not processed for user `4636896816224423b6f379b160c609ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:30.039834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-66e46ae5-5a57-4ac4-befc-844bc1a75e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:30.092775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1780/3532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:32.002954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb7-1527-4181-8733-a40dc09f7cae None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:32.004433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb7-1527-4181-8733-a40dc09f7cae None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:32.005402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb7-1527-4181-8733-a40dc09f7cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8164dbb7-1527-4181-8733-a40dc09f7cae None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:43:32.023271 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:32.024770 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:43:32.035685 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1753/3533] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:32 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:43:32.095951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:32.095951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:32.095951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:32.180903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] MFA Rules not processed for user `4636896816224423b6f379b160c609ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:32.196167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:32.258020 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1781/3534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:32.840439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e868f7-36a8-4c41-9890-2be92b43a488 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:32.840913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e868f7-36a8-4c41-9890-2be92b43a488 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:32.841395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e868f7-36a8-4c41-9890-2be92b43a488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:32.993881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-37e868f7-36a8-4c41-9890-2be92b43a488 None None] MFA Rules not processed for user `00182ff09f2648ffb4f7d1b57f169adf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:33.000050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37e868f7-36a8-4c41-9890-2be92b43a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:33.266440 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1754/3535] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:33.297861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:33.300822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:33.708105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a505e-eeec-4c5c-a7e9-a9d88b5c4f9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:33.731266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:33.735419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:33.736450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:33.737264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:33.781041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:33.796532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:33.822873 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1782/3536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:37.180204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:37.182757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:37.184711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:43:37.294686 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:43:37.296454 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:43:37.308962 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1755/3537] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 132 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:43:43.252750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=73 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:43.776162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:43.788579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:43.824357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:44.390658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228309db-81f3-4d17-8bd3-4c554adbad04 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:44.424160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:44.429112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:44.434724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:44.438363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] PATH_INFO: `/v3/users/927b3e0f9cb340978e6f3a16107becf0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:44.445269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927b3e0f9cb340978e6f3a16107becf0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:44.466004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:45.211782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927b3e0f9cb340978e6f3a16107becf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:45.219222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927b3e0f9cb340978e6f3a16107becf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:45.363959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927b3e0f9cb340978e6f3a16107becf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:45.473408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927b3e0f9cb340978e6f3a16107becf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:45.523991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d79848ad-6869-4af8-b916-962ec19fe171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927b3e0f9cb340978e6f3a16107becf0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:45.556032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1783/3538] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:43:43 2022] DELETE /identity/v3/users/927b3e0f9cb340978e6f3a16107becf0 => generated 0 bytes in 1782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:46.810621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:46.815041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:47.225393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edde84b-b253-487b-b88b-1dc975b1cba3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:47.284163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:47.315366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:47.317996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:47.324985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] PATH_INFO: `/v3/projects/477e43afdaeb4926a8a0ef8560e30980` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:47.344977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477e43afdaeb4926a8a0ef8560e30980)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:47.373150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:47.913524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477e43afdaeb4926a8a0ef8560e30980', 'request_id': 'req-da8d6715-e486-4c73-a430-c2400b875145'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:47.959618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477e43afdaeb4926a8a0ef8560e30980', 'request_id': 'req-da8d6715-e486-4c73-a430-c2400b875145'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:47.996642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477e43afdaeb4926a8a0ef8560e30980', 'request_id': 'req-da8d6715-e486-4c73-a430-c2400b875145'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:48.154498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] The token cache is being invalidate because project 477e43afdaeb4926a8a0ef8560e30980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:43:48.154498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:48.168054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-da8d6715-e486-4c73-a430-c2400b875145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:43:48.181635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1756/3539] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:43:46 2022] DELETE /identity/v3/projects/477e43afdaeb4926a8a0ef8560e30980 => generated 0 bytes in 1370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:48.205627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:48.209242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:48.210084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:48.356044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:48.359508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:48.938188 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1784/3540] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 734 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:48.957979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:48.958854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:48.959325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:49.081229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:49.083614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:49.157449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1757/3541] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:49.170934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:49.218182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040d0d7-b88d-41f7-9014-6bed047726ce None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:49.256608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:49.261553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:49.268078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:49.270877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:49.274225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:43:49.280014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:49.319338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:49.420029 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1785/3542] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:43:49.429449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:49.479734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b8c34-54be-4dff-bed6-1f2a4d643482 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:49.514422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:49.520350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:49.523857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:49.525886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:49.532184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:49.545279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:49.877592 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1758/3543] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:43:49 2022] POST /identity/v3/projects => generated 379 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:43:49.879998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:49.944573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58265d3-6c76-4122-aa32-1aea58d34be1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:50.004853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:50.355332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:50.363898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:50.372968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:50.376472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:50.409380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:50.417372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:50.749945 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1786/3544] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:43:49 2022] POST /identity/v3/users => generated 290 bytes in 870 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:43:50.756585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:50.803341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45eab-1e83-4de6-ba2e-67d7eda45ba9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:50.830755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:50.832393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:50.835636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:50.840062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:50.844801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:50.860616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:50.911006 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1759/3545] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:43:50.921508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:50.986116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bac0c8-7a85-49d3-a38f-3ab9c7eb9634 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:51.026669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:51.027828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:51.028355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:51.028855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:51.030152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:51.049822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7809-da79-47d4-a0b5-266ad8b71e4a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:51.125686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:51.134584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1787/3546] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:43:51.152008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67db98-ed91-48bd-b48e-dd2eb1d5fc70 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:51.182231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:51.183466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:51.183954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:51.186336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] PATH_INFO: `/v3/projects/9d5c0142707c420798e04f8826804031/users/7e9a0befa1584e64870462d780dcfc1f/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:51.244473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5c0142707c420798e04f8826804031, user_id=7e9a0befa1584e64870462d780dcfc1f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:51.251437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:51.367697 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1760/3547] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:43:51 2022] PUT /identity/v3/projects/9d5c0142707c420798e04f8826804031/users/7e9a0befa1584e64870462d780dcfc1f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:43:51.375760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa6bd-0c10-413b-aafe-572d663a886e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:51.377213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa6bd-0c10-413b-aafe-572d663a886e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:51.377888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faa6bd-0c10-413b-aafe-572d663a886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:51.510643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c7faa6bd-0c10-413b-aafe-572d663a886e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:51.514880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c7faa6bd-0c10-413b-aafe-572d663a886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:51.946682 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1788/3548] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:52.104019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:52.118838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:52.384850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:52.812463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3acef2-ca10-4611-9f5f-30953ccc2018 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:52.915586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:52.928868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:52.929941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:52.938619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:53.063861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:53.083706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:53.235172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1761/3549] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:43:55.288421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13aa9-97fe-49e7-8ec4-464ea4c8b241 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:55.289295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13aa9-97fe-49e7-8ec4-464ea4c8b241 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:55.289295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13aa9-97fe-49e7-8ec4-464ea4c8b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:55.360341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c5f13aa9-97fe-49e7-8ec4-464ea4c8b241 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:55.364171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5f13aa9-97fe-49e7-8ec4-464ea4c8b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:55.658758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1789/3550] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:55.695595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:55.699382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:56.111860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8816a-e9e5-4cd6-8de4-c29b98a1accc service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:56.131104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:56.132302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:56.133056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:56.133900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:56.184551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:56.189656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:56.246435 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1762/3551] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:56.977140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:56.978043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:56.978180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:57.163297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:43:57.166096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:57.252003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1790/3552] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:43:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:43:57.294128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:57.348751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34193f69-f7cf-46d0-976a-e7c434a243bf service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:57.408063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:57.410509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:57.411026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:57.415696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:57.483861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:57.502918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd018e-839f-44c7-b9bb-d762538e5c82 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:57.587426 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1763/3553] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:43:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:58.263062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:43:58.265679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:58.452314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:58.756547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696d30a-c09b-4531-925a-de1e3f8836cb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:43:58.778446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:43:58.780087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:43:58.784262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:43:58.784868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:43:58.793021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:43:58.830043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:43:58.833675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dd18e-5a8e-430e-9af1-1a7cd9a82d3f service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:43:58.890706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1791/3554] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:43:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:07.547927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=52 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:08.156974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:08.157805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:08.158361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:08.304270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] MFA Rules not processed for user `f641a595a9e242da9564a483717f3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:08.307092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:08.691192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1764/3555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:08.700982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:08.701854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:08.702450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:08.783687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] MFA Rules not processed for user `f641a595a9e242da9564a483717f3b48`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:08.788271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:08.818551 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1792/3556] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:10.481580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:10.485359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:10.583980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8a729-9cfe-44ac-86ff-5d0756b5be27 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:10.623445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:10.628830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:10.629725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:10.630433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] PATH_INFO: `/v3/users/4636896816224423b6f379b160c609ee` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:10.640968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4636896816224423b6f379b160c609ee)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:10.659453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:11.176327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4636896816224423b6f379b160c609ee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:11.311930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4636896816224423b6f379b160c609ee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:11.336899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4636896816224423b6f379b160c609ee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:11.417784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4636896816224423b6f379b160c609ee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:11.419018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6b9fa7c-369a-46dc-81b3-98873bc6a0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4636896816224423b6f379b160c609ee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:11.466425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1765/3557] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:10 2022] DELETE /identity/v3/users/4636896816224423b6f379b160c609ee => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:14.011311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:14.073123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c948b2-ae1a-4426-9275-2ad39a18f6ce None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:14.436592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:14.444205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:14.451923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:14.452789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] PATH_INFO: `/v3/projects/a9756cde63f04174a293f5b7558d1a96` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:14.455163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9756cde63f04174a293f5b7558d1a96)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:14.458158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:14.800431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9756cde63f04174a293f5b7558d1a96', 'request_id': 'req-d25cae14-1ef7-4da8-b158-2d06b2d742dd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:14.924113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9756cde63f04174a293f5b7558d1a96', 'request_id': 'req-d25cae14-1ef7-4da8-b158-2d06b2d742dd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:14.959018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9756cde63f04174a293f5b7558d1a96', 'request_id': 'req-d25cae14-1ef7-4da8-b158-2d06b2d742dd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:15.015354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] The token cache is being invalidate because project a9756cde63f04174a293f5b7558d1a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:15.016436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:15.018483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d25cae14-1ef7-4da8-b158-2d06b2d742dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:15.028390 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1793/3558] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:14 2022] DELETE /identity/v3/projects/a9756cde63f04174a293f5b7558d1a96 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:15.035548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:15.036355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:15.036355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:15.153170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:15.163795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:15.479322 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1766/3559] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:44:15.493057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:15.494340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:15.494340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:15.569255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:15.571054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:15.614473 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1794/3560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:15.620868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:15.665083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9de33-76b3-492f-bd6d-ce1c3e301111 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:15.701874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:15.702984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:15.703714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:15.704222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:15.705290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:44:15.705820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:15.733720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:15.788064 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1767/3561] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:15.800735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:15.841895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edef9c-4196-4d6e-ba61-720b3f6bf45c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:15.873426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:15.881205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:15.881205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:15.881205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:15.881205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:15.893348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:16.124579 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1795/3562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:15 2022] POST /identity/v3/projects => generated 397 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:16.129873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:16.147815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:16.163108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078d77-025c-4270-8a39-9cf36ecdf745 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:16.566878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:16.572438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:16.572931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:16.573424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:16.574717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:16.593117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:16.777368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1768/3563] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:16 2022] POST /identity/v3/users => generated 299 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:16.779983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:16.834888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0e03-0085-4a37-becd-173b92edb469 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:16.885191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:16.890951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:16.895087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:16.897975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:16.918487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:16.941126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:16.950776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:17.032564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1796/3564] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:17.034093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:17.097750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75663-cb94-4017-a126-a0cb22b04a91 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:17.324429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:17.324429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:17.324429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:17.324429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:17.326554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:17.326554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019daef5-b661-402e-ac72-3f8cf8f951dd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:17.326554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1769/3565] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:17.326876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:17.326876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4260bf0-9d57-480f-8968-d61f5bb83b33 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:17.326876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:17.326876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:17.327834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:17.327834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] PATH_INFO: `/v3/projects/35b911873f83408f8831ae7971cf021d/users/ef3619bf0324455db92ef500f16c664f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:17.414834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b911873f83408f8831ae7971cf021d, user_id=ef3619bf0324455db92ef500f16c664f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:17.437503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:17.639699 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1797/3566] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:17 2022] PUT /identity/v3/projects/35b911873f83408f8831ae7971cf021d/users/ef3619bf0324455db92ef500f16c664f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:17.647988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8366c-0233-4278-bbd4-e522e723a3ac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:17.649108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8366c-0233-4278-bbd4-e522e723a3ac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:17.649853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8366c-0233-4278-bbd4-e522e723a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:17.718914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f7e8366c-0233-4278-bbd4-e522e723a3ac None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:17.734617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f7e8366c-0233-4278-bbd4-e522e723a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:18.207641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1770/3567] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:18.227414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:18.230616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:18.707008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418aac9-7592-4c58-8352-97fd7d7b9797 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:18.720637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:18.721787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:18.722286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:18.722778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:18.777736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:18.783368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f89352-5b6a-455d-b109-d450cfa98e4b service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:18.841326 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1798/3568] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:20.651825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:20.652609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:20.652769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:20.815657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] MFA Rules not processed for user `7e9a0befa1584e64870462d780dcfc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:20.831765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:21.214793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4681a3-3870-4fe6-9cdc-6e1578eaaf5c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:21.215592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4681a3-3870-4fe6-9cdc-6e1578eaaf5c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:21.216385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4681a3-3870-4fe6-9cdc-6e1578eaaf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:21.224291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1771/3569] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:21.319935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ee4681a3-3870-4fe6-9cdc-6e1578eaaf5c None None] MFA Rules not processed for user `7e9a0befa1584e64870462d780dcfc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:21.329966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ee4681a3-3870-4fe6-9cdc-6e1578eaaf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:21.372597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1799/3570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:44:26.477857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:26.480585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:26.571278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b050-224d-4975-8356-b613cbe9a6a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:26.601655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:26.602855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:26.603356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:26.603859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] PATH_INFO: `/v3/users/04eb66102ef9437c844192b9bd228f44` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:26.606384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04eb66102ef9437c844192b9bd228f44)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:26.610934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:26.642173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:27.098230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04eb66102ef9437c844192b9bd228f44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:27.276976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04eb66102ef9437c844192b9bd228f44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:27.310652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04eb66102ef9437c844192b9bd228f44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:27.373570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04eb66102ef9437c844192b9bd228f44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:27.374777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04eb66102ef9437c844192b9bd228f44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:27.410066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1772/3571] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:26 2022] DELETE /identity/v3/users/04eb66102ef9437c844192b9bd228f44 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:27.412560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:27.414392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:27.415514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:27.507947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:27.513857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:27.847944 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1800/3572] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:44:27.869653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:27.876428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:28.274282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4d6c-677c-465e-9d5f-d3337400878f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:28.291709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:28.295400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:28.296074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:28.296630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:28.368590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:28.375571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d379-b96a-4350-9cb3-795228aa78e2 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:28.450625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1773/3573] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:44:29.628868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:29.631271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:29.689117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49fe2-cc4b-494d-8413-491cf2144a0c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:29.728494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:29.729690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:29.730179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:29.730650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] PATH_INFO: `/v3/projects/3144071d6ca344e29f2c4e2e52dcdb5a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:29.738585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3144071d6ca344e29f2c4e2e52dcdb5a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:29.742505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:30.068747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3144071d6ca344e29f2c4e2e52dcdb5a', 'request_id': 'req-729d54e0-c451-4023-8df4-62d70405b560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:30.185270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3144071d6ca344e29f2c4e2e52dcdb5a', 'request_id': 'req-729d54e0-c451-4023-8df4-62d70405b560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:30.210339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3144071d6ca344e29f2c4e2e52dcdb5a', 'request_id': 'req-729d54e0-c451-4023-8df4-62d70405b560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:30.227878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:30.261613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] The token cache is being invalidate because project 3144071d6ca344e29f2c4e2e52dcdb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:30.262144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:30.263794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-729d54e0-c451-4023-8df4-62d70405b560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:30.277226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:30.277226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:30.278095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:30.283584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1801/3574] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:29 2022] DELETE /identity/v3/projects/3144071d6ca344e29f2c4e2e52dcdb5a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:30.358231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:30.360275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:30.694145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:30.695606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:30.696161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:30.701549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1774/3575] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:30.773256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:30.787848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:30.816158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:30.827293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1802/3576] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:30.847337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c64d2-dd75-4b28-a978-aeee52c833de None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:30.875074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:30.876162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:30.876648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:30.877146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:30.878425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:44:30.878987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:30.882732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:30.942105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:30.953183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1775/3577] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:30.976683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595b6c-8958-4c44-9c7d-ca3a06dd1958 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:30.996771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:30.998342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:30.998839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:30.999372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:31.000630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:31.026414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:31.244375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1803/3578] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:30 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:31.247640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:31.300280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef6fc-08c5-4b2e-99d2-af70436bf798 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:31.360012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:31.665651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:31.670335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:31.670811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:31.739544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:31.748233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:31.756188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:31.956748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1776/3579] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:31 2022] POST /identity/v3/users => generated 293 bytes in 707 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:31.959463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:32.009979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d13a1-39d1-4489-90ca-5f2ac49c25f8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:32.044668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:32.049676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:32.057565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:32.068460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:32.075215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:32.078349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:32.156467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1804/3580] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:32.157276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:32.215976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af0c49-3ad6-484a-89e6-3ece7d6deca4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:32.237496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:32.240808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:32.242036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:32.242727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:32.252625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:32.260869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912745-7b2d-4b96-8a73-5ea82c19d16b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:32.314070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1777/3581] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:32.321012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:32.359515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5aa1b-bede-4d00-8177-7b1debd4e54b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:32.381345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:32.383240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:32.387492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:32.388481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] PATH_INFO: `/v3/projects/775f2ac906644d03883ec1451343e9f8/users/225ba944625b49e2a5647c0de4c1131a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:32.466610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775f2ac906644d03883ec1451343e9f8, user_id=225ba944625b49e2a5647c0de4c1131a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:32.472698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:32.613537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1805/3582] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:32 2022] PUT /identity/v3/projects/775f2ac906644d03883ec1451343e9f8/users/225ba944625b49e2a5647c0de4c1131a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:32.638039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:32.638535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:32.640928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:32.868186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] MFA Rules not processed for user `225ba944625b49e2a5647c0de4c1131a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:32.876884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:33.548966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:33.551819 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1778/3583] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 691 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:33.846392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10402a-6534-4503-a477-1bc6f8632a32 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:33.867725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:33.868856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:33.869349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:33.869836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:33.882809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:33.888300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:34.090373 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1806/3584] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:33 2022] POST /identity/v3/projects => generated 383 bytes in 774 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:34.096070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:34.136492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1eb42-596c-4ff4-8a0e-735e68fb1e46 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:34.445582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:34.449002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:34.451708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:34.454066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:34.457722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:34.469986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:34.785242 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1779/3585] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:34 2022] POST /identity/v3/users => generated 298 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:34.875695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:34.917369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601ed7-4f77-435b-afc6-f6b13cf059f8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:34.942172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:34.946046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:34.946748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:34.947558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:34.949102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:34.953207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:35.044455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1807/3586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:35.051524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:35.126939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11acd7-9798-4ae3-a4dc-9f0a5000182f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:35.151805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:35.153304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:35.158131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:35.158761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] PATH_INFO: `/v3/projects/40ecc491752a4d96ad62543799759912/users/7b87e0dbec0e44579af07ed8f20c47e9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:35.214022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:35.253411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ecc491752a4d96ad62543799759912, user_id=7b87e0dbec0e44579af07ed8f20c47e9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:35.269066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:35.425574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:35.445349 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1780/3587] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:35 2022] PUT /identity/v3/projects/40ecc491752a4d96ad62543799759912/users/7b87e0dbec0e44579af07ed8f20c47e9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:35.465691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb613b-69ac-40ae-b404-c02bde7808fc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:35.737116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:35.739547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:35.739998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:35.740467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:35.751346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:35.762040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a8451-c52a-4598-a1f6-c29b126fd23d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:35.782356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:35.806654 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1808/3588] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:35.813547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:35.851655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b90c-e7c2-4da7-a860-a68ced04b736 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:35.901291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:35.907121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:35.907988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:35.909491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] PATH_INFO: `/v3/projects/40ecc491752a4d96ad62543799759912/users/7b87e0dbec0e44579af07ed8f20c47e9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:35.919309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ecc491752a4d96ad62543799759912, user_id=7b87e0dbec0e44579af07ed8f20c47e9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:35.942595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:36.007905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1781/3589] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:35 2022] PUT /identity/v3/projects/40ecc491752a4d96ad62543799759912/users/7b87e0dbec0e44579af07ed8f20c47e9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:36.017097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:36.020650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:36.021424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:36.246534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] MFA Rules not processed for user `7b87e0dbec0e44579af07ed8f20c47e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:36.249911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:36.643533 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1809/3590] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 629 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:44:36.649985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:36.701461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012574d8-bc58-4a45-8233-be1860e38f1c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:36.714313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:36.716178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:36.716925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:36.717635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:36.719244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:36.721379 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:36.721379 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:36.721379 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:36.723628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:36.922259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1782/3591] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:36 2022] POST /identity/v3/services => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:36.933599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:36.995534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd26cb-dead-4eb7-9153-8a6b195b586d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:37.129969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:37.134051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:37.138781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:37.150247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:37.150247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:37.150247 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:37.150247 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:37.150247 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:37.159835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: On instance['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: On instance['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: 'False' Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise error Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application 'False' Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.247695 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:44:37.250423 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application 'False' Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:37.252446 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1810/3592] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:44:36 2022] POST /identity/v3/endpoints => generated 283 bytes in 323 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:37.260963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:37.303935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334bb61-4853-47e3-88ba-559aac08c5dd tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:37.328408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:37.329577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:37.330138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:37.332673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:37.334109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:37.336871 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:37.336871 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:37.336871 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:37.359635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-42c8a7e5-bb10-452e-956e-00783a45f223 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: On instance['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: On instance['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: 'True' Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'True' Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.374597 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:44:37.377349 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'True' Oct 04 20:44:37.379707 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:37.385110 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1783/3593] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:44:37 2022] POST /identity/v3/endpoints => generated 281 bytes in 125 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:37.387546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:37.424585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd48a8-2d86-4358-8527-0b774d4aee15 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:37.434352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:37.435722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:37.436026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:37.436542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:37.437943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:37.451039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:37.637970 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1994809769. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:44:37.637970 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:44:37.637970 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:37.857600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:37.857600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:37.861541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:37.868308 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1811/3594] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:44:37 2022] POST /identity/v3/endpoints => generated 361 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:37.875599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:37.933517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:37.941296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:38.053065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e6efa-70c9-4aad-9993-c116d2fd708d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.072886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.075368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.076185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.103253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/regions/tempest-region-1994809769` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.105890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1994809769)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.113922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:38.140326 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1812/3595] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:44:37 2022] GET /identity/v3/regions/tempest-region-1994809769 => generated 180 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:38.143371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:38.209714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19fa6-f834-413d-923e-d17e8ce1f9c5 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.230350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.231579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.236461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.236461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints/0525ad057ea14d38842afd4722c9a018` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.249345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0525ad057ea14d38842afd4722c9a018)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.252015 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:38.252015 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:38.252015 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:38.253564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: On instance['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: On instance['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: 'False' Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise error Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application 'False' Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.270470 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:44:38.273578 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application 'False' Oct 04 20:44:38.275362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:38.281710 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1813/3596] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 4 20:44:38 2022] PATCH /identity/v3/endpoints/0525ad057ea14d38842afd4722c9a018 => generated 283 bytes in 140 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:38.284647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:38.314016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc41-612e-4f81-831f-7f4ae7b7fb1c tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.326705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.327877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.328378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.328890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints/0525ad057ea14d38842afd4722c9a018` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.332542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0525ad057ea14d38842afd4722c9a018)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.337158 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:38.337158 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:38.337158 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:38.340312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:38.370619 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1784/3597] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:44:37 2022] POST /identity/v3/auth/tokens => generated 3510 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:44:38.401023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:38.405022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:38.459676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0525ad057ea14d38842afd4722c9a018', 'request_id': 'req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:38.520088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1814/3598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:38 2022] DELETE /identity/v3/endpoints/0525ad057ea14d38842afd4722c9a018 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:38.528814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:38.604800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c67a-b86c-4ec5-af0d-e123dec8b5b3 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.623511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.625828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.626730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.632593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/regions/tempest-region-1994809769` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.634299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1994809769)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.648026 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:38.648026 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:38.648026 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:38.649938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:38.689500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fe486-e3cc-4d05-aee0-1ddec7290c3b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.740316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.742310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.743096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.743613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.764338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.768870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:38.790885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1785/3599] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:44:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:38.854396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1815/3600] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:44:38 2022] DELETE /identity/v3/regions/tempest-region-1994809769 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:38.863505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:38.891074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ffbb-1908-4bc6-89f0-b34bba93ffa5 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:38.969321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:38.971706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:38.972438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:38.973094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:38.974693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:38.978904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:39.120442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:39.238766 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1567181858. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:44:39.238766 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:44:39.238766 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:39.400750 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1786/3601] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:44:38 2022] POST /identity/v3/endpoints => generated 360 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:39.402611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:39.439483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ca76-2682-46ff-b2d4-5f6f6bf746b9 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:39.489352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:39.490604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:39.491311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:39.491879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/regions/tempest-region-1567181858` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:39.493079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1567181858)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:39.495486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:39.500130 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1816/3602] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:44:39 2022] GET /identity/v3/regions/tempest-region-1567181858 => generated 180 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:39.507961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:39.537894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c54e2-1d57-4fe5-bb53-49e03036190a tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:39.554727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:39.556517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:39.557663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:39.558684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints/f833e3de86df454a825ef8ae38268380` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:39.579834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=f833e3de86df454a825ef8ae38268380)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:39.603895 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:39.603895 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:39.603895 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:39.609890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: On instance['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: On instance['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: 'True' Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'True' Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.650623 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:44:39.653467 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['enabled']: Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'True' Oct 04 20:44:39.655908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:39.663015 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1787/3603] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 4 20:44:39 2022] PATCH /identity/v3/endpoints/f833e3de86df454a825ef8ae38268380 => generated 281 bytes in 157 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:39.674540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:39.708336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab477-9ced-4835-bfcd-166f6d266a5b tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:39.755296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:39.756515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:39.757130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:39.757651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/endpoints/f833e3de86df454a825ef8ae38268380` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:39.764745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f833e3de86df454a825ef8ae38268380)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:39.768047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:39.775828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:39.905393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f833e3de86df454a825ef8ae38268380', 'request_id': 'req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:39.932625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1817/3604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] DELETE /identity/v3/endpoints/f833e3de86df454a825ef8ae38268380 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:39.939448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:39.994881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f8589-098e-41a6-b0b7-1a6828feb617 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:40.055959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:40.057546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:40.058179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:40.058744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/regions/tempest-region-1567181858` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:40.059886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1567181858)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:40.062210 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:40.062210 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:40.062210 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:40.064673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:40.279441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1788/3605] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:44:39 2022] DELETE /identity/v3/regions/tempest-region-1567181858 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:40.288094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:40.323183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c5d4c-8601-4a43-8e3a-8aa3f280d93e tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:40.357478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b87e0dbec0e44579af07ed8f20c47e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ecc491752a4d96ad62543799759912', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:40.359351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:40.360141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:40.361137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] PATH_INFO: `/v3/services/a4e4bab1e5e0413ea71fd68f55164a1c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:40.363232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a4e4bab1e5e0413ea71fd68f55164a1c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:40.365520 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:40.365520 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:40.365520 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:40.368813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:40.542041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:40.542383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1818/3606] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:40 2022] DELETE /identity/v3/services/a4e4bab1e5e0413ea71fd68f55164a1c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:40.547173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:40.555862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:40.780607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfc3d-7f71-4c88-ba47-ca9d1bd0dc0d tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:40.803256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ad-d616-4b06-b095-d28abd4d5f56 tempest-EndpointsNegativeTestJSON-57789207 tempest-EndpointsNegativeTestJSON-57789207-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:40.820290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:40.821489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:40.821987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:40.822484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] PATH_INFO: `/v3/users/225ba944625b49e2a5647c0de4c1131a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:40.826229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225ba944625b49e2a5647c0de4c1131a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:40.826618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:40.827850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:40.828575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:40.829069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:40.830317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:40.832974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:40.995317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:40.998708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c26ed-a7bc-46bf-9a6a-f173931cd90f service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:41.041991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1819/3607] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:44:41.044339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b899b2-b096-4d97-9108-9dd486cda8ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:41.044855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b899b2-b096-4d97-9108-9dd486cda8ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:41.045344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b899b2-b096-4d97-9108-9dd486cda8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:41.111350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69b899b2-b096-4d97-9108-9dd486cda8ca None None] MFA Rules not processed for user `ef3619bf0324455db92ef500f16c664f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:41.114060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69b899b2-b096-4d97-9108-9dd486cda8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:41.173017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:41.282632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225ba944625b49e2a5647c0de4c1131a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:41.293519 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1820/3608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:41.318178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfccd2-e319-45d7-a55f-5031b6c6317b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:41.318691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfccd2-e319-45d7-a55f-5031b6c6317b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:41.320753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfccd2-e319-45d7-a55f-5031b6c6317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:41.360993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69dfccd2-e319-45d7-a55f-5031b6c6317b None None] MFA Rules not processed for user `ef3619bf0324455db92ef500f16c664f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:41.364098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69dfccd2-e319-45d7-a55f-5031b6c6317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:41.379275 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1821/3609] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:41.474719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225ba944625b49e2a5647c0de4c1131a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:41.500241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225ba944625b49e2a5647c0de4c1131a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:41.531813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225ba944625b49e2a5647c0de4c1131a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:41.533579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225ba944625b49e2a5647c0de4c1131a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:41.552629 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1789/3610] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:40 2022] DELETE /identity/v3/users/225ba944625b49e2a5647c0de4c1131a => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:41.561712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e066c-bbdf-4f13-ae5e-72d5114d316f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:41.562545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e066c-bbdf-4f13-ae5e-72d5114d316f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:41.562750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e066c-bbdf-4f13-ae5e-72d5114d316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:41.607696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e74e066c-bbdf-4f13-ae5e-72d5114d316f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:41.610522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e74e066c-bbdf-4f13-ae5e-72d5114d316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:41.774698 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1822/3611] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:41.797423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:41.799329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:41.814599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:41.901348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef65e-aa8a-4807-9317-6c7d4b278659 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:41.901987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef65e-aa8a-4807-9317-6c7d4b278659 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:41.902625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef65e-aa8a-4807-9317-6c7d4b278659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-11cef65e-aa8a-4807-9317-6c7d4b278659 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:41.920595 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:41.922161 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:41.927452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1823/3612] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:44:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:41.981536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:41.981536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:41.981536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:41.991391 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:41.992911 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:41.994394 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1824/3613] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:44:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:41.995695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:42.011264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.036793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dc9fc-0f22-4ed6-a2c7-cc7faf9e6c29 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:42.036793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:42.036793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:42.036793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:42.045185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:42.063917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:42.067091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2a21a-0b87-4d0a-83e5-df0074a5dbec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:42.092326 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1790/3614] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:42.101598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9522ba-5bc1-4777-b693-300232653767 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:42.101825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9522ba-5bc1-4777-b693-300232653767 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:42.102643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9522ba-5bc1-4777-b693-300232653767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:42.177340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9c9522ba-5bc1-4777-b693-300232653767 None None] MFA Rules not processed for user `7e9a0befa1584e64870462d780dcfc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:42.180179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c9522ba-5bc1-4777-b693-300232653767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.325722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ba29-e172-4796-adc5-7eed1cfd0046 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:42.327612 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1791/3615] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:42.329569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:42.330033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:42.330523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:42.344507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:42.346076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:42.346076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:42.346580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:42.351335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.369941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:42.372246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.511716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:42.517185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:42.523122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:42.541881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1792/3616] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:42.576835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:42.582522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.596676 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1825/3617] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:42.735480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:42.864160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3611837-4cf2-4582-b032-0454da693d79 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:42.875561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:42.877039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:42.877503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:42.878198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:42.898025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:42.901561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:42.920736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1793/3618] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:42.957568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:42.960547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:42.997638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75a3b-6ba5-425b-9f5a-80e67b2d71bd service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:43.011703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:43.013501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:43.014760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:43.015496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] PATH_INFO: `/v3/projects/775f2ac906644d03883ec1451343e9f8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:43.040710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775f2ac906644d03883ec1451343e9f8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:43.041029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:43.267817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:43.312036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fecf08-5040-4c43-baca-1676a7e5182e service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:43.325957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775f2ac906644d03883ec1451343e9f8', 'request_id': 'req-cb5fde35-02de-4eb7-a929-151315fab936'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:43.427021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775f2ac906644d03883ec1451343e9f8', 'request_id': 'req-cb5fde35-02de-4eb7-a929-151315fab936'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:43.461072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775f2ac906644d03883ec1451343e9f8', 'request_id': 'req-cb5fde35-02de-4eb7-a929-151315fab936'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:43.482754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:43.488278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:43.489018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:43.489755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:43.492783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] The token cache is being invalidate because project 775f2ac906644d03883ec1451343e9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:43.493271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:43.494705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:43.500203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:43.505521 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1826/3619] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:42 2022] DELETE /identity/v3/projects/775f2ac906644d03883ec1451343e9f8 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:43.507826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:43.511455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:43.688078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:43.691299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde35-02de-4eb7-a929-151315fab936 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:43.692319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e46153-b38c-4b39-ac22-789f3db96a20 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:43.713073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:43.714900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:43.715106 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1794/3620] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:44:43.718274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:43.719491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] PATH_INFO: `/v3/users/7b87e0dbec0e44579af07ed8f20c47e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:43.726124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b87e0dbec0e44579af07ed8f20c47e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:43.729288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:44.122865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b87e0dbec0e44579af07ed8f20c47e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:44.127066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b87e0dbec0e44579af07ed8f20c47e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:44.244621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b87e0dbec0e44579af07ed8f20c47e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:44.290503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:44.295124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b87e0dbec0e44579af07ed8f20c47e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:44.314871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e39b8ecf-f2f6-4f7c-93ab-14f566a556c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b87e0dbec0e44579af07ed8f20c47e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:44.338778 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1827/3621] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:43 2022] DELETE /identity/v3/users/7b87e0dbec0e44579af07ed8f20c47e9 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:44.357115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:44.357804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:44.359639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:44.382889 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:44.384682 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:44.386387 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1795/3622] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:44:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:44:45.577371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3690-97fb-4b97-8c53-8e77c9d350e1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:45.579335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3690-97fb-4b97-8c53-8e77c9d350e1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:45.580552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3690-97fb-4b97-8c53-8e77c9d350e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:45.695443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c89a3690-97fb-4b97-8c53-8e77c9d350e1 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:45.701378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c89a3690-97fb-4b97-8c53-8e77c9d350e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:45.945662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1828/3623] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:44:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:45.992195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:45.997768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:46.012897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:46.013602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:46.014330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:46.047589 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:46.049175 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:44:46.103553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1829/3624] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:44:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:44:46.103553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:46.103553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:46.531589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182acb-23f7-411e-86a5-01679dd74abb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:46.576762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:46.577910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:46.579591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:46.580398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:46.584136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:46.623952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:46.634643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:46.680184 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1830/3625] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:46.760090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:46.801796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7cf5-3e26-47e1-8198-0d1db1629083 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:46.816138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:46.817319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:46.818018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:46.818528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:46.844957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:46.847413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:46.884966 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1796/3626] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 893 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:46.956555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:46.964770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:47.216370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608b40-d0f2-4928-a22b-13ac6b79f390 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:47.227541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:47.228771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:47.229335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:47.229827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] PATH_INFO: `/v3/projects/40ecc491752a4d96ad62543799759912` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:47.233843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ecc491752a4d96ad62543799759912)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:47.239164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:47.349710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:47.613681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ecc491752a4d96ad62543799759912', 'request_id': 'req-65e6223a-cd16-4e08-b39e-ed531a5baeca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:47.709804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:47.714096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:47.726402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ecc491752a4d96ad62543799759912', 'request_id': 'req-65e6223a-cd16-4e08-b39e-ed531a5baeca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:47.754817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ecc491752a4d96ad62543799759912', 'request_id': 'req-65e6223a-cd16-4e08-b39e-ed531a5baeca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:47.782500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c02f9-7788-46aa-8e68-bf126033e5c7 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:47.810875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] The token cache is being invalidate because project 40ecc491752a4d96ad62543799759912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:47.811901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:47.816014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e6223a-cd16-4e08-b39e-ed531a5baeca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:47.830689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1831/3627] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:46 2022] DELETE /identity/v3/projects/40ecc491752a4d96ad62543799759912 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:47.836248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f7c-3e5c-4fcb-8b02-bd980a2106a0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:47.847328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f7c-3e5c-4fcb-8b02-bd980a2106a0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:47.850015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f7c-3e5c-4fcb-8b02-bd980a2106a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:47.960292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e3889f7c-3e5c-4fcb-8b02-bd980a2106a0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:47.965024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3889f7c-3e5c-4fcb-8b02-bd980a2106a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:48.135317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:48.136402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:48.136940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:48.137413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] PATH_INFO: `/v3/users/5e0144899b8946309d4524a4cf515d98` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:48.141281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0144899b8946309d4524a4cf515d98)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:48.153739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:48.244735 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1832/3628] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:48.249475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07fc71-4d59-49af-a9ce-bbca70ffb700 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:48.250497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07fc71-4d59-49af-a9ce-bbca70ffb700 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:48.250838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07fc71-4d59-49af-a9ce-bbca70ffb700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:48.301837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7a07fc71-4d59-49af-a9ce-bbca70ffb700 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:48.305054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7a07fc71-4d59-49af-a9ce-bbca70ffb700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:48.527368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0144899b8946309d4524a4cf515d98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:48.585953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1833/3629] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:44:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:48.625192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beac14-b207-4131-b39e-0e10eb3560b6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:48.634519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beac14-b207-4131-b39e-0e10eb3560b6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:48.636120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beac14-b207-4131-b39e-0e10eb3560b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:48.637472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0144899b8946309d4524a4cf515d98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:48.658182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0144899b8946309d4524a4cf515d98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:48.688760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-63beac14-b207-4131-b39e-0e10eb3560b6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:48.692715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-63beac14-b207-4131-b39e-0e10eb3560b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:48.703197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0144899b8946309d4524a4cf515d98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:48.705059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0144899b8946309d4524a4cf515d98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:48.720362 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1797/3630] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:47 2022] DELETE /identity/v3/users/5e0144899b8946309d4524a4cf515d98 => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:48.740020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:48.748136 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1834/3631] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:48.750276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:48.759338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:48.759882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:48.760307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:48.816654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:48.820076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:48.965570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:49.039421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1835/3632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:49.039421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:49.062936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07602f-5e32-4808-ab21-8d4b43e26e8d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:49.073913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185498-2001-4d0f-b6f2-3672ad804bc7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:49.085809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:49.087285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:49.087805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:49.088254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:49.089147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:49.091498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:49.091861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:49.094463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:49.096191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:49.098184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:44:49.114700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:49.115541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:49.123360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:49.165327 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1836/3633] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:49.167612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:49.175672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:49.365726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:49.366267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8bf5-8ca9-484e-a424-c64dc77b6dbe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:49.369347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:49.385860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:49.389848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:49.391119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1798/3634] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:49.391598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:49.393595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:49.394399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:49.422288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556460-d5dd-4d8a-a1cf-2ea8a5e7d8a9 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:49.436135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:49.438101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:49.440955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:49.440955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:49.442904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:49.443646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:49.446974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:49.449536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:49.470984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1837/3635] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:49.625860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1799/3636] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:49 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:49.627084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:49.655764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2b63-cda8-4223-8f67-72fa2c82a692 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:49.886989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:49.890310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:49.891468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:49.892708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:49.893994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:49.899880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:50.118606 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1838/3637] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:49 2022] POST /identity/v3/users => generated 288 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:50.129213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:50.176106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c5ebb-94b5-4e4b-afa4-6ca34f454c03 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:50.193146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:50.193446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:50.194516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:50.194951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:50.196094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:50.198886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:50.226674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1800/3638] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:50.232324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:50.265370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a53d0-8cf8-45dd-88ae-97aab4d9b7ab admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:50.276110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:50.277137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:50.277521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:50.278035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:50.280377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:50.285290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662b98c-01dd-40a9-9732-a51c3ed438d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:50.314386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1839/3639] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:50.319654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:50.340445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181da9-620e-4d0e-ab3e-727914690a1e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:50.349850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:50.352337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:50.352337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:50.352739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] PATH_INFO: `/v3/projects/ec86540d601d461ea5b60ed430728da5/users/08fa6761a69f4ca3acf597b988dfafc4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:50.393218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec86540d601d461ea5b60ed430728da5, user_id=08fa6761a69f4ca3acf597b988dfafc4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:50.399913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:50.529695 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1801/3640] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:50 2022] PUT /identity/v3/projects/ec86540d601d461ea5b60ed430728da5/users/08fa6761a69f4ca3acf597b988dfafc4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:50.534296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:50.535356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:50.537974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:50.640999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] MFA Rules not processed for user `08fa6761a69f4ca3acf597b988dfafc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:50.646144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:50.888686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:50.957679 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1840/3641] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:50.964963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:51.127242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697564da-d7ef-47d9-b6ed-d227c768a1b5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:51.137632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:51.139959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:51.140576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:51.141108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:51.142480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:51.146951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:51.332859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:51.336145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:51.345112 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1802/3642] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:50 2022] POST /identity/v3/projects => generated 377 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:51.350298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:51.408560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb43a78-f9b8-48df-9826-1593a15b2e2a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:51.603513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:51.690892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f26d6-d1bf-4407-81ea-d39cdc153fd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:51.714415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:51.715529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:51.718199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:51.718199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:51.718199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:51.728906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:51.733770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:51.736907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:51.738156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:51.738944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] PATH_INFO: `/v3/projects/b46055f08aae47a99a59e1192db71b8e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:51.744400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46055f08aae47a99a59e1192db71b8e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:51.752249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:51.900589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1803/3643] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:51 2022] POST /identity/v3/users => generated 295 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:51.903416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:51.950832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e609c1d-1919-45b5-8664-6b749f8b1ed9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:51.973531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:51.974542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:51.975066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:51.975585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:51.977045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:51.980257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:52.031736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1804/3644] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:44:52.033356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:52.080120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eab2b9-7ed7-4c9c-850f-f08fa1b9d211 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:52.120459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46055f08aae47a99a59e1192db71b8e', 'request_id': 'req-95e611a8-f92f-47ed-a592-f94b057456ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:52.229794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:52.231565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.232978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.232978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] PATH_INFO: `/v3/projects/063d5f74c5fc4da79ff187defa4e65fe/users/11390e9dea0e45c68d71f242d6cf8027/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.295336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063d5f74c5fc4da79ff187defa4e65fe, user_id=11390e9dea0e45c68d71f242d6cf8027, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:52.299651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46055f08aae47a99a59e1192db71b8e', 'request_id': 'req-95e611a8-f92f-47ed-a592-f94b057456ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:52.301267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:52.323307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46055f08aae47a99a59e1192db71b8e', 'request_id': 'req-95e611a8-f92f-47ed-a592-f94b057456ad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:52.358971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] The token cache is being invalidate because project b46055f08aae47a99a59e1192db71b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:52.360485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:52.363825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95e611a8-f92f-47ed-a592-f94b057456ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:52.369140 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1841/3645] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:51 2022] DELETE /identity/v3/projects/b46055f08aae47a99a59e1192db71b8e => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:52.376939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ccb23-3e16-4914-b096-a893bd02743f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.378442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ccb23-3e16-4914-b096-a893bd02743f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.379531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ccb23-3e16-4914-b096-a893bd02743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.431187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-226ccb23-3e16-4914-b096-a893bd02743f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:52.435074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-226ccb23-3e16-4914-b096-a893bd02743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:52.456726 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1842/3646] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:52.473316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.473825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.474327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.515588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1805/3647] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:52 2022] PUT /identity/v3/projects/063d5f74c5fc4da79ff187defa4e65fe/users/11390e9dea0e45c68d71f242d6cf8027/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:52.522604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:52.539753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:52.540639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:52.552545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:52.695272 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1843/3648] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:52.712228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:52.728641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:52.744098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca9d9-c823-4c45-9044-dc2a6103d164 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:52.758788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:52.760540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.761152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.761926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.770033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:44:52.770033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:52.770033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:52.805927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1844/3649] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:52.812804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:52.837496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69795c-7c8d-427e-acdb-d4a7bdb22064 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:52.846726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:52.849059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.849857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.850917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.853409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:52.865295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:52.874600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381bdda-bce3-407d-929a-3f294bd55fd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:52.912540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:52.913834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.914292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.914832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.915992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:52.921256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:52.949007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1806/3650] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:44:52.957554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:52.982083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6de4e-a34b-4721-a8f6-b7fa50a08d88 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:52.992764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:52.993973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:52.994532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:52.994977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] PATH_INFO: `/v3/projects/063d5f74c5fc4da79ff187defa4e65fe/users/11390e9dea0e45c68d71f242d6cf8027/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:52.999732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=063d5f74c5fc4da79ff187defa4e65fe, user_id=11390e9dea0e45c68d71f242d6cf8027, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.005653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d879e2-8153-4605-90c7-b227e62e77ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.036771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1807/3651] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:52 2022] PUT /identity/v3/projects/063d5f74c5fc4da79ff187defa4e65fe/users/11390e9dea0e45c68d71f242d6cf8027/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:53.058837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d83-2043-4912-956a-db092691c2b3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.059484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d83-2043-4912-956a-db092691c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.059858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d83-2043-4912-956a-db092691c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.108485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1845/3652] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:44:52 2022] POST /identity/v3/projects => generated 397 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:44:53.115738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.165757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-15924d83-2043-4912-956a-db092691c2b3 None None] MFA Rules not processed for user `11390e9dea0e45c68d71f242d6cf8027`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:53.172582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15924d83-2043-4912-956a-db092691c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:53.210460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:53.410351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298fb9e-03f9-4e8d-b9aa-fd0d0daaf602 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.437561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.438014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.438715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.438870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.440016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.443379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.502277 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1808/3653] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:53.508811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924d83-2043-4912-956a-db092691c2b3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.532071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924d83-2043-4912-956a-db092691c2b3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.548796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.550555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.551834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.552556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.569205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.574552 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:53.574552 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:53.574552 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:53.579416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.612103 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1846/3654] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:44:53 2022] POST /identity/v3/users => generated 299 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:53.614424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.643030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694205-f8cc-4514-8cee-04244c6307d9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.662096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.663225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.663755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.664127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.665136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.667578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.705480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1847/3655] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:44:53.712560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.751287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4ccf7-b092-4caa-9eb1-82363269e903 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.778350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.778955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.779493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.779984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.781254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.784481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.829913 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1809/3656] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 4 20:44:53 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:53.830806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.837242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1848/3657] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:44:53.843946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:53.874259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115e44c-a730-415a-bd52-b609259d4a39 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.876561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc57de-4ec3-407a-ae02-15e08243e5a5 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:53.889915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.893255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.893255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.893255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0846d49d8d124f52aaee3e284e5193d9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.893757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:53.894558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0846d49d8d124f52aaee3e284e5193d9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:53.894994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:53.897855 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:53.897855 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:53.897855 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:53.898788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:53.899472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] PATH_INFO: `/v3/projects/104842f18dae47dcaab4e91bca1e5d7c/users/eb630c940efb4637b63a798b3e6d1172/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:53.900336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:53.938381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1810/3658] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:53 2022] GET /identity/v3/OS-OAUTH1/consumers/0846d49d8d124f52aaee3e284e5193d9 => generated 219 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:54.130159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104842f18dae47dcaab4e91bca1e5d7c, user_id=eb630c940efb4637b63a798b3e6d1172, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:54.130159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5a50-4423-4618-be12-9ddb15c10a85 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:54.130762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:54.156032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948bfa-5f25-43fb-9057-0f0e5d4d1af1 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:54.190371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:54.199763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:54.200599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:54.201466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0846d49d8d124f52aaee3e284e5193d9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:54.210041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0846d49d8d124f52aaee3e284e5193d9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:54.220014 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:54.220014 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:54.220014 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:54.224683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:54.226158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer 0846d49d8d124f52aaee3e284e5193d9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:54.226974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:54.230133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:54.359682 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1849/3659] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:44:53 2022] PUT /identity/v3/projects/104842f18dae47dcaab4e91bca1e5d7c/users/eb630c940efb4637b63a798b3e6d1172/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:44:54.383301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3e87-1924-4ae1-9f37-70bdc69fb5bb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:54.384034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3e87-1924-4ae1-9f37-70bdc69fb5bb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:54.384708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3e87-1924-4ae1-9f37-70bdc69fb5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:54.488737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0846d49d8d124f52aaee3e284e5193d9', 'request_id': 'req-bd5cd4e7-5d87-411a-9134-56eee8e9c434'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:54.493574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-db2f3e87-1924-4ae1-9f37-70bdc69fb5bb None None] MFA Rules not processed for user `eb630c940efb4637b63a798b3e6d1172`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:54.495788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db2f3e87-1924-4ae1-9f37-70bdc69fb5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:54.638603 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1811/3660] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:54 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0846d49d8d124f52aaee3e284e5193d9 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:54.644497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:54.652181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:54.709854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd4e7-5d87-411a-9134-56eee8e9c434 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:54.779051 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1850/3661] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:54.782579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:54.783100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:54.783649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:54.799499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:54.860411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] MFA Rules not processed for user `91627f3584b0402896fd6e64b421b458`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:54.868230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:55.076290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:55.078163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:55.082486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:55.082891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:55.085867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:55.095901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:55.156937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1851/3662] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:55.156937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:55.156937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:55.283714 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1812/3663] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 4 20:44:54 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:55.291324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:55.329097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32764b1-8128-4d63-96a3-765cb91b645e tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:55.364356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:55.364356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:55.365763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:55.365763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:55.371158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bda246f39ce741d6bc7aa7b994eaf017)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:55.383867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:55.416331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ff641-9914-4a07-acd1-6608e7bd6708 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:55.426413 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1813/3664] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:55 2022] GET /identity/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017 => generated 221 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:44:55.427881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:55.441884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:55.443250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:55.444199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:55.446474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:55.490950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0f78a-7076-43b5-b971-7f3a1597fa96 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:55.492590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:55.496139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:55.523380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:55.524848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:55.525511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:55.526660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:55.527061 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1852/3665] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:44:55.528282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bda246f39ce741d6bc7aa7b994eaf017)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:55.532027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:55.539061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer bda246f39ce741d6bc7aa7b994eaf017 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:55.539061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:55.539061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:55.656150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:55.659239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:55.675917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bda246f39ce741d6bc7aa7b994eaf017', 'request_id': 'req-fbd704ab-d182-4af4-b3da-02bc52a14fd0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:55.890446 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1814/3666] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:55.898202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:55.905396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:56.005437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd704ab-d182-4af4-b3da-02bc52a14fd0 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.044002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:56.045845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4f1f-86e0-4af9-a6a6-b91373e626d2 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.048302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.048771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.049253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.052679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bda246f39ce741d6bc7aa7b994eaf017)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:56.060087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:56.080151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:56.084097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.084616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.085073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] PATH_INFO: `/v3/users/eb630c940efb4637b63a798b3e6d1172` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.089801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb630c940efb4637b63a798b3e6d1172)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:56.104097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 04 20:44:56.127280 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 04 20:44:56.129444 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:56.133895 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1815/3667] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:55 2022] GET /identity/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017 => generated 74 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:44:56.137277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:56.195203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f5e25-6fb3-4fe7-ae64-ba123ac656f3 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.242932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:56.244367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.246913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.247699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.249931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bda246f39ce741d6bc7aa7b994eaf017)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:56.257645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:56.258344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer bda246f39ce741d6bc7aa7b994eaf017 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:56.259191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.260662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.266036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 04 20:44:56.306373 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 04 20:44:56.308343 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:56.321988 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1816/3668] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bda246f39ce741d6bc7aa7b994eaf017 => generated 74 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 20:44:56.325487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:56.330500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:56.370553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c1d0-b9f5-41fc-be17-acf664b1a980 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.387979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:56.390343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.392350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.393373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.395501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:56.407710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:56.544073 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1817/3669] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 4 20:44:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:56.547212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:56.552454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:56.590933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dabf6-526f-4ad2-be8c-0722b25c6d94 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.595640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb630c940efb4637b63a798b3e6d1172'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.597645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb630c940efb4637b63a798b3e6d1172'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.620565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:56.621730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.622642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.622984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.624399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:56.649169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:56.738302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb630c940efb4637b63a798b3e6d1172'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.794347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb630c940efb4637b63a798b3e6d1172'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.817560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5798e15-5a9c-4da9-a8ac-338a33d03fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb630c940efb4637b63a798b3e6d1172'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:56.831632 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1818/3670] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 4 20:44:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:56.839010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:56.843331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:56.847095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1853/3671] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:55 2022] DELETE /identity/v3/users/eb630c940efb4637b63a798b3e6d1172 => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:56.853516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:56.858776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:56.859897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:56.903580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:44:56.903881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62ecf9-fd70-493c-8422-fc6872686277 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:56.906744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:57.082024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1854/3672] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:44:57.156257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:57.158754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:57.187005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:57.188651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:57.191023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:57.192147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:57.200319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:57.208925 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:57.208925 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:44:57.208925 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:44:57.212771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:57.235876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1819/3673] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 4 20:44:56 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:44:57.239925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:57.265213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df257c-dc4a-459f-8a05-da1545780925 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:57.274835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:57.276213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:57.277033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:57.277331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0ec195c608824dc8a131733fe39608c0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:57.279060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0ec195c608824dc8a131733fe39608c0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:57.281815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:57.283415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer 0ec195c608824dc8a131733fe39608c0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:57.284275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:57.285350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:57.319483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51d58-2090-4a53-9f5b-1a21a20987e5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:57.327625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:57.329010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:57.329585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:57.330392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:57.334664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:57.356081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:57.359216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:57.382844 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1855/3674] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:44:57.399576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0ec195c608824dc8a131733fe39608c0', 'request_id': 'req-c3e4646e-35fd-48e6-9e1c-95ccd6318871'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:57.556839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1820/3675] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0ec195c608824dc8a131733fe39608c0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:57.563793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:57.566188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:57.644560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de3ca-4f70-455a-b387-b8ccdc4d1e54 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:57.671576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:57.677098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:57.677098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:57.677098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ded39370394e42378b671eb42e151205` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:57.677098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ded39370394e42378b671eb42e151205)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:57.677457 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:57.677457 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:57.677457 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:57.677457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:57.677457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer ded39370394e42378b671eb42e151205 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:57.687638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:57.692653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:57.870363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ded39370394e42378b671eb42e151205', 'request_id': 'req-2714cefa-3dad-4e80-b950-1b61c12d5f0f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:58.029805 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1856/3676] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ded39370394e42378b671eb42e151205 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:58.038860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:58.102960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4646e-35fd-48e6-9e1c-95ccd6318871 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:58.141901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:58.145470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:58.146296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:58.148478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:58.151866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:58.157507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:58.317715 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1821/3677] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 4 20:44:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:44:58.317976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:58.320723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:58.348184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cefa-3dad-4e80-b950-1b61c12d5f0f tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:58.358834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:58.364968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:58.366073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:58.366887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:58.368304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=8bcac18392f5464e8a63138f0496377c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:58.370657 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:44:58.370657 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:44:58.370657 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:44:58.373483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:58.498583 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1857/3678] 10.222.0.78 () {60 vars in 1285 bytes} [Tue Oct 4 20:44:58 2022] PATCH /identity/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c => generated 220 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:58.508264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:58.556373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624bd0-8555-4572-b1b2-ba363927a2ee tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:58.579767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:58.579767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:58.579767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:58.580301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:58.581588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8bcac18392f5464e8a63138f0496377c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:58.585801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283500-b138-45cc-8910-a7d8c0a27bda tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:58.611105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1822/3679] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:58 2022] GET /identity/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c => generated 220 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:44:58.625314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:58.660326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ba940-a92a-4128-9588-3bb5e4772b76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:58.685565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11390e9dea0e45c68d71f242d6cf8027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '063d5f74c5fc4da79ff187defa4e65fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:58.687593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:58.689050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:58.689482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:58.691014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8bcac18392f5464e8a63138f0496377c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:58.696669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:58.701241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invalidating token cache because consumer 8bcac18392f5464e8a63138f0496377c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:44:58.701241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:58.701241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:58.720167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:58.853810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8bcac18392f5464e8a63138f0496377c', 'request_id': 'req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:58.959294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:58.960396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:58.961002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:59.021295 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1858/3680] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:44:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8bcac18392f5464e8a63138f0496377c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:44:59.021789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:44:59.023224 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:44:59.025106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:59.025253 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1823/3681] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:44:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:44:59.028808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:59.086730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2d9c2-bab1-445e-b7da-6ecbe5ff1e76 tempest-OAUTHConsumersV3Test-1294307234 tempest-OAUTHConsumersV3Test-1294307234-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:59.122524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:59.124354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:59.124354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:59.124816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] PATH_INFO: `/v3/users/08fa6761a69f4ca3acf597b988dfafc4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:59.130568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fa6761a69f4ca3acf597b988dfafc4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:59.143724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:59.464563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:44:59.470857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:44:59.604628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fa6761a69f4ca3acf597b988dfafc4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:59.607103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fa6761a69f4ca3acf597b988dfafc4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:59.729919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad210877-c749-4cf9-b112-a327a168a898 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:44:59.745613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:44:59.748580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:44:59.751014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:44:59.759371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] PATH_INFO: `/v3/projects/104842f18dae47dcaab4e91bca1e5d7c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:44:59.759371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104842f18dae47dcaab4e91bca1e5d7c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:44:59.769076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:44:59.790754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fa6761a69f4ca3acf597b988dfafc4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:59.861238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fa6761a69f4ca3acf597b988dfafc4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:44:59.927547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c72d35c3-d4f9-4c8d-95a1-db084b037fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fa6761a69f4ca3acf597b988dfafc4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.000003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1859/3682] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:44:59 2022] DELETE /identity/v3/users/08fa6761a69f4ca3acf597b988dfafc4 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:00.007888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:00.009389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:00.010421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:00.098937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:00.102337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:00.148929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:00.157405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104842f18dae47dcaab4e91bca1e5d7c', 'request_id': 'req-31118f40-77c2-4585-ab95-8f4de4606c56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.175731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104842f18dae47dcaab4e91bca1e5d7c', 'request_id': 'req-31118f40-77c2-4585-ab95-8f4de4606c56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.244208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104842f18dae47dcaab4e91bca1e5d7c', 'request_id': 'req-31118f40-77c2-4585-ab95-8f4de4606c56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.351852 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1860/3683] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:00.353466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:00.359232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:00.381696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] The token cache is being invalidate because project 104842f18dae47dcaab4e91bca1e5d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:00.382380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.386221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.398990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1824/3684] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:44:59 2022] DELETE /identity/v3/projects/104842f18dae47dcaab4e91bca1e5d7c => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:00.405851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:00.410525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:00.445942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab5f50-159e-4a55-b2d2-d7b4bc8ce3c6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:00.467893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:00.472115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:00.473985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:00.476387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] PATH_INFO: `/v3/users/7e9a0befa1584e64870462d780dcfc1f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:00.481975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9a0befa1584e64870462d780dcfc1f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:00.517223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:00.703518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118f40-77c2-4585-ab95-8f4de4606c56 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:00.724979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:00.726536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:00.727219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:00.727979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:00.738570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:00.891545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:00.896336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eaacc-8def-407c-b4c5-1f1b9f5488ab service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:00.949090 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1825/3685] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:00.952294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb144ec-f743-46b5-b6e7-3c06adaf5abb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:00.956526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb144ec-f743-46b5-b6e7-3c06adaf5abb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:00.956526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb144ec-f743-46b5-b6e7-3c06adaf5abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:00.976156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9a0befa1584e64870462d780dcfc1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:00.984422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9a0befa1584e64870462d780dcfc1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:01.017541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-deb144ec-f743-46b5-b6e7-3c06adaf5abb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:01.023689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deb144ec-f743-46b5-b6e7-3c06adaf5abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:01.102555 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1826/3686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:01.119716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:01.121525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:01.121525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:01.152583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9a0befa1584e64870462d780dcfc1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:01.157666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=20,keystone:SELECT=77,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:01.202890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:01.207749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:01.215263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9a0befa1584e64870462d780dcfc1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:01.266840 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1827/3687] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:45:01.271231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:01.280214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9a0befa1584e64870462d780dcfc1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:01.303508 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1861/3688] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:00 2022] DELETE /identity/v3/users/7e9a0befa1584e64870462d780dcfc1f => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:01.309899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7698d5e-d01a-498d-8910-5876c28ec0c0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:01.585116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:01.586588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:01.588589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:01.589314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:01.591270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:01.592258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:01.596734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:01.652062 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1828/3689] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:45:01.658475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:01.667009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:01.857191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339653-9857-449a-a1a5-017cf72ac1b7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:01.887346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:01.888474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:01.888987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:01.890340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:01.890980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:01.895429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:02.207795 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1862/3690] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:01 2022] POST /identity/v3/projects => generated 375 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:02.212845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:02.266835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73175e-6c3b-4c78-9194-03a0b94b7b3f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:02.372433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:02.493393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:02.495364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:02.497481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:02.498809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:02.505850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:02.514106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:02.745720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1829/3691] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:02 2022] POST /identity/v3/users => generated 288 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:02.752306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:02.769256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92349c-ab20-4b0a-bcaf-b2edbdcc182b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:02.778705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:02.779980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:02.780492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:02.781099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:02.783670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:02.786646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:02.810210 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1863/3692] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:02.815937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:02.843077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727195b3-0d91-45e8-bdd7-bfb4e805586f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:02.862539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:02.864865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:02.865865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:02.866922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:02.868837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:02.874060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c18f0-049a-4277-9e18-766b0a3714a0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:02.976461 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1830/3693] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:02.983339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:03.038521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89f0d-8dca-42d1-8aa1-b788dd939ebe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:03.055122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:03.058713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:03.061793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:03.064633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] PATH_INFO: `/v3/projects/649d27ef54104cce8d99a13d9d49da3a/users/ab7b3c3e499f44de893ccc5a57912701/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:03.157286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649d27ef54104cce8d99a13d9d49da3a, user_id=ab7b3c3e499f44de893ccc5a57912701, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:03.187320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:03.353902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1864/3694] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:02 2022] PUT /identity/v3/projects/649d27ef54104cce8d99a13d9d49da3a/users/ab7b3c3e499f44de893ccc5a57912701/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:03.375779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84cb38-477b-4284-8223-45464abc441b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:03.376580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84cb38-477b-4284-8223-45464abc441b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:03.376772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84cb38-477b-4284-8223-45464abc441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:03.481117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9d84cb38-477b-4284-8223-45464abc441b None None] MFA Rules not processed for user `ab7b3c3e499f44de893ccc5a57912701`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:03.493640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d84cb38-477b-4284-8223-45464abc441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:03.664426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:03.670584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:03.693029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1831/3695] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:03.723178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84cb38-477b-4284-8223-45464abc441b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:03.728769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d84cb38-477b-4284-8223-45464abc441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:04.002581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87f0-b8e0-416f-b5c1-4190ebbd9f73 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:04.025873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:04.025873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:04.025873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:04.026470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] PATH_INFO: `/v3/projects/ec86540d601d461ea5b60ed430728da5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:04.031268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec86540d601d461ea5b60ed430728da5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:04.040166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:04.142195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84cb38-477b-4284-8223-45464abc441b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:04.157679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:04.159435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:04.160313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:04.161039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:04.182816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:04.187929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdce03-7be1-4363-9bae-ec0338577ab7 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:04.231627 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1832/3696] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:45:04.242177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:04.248326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:04.255165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:04.326106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec86540d601d461ea5b60ed430728da5', 'request_id': 'req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:04.339663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:04.367024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:04.377946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:04.460485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec86540d601d461ea5b60ed430728da5', 'request_id': 'req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:04.502867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec86540d601d461ea5b60ed430728da5', 'request_id': 'req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:04.558382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] The token cache is being invalidate because project ec86540d601d461ea5b60ed430728da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:04.558923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:04.560494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:04.576252 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1865/3697] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:03 2022] DELETE /identity/v3/projects/ec86540d601d461ea5b60ed430728da5 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:04.578032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:04.581066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:04.628062 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1833/3698] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:04.629773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:04.642382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:04.872372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efea7d8-5f4d-4dcb-b4d0-7fb1f0f53eb4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:04.891470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:04.892504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:04.892931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:04.895325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] PATH_INFO: `/v3/projects/9d5c0142707c420798e04f8826804031` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:04.895684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5c0142707c420798e04f8826804031)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:04.899037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:04.966773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c11d-273f-4342-8910-8235584ec293 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:04.997817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:04.998527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:04.998948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:04.999208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] PATH_INFO: `/v3/users/11390e9dea0e45c68d71f242d6cf8027` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:05.002408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11390e9dea0e45c68d71f242d6cf8027)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:05.008700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:05.238768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5c0142707c420798e04f8826804031', 'request_id': 'req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.392977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11390e9dea0e45c68d71f242d6cf8027'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.439531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5c0142707c420798e04f8826804031', 'request_id': 'req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.441205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:05.488767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5c0142707c420798e04f8826804031', 'request_id': 'req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.557856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] The token cache is being invalidate because project 9d5c0142707c420798e04f8826804031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:05.558400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.564145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.567893 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1866/3699] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:04 2022] DELETE /identity/v3/projects/9d5c0142707c420798e04f8826804031 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:05.571090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:05.581160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:05.676485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11390e9dea0e45c68d71f242d6cf8027'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.715388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11390e9dea0e45c68d71f242d6cf8027'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.767571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11390e9dea0e45c68d71f242d6cf8027'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.768914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f0ad0aa-f81e-4832-b6a6-e4945d64dfd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11390e9dea0e45c68d71f242d6cf8027'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:05.815521 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1834/3700] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:04 2022] DELETE /identity/v3/users/11390e9dea0e45c68d71f242d6cf8027 => generated 0 bytes in 1187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:05.824423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374401f3-1ebf-41d4-8187-51f8ee656411 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:05.827948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374401f3-1ebf-41d4-8187-51f8ee656411 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:05.829879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374401f3-1ebf-41d4-8187-51f8ee656411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:05.891305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-374401f3-1ebf-41d4-8187-51f8ee656411 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:05.894278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-374401f3-1ebf-41d4-8187-51f8ee656411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:05.931742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2995-a8d5-42c7-9f33-f82677eaa1c8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:06.129860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1835/3701] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:06.132300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.132801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.135860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.138990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:06.140326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.141170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.141874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.145710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:06.171788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:06.178157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:06.202467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1867/3702] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:06.204859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:06.207765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:06.261769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a4cc-8cda-47df-baf1-5482719c524e service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:06.272410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:06.274000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.274256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.278732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.300864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:06.304563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5c964-14e9-4153-a5b1-f5ba8bf943e0 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:06.326061 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1868/3703] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:06.366080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:06.368536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:06.650740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1836/3704] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:06.670035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.670709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.671047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.736466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:06.742932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:06.758485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:06.762347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:06.796701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9e8e-2ac3-447f-b852-59f5af790ec0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:06.807464 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1869/3705] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:06.809639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:06.815966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:06.816971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.817429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.818194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] PATH_INFO: `/v3/users/ef3619bf0324455db92ef500f16c664f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.822230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3619bf0324455db92ef500f16c664f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:06.826944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:06.830364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0371b-f3a8-4657-bc32-38c91434f09f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:06.839749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:06.840860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.841362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.841857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.843285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:06.844251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:06.848252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:06.886193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1870/3706] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:06.888348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:06.913356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b47a-2ff5-4cc1-97ff-faad21fdb2e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:06.926149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:06.928083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:06.929464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:06.930531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:06.932340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:06.937523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:07.333451 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1871/3707] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:06 2022] POST /identity/v3/projects => generated 359 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:07.336143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:07.434880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3619bf0324455db92ef500f16c664f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:07.548043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2572-fae0-4b38-8583-95a51679fc80 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:07.561355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3619bf0324455db92ef500f16c664f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:07.576668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:07.578029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:07.579346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:07.580189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:07.587241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3619bf0324455db92ef500f16c664f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:07.600139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:07.613653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:07.653269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:07.660676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3619bf0324455db92ef500f16c664f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:07.661932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3619bf0324455db92ef500f16c664f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:07.699379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:07.707298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1837/3708] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:06 2022] DELETE /identity/v3/users/ef3619bf0324455db92ef500f16c664f => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:07.714017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:07.727384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:07.791226 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1872/3709] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:07 2022] POST /identity/v3/users => generated 280 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:07.797782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:07.805467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:07.842332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f09a-6019-4ed3-98c1-823416138b6d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:07.966893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e83d0-9eca-4b3b-8614-d7cc5b7e8438 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:07.980430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:07.981901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:07.985724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:07.985724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] PATH_INFO: `/v3/projects/063d5f74c5fc4da79ff187defa4e65fe` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:07.987770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063d5f74c5fc4da79ff187defa4e65fe)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:07.999397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:08.049773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:08.053159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:08.054507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:08.055498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:08.057584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:08.067479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:08.103785 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1873/3710] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:08.129836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:08.166326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14b7bb-077c-4f25-aee3-b8b6867c6eec admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:08.187393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:08.188732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:08.188732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:08.189285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:08.190135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:08.197797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:08.291980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1874/3711] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:08.303062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:08.366510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff08bc-7b63-40ba-88ee-f7ff9326951d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:08.368573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063d5f74c5fc4da79ff187defa4e65fe', 'request_id': 'req-fed6f038-3962-46f8-9b72-50941ee948c9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:08.404261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063d5f74c5fc4da79ff187defa4e65fe', 'request_id': 'req-fed6f038-3962-46f8-9b72-50941ee948c9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:08.433183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063d5f74c5fc4da79ff187defa4e65fe', 'request_id': 'req-fed6f038-3962-46f8-9b72-50941ee948c9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:08.606694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] The token cache is being invalidate because project 063d5f74c5fc4da79ff187defa4e65fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:08.608000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:08.609736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fed6f038-3962-46f8-9b72-50941ee948c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:08.625361 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1838/3712] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:07 2022] DELETE /identity/v3/projects/063d5f74c5fc4da79ff187defa4e65fe => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:08.630592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:08.631887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:08.632824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:08.772821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:08.785060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:08.831989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:08.834674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:08.835489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:08.840830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] PATH_INFO: `/v3/projects/92a9a9dac9f2406db27f20da0159ebd7/users/8a9cc2e1a46349cf955b986f77916d74/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:08.933869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a9a9dac9f2406db27f20da0159ebd7, user_id=8a9cc2e1a46349cf955b986f77916d74, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:08.963434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f305dd-03e7-41f3-8ebd-29b911bc8e4f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:08.974984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:09.049249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:09.094506 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1839/3713] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:09.097106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:09.102478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:09.143036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11d26-5849-407a-a1cd-3922cbc46f5c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:09.175655 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1875/3714] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:08 2022] PUT /identity/v3/projects/92a9a9dac9f2406db27f20da0159ebd7/users/8a9cc2e1a46349cf955b986f77916d74/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:09.187411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f8cb-e4b3-4b34-864e-17083f3ca190 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:09.187411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f8cb-e4b3-4b34-864e-17083f3ca190 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:09.187411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f8cb-e4b3-4b34-864e-17083f3ca190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:09.290721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0027f8cb-e4b3-4b34-864e-17083f3ca190 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:09.297053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0027f8cb-e4b3-4b34-864e-17083f3ca190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:09.468398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:09.469178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:09.471757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:09.472165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] PATH_INFO: `/v3/projects/35b911873f83408f8831ae7971cf021d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:09.477927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b911873f83408f8831ae7971cf021d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:09.479111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:09.693539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1876/3715] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:09.697538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:09.698465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:09.700717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:09.820526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] MFA Rules not processed for user `8a9cc2e1a46349cf955b986f77916d74`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:09.823210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:09.850961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b911873f83408f8831ae7971cf021d', 'request_id': 'req-06ecae66-e0f7-4f18-8837-0cdf62ca881d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:09.874968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b911873f83408f8831ae7971cf021d', 'request_id': 'req-06ecae66-e0f7-4f18-8837-0cdf62ca881d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:09.895056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:09.908334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b911873f83408f8831ae7971cf021d', 'request_id': 'req-06ecae66-e0f7-4f18-8837-0cdf62ca881d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:10.039341 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1877/3716] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:10.050600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:10.125446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] The token cache is being invalidate because project 35b911873f83408f8831ae7971cf021d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:10.126025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:10.132395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06ecae66-e0f7-4f18-8837-0cdf62ca881d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:10.138062 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1840/3717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:09 2022] DELETE /identity/v3/projects/35b911873f83408f8831ae7971cf021d => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:10.165912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8fa9-3f9b-4467-b53f-882376fdcc67 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:10.166407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8fa9-3f9b-4467-b53f-882376fdcc67 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:10.167758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8fa9-3f9b-4467-b53f-882376fdcc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:10.233480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:10.281882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2d1d8fa9-3f9b-4467-b53f-882376fdcc67 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:10.287822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2d1d8fa9-3f9b-4467-b53f-882376fdcc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:10.339369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973838-c02c-4da1-be99-3e94ffc8b461 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:10.358539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:10.360130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:10.360548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:10.362256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:10.365807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:10.367592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:10.375442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:10.409748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1841/3718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:45:10.423971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:10.425552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:10.433724 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1878/3719] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:10.436879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:10.461331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:10.485948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:10.590426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f983a7-07b5-477f-9ff6-d90b75c9cb0f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:10.616232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:10.621322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:10.625054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:10.627584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:10.628148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:10.628639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:10.629904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:10.640758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:10.660740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1842/3720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:10.668495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:10.692630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:10.761601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606110fe-98f1-4a48-835a-611778c6e09b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:10.782863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:10.784062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:10.784483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:10.784977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] PATH_INFO: `/v3/users/8a9cc2e1a46349cf955b986f77916d74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:10.792870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9cc2e1a46349cf955b986f77916d74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:10.804566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:10.988772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1879/3721] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:10 2022] POST /identity/v3/projects => generated 383 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:10.992381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:11.277373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f2c55-7383-456c-8ce7-5dcc3c2c3169 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:11.291786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:11.293988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:11.294832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:11.295559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:11.298821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:11.299794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:11.308435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:11.363915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9cc2e1a46349cf955b986f77916d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:11.384276 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1880/3722] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:11.385282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:11.440259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf93773-df28-4199-816f-a64dad552145 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:11.467913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:11.471358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:11.472205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:11.472645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:11.478041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:11.495112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:11.532791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9cc2e1a46349cf955b986f77916d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:11.566605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9cc2e1a46349cf955b986f77916d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:11.672502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1881/3723] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:11 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:11.690643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:11.702645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9cc2e1a46349cf955b986f77916d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:11.704327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9cc2e1a46349cf955b986f77916d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:11.733939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cd1b-0998-44f2-a22f-704f0a278310 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:11.740623 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1843/3724] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:10 2022] DELETE /identity/v3/users/8a9cc2e1a46349cf955b986f77916d74 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:11.745074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:11.750228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:11.819309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:12.030614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:12.033984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:12.034938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:12.035656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:12.037708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:12.043233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:12.059939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:12.078469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1456b-3316-4768-bb2a-82723f33e47a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:12.104213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:12.105847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:12.106461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:12.107001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:12.108330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:12.115793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68651d91-22b3-4b5e-9b3c-6731b9adcfd6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:12.166977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1844/3725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:12.169604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:12.170238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:12.170747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:12.257016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:12.261258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:12.278733 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1882/3726] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:11 2022] POST /identity/v3/projects => generated 391 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:12.287471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:12.541292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1845/3727] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:12.541292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:12.559478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:12.627407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ee3cf-f2f5-42d2-afe4-84e6bbd382da None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:12.649165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:12.650847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:12.653549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:12.654777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:12.658630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:12.664346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:12.697270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a731996-38c8-4abb-9224-186569b68fbe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:12.720546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:12.725551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:12.727811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:12.732943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] PATH_INFO: `/v3/projects/d0322ecaba43479982bf40bf4b8c18ae/users/7999be6f59c4494b81ce93fd13ebcc16/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:12.803383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0322ecaba43479982bf40bf4b8c18ae, user_id=7999be6f59c4494b81ce93fd13ebcc16, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:12.820749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:12.902306 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1846/3728] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:12 2022] POST /identity/v3/users => generated 296 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:12.914455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:12.917446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:13.003665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1883/3729] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:12 2022] PUT /identity/v3/projects/d0322ecaba43479982bf40bf4b8c18ae/users/7999be6f59c4494b81ce93fd13ebcc16/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:13.015860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.101315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ff043-44d1-4598-bddb-c43092a7025c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.348496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.349800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.350363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.358220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.433999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18dc7-8052-4879-bdf1-3c02415db2db admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.463536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.476422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.476943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.477446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.496320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.496320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:13.534389 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1884/3730] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:13.536075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.564822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e102-c883-4517-a5e7-69ef8b2a9112 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.568128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:13.604114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.606084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.607885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.608541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.615212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.618723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:13.664412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1885/3731] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:13.666391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.698716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70302d6a-c0e3-4779-8afe-bbe3e888c816 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.714475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.715737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.716213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.716832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.717994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.721289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:13.727100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:13.749972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.753445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:13.771440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1886/3732] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:13.771440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.772775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:13.814604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1847/3733] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:13.816888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.838956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32362a5-ef51-430b-badb-a97a7a26e1ef service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.844794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcdd4-5750-480e-b8ae-b3ab148e2e05 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:13.851996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.853440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.854343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.854901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] PATH_INFO: `/v3/projects/d0322ecaba43479982bf40bf4b8c18ae/users/7999be6f59c4494b81ce93fd13ebcc16/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.859562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0322ecaba43479982bf40bf4b8c18ae, user_id=7999be6f59c4494b81ce93fd13ebcc16, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.866654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:13.899502 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1848/3734] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:13 2022] PUT /identity/v3/projects/d0322ecaba43479982bf40bf4b8c18ae/users/7999be6f59c4494b81ce93fd13ebcc16/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:13.901546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:13.920705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:13.931867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:13.931867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:13.931867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] PATH_INFO: `/v3/users/ab7b3c3e499f44de893ccc5a57912701` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:13.943640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7b3c3e499f44de893ccc5a57912701)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:13.965099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:14.209357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65d45e-ab5a-4e3b-9ed7-a149e74265a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:14.234399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:14.238181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:14.241371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:14.242939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] PATH_INFO: `/v3/projects/62b8092f95334c3181e1703fd8d161fb/users/3cf02e28f0ec45ae86d4725e4abe49fa/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:14.317047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b8092f95334c3181e1703fd8d161fb, user_id=3cf02e28f0ec45ae86d4725e4abe49fa, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:14.331474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29827-45cb-4acb-9f88-5cfcd75dec26 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:14.561606 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1849/3735] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:13 2022] PUT /identity/v3/projects/62b8092f95334c3181e1703fd8d161fb/users/3cf02e28f0ec45ae86d4725e4abe49fa/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:14.561606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465809-767f-4e6b-8e50-be0c60bae3eb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:14.561606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465809-767f-4e6b-8e50-be0c60bae3eb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:14.561606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465809-767f-4e6b-8e50-be0c60bae3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:14.696862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7b3c3e499f44de893ccc5a57912701'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:14.698561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7b3c3e499f44de893ccc5a57912701'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:14.708451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-41465809-767f-4e6b-8e50-be0c60bae3eb None None] MFA Rules not processed for user `7999be6f59c4494b81ce93fd13ebcc16`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:14.710877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41465809-767f-4e6b-8e50-be0c60bae3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:14.868804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7b3c3e499f44de893ccc5a57912701'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:14.922939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7b3c3e499f44de893ccc5a57912701'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:14.963708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d64297b8-d5fa-4b38-a1c9-36b61de10f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7b3c3e499f44de893ccc5a57912701'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:14.982307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1887/3736] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:13 2022] DELETE /identity/v3/users/ab7b3c3e499f44de893ccc5a57912701 => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:14.985871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:14.986498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:14.988156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:15.060223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1850/3737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:15.066225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:15.067190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:15.068581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:15.068966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:15.071369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:15.140198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:15.142958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:15.281214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:15.369751 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1888/3738] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:15.374911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:15.382325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:15.434766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aaf44-4de6-4ba4-ae8f-59c0d4eab377 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:15.450927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:15.454628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:15.454628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:15.455192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:15.457635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:15.462382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:15.489889 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1851/3739] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:15.498902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:15.503996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:15.539350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07f38-fd3f-4430-8a23-7f14bfd64abf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:15.590220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:15.624633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:15.625371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:15.626952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] PATH_INFO: `/v3/projects/92a9a9dac9f2406db27f20da0159ebd7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:15.632407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a9a9dac9f2406db27f20da0159ebd7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:15.637557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:15.769031 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1889/3740] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:15 2022] POST /identity/v3/projects => generated 387 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:15.770961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:15.779515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:15.929660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a9a9dac9f2406db27f20da0159ebd7', 'request_id': 'req-5308cf33-4582-4be7-8ec4-27d593167fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:15.971091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a9a9dac9f2406db27f20da0159ebd7', 'request_id': 'req-5308cf33-4582-4be7-8ec4-27d593167fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:15.985281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:15.998159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702851-31cf-47bf-acd3-85b431203f15 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:16.001123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a9a9dac9f2406db27f20da0159ebd7', 'request_id': 'req-5308cf33-4582-4be7-8ec4-27d593167fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:16.150922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] The token cache is being invalidate because project 92a9a9dac9f2406db27f20da0159ebd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:16.156061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:16.161610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:16.165051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1852/3741] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:15 2022] DELETE /identity/v3/projects/92a9a9dac9f2406db27f20da0159ebd7 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:16.168178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:16.169734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:16.170072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:16.171630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:16.172912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:16.174174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.179002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.248549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308cf33-4582-4be7-8ec4-27d593167fec admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:16.268407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:16.271494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:16.271494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:16.271494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:16.285470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.497254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:16.500096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:16.546017 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1853/3742] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:16.547962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:16.551607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.560040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:16.572693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984b79-752b-4ae1-998f-0b8fcbda99a9 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:16.595599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4565-9e81-4524-8fbb-103c40bfa0d3 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:16.635485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:16.636498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:16.636972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:16.637383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:16.638734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:16.656835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:16.668942 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1890/3743] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 899 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:16.680748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adec04-f978-46f2-a496-87f85eeda347 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:16.681335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adec04-f978-46f2-a496-87f85eeda347 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:16.683610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adec04-f978-46f2-a496-87f85eeda347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:16.809470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-34adec04-f978-46f2-a496-87f85eeda347 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:16.817586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-34adec04-f978-46f2-a496-87f85eeda347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.858272 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1854/3744] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:16 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:16.869087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1891/3745] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:16.872039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:16.873731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:16.886515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:16.886515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:16.933130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:16.936187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:16.955735 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1892/3746] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:16.964356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:16.976337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab770b8-af42-473a-bede-97c837d593d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:16.998910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c9210-7e65-4720-8da7-e26535e98dde None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:17.000710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e493761-09de-4402-870c-42681df31265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:17.002509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493761-09de-4402-870c-42681df31265 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.005332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493761-09de-4402-870c-42681df31265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.005969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493761-09de-4402-870c-42681df31265 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.009461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e493761-09de-4402-870c-42681df31265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:17.019871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e493761-09de-4402-870c-42681df31265 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:17.028225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:17.030221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.030221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.030503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.032835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:17.033590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:17.038744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:17.076425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1855/3747] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:17.082390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e493761-09de-4402-870c-42681df31265 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:17.098313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1893/3748] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:45:17.103028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:17.140620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e493761-09de-4402-870c-42681df31265 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:17.148159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eaf491-9474-4a98-b5df-2a57fb67986a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:17.166118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:17.172597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.173481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.174099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.175309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:17.177428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.177779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.178276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.178562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:17.179521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:17.188249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:17.192344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:17.197444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:17.278220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1856/3749] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:17.284132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:17.350701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb592e-a657-459d-bb82-6bbbfacb7a8b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:17.373292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:17.376407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.380930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.381550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] PATH_INFO: `/v3/projects/2901aaa93ba54ad7b8f56fef2349c8f4/users/b7118d29dba04159a796e684a74862d8/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.455975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2901aaa93ba54ad7b8f56fef2349c8f4, user_id=b7118d29dba04159a796e684a74862d8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:17.464799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057941b1-3296-46c6-9d0a-fa5d4b6aaef1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:17.469365 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1894/3750] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:17 2022] POST /identity/v3/projects => generated 387 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:17.471460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:17.638346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1857/3751] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:17 2022] PUT /identity/v3/projects/2901aaa93ba54ad7b8f56fef2349c8f4/users/b7118d29dba04159a796e684a74862d8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:17.670728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:17.671475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:17.672004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:17.804640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22b117-dd92-4797-b216-03af3c47d866 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:17.891344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] MFA Rules not processed for user `b7118d29dba04159a796e684a74862d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:17.898473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:17.925982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:18.283566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:18.294658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:18.296700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:18.296700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:18.299309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:18.312404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:18.357025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1858/3752] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 688 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:18.368663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:18.372770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:18.567085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1895/3753] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:17 2022] POST /identity/v3/users => generated 294 bytes in 1097 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:18.574606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:18.616868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:18.693085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d441e-a479-4fd6-b0d2-f7a79c2909b7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:18.730805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:18.733425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:18.733942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:18.734447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] PATH_INFO: `/v3/projects/649d27ef54104cce8d99a13d9d49da3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:18.745366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649d27ef54104cce8d99a13d9d49da3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:18.756095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:18.778972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3e26-e0d2-44e5-a2e7-e6517ab1b73f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:18.799321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:18.800549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:18.801055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:18.801579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:18.810566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:19.059337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649d27ef54104cce8d99a13d9d49da3a', 'request_id': 'req-afc1e84e-6252-4c99-abc5-e5dd5d983697'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:19.094836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.097987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:19.155043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1859/3754] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:45:19.156821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:19.182077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649d27ef54104cce8d99a13d9d49da3a', 'request_id': 'req-afc1e84e-6252-4c99-abc5-e5dd5d983697'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:19.213765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649d27ef54104cce8d99a13d9d49da3a', 'request_id': 'req-afc1e84e-6252-4c99-abc5-e5dd5d983697'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:19.245239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:19.267949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e7069-11fe-48f8-82e3-dbabd963b4e7 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:19.279707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] The token cache is being invalidate because project 649d27ef54104cce8d99a13d9d49da3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:19.281812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:19.287771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-afc1e84e-6252-4c99-abc5-e5dd5d983697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:19.299289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1896/3755] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:18 2022] DELETE /identity/v3/projects/649d27ef54104cce8d99a13d9d49da3a => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:19.309454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12a9e-0d80-4adb-a699-76a93c8fd5f9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.313531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12a9e-0d80-4adb-a699-76a93c8fd5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.315448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12a9e-0d80-4adb-a699-76a93c8fd5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.471473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73a12a9e-0d80-4adb-a699-76a93c8fd5f9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:19.478856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73a12a9e-0d80-4adb-a699-76a93c8fd5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:19.513778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:19.515085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.515769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.516349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.517713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.521029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:19.530994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1897/3756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:19.544891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.546840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.546840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.578073 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1860/3757] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:19.584526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:19.587708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:19.638526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed43c8-c4e9-489a-b9ec-daef46644658 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:19.644958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:19.647740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:19.672527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:19.674584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.683610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.685705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1898/3758] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:19.692406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:19.693755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.694596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.697792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:19.720797 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1861/3759] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:45:19.731024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:19.768089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bb967-316c-4a82-9050-e0db932ec848 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:19.780408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc45841-3fe9-4ce7-b1f3-522e6bc936f6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:19.792756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:19.794129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.794657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.795342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.796634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:19.797207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.801887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:19.833870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:19.840530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.840530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.840530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] PATH_INFO: `/v3/projects/20a4ff06d4d748a7af1b5daf97fd6b39/users/2ba96f867da3438b9215039add0f4496/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.848457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1899/3760] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:45:19.851216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:19.889919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4166f-b3a4-444d-ac67-57bc6ed24072 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:19.925006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:19.929014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:19.929682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:19.934485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:19.973048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.985247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a4ff06d4d748a7af1b5daf97fd6b39, user_id=2ba96f867da3438b9215039add0f4496, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:19.990961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:20.007614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7029-82cb-4b98-9fa5-4b25f353e73d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:20.389844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1862/3761] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:19 2022] PUT /identity/v3/projects/20a4ff06d4d748a7af1b5daf97fd6b39/users/2ba96f867da3438b9215039add0f4496/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:20.398516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:20.398863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:20.399930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:20.423516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1900/3762] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:19 2022] POST /identity/v3/projects => generated 399 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:45:20.425024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:20.516717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:20.522562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:20.796392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:20.947584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a51ec1-e1f4-46bf-a8a2-0e2ea20e254a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:20.947584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:20.947584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:20.947584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:20.948296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:20.948296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:20.954180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:21.055172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1863/3763] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 659 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:45:21.069844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:21.076734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:21.475078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75df78-7c9a-4bdb-bc80-128d61fa9b0f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:21.483284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:21.485007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:21.485704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:21.486335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:21.535828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:21.540950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:21.570806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:21.602727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1864/3764] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:21.869276 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1901/3765] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:20 2022] POST /identity/v3/users => generated 300 bytes in 1447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:21.876019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:21.894718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71c935-285c-4c87-90d5-e71ee3c9cc1b service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:21.904421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:21.905524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:21.906025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:21.906486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:21.907878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:21.910931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:21.960948 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1865/3766] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:45:21.983093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:22.027976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362181-ef08-406e-a788-4ce17922d0d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:22.062408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:22.068878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:22.069337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:22.069774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:22.071362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:22.079887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3520db-a335-46c3-814e-433e577a5ae6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:22.131977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1902/3767] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:22.136162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:22.178830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00854b-443b-4d4c-bbb7-51a813ab8b0f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:22.203386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:22.206491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:22.206705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:22.207037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] PATH_INFO: `/v3/projects/f2c92a8a2d7b4a7f8d8374cfe5670ce1/users/bc9151f4e9bc4274b6c75f7d44d0873e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:22.256774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c92a8a2d7b4a7f8d8374cfe5670ce1, user_id=bc9151f4e9bc4274b6c75f7d44d0873e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:22.270512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:22.613747 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1866/3768] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:22 2022] PUT /identity/v3/projects/f2c92a8a2d7b4a7f8d8374cfe5670ce1/users/bc9151f4e9bc4274b6c75f7d44d0873e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:45:22.627804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:22.629720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:22.632265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:22.900264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:22.926658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:23.370102 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1903/3769] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 745 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:23.421290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:23.760810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776fa8-3916-41a5-881d-4d12e7a2fe3e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:23.779071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:23.782725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:23.783446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:23.785150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:23.843032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:23.851801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13168537-cded-440f-9b6f-eaefde329add service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:23.966938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1867/3770] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:25.112144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:25.114989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:25.170861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d8bd-dc58-4c79-908f-6c4244fbaa01 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:25.248422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:25.248422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:25.248422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:25.248422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] PATH_INFO: `/v3/users/7999be6f59c4494b81ce93fd13ebcc16` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:25.249221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7999be6f59c4494b81ce93fd13ebcc16)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:25.249221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:25.642633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7999be6f59c4494b81ce93fd13ebcc16'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:25.644290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7999be6f59c4494b81ce93fd13ebcc16'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:25.772497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7999be6f59c4494b81ce93fd13ebcc16'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:25.875743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7999be6f59c4494b81ce93fd13ebcc16'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:25.933936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7999be6f59c4494b81ce93fd13ebcc16'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:25.983460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1904/3771] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:25 2022] DELETE /identity/v3/users/7999be6f59c4494b81ce93fd13ebcc16 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:25.983781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:25.983781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:25.983781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:26.117252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:26.136145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:26.451523 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1868/3772] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:26.505792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:26.508369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:26.706200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:26.882544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc8ac-543d-4d13-9daa-8e868ad41202 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:26.904444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:26.911433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:26.918207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:26.918207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:26.977204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:26.980167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:27.050718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1905/3773] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:31.623573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:31.628753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:31.685098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745d730-3e28-4272-a039-295ffcc28382 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:31.714216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:31.714216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:31.714216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:31.714216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] PATH_INFO: `/v3/projects/d0322ecaba43479982bf40bf4b8c18ae` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:31.719073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0322ecaba43479982bf40bf4b8c18ae)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:31.729729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:32.159613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0322ecaba43479982bf40bf4b8c18ae', 'request_id': 'req-17fcbea6-438b-4566-8ce3-a1a38724ba67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:32.194908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0322ecaba43479982bf40bf4b8c18ae', 'request_id': 'req-17fcbea6-438b-4566-8ce3-a1a38724ba67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:32.211368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:32.215608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0322ecaba43479982bf40bf4b8c18ae', 'request_id': 'req-17fcbea6-438b-4566-8ce3-a1a38724ba67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:32.426806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] The token cache is being invalidate because project d0322ecaba43479982bf40bf4b8c18ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:32.431030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:32.435067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:32.446631 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1869/3774] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:31 2022] DELETE /identity/v3/projects/d0322ecaba43479982bf40bf4b8c18ae => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:32.452403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:32.495563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510dcb-b3f5-4439-b5ad-4f25f731b6a3 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:32.818636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:32.821160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:32.821919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:32.822754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] PATH_INFO: `/v3/users/b7118d29dba04159a796e684a74862d8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:32.825518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7118d29dba04159a796e684a74862d8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:32.834432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:33.331521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7118d29dba04159a796e684a74862d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:33.335937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7118d29dba04159a796e684a74862d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:33.497817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7118d29dba04159a796e684a74862d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:33.625714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7118d29dba04159a796e684a74862d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:33.698726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7118d29dba04159a796e684a74862d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:33.753515 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1906/3775] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:32 2022] DELETE /identity/v3/users/b7118d29dba04159a796e684a74862d8 => generated 0 bytes in 1298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:34.868986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:34.873451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:35.287477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcbea6-438b-4566-8ce3-a1a38724ba67 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:35.512602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:35.514059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:35.514778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:35.516096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:35.547536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:36.068597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:36.077804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8fe89-d6b7-46c3-9097-2f18e9ea36bd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:36.140848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1870/3776] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:37.205096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:37.208582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:37.270604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f96a31-ac3a-4701-a8bf-ae202c81be87 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:37.305136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:37.306449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:37.306792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:37.308879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] PATH_INFO: `/v3/users/edcdbeebe55e41cb9072a7561e0988f8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:37.318020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] RBAC: Authorizing `identity:delete_user(user_id=edcdbeebe55e41cb9072a7561e0988f8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:37.333683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:38.278105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:38.289952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edcdbeebe55e41cb9072a7561e0988f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:38.292376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edcdbeebe55e41cb9072a7561e0988f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:38.406278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edcdbeebe55e41cb9072a7561e0988f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:38.464312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edcdbeebe55e41cb9072a7561e0988f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:38.525453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edcdbeebe55e41cb9072a7561e0988f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:38.560624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1907/3777] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:37 2022] DELETE /identity/v3/users/edcdbeebe55e41cb9072a7561e0988f8 => generated 0 bytes in 1351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:45:38.563906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477eead-db34-463b-b341-b4c041758333 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:38.568151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477eead-db34-463b-b341-b4c041758333 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:38.569262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477eead-db34-463b-b341-b4c041758333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:38.695025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1477eead-db34-463b-b341-b4c041758333 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:38.713487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1477eead-db34-463b-b341-b4c041758333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:39.070635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:39.151244 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1871/3778] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:39.177768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:39.180616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:39.390306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5514d2-78d3-4f40-83a1-0a9e66cedcea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:39.418321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:39.419413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:39.431360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:39.431733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:39.480722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:39.485854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cf694-daa0-4bcc-939b-85ce4ec53447 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:39.515333 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1908/3779] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:40.188587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477eead-db34-463b-b341-b4c041758333 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:40.191645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1477eead-db34-463b-b341-b4c041758333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:40.263000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477eead-db34-463b-b341-b4c041758333 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:40.295774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:40.295774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:40.299984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:40.300544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] PATH_INFO: `/v3/projects/2901aaa93ba54ad7b8f56fef2349c8f4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:40.304285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2901aaa93ba54ad7b8f56fef2349c8f4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:40.310785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:40.583245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2901aaa93ba54ad7b8f56fef2349c8f4', 'request_id': 'req-9f0e95e3-daca-45da-a3c6-5372285cae09'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:40.607591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2901aaa93ba54ad7b8f56fef2349c8f4', 'request_id': 'req-9f0e95e3-daca-45da-a3c6-5372285cae09'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:40.638463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2901aaa93ba54ad7b8f56fef2349c8f4', 'request_id': 'req-9f0e95e3-daca-45da-a3c6-5372285cae09'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:40.833165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] The token cache is being invalidate because project 2901aaa93ba54ad7b8f56fef2349c8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:40.833681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:40.846564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9f0e95e3-daca-45da-a3c6-5372285cae09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:40.861889 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1872/3780] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:40 2022] DELETE /identity/v3/projects/2901aaa93ba54ad7b8f56fef2349c8f4 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:40.865622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:40.866516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:40.866657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:40.934375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:40.937252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:41.325392 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1909/3781] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:41.342059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:41.342971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:41.343401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:41.439517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:41.442477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:41.489645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1873/3782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:45:41.493883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:41.541554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138abe8-1304-41ad-aa85-b4c04c107eca None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:41.555803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:41.556926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:41.557451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:41.558025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:41.559474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:41.560101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:41.567519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:41.597457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1910/3783] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:41.608192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:41.650393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78e58-8788-48c8-a8ea-616cb7fe5614 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:41.675257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:41.677101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:41.677921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:41.678816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:41.680410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:41.683742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:41.988249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:41.989070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1874/3784] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:41 2022] POST /identity/v3/projects => generated 357 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:42.033469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45975c9-000d-4d86-b700-87662ee84ceb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:42.310505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:42.392083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:42.406771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:42.406771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:42.406771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:42.406771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:42.406771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:42.668097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:42.677830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1911/3785] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:41 2022] POST /identity/v3/users => generated 279 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:45:42.701268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b6d1c-e6cc-43e4-86cd-c00d246a42db admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:42.715774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:42.717798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:42.718547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:42.719251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:42.721368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:42.725536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:42.765941 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1875/3786] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:42.772424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:42.830746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a22-70ca-4ac5-8953-9937b6b4f0cb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:42.874255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:42.878642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:42.879922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:42.882721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:42.884429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:42.889768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:42.920918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1912/3787] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:42.933156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:42.978044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84e8b2-4002-48a9-99ba-fe2e72230175 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:43.007567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:43.010694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:43.013392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:43.013991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] PATH_INFO: `/v3/projects/ba39367c8d474f5aaef41d208defff8d/users/98cc75c2d3654e3aa02daa42cde1bab4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:43.136007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba39367c8d474f5aaef41d208defff8d, user_id=98cc75c2d3654e3aa02daa42cde1bab4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:43.158535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54c4ee-cb0c-4839-9c68-e56425a3f288 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:43.265048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:43.275506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:43.324163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1876/3788] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:42 2022] PUT /identity/v3/projects/ba39367c8d474f5aaef41d208defff8d/users/98cc75c2d3654e3aa02daa42cde1bab4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:45:43.351728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:43.352595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:43.353669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:43.403820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc51f76-0dcc-4d4a-a3e5-708be7946673 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:43.550277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] MFA Rules not processed for user `98cc75c2d3654e3aa02daa42cde1bab4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:43.556380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:43.806066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:43.808377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:43.810785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:43.814895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] PATH_INFO: `/v3/projects/e9fae788056d4b8e9d45e8988fc6920f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:43.821699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9fae788056d4b8e9d45e8988fc6920f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:43.831079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:44.016507 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1877/3789] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 666 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:44.038003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:44.056048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:44.078187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fdc09-ba8d-4396-ba24-f72d4e8e5b6b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:44.099998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:44.103335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:44.103847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:44.104493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] PATH_INFO: `/v3/users/98cc75c2d3654e3aa02daa42cde1bab4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:44.115862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cc75c2d3654e3aa02daa42cde1bab4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:44.123542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:44.209118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9fae788056d4b8e9d45e8988fc6920f', 'request_id': 'req-2804b7f8-b26c-442e-b478-e9344638ecc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.311029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9fae788056d4b8e9d45e8988fc6920f', 'request_id': 'req-2804b7f8-b26c-442e-b478-e9344638ecc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.332676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9fae788056d4b8e9d45e8988fc6920f', 'request_id': 'req-2804b7f8-b26c-442e-b478-e9344638ecc7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.392980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] The token cache is being invalidate because project e9fae788056d4b8e9d45e8988fc6920f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:44.392980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.399272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.407698 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1913/3790] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:43 2022] DELETE /identity/v3/projects/e9fae788056d4b8e9d45e8988fc6920f => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:44.418827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:44.423404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:44.566084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cc75c2d3654e3aa02daa42cde1bab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.682726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cc75c2d3654e3aa02daa42cde1bab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.713018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cc75c2d3654e3aa02daa42cde1bab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.719596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b7f8-b26c-442e-b478-e9344638ecc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:44.754656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:44.755877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:44.756376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:44.756869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] PATH_INFO: `/v3/users/8e202e88de9d4a468fe52feb39d1dd47` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:44.763048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e202e88de9d4a468fe52feb39d1dd47)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:44.766956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:44.787237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:44.834148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cc75c2d3654e3aa02daa42cde1bab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.837694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5df0355a-f055-4c43-b61e-60adf430f32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cc75c2d3654e3aa02daa42cde1bab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:44.860710 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1878/3791] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:44 2022] DELETE /identity/v3/users/98cc75c2d3654e3aa02daa42cde1bab4 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:45:44.871418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900923-b344-4c90-838c-9a448790a741 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:44.871894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900923-b344-4c90-838c-9a448790a741 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:44.872436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7900923-b344-4c90-838c-9a448790a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:44.927194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b7900923-b344-4c90-838c-9a448790a741 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:44.937304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7900923-b344-4c90-838c-9a448790a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:45.208986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1879/3792] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:45.243528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e202e88de9d4a468fe52feb39d1dd47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:45.245540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e202e88de9d4a468fe52feb39d1dd47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:45.254285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7900923-b344-4c90-838c-9a448790a741 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:45.256686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7900923-b344-4c90-838c-9a448790a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:45.378354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e202e88de9d4a468fe52feb39d1dd47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:45.450832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e202e88de9d4a468fe52feb39d1dd47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:45.487123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7900923-b344-4c90-838c-9a448790a741 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:45.497585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:45.498537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:45.499041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:45.499860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e202e88de9d4a468fe52feb39d1dd47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:45.500047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:45.528562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:45.531644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:45.533652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1914/3793] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:45:44 2022] DELETE /identity/v3/users/8e202e88de9d4a468fe52feb39d1dd47 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:45.557638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1880/3794] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:49.524583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:49.527542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:49.731456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:49.734308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:49.789627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533ec3c-7162-42c0-abe7-84d152cc0f03 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:49.887805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:49.939896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ba20-e3ba-4268-886d-671f98c7fd3d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:49.974574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:49.975728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:49.976095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:49.977379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] PATH_INFO: `/v3/projects/76ebb788e0674a7b99f294cb37a30f46` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:49.981206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ebb788e0674a7b99f294cb37a30f46)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:49.986612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:50.123224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:50.131654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:50.132025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:50.132229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] PATH_INFO: `/v3/projects/ba39367c8d474f5aaef41d208defff8d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:50.146169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba39367c8d474f5aaef41d208defff8d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:50.152855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:50.387311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ebb788e0674a7b99f294cb37a30f46', 'request_id': 'req-5c3bdb49-201e-4048-a345-d8053e9eb676'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.542180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ebb788e0674a7b99f294cb37a30f46', 'request_id': 'req-5c3bdb49-201e-4048-a345-d8053e9eb676'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.556193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba39367c8d474f5aaef41d208defff8d', 'request_id': 'req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.565068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ebb788e0674a7b99f294cb37a30f46', 'request_id': 'req-5c3bdb49-201e-4048-a345-d8053e9eb676'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.584577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba39367c8d474f5aaef41d208defff8d', 'request_id': 'req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.610125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba39367c8d474f5aaef41d208defff8d', 'request_id': 'req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.626941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] The token cache is being invalidate because project 76ebb788e0674a7b99f294cb37a30f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:50.628108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.629796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3bdb49-201e-4048-a345-d8053e9eb676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.655514 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1915/3795] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:49 2022] DELETE /identity/v3/projects/76ebb788e0674a7b99f294cb37a30f46 => generated 0 bytes in 1121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:50.658335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224756-f7b4-441b-ae46-8e39a3a3ee34 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:50.659102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224756-f7b4-441b-ae46-8e39a3a3ee34 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:50.660473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224756-f7b4-441b-ae46-8e39a3a3ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:50.753578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0d224756-f7b4-441b-ae46-8e39a3a3ee34 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:50.760427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0d224756-f7b4-441b-ae46-8e39a3a3ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:50.774582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:50.777107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] The token cache is being invalidate because project ba39367c8d474f5aaef41d208defff8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:45:50.777884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.783970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a42e7ed8-a5bc-4fc8-a0f9-650e0352ab62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:45:50.787758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1881/3796] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:49 2022] DELETE /identity/v3/projects/ba39367c8d474f5aaef41d208defff8d => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:45:50.797977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a0e6-8288-43fd-9ea8-147741fd5990 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:50.799807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a0e6-8288-43fd-9ea8-147741fd5990 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:50.804021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a0e6-8288-43fd-9ea8-147741fd5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:50.892451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5947a0e6-8288-43fd-9ea8-147741fd5990 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:50.892451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5947a0e6-8288-43fd-9ea8-147741fd5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:51.026790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1916/3797] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:51.030086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:51.030600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:51.031129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:51.114281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:51.116541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:51.178848 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1917/3798] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 04 20:45:51.178848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:51.196577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cf3f6-f487-46f2-bea3-2e9bc7d5bf71 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:51.203696 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1882/3799] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:45:51.206380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:51.207544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:51.207971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:51.217137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:51.218233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:51.218738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:51.219296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:51.224361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:51.224913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:51.232700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:51.286299 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1918/3800] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:51.288438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:51.331300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4b4af-f8c3-4bd7-9268-33de0806bd4f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:51.370491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:51.370491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:51.377292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:51.377431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:51.377431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:51.377431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:51.377745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:51.383834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:51.423725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1883/3801] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:51.434330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:51.480597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266ebd6-f3cd-449f-9f10-d8d21bba4916 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:51.497736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:51.502423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:51.502423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:51.502423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:51.506209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:45:51.507489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:51.511172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:51.567605 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1884/3802] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:45:51.577776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:51.637543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1919/3803] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:51 2022] POST /identity/v3/projects => generated 379 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:45:51.647656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:51.666051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d301-91b1-4129-8352-3efcc48d184d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:51.856747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:52.050082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:52.052840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:52.059329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:52.060974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:52.063555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:52.075447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:52.089995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25edd-446e-416a-b68a-b373f0491023 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:52.143882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:52.145673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:52.146078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:52.146538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:52.147629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:52.161413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:52.370557 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1920/3804] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:51 2022] POST /identity/v3/users => generated 290 bytes in 730 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:52.378141 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1885/3805] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:51 2022] POST /identity/v3/projects => generated 377 bytes in 802 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:52.385161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:52.385765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:52.429566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000a20-e79c-4078-b715-4911ec50b110 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:52.796541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:52.799228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:52.799605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:52.800147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:52.809805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47a46-a461-457e-bd32-0fee8970be64 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:52.815466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:52.819843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:52.829877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:52.844269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:52.845480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:52.848701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:52.851361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:52.852711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:52.861023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:52.892175 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1921/3806] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:45:52.893483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:52.940950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873b6b-4571-4dce-a583-e2380e403a45 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:52.964022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:52.965540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:52.965716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:52.966285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:52.968861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:52.972435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:53.056116 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1922/3807] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:53.060236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:53.114137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b598-f4d6-490f-9057-676f413c8fa6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:53.146432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:53.148337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:53.148808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:53.149538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] PATH_INFO: `/v3/projects/0320ad4639f0459295c6b219ed5668c8/users/fd92f4e1d7e44ef0b5d4ea851149e117/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:53.254715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0320ad4639f0459295c6b219ed5668c8, user_id=fd92f4e1d7e44ef0b5d4ea851149e117, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:53.261398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a51a-cf87-404c-bdaf-1833f86986cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:53.408972 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1886/3808] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:52 2022] POST /identity/v3/users => generated 289 bytes in 1025 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:45:53.416592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:53.454917 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1923/3809] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:53 2022] PUT /identity/v3/projects/0320ad4639f0459295c6b219ed5668c8/users/fd92f4e1d7e44ef0b5d4ea851149e117/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:53.475095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcd1a5-9391-41fc-a1b8-bc70265f855e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:53.476742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:53.478696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:53.480036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:53.627366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:53.640935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:53.856083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:53.863391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:53.872246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:53.872932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:53.876778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:53.886143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:53.965469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1887/3810] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:53.967592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:54.041389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92410-5e3a-4e11-a22a-54e6679d2cab admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:54.084465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:54.085643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:54.085996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:54.086442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:54.087722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:54.090661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:54.150608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1888/3811] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:45:54.177736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:54.191425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1924/3812] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 720 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:54.245047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54411a61-ba88-4326-8bcb-2516176628e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:54.285019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:54.286313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:54.286794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:54.287343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] PATH_INFO: `/v3/projects/580a17f3337d4598967c6fad7b7a420f/users/306feaabf5d64b489dd296d945e94cb6/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:54.334024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:54.338294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:54.386032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580a17f3337d4598967c6fad7b7a420f, user_id=306feaabf5d64b489dd296d945e94cb6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:54.396546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2a9a7-37c4-4a33-8074-ea77c0c930a5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:54.546257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1889/3813] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:54 2022] PUT /identity/v3/projects/580a17f3337d4598967c6fad7b7a420f/users/306feaabf5d64b489dd296d945e94cb6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:54.566176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:54.567073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:54.572212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:54.691009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:54.812519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] MFA Rules not processed for user `306feaabf5d64b489dd296d945e94cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:54.818514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:54.833261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2a28-67ca-42d9-80fb-953d8c3d42c0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:55.161002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:55.162109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:55.162616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:55.163108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:55.307399 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1890/3814] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 743 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:55.314369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:55.401932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:55.841137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:55.862007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:55.924359 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1925/3815] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:45:55.994230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f44f-915e-47dd-b4e9-138e3df79864 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:56.074351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:56.074351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:56.074351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:56.074351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:56.074838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:56.074838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:56.373432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:56.374302 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1891/3816] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:45:55 2022] POST /identity/v3/projects => generated 377 bytes in 1056 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:45:56.443921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cec7ee-c09b-43ad-9098-2703d26ed573 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:56.855183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:56.855183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:56.855183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:56.855183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:56.865805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:56.881309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:57.079172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1926/3817] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:45:56 2022] POST /identity/v3/users => generated 295 bytes in 703 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:45:57.081730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:57.142926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c466-8db5-4a3f-b9e1-a610e83870eb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:57.178743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:57.182574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:57.183167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:57.183690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:57.188208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:57.196549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:57.253421 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1892/3818] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:45:57.257062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:57.310764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a50480-bd14-4b5d-9c45-007008d9fcd0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:57.333131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:57.335841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:57.337361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:57.337934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] PATH_INFO: `/v3/projects/50717574c7a948b88193be54c01c30e1/users/87e978fabc294400bcd77effe329b4c1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:57.421736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=50717574c7a948b88193be54c01c30e1, user_id=87e978fabc294400bcd77effe329b4c1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:57.438197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:57.583422 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1927/3819] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:57 2022] PUT /identity/v3/projects/50717574c7a948b88193be54c01c30e1/users/87e978fabc294400bcd77effe329b4c1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:57.589960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:57.630385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62a9c1-71e3-40d3-8c47-3afe24e01c47 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:57.953650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:57.954611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:57.958038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:57.958681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:57.964271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:57.976508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a41c-d04d-48ee-8f15-a10a3dc42e5e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:58.044485 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1893/3820] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:45:58.058199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:58.114490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c184c-cd53-47cf-867a-1adeb79585ac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:58.137509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:58.141135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:58.142544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:58.144865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] PATH_INFO: `/v3/projects/50717574c7a948b88193be54c01c30e1/users/87e978fabc294400bcd77effe329b4c1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:58.174164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50717574c7a948b88193be54c01c30e1, user_id=87e978fabc294400bcd77effe329b4c1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:58.201297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:58.230023 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1928/3821] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:45:58 2022] PUT /identity/v3/projects/50717574c7a948b88193be54c01c30e1/users/87e978fabc294400bcd77effe329b4c1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:45:58.255804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64161-46be-4537-9df3-2ee19f523e1f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:58.256306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64161-46be-4537-9df3-2ee19f523e1f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:58.256710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec64161-46be-4537-9df3-2ee19f523e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:58.318473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:58.427087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bec64161-46be-4537-9df3-2ee19f523e1f None None] MFA Rules not processed for user `87e978fabc294400bcd77effe329b4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:45:58.432741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bec64161-46be-4537-9df3-2ee19f523e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:45:58.875267 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1894/3822] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:45:59.129425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:45:59.428671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e24500-5224-431d-85a5-adf5ab7a269f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:45:59.451290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:45:59.460266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:45:59.463497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:45:59.467320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:45:59.513232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:45:59.518504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361b0dc-3a5f-4ec3-8509-0d7789eeaeb6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:45:59.560023 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1929/3823] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:00.736825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:00.736825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:00.738490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:00.864636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] MFA Rules not processed for user `bc9151f4e9bc4274b6c75f7d44d0873e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:00.869379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:01.043183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1895/3824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:01.063828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc38f-e2e0-4c95-b766-4e5cff61f584 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:01.066041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc38f-e2e0-4c95-b766-4e5cff61f584 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:01.066971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc38f-e2e0-4c95-b766-4e5cff61f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:01.118947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-accdc38f-e2e0-4c95-b766-4e5cff61f584 None None] MFA Rules not processed for user `bc9151f4e9bc4274b6c75f7d44d0873e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:01.140202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-accdc38f-e2e0-4c95-b766-4e5cff61f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:01.180205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1930/3825] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:01.213159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:01.215857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:01.497176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6184-bebb-4880-b325-f6d1c1984fff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:01.526420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:01.529857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:01.530656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:01.531199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:01.554373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:01.559604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9edbdc-5bb8-435c-990b-472a0eee473c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:01.602124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1896/3826] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:03.577649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:03.579667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:03.580602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:46:03.650062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:03.652205 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:46:03.666670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1931/3827] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:46:03.750284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:03.751119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:03.751322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:03.773090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:03.826601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:03.829407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:04.076077 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1897/3828] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:46:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:04.111122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:04.115369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:04.269862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:04.469928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2edb5b-46a1-4e2c-a40f-1289fbb6c2ec None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:04.484796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:04.486512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:04.489332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:04.490678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:04.516361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:04.520201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079ec99-2c85-482c-8f33-57fdbca8cb9f service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:04.555861 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1932/3829] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:46:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:06.022402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:06.024927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:06.353136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2757-0760-4728-8045-e7936179c9ca None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:06.364647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:06.369015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:06.369015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:06.369015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] PATH_INFO: `/v3/users/91627f3584b0402896fd6e64b421b458` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:06.370156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] RBAC: Authorizing `identity:delete_user(user_id=91627f3584b0402896fd6e64b421b458)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:06.377216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:06.786478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91627f3584b0402896fd6e64b421b458'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:06.915596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91627f3584b0402896fd6e64b421b458'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:06.947527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91627f3584b0402896fd6e64b421b458'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:06.998090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91627f3584b0402896fd6e64b421b458'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:06.998090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6a1a7b9b-0c16-49cd-9a4d-6ab5733b92da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91627f3584b0402896fd6e64b421b458'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:06.998090 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1898/3830] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:06 2022] DELETE /identity/v3/users/91627f3584b0402896fd6e64b421b458 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:08.271471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:08.272108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:08.272886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:08.389860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] MFA Rules not processed for user `3cf02e28f0ec45ae86d4725e4abe49fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:08.394747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:08.669713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1933/3831] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:08.694889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:08.695839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:08.695962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:08.778170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] MFA Rules not processed for user `3cf02e28f0ec45ae86d4725e4abe49fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:08.781012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:08.817257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1899/3832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:08.835281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:08.838736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:09.149722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecb63-8da9-40cd-ae6b-268f364d58d5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:09.167305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:09.168498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:09.169080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:09.169690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:09.191002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:09.194549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:09.232189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1934/3833] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:46:09.626495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:09.630737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:09.754916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:09.910614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:09.914598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:10.011221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:10.013725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b61df-a4c1-4e5a-80ef-26502e69569e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:10.050850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:10.050850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:10.050850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:10.050850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] PATH_INFO: `/v3/projects/1181b876697c473ba1d15bbefeea2cf2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:10.052733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1181b876697c473ba1d15bbefeea2cf2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:10.065680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:10.189765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491919-b804-4982-977b-5c365ad52714 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:10.215985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:10.217137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:10.217640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:10.218190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] PATH_INFO: `/v3/users/306feaabf5d64b489dd296d945e94cb6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:10.225173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] RBAC: Authorizing `identity:delete_user(user_id=306feaabf5d64b489dd296d945e94cb6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:10.257296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:10.444334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1181b876697c473ba1d15bbefeea2cf2', 'request_id': 'req-6c427e91-e53e-4fd8-858f-8b6beb6d00be'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.464301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1181b876697c473ba1d15bbefeea2cf2', 'request_id': 'req-6c427e91-e53e-4fd8-858f-8b6beb6d00be'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.480862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1181b876697c473ba1d15bbefeea2cf2', 'request_id': 'req-6c427e91-e53e-4fd8-858f-8b6beb6d00be'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.685174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] The token cache is being invalidate because project 1181b876697c473ba1d15bbefeea2cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:10.685696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.698224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c427e91-e53e-4fd8-858f-8b6beb6d00be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.711996 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1900/3834] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:09 2022] DELETE /identity/v3/projects/1181b876697c473ba1d15bbefeea2cf2 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:10.715834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0551a9-3751-4a89-807b-688de6bf3509 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:10.725770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0551a9-3751-4a89-807b-688de6bf3509 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:10.726451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0551a9-3751-4a89-807b-688de6bf3509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:10.728994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306feaabf5d64b489dd296d945e94cb6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.730346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306feaabf5d64b489dd296d945e94cb6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.826467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306feaabf5d64b489dd296d945e94cb6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.853965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3a0551a9-3751-4a89-807b-688de6bf3509 None None] MFA Rules not processed for user `2ba96f867da3438b9215039add0f4496`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:10.856818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a0551a9-3751-4a89-807b-688de6bf3509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:10.892287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306feaabf5d64b489dd296d945e94cb6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.941838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306feaabf5d64b489dd296d945e94cb6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:10.976804 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1935/3835] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:09 2022] DELETE /identity/v3/users/306feaabf5d64b489dd296d945e94cb6 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:10.982640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:10.990088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:11.170200 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1901/3836] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:11.198226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675f19-0125-4c18-92bb-1d515b8de9fb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:11.198727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675f19-0125-4c18-92bb-1d515b8de9fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:11.199268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675f19-0125-4c18-92bb-1d515b8de9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-71675f19-0125-4c18-92bb-1d515b8de9fb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:46:11.233904 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:11.236571 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:46:11.242012 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1902/3837] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 72 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:46:11.246297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:11.249140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:11.257065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:11.361303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:11.364517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:11.494260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:11.532152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256ad4a-19bf-4543-867e-d5d870d4321f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:11.578455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:11.580047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:11.580613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:11.581647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] PATH_INFO: `/v3/users/00182ff09f2648ffb4f7d1b57f169adf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:11.588709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00182ff09f2648ffb4f7d1b57f169adf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:11.601264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:11.623215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1903/3838] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:11.624964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:11.631986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:11.929659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0f49-93ba-4860-8e75-42d1de593223 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:11.942807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:11.944137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:11.945063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:11.946005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:11.991356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:12.019770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00182ff09f2648ffb4f7d1b57f169adf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:12.024336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00182ff09f2648ffb4f7d1b57f169adf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:12.145476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:12.148947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:12.174483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1904/3839] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:12.176367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:12.178863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:12.198697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00182ff09f2648ffb4f7d1b57f169adf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:12.248792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00182ff09f2648ffb4f7d1b57f169adf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:12.295451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00182ff09f2648ffb4f7d1b57f169adf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:12.334723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1936/3840] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:10 2022] DELETE /identity/v3/users/00182ff09f2648ffb4f7d1b57f169adf => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:12.437139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749cddf-cb1b-45d4-86c6-f3b654fc3951 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:12.559569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:12.708510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:12.709476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:12.709920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:12.711189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:12.718403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:13.035259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:13.038878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:13.078659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1905/3841] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:15.647617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:15.647617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:15.647617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259e5d-7ec6-418c-8f49-a65173fd5b4c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:15.664273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:15.665839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:15.669818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:15.671860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] PATH_INFO: `/v3/projects/210941eb9659422f81b3cd68dcd5e13f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:15.685227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210941eb9659422f81b3cd68dcd5e13f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:15.707083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:15.888811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:15.891837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:15.944490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64a074-f8d1-49b0-9e2a-0355306975b1 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:15.960666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:15.961765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:15.962260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:15.962742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] PATH_INFO: `/v3/projects/580a17f3337d4598967c6fad7b7a420f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:15.982721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=580a17f3337d4598967c6fad7b7a420f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:15.996916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:16.104782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210941eb9659422f81b3cd68dcd5e13f', 'request_id': 'req-960b3adb-ed00-4257-ac8b-511d6fc23582'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.221234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210941eb9659422f81b3cd68dcd5e13f', 'request_id': 'req-960b3adb-ed00-4257-ac8b-511d6fc23582'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.245077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210941eb9659422f81b3cd68dcd5e13f', 'request_id': 'req-960b3adb-ed00-4257-ac8b-511d6fc23582'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.292434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580a17f3337d4598967c6fad7b7a420f', 'request_id': 'req-0d7fd807-68d0-4980-aa74-211d0605b88c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.310910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] The token cache is being invalidate because project 210941eb9659422f81b3cd68dcd5e13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:16.311911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.319627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-960b3adb-ed00-4257-ac8b-511d6fc23582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.325850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1937/3842] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:15 2022] DELETE /identity/v3/projects/210941eb9659422f81b3cd68dcd5e13f => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:16.326103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580a17f3337d4598967c6fad7b7a420f', 'request_id': 'req-0d7fd807-68d0-4980-aa74-211d0605b88c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.334534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431976-a175-477a-9432-21d4d2261120 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:16.335031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431976-a175-477a-9432-21d4d2261120 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:16.335579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431976-a175-477a-9432-21d4d2261120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:16.360903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580a17f3337d4598967c6fad7b7a420f', 'request_id': 'req-0d7fd807-68d0-4980-aa74-211d0605b88c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.426032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-48431976-a175-477a-9432-21d4d2261120 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:16.430817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-48431976-a175-477a-9432-21d4d2261120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:16.564304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] The token cache is being invalidate because project 580a17f3337d4598967c6fad7b7a420f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:16.564935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.570259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:16.580053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1906/3843] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:15 2022] DELETE /identity/v3/projects/580a17f3337d4598967c6fad7b7a420f => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:16.588239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:16.599598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:16.785999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1938/3844] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:16.802565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:16.805490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:16.805490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:16.888734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fd807-68d0-4980-aa74-211d0605b88c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:16.903021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:16.920132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:16.920132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:16.920132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] PATH_INFO: `/v3/users/87e978fabc294400bcd77effe329b4c1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:16.920132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e978fabc294400bcd77effe329b4c1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:16.920132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:16.923841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:16.928785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:16.932679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:16.959636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1939/3845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:16.968977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:17.015836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b936c-6e04-47b4-8e19-7004e06ad423 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:17.038830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:17.041280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:17.041280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:17.041972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:17.043866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:17.044566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:17.048418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:17.087594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1940/3846] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:17.101194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:17.195659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276657d1-a367-49aa-9bcd-476d6f931a86 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:17.230684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:17.238649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:17.240462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:17.243247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:17.245837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:17.258643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:17.356810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e978fabc294400bcd77effe329b4c1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:17.490418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e978fabc294400bcd77effe329b4c1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:17.521676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e978fabc294400bcd77effe329b4c1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:17.543309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:17.575991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e978fabc294400bcd77effe329b4c1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:17.577964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e978fabc294400bcd77effe329b4c1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:17.613906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1907/3847] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:16 2022] DELETE /identity/v3/users/87e978fabc294400bcd77effe329b4c1 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:17.626803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1941/3848] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:17 2022] POST /identity/v3/projects => generated 369 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:17.634173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:17.639578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:17.986773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d6665-0cbe-4d77-a556-75296231e794 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:18.291746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:18.292834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:18.293338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:18.293852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:18.295189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:18.305540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:18.573792 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1908/3849] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:17 2022] POST /identity/v3/users => generated 285 bytes in 940 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:18.579667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:18.646470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182ec50-40ea-4a32-997c-8a0c964a6574 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:18.709384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:18.709384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:18.709384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:18.709384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:18.710713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:18.710713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:18.753704 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1942/3850] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:18.761959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:18.836250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105833-e2dc-4e86-b55c-d1e6bc22ce6c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:18.860842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:18.863951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:18.864535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:18.865027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:18.872221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:18.888591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558912f-9ef6-4ba0-ab78-9d911d421d4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:18.931830 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1909/3851] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:18.938565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:18.968016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef659a6-ba88-4fb0-9bb8-78baca2975dc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:18.984054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:18.985923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:18.987417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:18.988466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] PATH_INFO: `/v3/projects/06dfaada3f54494480069629faf732e1/users/9274e654f0f24117b1c4cc4356db1a56/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:19.038882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dfaada3f54494480069629faf732e1, user_id=9274e654f0f24117b1c4cc4356db1a56, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:19.047032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:19.175182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1943/3852] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:18 2022] PUT /identity/v3/projects/06dfaada3f54494480069629faf732e1/users/9274e654f0f24117b1c4cc4356db1a56/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:19.181606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:19.185049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:19.185049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:19.243006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:19.299039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] MFA Rules not processed for user `9274e654f0f24117b1c4cc4356db1a56`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:19.302127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:19.573929 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1910/3853] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:19.604315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:19.609011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:19.898399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f09477-c076-43e6-8511-0d32b44bb79d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:19.929986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:19.932539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:19.933718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:19.934537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:19.965428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:19.970472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:19.992806 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1944/3854] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:21.750269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:22.025719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fe45-ad17-48a2-9b81-2242f510c04d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:22.034877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:22.054557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:22.054557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:22.054557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] PATH_INFO: `/v3/users/9274e654f0f24117b1c4cc4356db1a56` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:22.054557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9274e654f0f24117b1c4cc4356db1a56)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:22.054557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:22.671412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9274e654f0f24117b1c4cc4356db1a56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:22.797681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9274e654f0f24117b1c4cc4356db1a56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:22.799363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:22.818070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:22.855862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9274e654f0f24117b1c4cc4356db1a56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:22.896932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c036ca-a01c-4c2e-b8bf-4e20a1a3f96e service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:22.909633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:22.911440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:22.912432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:22.913624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] PATH_INFO: `/v3/users/c7677d259d034a68aaba770506475f73` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:22.915453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9274e654f0f24117b1c4cc4356db1a56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:22.917898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7677d259d034a68aaba770506475f73)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:22.919722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-12405323-dcce-4ff5-a44a-7d8681e7408f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9274e654f0f24117b1c4cc4356db1a56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:22.924426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:22.954038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1911/3855] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:21 2022] DELETE /identity/v3/users/9274e654f0f24117b1c4cc4356db1a56 => generated 0 bytes in 1205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:22.961395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:22.962724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:22.963655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:23.031356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:23.034403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:23.080395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:23.259891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1912/3856] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:23.273384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:23.275254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:23.465296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63195be6-d320-4491-b997-6b2b03c058d9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:23.486122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:23.489052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7677d259d034a68aaba770506475f73'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:23.489947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:23.492350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:23.493366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7677d259d034a68aaba770506475f73'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:23.494968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:23.540801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:23.544643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:23.570224 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1913/3857] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:46:23.572585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:23.576735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:23.606475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa961b48-44bc-48aa-b3ed-9bf342d28ad8 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:23.609283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7677d259d034a68aaba770506475f73'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:23.660752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:23.665050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:23.671473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:23.677450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] PATH_INFO: `/v3/projects/50717574c7a948b88193be54c01c30e1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:23.685373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=50717574c7a948b88193be54c01c30e1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:23.703801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7677d259d034a68aaba770506475f73'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:23.705496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:23.754942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edea3c3-a625-475a-9d82-f475c45b37ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7677d259d034a68aaba770506475f73'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:23.791024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1945/3858] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:22 2022] DELETE /identity/v3/users/c7677d259d034a68aaba770506475f73 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:23.798133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:23.801777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:23.806247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:23.887059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:23.890510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:23.958948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:24.040811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50717574c7a948b88193be54c01c30e1', 'request_id': 'req-653b4728-f15e-4d26-9398-0937348332ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:24.054613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50717574c7a948b88193be54c01c30e1', 'request_id': 'req-653b4728-f15e-4d26-9398-0937348332ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:24.067315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50717574c7a948b88193be54c01c30e1', 'request_id': 'req-653b4728-f15e-4d26-9398-0937348332ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:24.093895 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1946/3859] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:24.140195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:24.142383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:24.185272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] The token cache is being invalidate because project 50717574c7a948b88193be54c01c30e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:24.185832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:24.187007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-653b4728-f15e-4d26-9398-0937348332ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:24.197525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1914/3860] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:23 2022] DELETE /identity/v3/projects/50717574c7a948b88193be54c01c30e1 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:24.202032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c51d-da47-4eed-a324-66020ffec8ef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.202639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c51d-da47-4eed-a324-66020ffec8ef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.203583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c51d-da47-4eed-a324-66020ffec8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.281732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5a93c51d-da47-4eed-a324-66020ffec8ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:24.287940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a93c51d-da47-4eed-a324-66020ffec8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:24.308093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e9df-c59c-487f-a189-d35205e729e3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:24.443202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:24.510113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:24.512584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.515784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.516437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.523693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:24.576195 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1915/3861] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:46:24.590346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.590820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.591337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.682516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:24.684529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:24.730035 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1916/3862] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:24.731569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:24.742660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:24.772463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:24.775538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:24.796198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f361c-8f7f-44ef-8783-f359ab6e97b2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:24.802725 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1947/3863] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:24.804507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:24.809224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:24.810409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.810905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.811521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] PATH_INFO: `/v3/users/3cf02e28f0ec45ae86d4725e4abe49fa` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.816352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf02e28f0ec45ae86d4725e4abe49fa)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:24.823619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:24.858391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a6ae-d031-4ba6-90af-f95e8e9eee66 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:24.884732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:24.886471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.887992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.888817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.891108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:24.893496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:24.901904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:24.934055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1948/3864] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:24.940809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:24.962640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996c2f-619e-44ee-894b-0cf1689b2ac8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:24.983823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:24.986254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:24.987172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:24.989453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:24.993467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:24.997642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:25.035663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:25.430896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1949/3865] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:24 2022] POST /identity/v3/projects => generated 359 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:25.432674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:25.437188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:25.598523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf02e28f0ec45ae86d4725e4abe49fa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:25.636402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2746-4a0e-4f0a-be74-43924395d7ea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:25.645893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:25.647069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:25.647860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:25.648299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] PATH_INFO: `/v3/projects/06dfaada3f54494480069629faf732e1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:25.650979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dfaada3f54494480069629faf732e1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:25.655332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:25.741150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf02e28f0ec45ae86d4725e4abe49fa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:25.763523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf02e28f0ec45ae86d4725e4abe49fa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:25.792032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf02e28f0ec45ae86d4725e4abe49fa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:25.793368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf02e28f0ec45ae86d4725e4abe49fa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:25.814479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1917/3866] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:24 2022] DELETE /identity/v3/users/3cf02e28f0ec45ae86d4725e4abe49fa => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:25.814479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:25.826578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:25.888264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dfaada3f54494480069629faf732e1', 'request_id': 'req-8a672985-cb3b-45e2-856f-315591923cb8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.012006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf97c2-8a07-48c6-8349-20225adb122e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:26.098465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dfaada3f54494480069629faf732e1', 'request_id': 'req-8a672985-cb3b-45e2-856f-315591923cb8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.116833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dfaada3f54494480069629faf732e1', 'request_id': 'req-8a672985-cb3b-45e2-856f-315591923cb8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.151349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] The token cache is being invalidate because project 06dfaada3f54494480069629faf732e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:26.152545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.154596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.158883 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1950/3867] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:25 2022] DELETE /identity/v3/projects/06dfaada3f54494480069629faf732e1 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:26.161199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:26.166705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.184030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:26.186080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.187420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.189318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.196665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:26.202584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede7a1b-e840-4b70-8406-8194933d2112 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:26.324218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672985-cb3b-45e2-856f-315591923cb8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:26.334019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:26.335167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.335709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.336203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] PATH_INFO: `/v3/projects/baa9bc0601f141e48e1b5f001769d221` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.338809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa9bc0601f141e48e1b5f001769d221)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:26.342826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:26.382703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1918/3868] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:25 2022] POST /identity/v3/users => generated 280 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:26.385693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.388133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.389052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.432711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:26.438521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:26.442063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.470763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1919/3869] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:26.470763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:26.470763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.492399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392e9e7-0aa6-4a61-94b4-276d5f3630e1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:26.508772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:26.513303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:26.515515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.516189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.517057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.520451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:26.523993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:26.551227 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1920/3870] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:26.551227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:26.556277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.559396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa9bc0601f141e48e1b5f001769d221', 'request_id': 'req-3f6c9c20-f434-497e-98ce-e36476feea92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.591456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02a5e0-b641-454b-bd00-a21a30029a41 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:26.726539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa9bc0601f141e48e1b5f001769d221', 'request_id': 'req-3f6c9c20-f434-497e-98ce-e36476feea92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.735494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:26.737314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.737800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.738529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] PATH_INFO: `/v3/projects/62b8092f95334c3181e1703fd8d161fb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.740991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b8092f95334c3181e1703fd8d161fb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:26.748055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa9bc0601f141e48e1b5f001769d221', 'request_id': 'req-3f6c9c20-f434-497e-98ce-e36476feea92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.748289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:26.768490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] The token cache is being invalidate because project baa9bc0601f141e48e1b5f001769d221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:26.768954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.770089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f6c9c20-f434-497e-98ce-e36476feea92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:26.773265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1951/3871] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:26 2022] DELETE /identity/v3/projects/baa9bc0601f141e48e1b5f001769d221 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:26.776690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.777386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.778026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.824236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:26.826623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.842101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1952/3872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:26.844005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:26.847679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.872791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba15f1-192f-4300-804c-aad91c1ce884 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:26.883126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:26.884359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.884850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.885372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.886719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:26.890280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031267c-6201-4c76-985f-743e4ac09b63 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:26.914871 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1953/3873] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:26.925412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:26.925412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:26.925412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:26.964159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:26.967461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:26.996689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1954/3874] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:26.999346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:27.026058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583d48e-bf4c-4f9a-a563-6465813727b3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:27.042763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b8092f95334c3181e1703fd8d161fb', 'request_id': 'req-034a1738-894f-42f0-b3de-fe636f300a78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:27.061242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b8092f95334c3181e1703fd8d161fb', 'request_id': 'req-034a1738-894f-42f0-b3de-fe636f300a78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:27.080278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b8092f95334c3181e1703fd8d161fb', 'request_id': 'req-034a1738-894f-42f0-b3de-fe636f300a78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:27.197419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:27.198595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:27.199054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:27.199485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:27.200908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:27.201449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:27.204667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:27.241598 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1955/3875] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:27.243443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:27.269885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092642-b1d3-4c91-b37e-29f06c051558 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:27.279617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:27.280962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:27.281655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:27.282272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] PATH_INFO: `/v3/projects/869ac0b5366d400d99edf8b0539f2d2d/users/5e1a29eabafc477f8a764285142ce61a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:27.318164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869ac0b5366d400d99edf8b0539f2d2d, user_id=5e1a29eabafc477f8a764285142ce61a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:27.323922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f182f2b-0188-4a47-9792-20a91bb1fc34 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:27.917294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] The token cache is being invalidate because project 62b8092f95334c3181e1703fd8d161fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:27.918157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:27.922284 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1956/3876] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:27 2022] PUT /identity/v3/projects/869ac0b5366d400d99edf8b0539f2d2d/users/5e1a29eabafc477f8a764285142ce61a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:27.928619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6c5f-e599-4f42-8b00-c12e5a9c1222 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:27.929249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6c5f-e599-4f42-8b00-c12e5a9c1222 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:27.929796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6c5f-e599-4f42-8b00-c12e5a9c1222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:27.938354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:27.944333 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1921/3877] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:26 2022] DELETE /identity/v3/projects/62b8092f95334c3181e1703fd8d161fb => generated 0 bytes in 1398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:27.946127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:27.962564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:28.012061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1738-894f-42f0-b3de-fe636f300a78 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:28.040026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6b4b6c5f-e599-4f42-8b00-c12e5a9c1222 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:28.045174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b4b6c5f-e599-4f42-8b00-c12e5a9c1222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:28.276077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:28.277448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:28.278049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:28.278664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:28.283487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:28.289155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677145a9-c2b9-45ae-89c6-71606b004a0d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:28.411319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1957/3878] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:28.411319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:28.413563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:28.414382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:28.559110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] MFA Rules not processed for user `5e1a29eabafc477f8a764285142ce61a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:28.562009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:28.584899 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1922/3879] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:27 2022] POST /identity/v3/projects => generated 381 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:28.616813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:28.621750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:28.628018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:28.628018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:28.671723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:28.691189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:28.775921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:28.928032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1958/3880] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:28.939540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:28.984614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b3279-4ab0-4f31-9a21-5aa97c46290f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:29.046298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1923/3881] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:29.051330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:29.076876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb4d06-aed8-4fa0-b0b3-e024ce8c5bd5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:29.096966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:29.096966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.096966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.096966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.097732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:29.104855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318af84a-f4cd-4307-b33c-a7a8c7f3e33f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:29.273742 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1924/3882] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:29 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:29.276840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fc895-b158-4d85-84e1-98d2320215cb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.277536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fc895-b158-4d85-84e1-98d2320215cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.278183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fc895-b158-4d85-84e1-98d2320215cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.281221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:29.286340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.288918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.290317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.295053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:29.296052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:29.304412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:29.329053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3d2fc895-b158-4d85-84e1-98d2320215cb None None] MFA Rules not processed for user `2ba96f867da3438b9215039add0f4496`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:29.333228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3d2fc895-b158-4d85-84e1-98d2320215cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:29.380277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1959/3883] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:29.381482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:29.396055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:29.540745 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1925/3884] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:29.548188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.548890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.553359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.651845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:29.656287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:29.694580 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1926/3885] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:29.696870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:29.729830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c28dbf-2faa-4eba-b844-9e03b66e5787 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:29.733416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841ac6-26ef-4241-acda-e26b62bd535e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:29.737348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:29.738693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.739470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.739982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.756978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:29.758066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.758974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.771449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.771449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:29.774994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:29.822963 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1927/3886] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:29.828565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:29.882610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db57a-5b9d-4367-a5a0-2ae6b7b84e4e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:29.901969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:29.903104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:29.903653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:29.906298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:29.907777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:29.913517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:29.919361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.008949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:30.019692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.049938 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1960/3887] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:30.056618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.102803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf48273-d2cc-4882-8830-8c9501dcb3af service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:30.119680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:30.120828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:30.121540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:30.123320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:30.124934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:30.127172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:30.130798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.206377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1961/3888] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:30.208080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.226148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1928/3889] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:29 2022] POST /identity/v3/projects => generated 395 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:30.230081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.249328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1e83-2c72-4856-8437-1b9c629fa215 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:30.392758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:30.443169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:30.444385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:30.445141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:30.445832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:30.447092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:30.451619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.502224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1962/3890] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:30.510147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.520296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b82163-e0ea-4487-a9f2-60d94282dfaf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:30.531486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574851-4c48-4e92-b120-5129def19ae5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:30.543515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:30.561517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:30.561517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:30.561517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:30.561517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:30.562716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:30.562881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:30.562881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:30.563201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.563373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:30.563373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:30.563373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:30.735777 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1963/3891] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:30 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:30.738243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.813722 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1929/3892] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:30 2022] POST /identity/v3/projects => generated 371 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:30.819904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:30.823069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f8aed-cba4-4e39-aa11-f93b9cb57b4c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:31.127821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73877d8-2c88-4b95-834a-229dae886ff4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:31.137925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:31.139204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.140320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.141233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.142682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:31.144188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:31.146450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.147092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:31.147533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.148613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] PATH_INFO: `/v3/projects/d0f1de86b29c47899f3a04f3fb5b9108/users/012d4505c0a74ee286d4359926302d68/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.194645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1930/3893] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:31.198091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:31.208807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f1de86b29c47899f3a04f3fb5b9108, user_id=012d4505c0a74ee286d4359926302d68, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:31.222721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4cb9-10dd-4c4a-9bd5-9a67bce32c90 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:31.252715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d9e6b-a110-4624-bde4-f075d5e1edbb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:31.269230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:31.269230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.269230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.269230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.269947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:31.274098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1f8c-7a4c-404a-8ed2-2d65a91f3206 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:31.359070 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1964/3894] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:30 2022] PUT /identity/v3/projects/d0f1de86b29c47899f3a04f3fb5b9108/users/012d4505c0a74ee286d4359926302d68/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:31.363725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.364486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.365200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:46:31.383439 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:31.385091 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:46:31.401681 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1965/3895] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:31 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:46:31.402748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:31.498979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1931/3896] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:31 2022] POST /identity/v3/users => generated 286 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:31.510863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.512065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.515063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.623116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:31.636455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] MFA Rules not processed for user `012d4505c0a74ee286d4359926302d68`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:31.640452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:31.746867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526df826-b3e2-4760-9eb7-a46800409e86 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:31.759287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:31.760952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.762196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.764381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.766873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:31.773506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:31.861475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1966/3897] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:31.861475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:31.894015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fce13-6d6d-41b4-9b24-10b5cba8b5bb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:31.915033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:31.918167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:31.919595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:31.922370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:31.926913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:31.932019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:32.062979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1967/3898] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:32.065964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.080431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1932/3899] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 580 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:32.093764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.095204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d833e9-fed1-4978-9e63-cf7eede133be admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:32.106570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:32.108826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:32.109647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:32.110213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] PATH_INFO: `/v3/projects/e82f7c37d2584e16b55273fcd62d6cb2/users/9230cf6673344abc861153e01ab4da92/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:32.139866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2acf-6acf-4956-b51b-890cbd1139dd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:32.156115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82f7c37d2584e16b55273fcd62d6cb2, user_id=9230cf6673344abc861153e01ab4da92, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:32.163180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:32.166772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:32.168227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:32.168736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:32.169581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:32.171120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:32.175286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:32.223297 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1933/3900] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:32.225432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.230369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:32.270076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:32.349213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1968/3901] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:32 2022] PUT /identity/v3/projects/e82f7c37d2584e16b55273fcd62d6cb2/users/9230cf6673344abc861153e01ab4da92/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:32.358905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.361700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:32.481421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334edb5-42b3-45d0-8ab7-dff7550b0555 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:32.623173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951c83-5a12-4539-9e5a-d719545b0ab1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:32.641083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:32.649106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:32.649467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:32.649931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:32.697783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:32.702829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:32.704074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:32.706653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:32.709279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:32.742582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:32.745101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:32.780662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1934/3902] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:32.784637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.902134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:32.905703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:32.952025 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1969/3903] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:32.957653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:32.970287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:33.155216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790ff5d-ccbf-4737-a78b-13de5d994063 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:33.181125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:33.182404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:33.182913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:33.183653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] PATH_INFO: `/v3/projects/0bda882a4cd446619c42073bf0aec919/users/06009ef2882e401f82f8858e5b816f4a/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:33.212037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:33.255091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bda882a4cd446619c42073bf0aec919, user_id=06009ef2882e401f82f8858e5b816f4a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:33.261267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bac2b2-6bd3-4228-8ac0-7b1a046d4e6c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:33.283520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9582c-71d0-49cf-a35a-b3015f6178f3 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:33.307088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:33.307088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:33.307088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:33.307088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] PATH_INFO: `/v3/users/bc9151f4e9bc4274b6c75f7d44d0873e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:33.309647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9151f4e9bc4274b6c75f7d44d0873e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:33.313808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:33.666768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1935/3904] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:32 2022] PUT /identity/v3/projects/0bda882a4cd446619c42073bf0aec919/users/06009ef2882e401f82f8858e5b816f4a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:33.670259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ca2b-fea1-42dc-8442-df4d6b96433c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:33.670647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ca2b-fea1-42dc-8442-df4d6b96433c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:33.671080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ca2b-fea1-42dc-8442-df4d6b96433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:33.738660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7920ca2b-fea1-42dc-8442-df4d6b96433c None None] MFA Rules not processed for user `9230cf6673344abc861153e01ab4da92`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:33.740868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7920ca2b-fea1-42dc-8442-df4d6b96433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:33.778622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:33.964421 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1936/3905] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:33.964421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:33.964421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:33.964421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:34.029531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9151f4e9bc4274b6c75f7d44d0873e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:34.030896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9151f4e9bc4274b6c75f7d44d0873e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:34.080991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] MFA Rules not processed for user `06009ef2882e401f82f8858e5b816f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:34.083557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:34.148762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9151f4e9bc4274b6c75f7d44d0873e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:34.211096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9151f4e9bc4274b6c75f7d44d0873e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:34.245423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01d5de19-db1a-4b08-b10c-898629ad7562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9151f4e9bc4274b6c75f7d44d0873e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:34.281497 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1970/3906] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:32 2022] DELETE /identity/v3/users/bc9151f4e9bc4274b6c75f7d44d0873e => generated 0 bytes in 1329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:34.285076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ae14-7d3b-412c-a44d-4514f79a6898 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:34.285969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ae14-7d3b-412c-a44d-4514f79a6898 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:34.286720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711ae14-7d3b-412c-a44d-4514f79a6898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:34.349831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c711ae14-7d3b-412c-a44d-4514f79a6898 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:34.352632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c711ae14-7d3b-412c-a44d-4514f79a6898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:34.448667 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1937/3907] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:34.450470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:34.458533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:34.657430 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1971/3908] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:34.660783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:34.667552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:34.668422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:34.746779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] MFA Rules not processed for user `06009ef2882e401f82f8858e5b816f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:34.757166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:34.881382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2bd8-d203-4729-9d98-d845375c740b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:35.093256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1972/3909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:35.101407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:35.108636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:35.116741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:35.196123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:35.197376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:35.197917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:35.198523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:35.207047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:35.225313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:35.480639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:35.484262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:35.547053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1938/3910] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:34 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 1097 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:35.551275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:35.558046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:35.590064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfabec8-73d9-451b-acd9-4922c57179c7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:35.641479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cbdfb-a590-45a8-84ad-fb0b66b563dd service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:35.644740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:35.646095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:35.649943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:35.649943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:35.682651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:35.684551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:35.689966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:35.694531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:35.696392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:35.703498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f752-d442-4220-a028-eed0e729f915 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:35.726266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:35.736281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:35.753873 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1973/3911] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:46:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:35.784323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1939/3912] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:35.881694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:35.882258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:35.882772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:35.940666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:35.945924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:35.957486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] MFA Rules not processed for user `9230cf6673344abc861153e01ab4da92`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:35.958483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:35.983029 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1974/3913] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:36.203481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f22c4-8bf0-4f7b-98ea-71ca658c9eb2 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:36.212657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:36.215195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:36.222799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:36.223988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:36.224477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:36.224953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:36.263528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:36.284261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:36.290440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:36.397636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1940/3914] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:46:36.453466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:36.481296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa824b-73f1-425c-b857-4e335434a482 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:36.493647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:36.495677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:36.496453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:36.497188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] PATH_INFO: `/v3/projects/f2c92a8a2d7b4a7f8d8374cfe5670ce1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:36.499519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40583639-3fd7-4492-bd38-c5fe4fa328b2 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:36.501127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c92a8a2d7b4a7f8d8374cfe5670ce1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:36.507723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:36.521756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:36.527921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:36.528327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:36.528807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:36.549392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:36.654876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:36.661060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f4e0-49ee-4a72-a785-d5e7326a72b1 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:36.731401 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1941/3915] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:36.848933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c92a8a2d7b4a7f8d8374cfe5670ce1', 'request_id': 'req-da2a4d7b-ced8-4192-b875-73e91f77b4ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:36.993449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c92a8a2d7b4a7f8d8374cfe5670ce1', 'request_id': 'req-da2a4d7b-ced8-4192-b875-73e91f77b4ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.016156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c92a8a2d7b4a7f8d8374cfe5670ce1', 'request_id': 'req-da2a4d7b-ced8-4192-b875-73e91f77b4ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.063590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] The token cache is being invalidate because project f2c92a8a2d7b4a7f8d8374cfe5670ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:37.064629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.074992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.079529 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1975/3916] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:36 2022] DELETE /identity/v3/projects/f2c92a8a2d7b4a7f8d8374cfe5670ce1 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:46:37.098165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b22e-fe54-4123-b9bc-3e23c7c7d090 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:37.103408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b22e-fe54-4123-b9bc-3e23c7c7d090 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:37.103408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18b22e-fe54-4123-b9bc-3e23c7c7d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:37.188520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2f18b22e-fe54-4123-b9bc-3e23c7c7d090 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:37.209643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f18b22e-fe54-4123-b9bc-3e23c7c7d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:37.219965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:37.224633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:37.350921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:37.377943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:37.441586 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1942/3917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:37.447618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:37.449578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:37.451482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:37.507104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4d7b-ced8-4192-b875-73e91f77b4ce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:37.524704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:37.525838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:37.526366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:37.526846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] PATH_INFO: `/v3/users/f641a595a9e242da9564a483717f3b48` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:37.535765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f641a595a9e242da9564a483717f3b48)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:37.539470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:37.633109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:37.636958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:37.679448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1943/3918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:37.697262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:37.738891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389764c-0ae2-4dcc-a5ab-a9385f725305 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:37.766497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15509402-712c-4015-af63-19fef5376363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:37.767690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509402-712c-4015-af63-19fef5376363 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:37.768217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509402-712c-4015-af63-19fef5376363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:37.768749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15509402-712c-4015-af63-19fef5376363 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:37.770163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15509402-712c-4015-af63-19fef5376363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:37.770737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15509402-712c-4015-af63-19fef5376363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:37.786228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15509402-712c-4015-af63-19fef5376363 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:37.870269 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1944/3919] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:46:37.881696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15509402-712c-4015-af63-19fef5376363 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:37.925333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f641a595a9e242da9564a483717f3b48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.930571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f641a595a9e242da9564a483717f3b48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:37.969799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15509402-712c-4015-af63-19fef5376363 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:37.982739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:37.984830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:37.984830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:37.993082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:37.994310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:38.005269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:38.076136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f641a595a9e242da9564a483717f3b48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:38.143589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f641a595a9e242da9564a483717f3b48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:38.185376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10c61c96-332e-46d6-878d-9015a530e4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f641a595a9e242da9564a483717f3b48'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:38.232596 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1945/3920] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:38.240708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:38.247426 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1976/3921] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:37 2022] DELETE /identity/v3/users/f641a595a9e242da9564a483717f3b48 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:46:38.252829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:38.253684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:38.256017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:38.258326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:38.353273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] MFA Rules not processed for user `06009ef2882e401f82f8858e5b816f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:38.360188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:38.631427 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1977/3922] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:38.631427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:38.640129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170c6a-f038-405a-92ba-d8378cea6e77 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:38.649353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:38.857372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:38.947924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df63ba-98f5-4931-995b-ed3b9c3d4c99 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:38.969274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:38.969274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:38.969274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:38.969274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] PATH_INFO: `/v3/users/9230cf6673344abc861153e01ab4da92` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:38.969966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:38.969966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:38.969966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:38.971252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:38.977045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9230cf6673344abc861153e01ab4da92)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:38.979853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:38.986362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:39.009433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:39.240545 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1978/3923] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:38 2022] POST /identity/v3/users => generated 290 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:39.242825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:39.246983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:39.297447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1232166-0007-47a8-b183-47e974274bb7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:39.318414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:39.320006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:39.320593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:39.321506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] PATH_INFO: `/v3/projects/6c5aaa2031d8481ebc5a7b3b9a0522dc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:39.324435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5aaa2031d8481ebc5a7b3b9a0522dc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:39.329274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:39.509476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9230cf6673344abc861153e01ab4da92'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.601648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5aaa2031d8481ebc5a7b3b9a0522dc', 'request_id': 'req-339e2cd2-0cb4-48dc-a9f3-746e1950d966'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.631668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9230cf6673344abc861153e01ab4da92'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.650256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9230cf6673344abc861153e01ab4da92'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.705778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:39.707756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9230cf6673344abc861153e01ab4da92'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.720089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9230cf6673344abc861153e01ab4da92'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.739641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1946/3924] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:38 2022] DELETE /identity/v3/users/9230cf6673344abc861153e01ab4da92 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:39.739641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:39.742686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:39.812077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5aaa2031d8481ebc5a7b3b9a0522dc', 'request_id': 'req-339e2cd2-0cb4-48dc-a9f3-746e1950d966'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.844135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5aaa2031d8481ebc5a7b3b9a0522dc', 'request_id': 'req-339e2cd2-0cb4-48dc-a9f3-746e1950d966'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.898315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] The token cache is being invalidate because project 6c5aaa2031d8481ebc5a7b3b9a0522dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:39.898614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.905652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:39.910146 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1979/3925] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:39 2022] DELETE /identity/v3/projects/6c5aaa2031d8481ebc5a7b3b9a0522dc => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:39.912257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:39.918148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:39.996714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8586b9-bc48-4822-b0e0-521f86e5b4a7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:40.031732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:40.033327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:40.033838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:40.039765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:40.046092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:40.049515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1abc-ad6a-4718-9464-670f10c1ee28 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:40.103494 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1947/3926] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:40.107102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:40.107629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:40.108147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:40.181475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:40.183904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:40.208878 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1948/3927] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:40.208878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:40.216785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:40.252157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e2cd2-0cb4-48dc-a9f3-746e1950d966 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:40.280005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7669-b120-4b57-ae22-76d3932024fe None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:40.300721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:40.302159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:40.302871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:40.303754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] PATH_INFO: `/v3/users/dc09d7571a634563a26c01daf57f3947` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:40.318422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc09d7571a634563a26c01daf57f3947)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:40.318422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:40.640110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:40.641335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:40.643000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:40.644236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:40.648911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:40.700795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:40.716909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc09d7571a634563a26c01daf57f3947'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:40.742904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:40.759243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:40.855813 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1980/3928] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 942 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:40.856823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:40.861256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:40.907630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ea6-e10d-4bf3-8046-1e638eede477 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:40.916038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc09d7571a634563a26c01daf57f3947'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:40.940321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:40.941469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:40.946174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:40.954061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc09d7571a634563a26c01daf57f3947'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:40.955224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:40.960118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:40.966888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:41.038731 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1981/3929] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:41.047027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:41.056626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:41.065484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc09d7571a634563a26c01daf57f3947'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:41.067277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0233e32d-2a2a-4e3b-a528-922f18f97386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc09d7571a634563a26c01daf57f3947'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:41.100407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1949/3930] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:40 2022] DELETE /identity/v3/users/dc09d7571a634563a26c01daf57f3947 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:41.104723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:41.105274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:41.111954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:41.241270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] MFA Rules not processed for user `fd92f4e1d7e44ef0b5d4ea851149e117`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:41.255044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:41.319962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b8ee-97a2-4b89-a2f6-a18e38cad6e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:41.489534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:41.543397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:41.549800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:41.553074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:41.555999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:41.568060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:41.719200 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1950/3931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:41.719200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:41.721684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:41.952972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:41.959554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e91f-d03b-4783-8053-53570ab227d9 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:41.997962 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1982/3932] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 959 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:42.000141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31efea-12c0-4734-9de0-bdfccc8b199e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:42.000420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:42.000964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:42.002266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:42.027845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:42.029308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:42.029811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:42.030298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] PATH_INFO: `/v3/projects/6eaee4910b0c4b3ba89057bcc76771ff/users/9d65ad24790c45de95ef1e772d24fbe9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:42.099913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] MFA Rules not processed for user `fd92f4e1d7e44ef0b5d4ea851149e117`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:42.108962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:42.127552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaee4910b0c4b3ba89057bcc76771ff, user_id=9d65ad24790c45de95ef1e772d24fbe9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:42.133212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8c57-62f6-4623-9c32-2edd6c4ebdaa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:42.169798 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1983/3933] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:42.184804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:42.187907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:42.370758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:42.448626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8ac1-3c20-4b33-9394-8497336401a4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:42.467661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:42.468530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:42.468994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:42.469465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:42.495869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:42.499612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:42.519191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1984/3934] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:42.580931 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1951/3935] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:41 2022] PUT /identity/v3/projects/6eaee4910b0c4b3ba89057bcc76771ff/users/9d65ad24790c45de95ef1e772d24fbe9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:42.599122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:42.604885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:42.610139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd4ac-abf9-40d4-a872-0798b09dffa8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:42.614425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd4ac-abf9-40d4-a872-0798b09dffa8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:42.615739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd4ac-abf9-40d4-a872-0798b09dffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:42.717857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba76a42-cbbf-4047-9945-fe1fcd985b7c service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:42.820768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7b2cd4ac-abf9-40d4-a872-0798b09dffa8 None None] MFA Rules not processed for user `9d65ad24790c45de95ef1e772d24fbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:42.823162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b2cd4ac-abf9-40d4-a872-0798b09dffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:42.996749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:42.998611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:42.999555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:43.000428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] PATH_INFO: `/v3/projects/24e71aeef8ae451d8e152abb19afe23b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:43.005490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e71aeef8ae451d8e152abb19afe23b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:43.011188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:43.227777 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1952/3936] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:43.237620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64dca-5ddb-444c-8cef-767751f05da5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:43.238974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64dca-5ddb-444c-8cef-767751f05da5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:43.239314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb64dca-5ddb-444c-8cef-767751f05da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:43.330933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fbb64dca-5ddb-444c-8cef-767751f05da5 None None] MFA Rules not processed for user `9d65ad24790c45de95ef1e772d24fbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:43.344377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fbb64dca-5ddb-444c-8cef-767751f05da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:43.402460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e71aeef8ae451d8e152abb19afe23b', 'request_id': 'req-3412c380-60dc-428f-aeac-12a9cd65746a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:43.511691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e71aeef8ae451d8e152abb19afe23b', 'request_id': 'req-3412c380-60dc-428f-aeac-12a9cd65746a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:43.540539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e71aeef8ae451d8e152abb19afe23b', 'request_id': 'req-3412c380-60dc-428f-aeac-12a9cd65746a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:43.572735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:43.599476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] The token cache is being invalidate because project 24e71aeef8ae451d8e152abb19afe23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:43.600090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:43.602186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3412c380-60dc-428f-aeac-12a9cd65746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:43.616706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1985/3937] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:42 2022] DELETE /identity/v3/projects/24e71aeef8ae451d8e152abb19afe23b => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:43.619200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:43.619710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:43.620198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:43.632662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1953/3938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:46:43.637222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:43.638226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:43.640673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:46:43.659573 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:43.661053 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:46:43.679236 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1986/3939] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:43 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:46:43.777965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:43.783002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:43.816135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:43.820205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:44.067749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:44.097722 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1954/3940] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:44.099935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:44.102866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:44.137033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafd967-a56d-40df-a730-bd1f34cc64d6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:44.150644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:44.152589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:44.153064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:44.153634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] PATH_INFO: `/v3/projects/e82f7c37d2584e16b55273fcd62d6cb2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:44.156724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82f7c37d2584e16b55273fcd62d6cb2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:44.164816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:44.198393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8481-ac51-4533-95c7-73f6c66b0c44 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:44.238675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:44.239946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:44.241867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:44.242288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:44.255293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:44.289830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:44.293434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b74e1-3235-4a93-ac34-049e0f6a0dd0 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:44.339030 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1987/3941] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:44.342285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:44.342924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:44.343548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:44.467361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:44.471319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:44.562377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82f7c37d2584e16b55273fcd62d6cb2', 'request_id': 'req-2cb2139c-f031-4601-adc1-4577dcff29d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:44.612362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82f7c37d2584e16b55273fcd62d6cb2', 'request_id': 'req-2cb2139c-f031-4601-adc1-4577dcff29d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:44.657637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82f7c37d2584e16b55273fcd62d6cb2', 'request_id': 'req-2cb2139c-f031-4601-adc1-4577dcff29d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:44.858024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] The token cache is being invalidate because project e82f7c37d2584e16b55273fcd62d6cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:46:44.863499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:44.866551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2cb2139c-f031-4601-adc1-4577dcff29d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:44.881079 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1988/3942] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:44.896333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:44.906842 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1955/3943] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:44 2022] DELETE /identity/v3/projects/e82f7c37d2584e16b55273fcd62d6cb2 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:44.911842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e533b0-d4bc-4551-b389-f3fa0f1011c6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:44.914564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e533b0-d4bc-4551-b389-f3fa0f1011c6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:44.915348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e533b0-d4bc-4551-b389-f3fa0f1011c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:44.962350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ecca-6880-4b21-8693-55149bde4492 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:44.976761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:44.977819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:44.978483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:44.979840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:44.981689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:44.982623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:44.994035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:45.059273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1989/3944] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:45.061400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:45.067183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-99e533b0-d4bc-4551-b389-f3fa0f1011c6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:45.080924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-99e533b0-d4bc-4551-b389-f3fa0f1011c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:45.094374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75918d-b81c-4e0d-863f-ba0a027a770d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:45.116928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:45.135792 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1956/3945] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:45.140143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:45.145957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:45.145957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:45.145957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:45.158950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:45.159623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:45.160177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:45.160686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:45.205730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:45.207936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:45.255282 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1957/3946] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:46:45.262344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:45.312923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35029e1f-344f-4626-a0af-3655000be0ca None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:45.338422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:45.346099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:45.347741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:45.350612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:45.358500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:46:45.362312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:45.369850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:45.423736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1958/3947] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:46:45.450131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:45.506732 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1990/3948] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:45 2022] POST /identity/v3/projects => generated 389 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:45.508803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:45.524388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f109-70f6-4856-a541-b159389a691d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:45.814392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890abdb3-d749-4aaa-9f75-09897fd24fc1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:45.825133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:45.827059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:45.828825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:45.829082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:45.830212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:45.830820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:45.831615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:45.832201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:45.832546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:45.833659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:45.836784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:45.838648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:45.852909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:46.314385 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1991/3949] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:45 2022] POST /identity/v3/users => generated 295 bytes in 798 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:46:46.316263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:46.340423 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1959/3950] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:46:45 2022] POST /identity/v3/projects => generated 377 bytes in 897 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:46.349953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776e29-849f-40d0-a553-e83dae020025 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:46.350478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:46.579406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:46.580732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:46.581265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:46.581769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:46.583099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:46.601548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:46.655766 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1992/3951] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:46.659103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:46.711950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c425-a36c-457f-b9da-3a14f30f5a9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:46.739237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:46.739432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:46.739858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:46.740325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:46.741447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:46.756399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:46.800350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc0670-fa6f-472d-8e1a-2b02e25316ba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:46.820549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1993/3952] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:46.826420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:46.846125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:46.847391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:46.847989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:46.852103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:46.853693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:46.859001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:46.873436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982539-c295-4ed2-9de9-a16bec3448cb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:46.904303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:46.905145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:46.905417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:46.910799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] PATH_INFO: `/v3/projects/5452397c0d2c44f2a98d71701462dcfd/users/f233341383994ae29d0b661faf734d82/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:46.943886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5452397c0d2c44f2a98d71701462dcfd, user_id=f233341383994ae29d0b661faf734d82, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:46.948905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecf1c0-6e31-44de-81d6-5c9d9913c5a7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:47.166156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1960/3953] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:46:46 2022] POST /identity/v3/users => generated 289 bytes in 819 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:46:47.172400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:47.219579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970beb5-8bc1-432e-93c1-9fa1832dea60 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:47.229638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:47.231057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:47.233484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:47.234266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:47.237843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:47.240333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:47.276861 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1961/3954] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:47.283816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:47.293135 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1994/3955] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:46 2022] PUT /identity/v3/projects/5452397c0d2c44f2a98d71701462dcfd/users/f233341383994ae29d0b661faf734d82/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:47.302422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:47.303036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:47.303542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:47.306292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566244b1-47c0-43d9-8610-2df03e082325 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:47.367696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:47.369430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:47.583731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:47.588381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:47.591104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:47.603574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:47.611050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:47.617626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:47.695208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1962/3956] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:46:47.703479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:47.710504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:47.750520 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1995/3957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:47.757573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:47.818428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ddf83-9e3b-413c-9b54-600ad39f5058 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:47.842185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:47.843359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:47.844082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:47.849441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] PATH_INFO: `/v3/projects/2afc6ef8dc874ff5ad52048c0ea409e2/users/3b15e8c511234609ac4c8549a748f73b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:47.992898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545d8de-0025-4c6f-8e4e-3301ca10f498 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:47.996388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afc6ef8dc874ff5ad52048c0ea409e2, user_id=3b15e8c511234609ac4c8549a748f73b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:48.007593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:48.009139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:48.009913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:48.010638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:48.010859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72ce49-a668-4c61-8236-9c3c25b9fa1b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:48.018158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:48.068151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:48.073977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:48.132194 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1963/3958] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:48.134105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:48.182357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1eb4a-34a4-4203-8e22-3eb3d08fad1d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:48.241020 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1996/3959] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:46:47 2022] PUT /identity/v3/projects/2afc6ef8dc874ff5ad52048c0ea409e2/users/3b15e8c511234609ac4c8549a748f73b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:46:48.254053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985167-3da6-444f-b434-10d5909fffee None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:48.255502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985167-3da6-444f-b434-10d5909fffee None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:48.256778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985167-3da6-444f-b434-10d5909fffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:48.379194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-43985167-3da6-444f-b434-10d5909fffee None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:48.396639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-43985167-3da6-444f-b434-10d5909fffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:48.408178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:48.409391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:48.409871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:48.416357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:48.462059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:48.966183 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1997/3960] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 715 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:46:49.025759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:49.036042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1904a-db47-4bdb-ad4a-74adf0042d5d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:49.084448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985167-3da6-444f-b434-10d5909fffee None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:49.088352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-43985167-3da6-444f-b434-10d5909fffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:49.155342 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1964/3961] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1021 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:46:49.206994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985167-3da6-444f-b434-10d5909fffee None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:49.223922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:49.264301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:49.264301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:49.264301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:49.264301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:49.343009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:49.349281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df2f6-dc13-4875-b778-5b86861ba518 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:49.455989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95451f0d-1ddd-46e0-9858-32d043fe2fec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:49.456989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95451f0d-1ddd-46e0-9858-32d043fe2fec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:49.457802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95451f0d-1ddd-46e0-9858-32d043fe2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:49.501641 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1998/3962] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:46:49.567987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-95451f0d-1ddd-46e0-9858-32d043fe2fec None None] MFA Rules not processed for user `2ba96f867da3438b9215039add0f4496`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:49.570295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-95451f0d-1ddd-46e0-9858-32d043fe2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:49.908604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1965/3963] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:46:51.843600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:51.844419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:51.844676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:46:51.894259 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:46:51.901760 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:46:51.906714 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 1999/3964] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:46:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:46:54.419623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:54.420478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:54.420680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:54.542540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:54.544657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:54.830809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:54.908850 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1966/3965] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:54.945672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:54.948936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:54.974732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:55.296494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b371d23-e0b6-463a-a941-28786b9b7847 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:55.328891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:55.330025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:55.330714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:55.331212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:55.370807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:55.384736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc658-154d-46ea-8bd2-6c52630676a5 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:55.447788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2000/3966] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:46:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:56.244652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:56.247175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:56.303529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0384c-0e8d-4dd6-992d-6627a601a989 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:56.348400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:56.350261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:56.354940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:56.357786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] PATH_INFO: `/v3/users/012d4505c0a74ee286d4359926302d68` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:56.362599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=012d4505c0a74ee286d4359926302d68)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:56.385845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:56.786842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012d4505c0a74ee286d4359926302d68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:56.931572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012d4505c0a74ee286d4359926302d68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:56.961728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012d4505c0a74ee286d4359926302d68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:57.030987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012d4505c0a74ee286d4359926302d68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:57.034396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012d4505c0a74ee286d4359926302d68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:46:57.058305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1967/3967] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:46:56 2022] DELETE /identity/v3/users/012d4505c0a74ee286d4359926302d68 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:46:57.068026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:57.068026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:57.068026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:57.163320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:46:57.167127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:57.421660 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2001/3968] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:46:57.543482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:46:57.550859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:46:57.883942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c9ef-bad1-4b88-8820-95a6e904f88e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:46:57.898575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:46:57.903448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:46:57.903959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:46:57.909213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:46:57.936852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:46:57.939924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905b519-f57b-400d-9f33-c4b1f429eba2 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:46:58.062292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1968/3969] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:01.151927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:01.156212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:01.200975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920693b-5059-4557-a6bf-7c428c4461a2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:01.245199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:01.246920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:01.249169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:01.250363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] PATH_INFO: `/v3/projects/d0f1de86b29c47899f3a04f3fb5b9108` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:01.253767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f1de86b29c47899f3a04f3fb5b9108)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:01.281985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:01.610229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f1de86b29c47899f3a04f3fb5b9108', 'request_id': 'req-e97cef45-5d7c-4788-b349-abf3aba7df7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:01.749690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f1de86b29c47899f3a04f3fb5b9108', 'request_id': 'req-e97cef45-5d7c-4788-b349-abf3aba7df7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:01.790558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f1de86b29c47899f3a04f3fb5b9108', 'request_id': 'req-e97cef45-5d7c-4788-b349-abf3aba7df7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:01.824935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] The token cache is being invalidate because project d0f1de86b29c47899f3a04f3fb5b9108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:01.825473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:01.832758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e97cef45-5d7c-4788-b349-abf3aba7df7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:01.835871 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2002/3970] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:01 2022] DELETE /identity/v3/projects/d0f1de86b29c47899f3a04f3fb5b9108 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:01.846339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:01.847208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:01.847448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:01.912794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:01.919491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:02.132487 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1969/3971] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:02.150205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:02.151749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:02.152806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:02.231041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:02.237166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:02.287935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2003/3972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:02.294854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:02.334022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78b1f8-2453-4fb8-8008-4d43cce13636 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:02.334740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:02.335988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:02.336505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:02.337012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:02.338440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:47:02.338997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:02.342605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:02.348863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:02.375873 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1970/3973] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:02.383867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:02.467196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1851f2-c4fa-4ed3-b347-63005bd5f565 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:02.479458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:02.480517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:02.481807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:02.482397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:02.483881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:02.497514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:02.543361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:02.940507 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2004/3974] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:02 2022] POST /identity/v3/projects => generated 397 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:02.942740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:02.978813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45f3d0-e1c9-4eed-94e9-77abb24f8088 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:03.281863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:03.283820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:03.284629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:03.285237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:03.286581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:03.294615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:03.530905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1971/3975] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:02 2022] POST /identity/v3/users => generated 299 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:03.537336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:03.592075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4412-8546-470a-8dd5-054c98ef700d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:03.629882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:03.630944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:03.631456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:03.631978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:03.633302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:03.659244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:03.721049 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2005/3976] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:03.727972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:03.774365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb415db-c35b-4bac-a1bd-4f2803fa6734 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:03.803909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:03.821179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:03.821657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:03.822176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:03.826343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:03.830329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1bbd9-5fb4-49fd-bff6-37cf774acf62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:03.892403 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1972/3977] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:03.898941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:03.934336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed296-2cd4-480b-b722-b4ddebc923c8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:03.952745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:03.967440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:03.967440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:03.967440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] PATH_INFO: `/v3/projects/2ef7f47c67d54d6aa7dbc5165d7addaf/users/c14511a8912e435aae83d33db7645926/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:04.010014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef7f47c67d54d6aa7dbc5165d7addaf, user_id=c14511a8912e435aae83d33db7645926, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:04.023982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:04.180375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2006/3978] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:03 2022] PUT /identity/v3/projects/2ef7f47c67d54d6aa7dbc5165d7addaf/users/c14511a8912e435aae83d33db7645926/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:04.202622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:04.205212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:04.206045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:04.310637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] MFA Rules not processed for user `c14511a8912e435aae83d33db7645926`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:04.316546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:04.716093 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1973/3979] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:04.724800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:04.728377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:05.089959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08a64c-a6cd-4b71-9493-0eb7fd365849 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:05.104708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:05.110118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:05.110118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:05.110625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:05.142902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:05.147254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142edb7-aead-4174-8bfb-393607db79e6 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:05.170485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2007/3980] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:47:06.147448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:06.442220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84484894-4c8d-4c6e-a88f-b31a1d94df0a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:06.457978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:06.460855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:06.461889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:06.462822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] PATH_INFO: `/v3/users/c14511a8912e435aae83d33db7645926` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:06.466368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14511a8912e435aae83d33db7645926)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:06.472870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:06.486689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:06.858896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14511a8912e435aae83d33db7645926'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:07.172118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14511a8912e435aae83d33db7645926'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:07.234458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14511a8912e435aae83d33db7645926'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:07.274921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14511a8912e435aae83d33db7645926'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:07.276697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14511a8912e435aae83d33db7645926'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:07.294147 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1974/3981] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:06 2022] DELETE /identity/v3/users/c14511a8912e435aae83d33db7645926 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:07.302625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:07.303632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:07.304165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:07.348831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:07.352746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:07.603401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2008/3982] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:07.678217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:07.691750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:07.918569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e6814-7118-4c4c-b1c2-9e65372511cf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:07.928091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:07.932211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:07.933024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:07.934052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:07.967203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:07.972126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ff9da-3336-4bf2-b15d-e596a1dc908e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:07.996777 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1975/3983] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:10.201049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:10.204741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:10.262630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400698dd-a53f-4868-ae8b-692f52975c00 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:10.283447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:10.285318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:10.286251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:10.287091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] PATH_INFO: `/v3/users/9d65ad24790c45de95ef1e772d24fbe9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:10.291715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d65ad24790c45de95ef1e772d24fbe9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:10.302921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:10.727343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:10.820388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d65ad24790c45de95ef1e772d24fbe9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:10.822465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d65ad24790c45de95ef1e772d24fbe9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:10.937390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d65ad24790c45de95ef1e772d24fbe9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:11.002461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d65ad24790c45de95ef1e772d24fbe9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:11.051122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d65ad24790c45de95ef1e772d24fbe9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:11.084481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2009/3984] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:10 2022] DELETE /identity/v3/users/9d65ad24790c45de95ef1e772d24fbe9 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:11.091973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:11.092799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:11.092946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:11.132938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:11.135284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:11.311492 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1976/3985] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:11.427711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:11.432876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:11.576281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:11.580975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:11.642516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f5e5e-1754-43e2-963b-50729d12fbe0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:11.657744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:11.658962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:11.659487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:11.659975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] PATH_INFO: `/v3/projects/2ef7f47c67d54d6aa7dbc5165d7addaf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:11.668820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef7f47c67d54d6aa7dbc5165d7addaf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:11.680128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:11.684754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fa4c2-d986-4647-a0f5-5df978fc4deb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:11.711113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:11.712293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:11.712794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:11.713393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:11.783216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:11.786509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5079f0-9b88-454f-abf3-e494545bcafe service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:11.786735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:11.840597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2010/3986] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:12.001293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef7f47c67d54d6aa7dbc5165d7addaf', 'request_id': 'req-6f2c7185-c112-4a8d-a670-15a2563fc3cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:12.035661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef7f47c67d54d6aa7dbc5165d7addaf', 'request_id': 'req-6f2c7185-c112-4a8d-a670-15a2563fc3cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:12.063272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef7f47c67d54d6aa7dbc5165d7addaf', 'request_id': 'req-6f2c7185-c112-4a8d-a670-15a2563fc3cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:12.221903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] The token cache is being invalidate because project 2ef7f47c67d54d6aa7dbc5165d7addaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:12.223542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:12.231067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2c7185-c112-4a8d-a670-15a2563fc3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:12.234881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1977/3987] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:11 2022] DELETE /identity/v3/projects/2ef7f47c67d54d6aa7dbc5165d7addaf => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:12.244157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:12.244692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:12.246822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:12.329448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:12.342191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:12.715710 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2011/3988] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:47:12.733462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:12.733832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:12.734371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:12.842997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:12.847128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:12.871273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1978/3989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:12.879222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:12.912609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e2e87-1c91-465d-8f6b-ba213ea213bf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:12.932541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:12.936877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:12.937722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:12.940083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:12.945697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:47:12.946708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:12.953323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:13.014788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2012/3990] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:13.018006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:13.042085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae588c7-64d7-4141-87a0-a5d37275ec94 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:13.058563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:13.059939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:13.061783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:13.062514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:13.066571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:13.073771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:13.188171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:13.193108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:13.250349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42449cac-f515-4795-bd7e-de4e59f91590 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:13.274476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:13.276170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:13.276862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:13.277364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] PATH_INFO: `/v3/users/fd92f4e1d7e44ef0b5d4ea851149e117` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:13.287553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd92f4e1d7e44ef0b5d4ea851149e117)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:13.292315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:13.442381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1979/3991] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:13 2022] POST /identity/v3/projects => generated 387 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:13.446063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:13.809488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:13.881145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd92f4e1d7e44ef0b5d4ea851149e117'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:13.883261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbecc81-bfe2-426f-b4ad-58ac86e7bd77 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:13.885354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd92f4e1d7e44ef0b5d4ea851149e117'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:13.914209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:13.919469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:13.920045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:13.920555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:13.922502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:13.936618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:14.075584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd92f4e1d7e44ef0b5d4ea851149e117'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:14.141684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd92f4e1d7e44ef0b5d4ea851149e117'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:14.146527 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1980/3992] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:13 2022] POST /identity/v3/users => generated 294 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:14.153796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:14.188571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd92f4e1d7e44ef0b5d4ea851149e117'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:14.209566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926f7f-6ef1-4e38-8de8-69525961d6f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:14.222020 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2013/3993] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:13 2022] DELETE /identity/v3/users/fd92f4e1d7e44ef0b5d4ea851149e117 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:14.245873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:14.247501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:14.248279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:14.249052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:14.250651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:14.263674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:14.315056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:14.316312 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1981/3994] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:14.318224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:14.719493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e1d-c1fa-482d-8ffb-86dd06c524b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:14.740645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:14.743480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:14.746011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:14.747918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:14.751543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:14.756436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98123bee-3c93-4694-80a2-077f63a6adec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:14.813709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:14.819794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2014/3995] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:14.855686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b1bd2-cf16-4f5c-8251-b81d5253e19c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:14.885875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:14.887535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:14.888516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:14.889224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] PATH_INFO: `/v3/projects/e7e1ecd83e39483281a9b6b3db59648e/users/124ee4952519479f95536e976a096335/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:14.952645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1ecd83e39483281a9b6b3db59648e, user_id=124ee4952519479f95536e976a096335, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:14.969797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:15.242088 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1982/3996] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:14 2022] PUT /identity/v3/projects/e7e1ecd83e39483281a9b6b3db59648e/users/124ee4952519479f95536e976a096335/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:15.250369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:15.250860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:15.251401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:15.351940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:15.353740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:15.773276 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2015/3997] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:15.828208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:15.832907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:15.967281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:16.019331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08006-3b17-44c9-88a3-7b949d1d42ea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:16.036909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:16.038112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:16.038452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:16.039195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:16.059101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:16.063370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963f6ae-2a9c-47a1-b8e9-1533e8b465a0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:16.087390 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1983/3998] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:17.095528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:17.098226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:17.159269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37b73-5a1f-4c64-bd37-15c70c9628e7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:17.170819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:17.172388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:17.173233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:17.174238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] PATH_INFO: `/v3/projects/0320ad4639f0459295c6b219ed5668c8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:17.178313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0320ad4639f0459295c6b219ed5668c8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:17.182741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:17.764640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:17.789422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0320ad4639f0459295c6b219ed5668c8', 'request_id': 'req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:17.902355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0320ad4639f0459295c6b219ed5668c8', 'request_id': 'req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:17.926429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0320ad4639f0459295c6b219ed5668c8', 'request_id': 'req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:18.019055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] The token cache is being invalidate because project 0320ad4639f0459295c6b219ed5668c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:18.019666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:18.021630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:18.037167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2016/3999] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:17 2022] DELETE /identity/v3/projects/0320ad4639f0459295c6b219ed5668c8 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:18.041216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ec00-4ff8-4805-8166-99097a22890b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:18.042136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ec00-4ff8-4805-8166-99097a22890b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:18.043830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ec00-4ff8-4805-8166-99097a22890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:18.105971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e693ec00-4ff8-4805-8166-99097a22890b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:18.109740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e693ec00-4ff8-4805-8166-99097a22890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:18.197838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:18.202721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:18.381725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1984/4000] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:18.403298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:18.404420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:18.405226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:18.459392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:18.462613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:18.485209 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1985/4001] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:47:18.493513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:18.522060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe570ba-c32a-479c-89b6-b1bf5c3e3aec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:18.563957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:18.573034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:18.573592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:18.574083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:18.575576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:47:18.580762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:18.598287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:18.681243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1986/4002] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:18.688128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:18.708428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5002-d795-4a6f-9bdc-24dfdeb6db3a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:18.733344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:18.735613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:18.736508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:18.741714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] PATH_INFO: `/v3/projects/6eaee4910b0c4b3ba89057bcc76771ff` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:18.743951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaee4910b0c4b3ba89057bcc76771ff)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:18.751743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b42f14-477a-44da-b036-7bf70ccf190f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:18.752663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:18.789576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:18.790907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:18.791489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:18.792032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:18.801867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:18.812402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.050169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1987/4003] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:18 2022] POST /identity/v3/projects => generated 387 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:19.060444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:19.100568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaee4910b0c4b3ba89057bcc76771ff', 'request_id': 'req-13eec4ba-f330-44f7-b792-d69d318af3e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:19.270516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaee4910b0c4b3ba89057bcc76771ff', 'request_id': 'req-13eec4ba-f330-44f7-b792-d69d318af3e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:19.298492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaee4910b0c4b3ba89057bcc76771ff', 'request_id': 'req-13eec4ba-f330-44f7-b792-d69d318af3e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:19.358364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] The token cache is being invalidate because project 6eaee4910b0c4b3ba89057bcc76771ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:19.358920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:19.384495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13eec4ba-f330-44f7-b792-d69d318af3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:19.395892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2017/4004] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:18 2022] DELETE /identity/v3/projects/6eaee4910b0c4b3ba89057bcc76771ff => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:19.399735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dded53-1267-431b-a4db-dd0649d3f8d3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.400599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dded53-1267-431b-a4db-dd0649d3f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.401339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dded53-1267-431b-a4db-dd0649d3f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.411788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6273c-1f9f-498b-ba26-cf6098e7db83 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:19.440642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:19.442078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.442517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.442903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.443784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:19.447249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.477056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-84dded53-1267-431b-a4db-dd0649d3f8d3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:19.484211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-84dded53-1267-431b-a4db-dd0649d3f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:19.532385 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2018/4005] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:19.545330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.546359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.547215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.611102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:19.614517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:19.636856 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2019/4006] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:19.646236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:19.661146 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1988/4007] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:19 2022] POST /identity/v3/users => generated 294 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:19.665338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:19.678534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:19.683398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693e57-0615-4a25-bcca-a380c1fdc2a8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:19.711600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:19.715635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.717223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.723017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.726317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:47:19.729821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:19.735635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.767085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691012-4982-4c09-b124-defd456e21b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:19.775705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2020/4008] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:19.778217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:19.800510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:19.804275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.805024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.812486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.814419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:19.818120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.834122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6509e9e-354d-423d-9bde-892c44025e59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:19.846767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:19.848587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.850352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.851258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.852793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:19.858072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.862754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1989/4009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:19.870118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:19.908748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb49812-bb4c-4a6a-a5aa-373e657d875c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:19.931724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:19.933235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:19.934213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:19.937077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:19.938690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:19.948231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:19.995040 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1990/4010] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:20.002115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:20.032572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:20.035891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2021/4011] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:19 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:20.053703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:20.056568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120481a5-effc-4bc3-8bf3-423ab64bb5ea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:20.125309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:20.305833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:20.310660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:20.311352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:20.313215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] PATH_INFO: `/v3/projects/cfa8bdf2eb414417a0ee4e64f7932019/users/895545f1707940e4a10fbfc84253d705/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:20.388138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e222-dc96-41ef-af03-2fbe8f9bdeae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:20.400840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa8bdf2eb414417a0ee4e64f7932019, user_id=895545f1707940e4a10fbfc84253d705, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:20.407990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:20.408967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:20.410289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:20.414812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:20.416054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:20.418559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad6bb7-4cd1-433c-a156-d7d4b50ecea3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:20.428407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:20.574554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1991/4012] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:20 2022] PUT /identity/v3/projects/cfa8bdf2eb414417a0ee4e64f7932019/users/895545f1707940e4a10fbfc84253d705/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:20.577668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:20.578167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:20.578936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:20.622739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2022/4013] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:20 2022] POST /identity/v3/users => generated 291 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:20.630163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:20.704741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:20.707082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e9cd-c5fe-45be-b6d8-43be469fb99f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:20.713492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:20.942811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:20.944524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:20.946052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:20.946052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:20.946879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:20.952208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1992/4014] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:47:20.952980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:20.993588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2023/4015] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:21.000895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:21.005326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:21.009807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:21.066649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78efdb-11c9-48a8-9eb8-f74aef55bd95 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:21.083543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:21.084786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:21.085572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:21.086366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:21.090209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:21.093845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290493b-5f48-4fbc-a29c-c0797e92792d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:21.148587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1993/4016] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:21.156337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:21.157293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:21.163338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:21.249579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc760a3-1003-4b63-a78f-54c752e7a199 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:21.270913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:21.272206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:21.272659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:21.273215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:21.283077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] MFA Rules not processed for user `3b15e8c511234609ac4c8549a748f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:21.289709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:21.315482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:21.318341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:21.364319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2024/4017] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:21.366608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:21.416770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fbc10-789c-4d53-ba31-8c0cfae2857e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:21.443040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:21.444383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:21.444918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:21.445463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] PATH_INFO: `/v3/projects/ce3823a32e454504b467aa845688fc46/users/806303426c474dbda5f6d91022dce7cb/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:21.524932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3823a32e454504b467aa845688fc46, user_id=806303426c474dbda5f6d91022dce7cb, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:21.531591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae45b-d533-4e42-8c03-c19e44fa673a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:21.539058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1994/4018] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:21.586664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:21.590464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:21.628502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:21.794188 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2025/4019] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:21 2022] PUT /identity/v3/projects/ce3823a32e454504b467aa845688fc46/users/806303426c474dbda5f6d91022dce7cb/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:21.803566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:21.808542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:21.811985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:21.913229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:21.916673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:21.966136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b58-9041-4738-bd69-0023edd2fbba None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:21.991542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:22.202080 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2026/4020] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:22.280796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:22.283418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:22.284570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:22.285405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:22.292840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:22.297713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:22.520740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b20cd-98a6-4fdc-8897-62308d13576a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:22.530338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:22.533136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:22.533884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:22.534637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:22.567684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:22.571505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:22.584599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:22.588958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:22.618033 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2027/4021] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:22.631088 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1995/4022] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1049 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:47:22.775608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:22.787205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:23.079747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88297e16-ff2c-4e4d-8327-ac965b5c33e3 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:23.096424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:23.097647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:23.098299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:23.098828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:23.103168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:23.139562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:23.143884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087a01-bdce-452c-863e-782b8e700d4b service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:23.186864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2028/4023] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:23.202754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:23.203042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:23.264273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6f9e-ba65-445c-9ff5-9e9a59e8ae03 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:23.279009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:23.284586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:23.286583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:23.287653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] PATH_INFO: `/v3/users/2ba96f867da3438b9215039add0f4496` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:23.292818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba96f867da3438b9215039add0f4496)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:23.299927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:23.646566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:23.681368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c1cf-9303-4e3c-8feb-6c6ccd42c262 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:23.682331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c1cf-9303-4e3c-8feb-6c6ccd42c262 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:23.682331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c1cf-9303-4e3c-8feb-6c6ccd42c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:23.698332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba96f867da3438b9215039add0f4496'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:23.803618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b139c1cf-9303-4e3c-8feb-6c6ccd42c262 None None] MFA Rules not processed for user `f233341383994ae29d0b661faf734d82`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:23.812200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b139c1cf-9303-4e3c-8feb-6c6ccd42c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:23.908733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba96f867da3438b9215039add0f4496'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:23.928883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:23.943324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba96f867da3438b9215039add0f4496'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:24.006571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba96f867da3438b9215039add0f4496'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:24.011692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba96f867da3438b9215039add0f4496'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:24.031286 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2029/4024] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:47:24.041698 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1996/4025] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:23 2022] DELETE /identity/v3/users/2ba96f867da3438b9215039add0f4496 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:24.049329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:24.049791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:24.050273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:24.092607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] MFA Rules not processed for user `f233341383994ae29d0b661faf734d82`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:24.096688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:24.330139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2030/4026] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:24.351065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:24.355047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:24.610946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128045-fdd1-4317-91d1-8131b3ddcf31 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:24.624968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:24.626349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:24.627222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:24.627437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:24.631482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:24.680348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:24.695945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6916f4b-69b4-4436-953a-4a5c8c0cf479 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:24.729202 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1997/4027] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:25.584473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:25.588622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:25.978388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558affd5-cb73-4086-a9d3-40e73eeb7bd2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:25.979599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558affd5-cb73-4086-a9d3-40e73eeb7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:25.979599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558affd5-cb73-4086-a9d3-40e73eeb7bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-558affd5-cb73-4086-a9d3-40e73eeb7bd2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:26.020952 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:47:26.022689 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:47:26.049244 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1998/4028] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:47:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:47:26.063443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f862-513f-4668-9340-8ef1304997cc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:26.063443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:26.063443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:26.063443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:26.073469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] PATH_INFO: `/v3/projects/20a4ff06d4d748a7af1b5daf97fd6b39` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:26.073469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a4ff06d4d748a7af1b5daf97fd6b39)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:26.079168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:26.457093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a4ff06d4d748a7af1b5daf97fd6b39', 'request_id': 'req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:26.555063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a4ff06d4d748a7af1b5daf97fd6b39', 'request_id': 'req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:26.599480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a4ff06d4d748a7af1b5daf97fd6b39', 'request_id': 'req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:26.650989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] The token cache is being invalidate because project 20a4ff06d4d748a7af1b5daf97fd6b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:26.651479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:26.652656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b2c74c6b-9071-42ea-8b06-38b463bbb1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:26.669820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:26.670393 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2031/4029] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:25 2022] DELETE /identity/v3/projects/20a4ff06d4d748a7af1b5daf97fd6b39 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:26.670606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:26.671835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:26.780348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:26.786855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:27.084053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 1999/4030] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:27.101402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:27.106430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:27.106430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:27.206230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:27.213643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:27.247084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2032/4031] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:27.258740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:27.291698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7727cd-7548-4fad-92fe-58095d5df4aa None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:27.304906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:27.309466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:27.311154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:27.312385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:27.314980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:47:27.316113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:27.322833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:27.379461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:27.391458 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2000/4032] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:47:27.409514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f86133-b99a-4b49-b3ba-4a4bb91bde12 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:27.435071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:27.445994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:27.446459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:27.447288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:27.448989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:27.503614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:27.563309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:27.813360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:27.822668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2033/4033] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:27 2022] POST /identity/v3/projects => generated 389 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:27.865683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce096db-d58f-4ed3-a05d-6425b6b4748a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:27.987329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:28.084180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:28.085765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:28.086687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:28.088550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:28.090943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:28.096265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:28.310920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:28.320682 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2001/4034] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:27 2022] POST /identity/v3/users => generated 295 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:28.369914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67cec2-3c69-4a39-92b5-0ccd542ec1f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:28.408837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:28.415127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:28.417077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:28.418186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:28.421894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:28.426736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:28.461465 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2034/4035] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:28.470116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:28.527350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47d2e-029f-4393-990b-37d20833cb03 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:28.549182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:28.550342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:28.550848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:28.552289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:28.552741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:28.556288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318e827-c833-4f4f-bbeb-17fe615b39b6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:28.618761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:28.624261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2002/4036] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:28.678422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265370a8-1f29-4d04-9f87-8f37ecd60eb4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:28.704961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:28.706392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:28.707354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:28.708043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] PATH_INFO: `/v3/projects/a389ac5392924f5d8ad261551f5c5872/users/759924962d5e4bcd9ea6df8c3e8f27e7/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:28.781600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a389ac5392924f5d8ad261551f5c5872, user_id=759924962d5e4bcd9ea6df8c3e8f27e7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:28.794026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:29.435337 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2035/4037] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:28 2022] PUT /identity/v3/projects/a389ac5392924f5d8ad261551f5c5872/users/759924962d5e4bcd9ea6df8c3e8f27e7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:29.458681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:29.459606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:29.459796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:29.603958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] MFA Rules not processed for user `759924962d5e4bcd9ea6df8c3e8f27e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:29.606651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:29.961971 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2003/4038] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:29.971289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:30.441887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185d97-991e-44cc-8eb8-46b2e9c03087 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:30.465170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:30.466206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:30.466703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:30.469147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:30.479628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:30.484291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:30.693794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2036/4039] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:47:29 2022] POST /identity/v3/projects => generated 391 bytes in 722 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:30.697497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:30.762866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2cb5e-d924-4b52-b9d7-be662e3fe74d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:31.155556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:31.156894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:31.157467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:31.159762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:31.161910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:31.174284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:31.334458 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2004/4040] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:47:30 2022] POST /identity/v3/users => generated 302 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:31.336935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:31.384356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1cc47-84f3-44c3-a361-af221ebd3719 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:31.398767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:31.403632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:31.404542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:31.405654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:31.409338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:31.418540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:31.470639 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2037/4041] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:31.475190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:31.522411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d976801-f306-4ca7-afda-51619bd95892 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:31.553585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:31.554962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:31.555522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:31.556028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] PATH_INFO: `/v3/projects/59d9e06fb7874692bddf701463cf6691/users/c43a4daa9d4a4c2e8ee9d085e09dbc21/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:31.649620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d9e06fb7874692bddf701463cf6691, user_id=c43a4daa9d4a4c2e8ee9d085e09dbc21, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:31.665715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:31.821188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:31.846855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2005/4042] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:31 2022] PUT /identity/v3/projects/59d9e06fb7874692bddf701463cf6691/users/c43a4daa9d4a4c2e8ee9d085e09dbc21/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:31.853426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:31.884034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c54-e5ef-44ae-98ad-5f7d6de2d9e1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:32.336746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:32.340550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:32.349741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:32.349741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:32.350186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:32.353391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17feb7b0-d0b0-45d1-8644-78ef8a5a2de2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:32.420660 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2038/4043] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:32.427608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:32.472978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede6ac-769f-4804-b462-f0aac7e6bd3d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:32.486974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:32.496199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:32.497297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:32.498003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] PATH_INFO: `/v3/projects/59d9e06fb7874692bddf701463cf6691/users/c43a4daa9d4a4c2e8ee9d085e09dbc21/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:32.507663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d9e06fb7874692bddf701463cf6691, user_id=c43a4daa9d4a4c2e8ee9d085e09dbc21, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:32.523239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:32.593733 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2006/4044] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:47:32 2022] PUT /identity/v3/projects/59d9e06fb7874692bddf701463cf6691/users/c43a4daa9d4a4c2e8ee9d085e09dbc21/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:32.616360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:32.619462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:32.620348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:32.794541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] MFA Rules not processed for user `c43a4daa9d4a4c2e8ee9d085e09dbc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:32.802467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:32.885109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:33.258575 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2039/4045] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 644 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:33.267546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:33.325653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbff8b-3101-44e1-91b7-3901b7154256 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:33.346430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:33.347644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:33.348100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:33.362402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:33.365068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:33.371283 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:33.371283 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:33.371283 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:33.382862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:33.889918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2007/4046] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:47:33 2022] POST /identity/v3/domains => generated 275 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:33.894839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:33.946701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e75a4-0dce-4f5a-8311-7c658b9954df None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:34.470502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:34.471772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:34.472289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:34.472808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:34.474353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:34.486677 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:34.486677 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:34.486677 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:34.489050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:34.803640 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2040/4047] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:47:33 2022] PUT /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config => generated 138 bytes in 910 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:34.810627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:34.885633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b414f-8d21-4952-816a-bb3f5dc4d720 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:34.928307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:34.936781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:34.937887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:34.940005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:34.950844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5, group=identity)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:34.957825 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:34.957825 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:34.957825 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:34.964978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.036402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2008/4048] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 4 20:47:34 2022] GET /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/identity => generated 45 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:35.044550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.106598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8288349-5bb3-459f-a5c8-43b1834f2ab5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.137433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.142374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.144349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.146441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/identity/driver` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.157561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5, group=identity, option=driver)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.163833 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:35.163833 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:35.163833 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:35.167953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.202924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2041/4049] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 4 20:47:35 2022] GET /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/identity/driver => generated 31 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:35.208861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.258466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f177fc-9f2e-443f-a2cb-267e33d04b7b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.283565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.286963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.287869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.289872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.294163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5, group=ldap)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.305716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.334199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2009/4050] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:47:35 2022] GET /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap => generated 106 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:35.337862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.417797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735ead-d4e4-4396-83ca-9e5d16c823ea tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.460919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.462852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.464023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.464779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap/url` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.474561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5, group=ldap, option=url)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.485864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.513455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2042/4051] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 4 20:47:35 2022] GET /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap/url => generated 46 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:35.525544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.598799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e403e-374e-4b56-b91b-bdb8b2e777f2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.626780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.628427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.629180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.629902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap/user_tree_dn` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.633322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5, group=ldap, option=user_tree_dn)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.660814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.680429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2010/4052] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:35 2022] GET /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config/ldap/user_tree_dn => generated 63 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:35.691097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.731044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43707b-875a-4325-abc8-de69ce9fa11a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.748376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.750255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.751082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.751885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.757047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.759765 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:35.759765 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:35.759765 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:35.766087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:35.880651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2043/4053] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:35 2022] DELETE /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5/config => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:35.887598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:35.957868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1aad1-f3fb-4b58-a4e0-c73202c74e39 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:35.984762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:35.987129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:35.987892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:35.989555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:35.993373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:35.996423 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:35.996423 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:35.996423 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:36.005247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:36.100374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:36.105762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:36.352762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:36.358997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:36.380468 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2011/4054] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:35 2022] PATCH /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5 => generated 276 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:36.387068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:36.391718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:36.445162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba403985-c2ec-4f31-9f6c-e69da7f49a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:36.668204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:36.724529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:36.729946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:36.730420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:36.730890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:36.771316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08fb3e709dcd4c47a0ff3c4c3c05eba5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:36.774291 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:36.774291 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:36.774291 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:36.777673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:36.864800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:36.930179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.272898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.689533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.711755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.737371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] The token cache is being invalidate because project 08fb3e709dcd4c47a0ff3c4c3c05eba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:37.739011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.739687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.781131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.782571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.783757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08fb3e709dcd4c47a0ff3c4c3c05eba5', 'request_id': 'req-39b9d851-7b56-4faf-b85e-60adbef16464'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:37.835907 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2044/4055] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:36 2022] DELETE /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5 => generated 0 bytes in 1450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:37.847619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:37.870564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed71a-9072-4a6a-a98f-f424ca6d18e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:38.077197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:38.078618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:38.079484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:38.079925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:38.080560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:38.082415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:38.359990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2012/4056] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:47:37 2022] POST /identity/v3/domains => generated 277 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:38.362070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:38.365637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:38.392244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d851-7b56-4faf-b85e-60adbef16464 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:38.635329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:38.648752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:38.651682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:38.653108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:38.661422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:38.665347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:38.892494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:38.899677 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2045/4057] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:47:38 2022] PUT /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 138 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:47:38.907489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:38.940168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01fed-e11a-4346-b7b2-db4f59589af1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:38.970216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:38.971846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:38.972753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:38.976192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:38.977963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:38.989069 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:38.989069 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:38.989069 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:38.998056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.318407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:39.330509 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2013/4058] 10.222.0.78 () {60 vars in 1271 bytes} [Tue Oct 4 20:47:38 2022] PATCH /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 141 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:39.359665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccdf1-b387-49b7-ac62-dbaac6f17ff6 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:39.383267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:39.385010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:39.388021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:39.388820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:39.392979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:39.401903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.422893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:39.434251 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2046/4059] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:39 2022] GET /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 141 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:47:39.445824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8b683-a25c-46d6-a4a7-372a3fa2a11b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:39.457231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:39.459228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:39.460545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:39.461506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:39.463317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:39.467857 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:39.467857 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:39.467857 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:39.474381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.594575 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2014/4060] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:39 2022] DELETE /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:39.608790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:39.640173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abb4f9-c2d0-418b-b344-9a3c1f228e65 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:39.650553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:39.653407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:39.654966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:39.656082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:39.659709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:39.669810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find any options in domain configuration for domain a3edb67dc9f24135accaf88bf84b6220.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a3edb67dc9f24135accaf88bf84b6220. Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:39.721959 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a3edb67dc9f24135accaf88bf84b6220. Oct 04 20:47:39.723457 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:39.735299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:39.744045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2047/4061] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:39 2022] GET /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 151 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:47:39.761475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a604c-6f8b-47fb-9b82-07532a22b2c1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:39.775993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:39.775993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:39.775993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:39.776557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:39.778587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:39.782936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.808753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:39.811346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2015/4062] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:39 2022] DELETE /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220/config => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:39.834519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb3b0-c9be-451c-9af8-7c9968da6432 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:39.855373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:39.855373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:39.855373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:39.856046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:39.859875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:39.863455 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:39.863455 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:39.863455 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:39.866016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:39.962714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:39.966360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:40.176220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:40.177777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5e882373-2b49-466b-acf3-86265fe722e7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:40.188761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2048/4063] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:39 2022] PATCH /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220 => generated 278 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:40.191450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:40.196298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:40.277711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ab1b-2dfa-44dc-aa8d-068fb106b1e1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:40.294615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:40.486560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:40.488576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:40.489490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:40.490284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:40.584636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a3edb67dc9f24135accaf88bf84b6220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:40.588716 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:40.588716 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:40.588716 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:40.590259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:40.689168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:40.726687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.149195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.169074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.182992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.194943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:41.196166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:41.196724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:41.241567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] MFA Rules not processed for user `3b15e8c511234609ac4c8549a748f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:41.243536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:41.316905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] The token cache is being invalidate because project a3edb67dc9f24135accaf88bf84b6220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:41.318034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.322598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.369229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.407011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.411007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a3edb67dc9f24135accaf88bf84b6220', 'request_id': 'req-0c40efe4-3b2e-41e3-897b-4acde0957b1f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:41.459668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2016/4064] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:40 2022] DELETE /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220 => generated 0 bytes in 1270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:41.467979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:41.471093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:41.528921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2049/4065] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:41.680874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:41.739701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40efe4-3b2e-41e3-897b-4acde0957b1f tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:41.749797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:41.751346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:41.751846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:41.752360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:41.754034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:41.757612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:41.870694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2017/4066] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:47:41 2022] POST /identity/v3/domains => generated 276 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:41.877945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:41.922225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697845a8-c052-4f40-adf6-e1666d53f0d9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:42.140308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:42.142102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:42.142805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:42.143475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:42.145484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:42.154320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:42.423560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2050/4067] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:47:41 2022] PUT /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config => generated 138 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:47:42.432195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:42.456984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23254-0477-445c-8bb2-90170d1f569c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:42.477763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:42.491476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:42.491912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:42.492212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:42.493435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:42.507582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:42.743844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2018/4068] 10.222.0.78 () {60 vars in 1297 bytes} [Tue Oct 4 20:47:42 2022] PATCH /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity => generated 175 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:42.749237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:42.803041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ee1d7-dfd4-43ae-853e-1eb9bced4fc5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:42.843554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:42.844441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:42.844815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:42.845107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:42.845938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity, option=driver)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:42.847325 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:42.847325 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:42.847325 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:42.848356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:42.880321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:43.044262 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2051/4069] 10.222.0.78 () {60 vars in 1318 bytes} [Tue Oct 4 20:47:42 2022] PATCH /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver => generated 176 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:47:43.052975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:43.090717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126a4e-dcbc-45bc-9b82-89fbdbb05110 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:43.121198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:43.124190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:43.124973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:43.125544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:43.126804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity, option=driver)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:43.131824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:43.273247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2019/4070] 10.222.0.78 () {58 vars in 1299 bytes} [Tue Oct 4 20:47:43 2022] DELETE /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:43.278126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:43.324816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55536c63-03b4-44d6-93f5-ededc71af8b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:43.366300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:43.370748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:43.371888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:43.376024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:43.385027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity, option=driver)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:43.388412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find option driver in group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:43.431522 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:43.440227 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2052/4071] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 4 20:47:43 2022] GET /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity/driver => generated 171 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:47:43.447339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:43.475586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aff6a-6774-4ca6-bcc2-e487c26befb1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:43.494882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:43.495842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:43.496384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:43.496870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:43.502928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:43.517350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:43.659204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2020/4072] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 20:47:43 2022] DELETE /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:43.665443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:43.688548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e364aa-c5a6-4043-ae55-0e86c2320286 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:43.714281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:43.715534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:43.716143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:43.716594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:43.719189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8, group=identity)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:43.722338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:43.762666 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:43.765309 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:43.769905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2053/4073] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 4 20:47:43 2022] GET /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config/identity => generated 154 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 04 20:47:43.776362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:43.803368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4995-fa5c-414d-9da5-61c8720acce9 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:43.816878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:43.816878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:43.818066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:43.818881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:43.820980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:43.824997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8fde6-df34-4232-8586-8eda157fdc22 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:43.990428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2021/4074] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:43 2022] DELETE /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8/config => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:43.996522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:44.016138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdbf22-a29b-48f1-aa26-143517cc0a57 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:44.037892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:44.037892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:44.037892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:44.038885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:44.044545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:44.050397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:44.117781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.119647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.122232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:44.122870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:44.123421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:44.139584 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:47:44.141286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:47:44.150326 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2022/4075] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:47:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:47:44.312674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.313837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.324501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2054/4076] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:43 2022] PATCH /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8 => generated 277 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:47:44.331173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:44.334596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:44.609779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6fc6-299d-48d1-92ae-1cd34155b4a5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:44.638438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:44.642400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:44.644032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:44.647947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:44.704333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=904fa30f5c694ebdbbf84f0dc2da18f8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:44.712699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:44.827555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.845730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:44.955992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:45.168963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.202785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.226855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.380522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] The token cache is being invalidate because project 904fa30f5c694ebdbbf84f0dc2da18f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:45.382551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.388497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.423268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.437578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.444177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '904fa30f5c694ebdbbf84f0dc2da18f8', 'request_id': 'req-62e2dd2b-6478-4b6c-a572-8542e199b08c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:45.465365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2023/4077] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:44 2022] DELETE /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:45.475108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:45.513141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27800660-2e67-43a0-b4b4-cd3e2c8f9f3d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:45.764680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:45.766932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:45.768148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:45.768660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:45.772453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:45.772896 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:45.772896 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:47:45.772896 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:47:45.775068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:45.789955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2055/4078] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 4 20:47:45 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:47:45.796797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:45.800550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:45.830235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd2b-6478-4b6c-a572-8542e199b08c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:45.855085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:45.856855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:45.864327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:45.864327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:45.864327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:45.870686 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:47:45.870686 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:47:45.870686 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:47:45.873955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:45.884305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:45.885259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2024/4079] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:47:45 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:45.932223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7582e-4f2a-45d8-be7f-24be60c7663a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:45.964770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:45.971024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:45.971650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:45.973666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:45.976207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:45.986264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:45.997381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2056/4080] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:47:45 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.000493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.038683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773b7-a4be-43fc-8844-daaea6a38299 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.068710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.070304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.072930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.073563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.074806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.082130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.095630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2025/4081] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:45 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:46.096011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.130485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b5f4f-b65b-44b0-b7de-9ce0fa05734a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.180814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.193425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.193901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.194433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.196739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.199387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.209311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2057/4082] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:47:46.212294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.246877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e18e7-a759-4048-8c83-3f209ed29b1b tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.273003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.274238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.274755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.275298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.276451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.279813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.292620 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2026/4083] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.299850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.350399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f629-44f1-40c2-b217-d4da3e2ebbe3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.377984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.381101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.381919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.384189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.387964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.391249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.405464 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2058/4084] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:46.408187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.435261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72b4ea-b8dc-4b95-96b1-9a2ca4ea73ad tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.460242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.461382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.467465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.468981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.470804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.473472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.485185 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2027/4085] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.488505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.522043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab7b39-d1e2-4c27-b30c-ec7d01b2ffb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.540595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.541976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.542447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.542928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.544132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.554349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.564335 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2059/4086] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.567033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.600446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9a56c-ed9d-41da-94d2-516e3fb37126 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.633541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.635799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.636718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.637237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.638170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.641132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.643452 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2028/4087] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.649776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.674319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9367095-854d-4a95-a90e-330ac77fa604 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.694908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.701816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.704503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.705488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.708788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.712239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.717394 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2060/4088] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:46.723961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.755284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b7a8-78f4-4187-8a4f-bcfeefe98849 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.766563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.767900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.768552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.769549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.770597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.774099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.778917 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2029/4089] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:46.782465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.808292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b924a-b6fa-4ed6-9756-a7cedead0dce tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.817799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.829814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.829814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.829814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.829814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.830233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.830233 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2061/4090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:46.833807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.870931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ae5e-ff1d-4399-8c28-f99b2f9e0044 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.892309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.893394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.894793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.894793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.895591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:46.899176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:46.911186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2030/4091] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:46.912507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:46.956212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7869-ca4f-4c42-9cbf-8554ab7f7993 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:46.992967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:46.994466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:46.996339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:46.997002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:46.998407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.003058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.015246 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2062/4092] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:46 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.016228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.067124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af99f-ca8b-4a12-87f7-1abaec2b3686 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.105675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.113790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.113790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.113790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.113790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.121716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.133247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.137672 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2031/4093] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.173346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e8d8-9ebb-4bb5-94fa-4a70821ed190 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.192768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.195866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.198697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.198697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.210267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.214247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.225487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2063/4094] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:47.230006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.274356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da3c-04db-47f1-be2a-da8c06cf9334 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.304566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.311476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.312457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.313318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.315378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.327572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.336935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.339044 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2032/4095] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.368470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706940ba-f341-4cbc-8dcb-99b9d6a782d3 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.394656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.395948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.396828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.397474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.401107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.408890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.416440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2064/4096] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.422806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.465937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a003-30e8-4cf8-8f96-86f96df080b1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.495616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.501633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.503266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.507032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.508758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.518379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.528211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.529636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2033/4097] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.558168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd4af-5e52-43e4-bb89-659ae4cbfa81 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.598876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.604424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.604424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.605699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.606976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.615114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.624896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.649949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2065/4098] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:47.660711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c467af-7482-457e-94d6-52b69745ad6d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.688999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.690213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.690966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.691720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.695035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.702743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.713547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2034/4099] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.716107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.749823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f7b9-8db3-4c07-987f-e9f774b3115a tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.769373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.770509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.770992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.771495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.772864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.778602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.786160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2066/4100] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.816886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.870018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4d50-6de3-4de1-85b0-9a11dfd4e332 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.914347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:47.916909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:47.922953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:47.922953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:47.922953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:47.927577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:47.933230 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2035/4101] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:47.939506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:47.977252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845776d-a835-46cf-a8b8-446bc2694c11 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:47.999902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.001517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.002486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.006971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.008585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.011944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.021053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2067/4102] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:47 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.027639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.058822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8cee4-6ec2-4f8c-b012-a26bfbcd6c66 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.089766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.095388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.099933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.105207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.110625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.120967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.131074 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2036/4103] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.138823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.193725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5360e-24e6-4ef8-b325-e62ea6b82cb2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.228871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.230006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.230497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.231026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.232986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.245908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.248163 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2068/4104] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.259554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.325904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7150ba7-5b85-4d15-a909-46e5dbea1cf5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.337981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.339379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.340179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.340885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.343392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.347751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.350791 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2037/4105] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.360612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.380831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1f9c-fd7b-4e0f-b585-a09242aa6fd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.418431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.419729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.420229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.420731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.421915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.435181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.437419 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2069/4106] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.444230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.493727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c4aa2-0413-4fcc-9a7c-62b79d4e8a45 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.519860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.520041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.520418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.521180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.522815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.526337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.530128 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2038/4107] 10.222.0.78 () {58 vars in 1308 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.536548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.563393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e9f4-f6e4-4825-9934-031b314be108 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.644110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.645373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.647466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.648628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.651346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.666816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.700630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.703232 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2070/4108] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.755577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220e2c-fb56-47a8-811f-a3876ae8da2d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.816258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.817466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.817981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.818482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.819711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.826977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.851705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2039/4109] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.857067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:48.899985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01733-abbe-4780-9f7c-5bc9cf00c448 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:48.940547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:48.941788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:48.942317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:48.942835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:48.944087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:48.956593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:48.966646 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2071/4110] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:48.970805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.004357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f632386-806e-4f83-97b9-6890a7532a62 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.062038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.065711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.066378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.087539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.089281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.098876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.107844 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2040/4111] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:47:48 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.112569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.179663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659688c-ea39-4395-939b-e473eaf17840 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.213113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.214828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.215637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.216419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.219155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.226606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.231571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2072/4112] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:49.238952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.281275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7d778-ea50-4cf3-b155-b4431c7664e5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.292649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.294455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.295476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.296330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.297748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.308354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.327985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.339334 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2041/4113] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.348648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dbc5d-a3fd-4ddd-84ea-6facfa519749 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.355729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.357332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.357984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.358757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.360268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.367509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.373821 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2073/4114] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:49.379813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.427469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957f82-59ff-4873-9d5e-57c70c53fb47 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.440406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.442044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.443038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.443876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.445425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.450032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.454280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2042/4115] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:49.460518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.545895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8a13-4fe8-44e0-b4c5-cb7592b98c13 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.570754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.572868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.573571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.574676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.576735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.580558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.587417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2074/4116] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.589640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.628223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d253-d58c-48c7-9008-2c6885b99e76 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.649323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.653801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.654461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.656123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.663228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.674428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.677556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2043/4117] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.690477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.727666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738a1ec-382b-4515-8527-5c130ba095ec tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.741806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.743469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.744271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.745059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.746400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.749912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.757762 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2075/4118] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.759999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.795012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1368fc-8f7b-4e31-82ba-5f16ae0020a1 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.830425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.832092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.833768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.834478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.837526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.843719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.854501 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2044/4119] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:49.856141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.901177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8870-9bb2-4acb-97a1-b64812188f0d tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:49.930313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:49.931566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:49.932092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:49.932436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:49.933626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:49.940894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:49.975862 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2076/4120] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:49.976140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:49.996017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598dc7-8eb3-4009-a5ca-6afc9360d1f0 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.012645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.014723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.018461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.018977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.019848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.023227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.042617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.051215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2045/4121] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 4 20:47:49 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 04 20:47:50.053731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=1,keystone:INSERT=1,keystone:SELECT=97,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:50.066910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca864921-b5aa-4814-bfd3-fb893eb1d5ff tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.076520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.078160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.079008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.079859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.081949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.085684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.095469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.105154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2077/4122] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.137586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2274-5401-424b-b476-5faae3063155 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.149520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.150851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.151407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.152043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.153310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.157242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.167951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.177238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2046/4123] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.193908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef4b0-7cc0-4dc2-ba3e-7c57965929c5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.205681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.207038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.208192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.208718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.210139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.213641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.226350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.251107 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2078/4124] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.281473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4151a-5a8d-4e64-9d41-b7f30ac01d6c tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.308481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.310608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.313456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.314108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.319631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.325926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.340309 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2047/4125] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.345413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.377397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6000-4def-4733-b0e7-3ac4deb07e33 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.405364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.406914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.407765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.408267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.420510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.427001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.437978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.448238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2079/4126] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.466375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430c64a-d217-4416-9b63-327f76286f10 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.480158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.481774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.484109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.484109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.484915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.489450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.500100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.544510 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2048/4127] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.563939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e528-94e1-4c4a-9c53-97a8841e7e2e tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.578467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.583513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.584342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.585015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.590795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.606564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.618765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2080/4128] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.621569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.729658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099bd64-45b5-469a-8b04-0b3d4e7fa3ca tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.778629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.798545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.802710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.807624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.812486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.815070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.830175 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2049/4129] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:50.835733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.888885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94a28-4500-460e-ba65-d8dc1b3ec264 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:50.927068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:50.934725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:50.937090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:50.937651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:50.941886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:50.949896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:50.961260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:50.961514 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2081/4130] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:51.008346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7b64-f696-484a-88ce-00fdf1b2ad90 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:51.032178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:51.033105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:51.038035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:51.038500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:51.049927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:51.054694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:51.071599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:51.088287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2050/4131] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 20:47:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:47:51.103007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead135f-764b-49c9-9328-2ee9e846a7c2 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:51.127697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:51.130570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:51.131270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:51.131698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:51.157976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find domain: 904fa30f5c694ebdbbf84f0dc2da18f8.: keystone.exception.DomainNotFound: Could not find domain: 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:51.172099 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:51.174063 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:47:51.176838 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 904fa30f5c694ebdbbf84f0dc2da18f8. Oct 04 20:47:51.179500 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.182085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:51.191417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2082/4132] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:51 2022] PATCH /identity/v3/domains/904fa30f5c694ebdbbf84f0dc2da18f8 => generated 112 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:47:51.204742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e746c-0c4c-445d-b7ed-0ee680afedd5 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:51.214907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:51.216085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:51.217111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:51.217607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/a3edb67dc9f24135accaf88bf84b6220` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:51.251254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find domain: a3edb67dc9f24135accaf88bf84b6220.: keystone.exception.DomainNotFound: Could not find domain: a3edb67dc9f24135accaf88bf84b6220. Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a3edb67dc9f24135accaf88bf84b6220. Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:51.285756 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:51.290714 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:47:51.292667 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a3edb67dc9f24135accaf88bf84b6220. Oct 04 20:47:51.295459 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:47:51.305379 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2051/4133] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:51 2022] PATCH /identity/v3/domains/a3edb67dc9f24135accaf88bf84b6220 => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 04 20:47:51.311994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:51.352905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cf7da-fa85-4864-905a-75769bd68538 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:51.376574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43a4daa9d4a4c2e8ee9d085e09dbc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d9e06fb7874692bddf701463cf6691', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:51.378206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:51.380344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:51.380980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] PATH_INFO: `/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:51.421218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7b7c30e7-19d8-426f-b317-f4db49ef8f87 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Could not find domain: 08fb3e709dcd4c47a0ff3c4c3c05eba5.: keystone.exception.DomainNotFound: Could not find domain: 08fb3e709dcd4c47a0ff3c4c3c05eba5. Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08fb3e709dcd4c47a0ff3c4c3c05eba5. Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:47:51.445886 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:47:51.456294 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:47:51.457665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08fb3e709dcd4c47a0ff3c4c3c05eba5. Oct 04 20:47:51.458881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:47:51.458881 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2083/4134] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:47:51 2022] PATCH /identity/v3/domains/08fb3e709dcd4c47a0ff3c4c3c05eba5 => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:47:51.462907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:51.466325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:51.557846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:51.699183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c6f2-31ea-44e0-b0db-a0749bc080a7 tempest-DomainConfigurationTestJSON-1721920048 tempest-DomainConfigurationTestJSON-1721920048-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:51.715376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:51.718591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:51.718952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:51.723330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] PATH_INFO: `/v3/users/759924962d5e4bcd9ea6df8c3e8f27e7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:51.732743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=759924962d5e4bcd9ea6df8c3e8f27e7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:51.742575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:52.190264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759924962d5e4bcd9ea6df8c3e8f27e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:52.334312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759924962d5e4bcd9ea6df8c3e8f27e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:52.396967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759924962d5e4bcd9ea6df8c3e8f27e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:52.458495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759924962d5e4bcd9ea6df8c3e8f27e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:52.459877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759924962d5e4bcd9ea6df8c3e8f27e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:52.482255 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2052/4135] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:51 2022] DELETE /identity/v3/users/759924962d5e4bcd9ea6df8c3e8f27e7 => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:52.485383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:52.487256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:52.488248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:52.602828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:52.608221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:52.953879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:52.954137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:53.074453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2084/4136] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:53.134901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:53.140645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:53.299632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec06a0-c5d3-477d-9c91-a04d09a55f4b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:53.330325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:53.331533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:53.332108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:53.332638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] PATH_INFO: `/v3/users/06009ef2882e401f82f8858e5b816f4a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:53.334752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06009ef2882e401f82f8858e5b816f4a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:53.343370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:53.479769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d96f-4f0d-4ddd-bb04-ff66437b12e4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:53.489964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:53.491273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:53.492183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:53.493510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:53.516431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:53.523851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43f93-ca15-4ff9-ba62-a65b70855d62 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:53.551055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2085/4137] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:47:53.737104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:53.740015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06009ef2882e401f82f8858e5b816f4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:53.836307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06009ef2882e401f82f8858e5b816f4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:53.864082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06009ef2882e401f82f8858e5b816f4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:53.918836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06009ef2882e401f82f8858e5b816f4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:53.922417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06009ef2882e401f82f8858e5b816f4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:53.946875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2053/4138] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:52 2022] DELETE /identity/v3/users/06009ef2882e401f82f8858e5b816f4a => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:47:53.955672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:53.956192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:53.956681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:54.021114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:54.023689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:54.231204 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2086/4139] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:54.332475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:54.342599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:54.590371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f02f4-2ebf-48b9-8e9f-620eb745d260 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:54.600716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:54.601930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:54.602513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:54.603176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:54.638019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:54.646691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737cefe-7355-4ba0-a72c-d0ff93ed179d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:54.680197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2054/4140] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:47:55.780775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:55.784673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:55.819192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033193a-02de-4a18-928c-80756f08e9ae None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:55.831609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:55.836822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:55.837721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:55.838904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] PATH_INFO: `/v3/projects/a389ac5392924f5d8ad261551f5c5872` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:55.849238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a389ac5392924f5d8ad261551f5c5872)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:55.854433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:55.860062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:56.032840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:56.035369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:56.036273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:56.136443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] MFA Rules not processed for user `895545f1707940e4a10fbfc84253d705`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:56.137217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a389ac5392924f5d8ad261551f5c5872', 'request_id': 'req-1d5ad7b7-8cce-4811-a86c-b490bf96d985'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:56.139914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:56.260633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a389ac5392924f5d8ad261551f5c5872', 'request_id': 'req-1d5ad7b7-8cce-4811-a86c-b490bf96d985'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:56.297576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a389ac5392924f5d8ad261551f5c5872', 'request_id': 'req-1d5ad7b7-8cce-4811-a86c-b490bf96d985'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:56.311930 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2055/4141] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:47:56.343726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] The token cache is being invalidate because project a389ac5392924f5d8ad261551f5c5872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:47:56.344193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:56.344440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:56.346322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:56.347073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:56.353664 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2087/4142] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:55 2022] DELETE /identity/v3/projects/a389ac5392924f5d8ad261551f5c5872 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:56.358180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:56.377058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:56.508595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:56.564537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4fb6-1dc7-47cc-9869-4067b52ea38d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:56.579085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:56.580498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:56.581866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:56.583123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:56.594441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:56.637679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ad7b7-8cce-4811-a86c-b490bf96d985 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:56.643994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:56.649144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:56.650654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:56.651179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:56.651677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] PATH_INFO: `/v3/users/c43a4daa9d4a4c2e8ee9d085e09dbc21` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:56.654422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43a4daa9d4a4c2e8ee9d085e09dbc21)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:56.656334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:56.659468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:56.715351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2056/4143] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:57.107574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43a4daa9d4a4c2e8ee9d085e09dbc21'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:57.108896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43a4daa9d4a4c2e8ee9d085e09dbc21'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:57.222771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43a4daa9d4a4c2e8ee9d085e09dbc21'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:57.272374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43a4daa9d4a4c2e8ee9d085e09dbc21'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:57.294409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10359ec0-439a-4d64-a486-3b523dc5ec99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43a4daa9d4a4c2e8ee9d085e09dbc21'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:57.310683 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2088/4144] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:56 2022] DELETE /identity/v3/users/c43a4daa9d4a4c2e8ee9d085e09dbc21 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:57.503424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:57.507328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:57.551767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ea8c-e30c-4531-a07a-221fe815564d service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:57.802157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:57.804673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:57.805360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:57.806201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] PATH_INFO: `/v3/users/f233341383994ae29d0b661faf734d82` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:57.809004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f233341383994ae29d0b661faf734d82)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:57.816134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:58.257254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f233341383994ae29d0b661faf734d82'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:58.369731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:58.369731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:58.369731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:58.390346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f233341383994ae29d0b661faf734d82'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:58.428433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f233341383994ae29d0b661faf734d82'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:58.454396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:58.499693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f233341383994ae29d0b661faf734d82'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:58.501067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f233341383994ae29d0b661faf734d82'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:47:58.507785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] MFA Rules not processed for user `124ee4952519479f95536e976a096335`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:47:58.526568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:58.535635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2057/4145] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:47:57 2022] DELETE /identity/v3/users/f233341383994ae29d0b661faf734d82 => generated 0 bytes in 1032 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:47:58.909585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2089/4146] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:47:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:47:58.929663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:58.932269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:47:59.151051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:59.186431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8974056-7e7a-4937-9bba-f9fa6aa72423 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:47:59.200495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:47:59.201952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:47:59.202457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:47:59.202948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:47:59.238839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:47:59.242745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:47:59.302519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2058/4147] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:47:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:47:59.930803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:47:59.935516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:00.282878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6f5f-2c51-475b-97d7-b8ed094bbc13 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:00.293984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:00.295782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:00.301340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:00.301969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] PATH_INFO: `/v3/projects/59d9e06fb7874692bddf701463cf6691` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:00.304668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d9e06fb7874692bddf701463cf6691)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:00.307920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:00.379895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:00.382151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:00.461923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9be64-f319-466f-87d1-f809d280a782 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:00.482951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:00.484670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:00.484991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:00.485321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] PATH_INFO: `/v3/projects/5452397c0d2c44f2a98d71701462dcfd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:00.489661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5452397c0d2c44f2a98d71701462dcfd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:00.500209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:00.558749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d9e06fb7874692bddf701463cf6691', 'request_id': 'req-c5d4e584-75d6-479b-8201-c3f2ae5629e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.679620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d9e06fb7874692bddf701463cf6691', 'request_id': 'req-c5d4e584-75d6-479b-8201-c3f2ae5629e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.708235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d9e06fb7874692bddf701463cf6691', 'request_id': 'req-c5d4e584-75d6-479b-8201-c3f2ae5629e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.774409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] The token cache is being invalidate because project 59d9e06fb7874692bddf701463cf6691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:00.775907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.782563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.795119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2090/4148] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:59 2022] DELETE /identity/v3/projects/59d9e06fb7874692bddf701463cf6691 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:00.802911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:00.846090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:00.944057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5452397c0d2c44f2a98d71701462dcfd', 'request_id': 'req-f71c1db4-8828-4ceb-981d-e54cc4ebc777'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:00.967638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:01.019923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5452397c0d2c44f2a98d71701462dcfd', 'request_id': 'req-f71c1db4-8828-4ceb-981d-e54cc4ebc777'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.057471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5452397c0d2c44f2a98d71701462dcfd', 'request_id': 'req-f71c1db4-8828-4ceb-981d-e54cc4ebc777'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.094183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e584-75d6-479b-8201-c3f2ae5629e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:01.161457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] The token cache is being invalidate because project 5452397c0d2c44f2a98d71701462dcfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:01.161816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.162654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f71c1db4-8828-4ceb-981d-e54cc4ebc777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.171848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2059/4149] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:00 2022] DELETE /identity/v3/projects/5452397c0d2c44f2a98d71701462dcfd => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:01.173497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e7f3-93d7-4b41-866e-7231fa8e638b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:01.173497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e7f3-93d7-4b41-866e-7231fa8e638b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:01.173497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e7f3-93d7-4b41-866e-7231fa8e638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:01.249212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2e50e7f3-93d7-4b41-866e-7231fa8e638b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:01.286333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e50e7f3-93d7-4b41-866e-7231fa8e638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:01.379232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:01.380641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:01.383941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:01.386154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] PATH_INFO: `/v3/projects/0bda882a4cd446619c42073bf0aec919` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:01.392604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bda882a4cd446619c42073bf0aec919)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:01.404451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:01.575245 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2060/4150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:01.575245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaaf28-a087-4136-b5ca-c2b045fba968 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:01.575245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaaf28-a087-4136-b5ca-c2b045fba968 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:01.575245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaaf28-a087-4136-b5ca-c2b045fba968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:01.619664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fcbaaf28-a087-4136-b5ca-c2b045fba968 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:01.625311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcbaaf28-a087-4136-b5ca-c2b045fba968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:01.652149 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2061/4151] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:01.665791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38798a5-8c3f-4a03-bb72-2c42438279ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:01.684452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38798a5-8c3f-4a03-bb72-2c42438279ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:01.691321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38798a5-8c3f-4a03-bb72-2c42438279ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:01.705311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bda882a4cd446619c42073bf0aec919', 'request_id': 'req-e76923e2-35c7-4620-b550-4e537620320a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.771436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b38798a5-8c3f-4a03-bb72-2c42438279ea None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:01.789647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b38798a5-8c3f-4a03-bb72-2c42438279ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:01.827707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bda882a4cd446619c42073bf0aec919', 'request_id': 'req-e76923e2-35c7-4620-b550-4e537620320a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.862674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bda882a4cd446619c42073bf0aec919', 'request_id': 'req-e76923e2-35c7-4620-b550-4e537620320a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.913348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] The token cache is being invalidate because project 0bda882a4cd446619c42073bf0aec919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:01.913876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.921638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e76923e2-35c7-4620-b550-4e537620320a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:01.934273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2091/4152] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:00 2022] DELETE /identity/v3/projects/0bda882a4cd446619c42073bf0aec919 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:01.934273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:01.934273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:01.934273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.006942 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2062/4153] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:02.009657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.014548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.014548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.033440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:02.036219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:02.042071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:02.094258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2092/4154] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:02.096527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.111016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:02.114979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:02.137240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6b9f-2e6f-418a-b69c-11dd6ef2c561 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:02.156123 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2063/4155] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:02.162589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.173789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:02.175214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.175834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.176360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.177630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:02.178387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:02.183417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:02.197026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015e0e-a29c-43b0-8ba8-371bfe8ab977 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:02.218466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:02.226446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b78d-36f3-492b-b947-c380f39056d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:02.281961 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2064/4157] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:02.282238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2093/4157] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:02.282238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.287958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.288417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.288914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.324552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a2f8-4fcc-40e0-bb7f-a4ad5ee4a9e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:02.361376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:02.361376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.361376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.361376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.362911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:02.368214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:02.400599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:02.404760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:02.431417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2065/4158] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:02.434424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.492664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e340f1a-492e-4d86-838b-2c55b3a5ee79 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:02.549809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:02.552772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:02.554722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:02.558089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:02.561487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:02.569265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:02.584576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2094/4159] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:02 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:02.584576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.715283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:02.777114 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2066/4160] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:02 2022] POST /identity/v3/projects => generated 367 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:02.783047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:02.830725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40995a-8662-451c-ad8d-2f0a60ee1827 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.035191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b290d-a6bb-4189-9a61-9c174975ebae admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.044675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.044675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.045587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.045587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.046829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:03.047377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.047772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.050570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.051288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.053088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.053088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.054714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.066946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.117987 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2095/4161] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:03.119944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:03.164148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eadd4f-b9d4-41e3-bdb5-383c479ca2fe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.176343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.179406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.179406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.179406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.180496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.191509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.293147 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2067/4162] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:02 2022] POST /identity/v3/users => generated 287 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:03.293147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:03.321977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacef29-1585-4317-9d4c-ed37b16b6517 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.342969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.351897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.352880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.353247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.358719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.364985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.373859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2096/4163] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:03 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:03.377512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:03.448632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f38e-37bf-442b-abeb-cc02e8f791c7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.516483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.517870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.518202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.518609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.519444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.521971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.568905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2068/4164] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:03 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:03.579068 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2097/4165] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:03.581146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:03.585210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:03.640552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe2f8-ea5c-4b16-9d09-e86bcaf98a75 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.917887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508dd82-229e-42a9-83c1-980496a25d1c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:03.941672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.942419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:03.944815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.945889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:03.947301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.947938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:03.948430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.948920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:03.950139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.952992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:03.957235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:03.969088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.005135 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2069/4166] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:04.019373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.047677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c59b-fcfc-4ae0-97ec-c01a29e24a7e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.057443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:04.059187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.061920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.062834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.064405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:04.069881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.112310 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2070/4167] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:04.118688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.148822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886501d-64dd-4c5e-9fd6-06bc8ecc9aa6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.160015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:04.161438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.161993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.162501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.172227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:04.176103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.181624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:04.198537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2098/4168] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:03 2022] POST /identity/v3/users => generated 287 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:04.206232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.225237 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2071/4169] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:04.226990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.253424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc38969-019f-4027-a80a-6d1d5e764897 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.280627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:04.281895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b5d57-2818-4b4b-b6b2-b5fa382d0f35 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.287877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.288421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.288944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] PATH_INFO: `/v3/projects/21485db3d9e240e0927cd9c3bcf0ed1f/users/d7cd5eb1f46c402393ddbd5bcd92c1c6/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.311248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:04.314897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.314897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.314897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.323952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:04.328939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.348982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21485db3d9e240e0927cd9c3bcf0ed1f, user_id=d7cd5eb1f46c402393ddbd5bcd92c1c6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:04.355651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.393199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2072/4170] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:04.398511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.442937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7cf1-f65f-4d41-9633-d1d050835571 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.464642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:04.465613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.466677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.467207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] PATH_INFO: `/v3/projects/d0920d2dd14e4228a97a1c49ad5eb688/users/222dadea6f0e4bc29b07947cb0d225c9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.536868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0920d2dd14e4228a97a1c49ad5eb688, user_id=222dadea6f0e4bc29b07947cb0d225c9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:04.554036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77034cd-7c47-4ecc-b434-e75d9a55e162 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:04.572198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2099/4171] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:04 2022] PUT /identity/v3/projects/21485db3d9e240e0927cd9c3bcf0ed1f/users/d7cd5eb1f46c402393ddbd5bcd92c1c6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:04.578414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:04.604124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:04.734500 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2073/4172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:04 2022] PUT /identity/v3/projects/d0920d2dd14e4228a97a1c49ad5eb688/users/222dadea6f0e4bc29b07947cb0d225c9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:04.741547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f9826-9c5a-488c-925f-1b57e86bbafb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:04.745408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f9826-9c5a-488c-925f-1b57e86bbafb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:04.756142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f9826-9c5a-488c-925f-1b57e86bbafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:04.869088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362452b-1d82-4e34-b989-44ada43437d9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:04.882377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-479f9826-9c5a-488c-925f-1b57e86bbafb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:04.890411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-479f9826-9c5a-488c-925f-1b57e86bbafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:05.178427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:05.182914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:05.183796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2074/4173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:05.186451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:05.189072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:05.190512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:05.191440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:05.195105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:05.196055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:05.207010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e869b2-ed8d-4778-89a9-150a3574d18c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:05.261088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2100/4174] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 688 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:05.271319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:05.271894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:05.274821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:05.337454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] MFA Rules not processed for user `222dadea6f0e4bc29b07947cb0d225c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:05.343695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:05.468791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] MFA Rules not processed for user `806303426c474dbda5f6d91022dce7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:05.471257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:05.732496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2075/4175] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:05.739074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:05.744533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:05.869109 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2101/4176] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:05.870295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:05.917193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab69b2-3929-4887-83ce-91cabbf4042e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:05.940501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:05.941780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:05.942488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:05.943273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] PATH_INFO: `/v3/projects/daded8d01de747ecb1500cba48234bb3/users/f9ae1b191aae4fe6bab48b85431f677f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:06.009659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daded8d01de747ecb1500cba48234bb3, user_id=f9ae1b191aae4fe6bab48b85431f677f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:06.023942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:06.055889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216337a-ffda-4c63-9e76-e27639bb0ed9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:06.073912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:06.080732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:06.081449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:06.083753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:06.112270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:06.138716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:06.141802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f0c2-8425-4a1c-98d7-9a40c7b167bd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:06.169569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2102/4177] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:05 2022] PUT /identity/v3/projects/daded8d01de747ecb1500cba48234bb3/users/f9ae1b191aae4fe6bab48b85431f677f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:06.171191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:06.198705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2076/4178] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:06.206161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ebc5-c49b-4baa-9028-de213bfe3dd2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:06.206161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ebc5-c49b-4baa-9028-de213bfe3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:06.213905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ebc5-c49b-4baa-9028-de213bfe3dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:06.215183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:06.280259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c983ebc5-c49b-4baa-9028-de213bfe3dd2 None None] MFA Rules not processed for user `806303426c474dbda5f6d91022dce7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:06.286275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c983ebc5-c49b-4baa-9028-de213bfe3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:06.454403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487afad8-3650-44aa-b730-aa999223b297 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:06.472790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:06.473683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:06.474178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:06.474669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:06.475808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:06.478417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:06.542274 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2077/4179] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:06.545310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:06.546382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:06.547279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:06.673990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] MFA Rules not processed for user `f9ae1b191aae4fe6bab48b85431f677f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:06.684709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:06.712203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2103/4180] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:06 2022] POST /identity/v3/projects => generated 365 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:06.719956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:06.723399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:07.060798 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2078/4181] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:07.062348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:07.088979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e2e6-e489-441a-b9bf-e3f834d46fb1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:07.114279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d004-4a02-4d60-a2da-c6c9970f9203 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:07.118409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:07.119811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:07.120460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:07.121117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:07.365094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:07.371310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:07.376240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:07.376607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:07.377021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:07.377504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:07.378838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:07.388690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:07.422256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2104/4182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:07.422256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:07.467255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356b32b-fbe1-43da-984c-55377fbe7cd3 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:07.508449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:07.513898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:07.515969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:07.517542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:07.520808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:07.533818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:07.572330 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2079/4183] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:07 2022] POST /identity/v3/users => generated 289 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:07.588272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:07.650828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfba79-ecf2-4fe9-9afe-eee02b53a338 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:07.692684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:07.702559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:07.702559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:07.702559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:07.702559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:07.711435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:07.767749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2105/4184] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:07 2022] POST /identity/v3/projects => generated 375 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:07.779243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:07.781615 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2080/4185] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:07.783504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:07.827665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:07.866218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec7b7d-ed62-4184-ba60-6b4bd365c234 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:07.874425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:08.103422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cee8c8-4a84-4a61-8d39-555d41f87235 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:08.111286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:08.112865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.113623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.114691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] PATH_INFO: `/v3/projects/d707a15a090d421fadc14564d2ef3764/users/7761a17fd4214ce98e5668190cb5aaf8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:08.138715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:08.139810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.144727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.144727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:08.144727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:08.145402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:08.187777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d707a15a090d421fadc14564d2ef3764, user_id=7761a17fd4214ce98e5668190cb5aaf8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:08.202622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:08.389065 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2106/4186] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:07 2022] POST /identity/v3/users => generated 294 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:48:08.390856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:08.395338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2081/4187] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:07 2022] PUT /identity/v3/projects/d707a15a090d421fadc14564d2ef3764/users/7761a17fd4214ce98e5668190cb5aaf8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:08.413909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221aa9-69ae-4af8-80e8-1b7a0b8ea065 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:08.418245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:08.685874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:08.688291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.688895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.689464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:08.691237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:08.695536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:08.738855 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2107/4188] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:08.744046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:08.761288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f038a68-83e6-48a5-ba3a-e93f053e9a8c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:08.787771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ade59-2b2c-4b57-83ff-418930208425 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:08.791021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:08.794743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.799746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.803986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:08.811098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:08.831516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b24952-76aa-463e-bfd1-3c4ceba5af22 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:08.840497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:08.843919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.846650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.849439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] PATH_INFO: `/v3/projects/19104120f10b4143a5304bc6eafc9d23/users/f23513120a5a4ea4b1f1b09674e7dd15/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:08.935228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19104120f10b4143a5304bc6eafc9d23, user_id=f23513120a5a4ea4b1f1b09674e7dd15, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:08.940429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2082/4189] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:08.942579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:08.963781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:08.965229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:08.977573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:09.079889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] MFA Rules not processed for user `895545f1707940e4a10fbfc84253d705`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:09.082752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:09.086704 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2108/4190] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:08 2022] PUT /identity/v3/projects/19104120f10b4143a5304bc6eafc9d23/users/f23513120a5a4ea4b1f1b09674e7dd15/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:09.086704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:09.384232 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2083/4191] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:09.389526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:09.417402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6fd83-3689-466c-8007-791efd2bc148 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:09.443261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:09.444819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:09.445802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:09.446755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:09.451703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:09.453512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e9f9-ad0d-4ae8-9576-e53407f312b8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:09.461734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:09.490124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644588f-056f-44c5-9957-671407185350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:09.496745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644588f-056f-44c5-9957-671407185350 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:09.497640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644588f-056f-44c5-9957-671407185350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:09.498168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644588f-056f-44c5-9957-671407185350 admin admin] PATH_INFO: `/v3/projects/d707a15a090d421fadc14564d2ef3764/users/7761a17fd4214ce98e5668190cb5aaf8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:09.520147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644588f-056f-44c5-9957-671407185350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d707a15a090d421fadc14564d2ef3764, user_id=7761a17fd4214ce98e5668190cb5aaf8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:09.528807 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2084/4192] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:09.537789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644588f-056f-44c5-9957-671407185350 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:09.539896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:09.611046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7832a-3a96-4ae8-ac40-3cff1a8772ac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:09.617896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2109/4193] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:09 2022] PUT /identity/v3/projects/d707a15a090d421fadc14564d2ef3764/users/7761a17fd4214ce98e5668190cb5aaf8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:09.641707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82251-94c2-468e-a643-528165197e5d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:09.650206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82251-94c2-468e-a643-528165197e5d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:09.650986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82251-94c2-468e-a643-528165197e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:09.766618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:09.768645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:09.856707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-19b82251-94c2-468e-a643-528165197e5d None None] MFA Rules not processed for user `7761a17fd4214ce98e5668190cb5aaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:09.859750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19b82251-94c2-468e-a643-528165197e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:10.007882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:10.009177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:10.009640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:10.010137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] PATH_INFO: `/v3/projects/19104120f10b4143a5304bc6eafc9d23/users/f23513120a5a4ea4b1f1b09674e7dd15/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:10.024807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19104120f10b4143a5304bc6eafc9d23, user_id=f23513120a5a4ea4b1f1b09674e7dd15, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:10.030658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d6d84-86f8-4caf-8b1e-23c46763b268 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:10.109792 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2085/4194] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:09 2022] PUT /identity/v3/projects/19104120f10b4143a5304bc6eafc9d23/users/f23513120a5a4ea4b1f1b09674e7dd15/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:10.133917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:10.147511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:10.147838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:10.255638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2110/4195] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:10.261541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82251-94c2-468e-a643-528165197e5d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:10.325554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] MFA Rules not processed for user `f23513120a5a4ea4b1f1b09674e7dd15`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:10.330468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:10.350683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82251-94c2-468e-a643-528165197e5d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:10.757666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:10.758872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:10.759385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:10.759903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:10.761203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:10.767843 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:10.767843 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:48:10.767843 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:48:10.777367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4d4a-d01f-4b22-a039-ebefeb4e204c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:10.798258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2086/4196] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 663 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:10.800888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:10.845973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ca68-bd11-4e31-bdcd-5bbfaa8c9972 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:10.882680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:10.883904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:10.884689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:10.885565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:10.887043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:10.899529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:11.004039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2111/4197] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:48:10 2022] POST /identity/v3/domains => generated 277 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:11.006636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567394-3f1d-462d-b773-63423989151a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:11.007239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567394-3f1d-462d-b773-63423989151a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:11.007848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567394-3f1d-462d-b773-63423989151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-af567394-3f1d-462d-b773-63423989151a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:48:11.032362 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:48:11.034473 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:48:11.069185 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2112/4198] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:48:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:48:11.069185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567394-3f1d-462d-b773-63423989151a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:11.219065 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2087/4199] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:10 2022] POST /identity/v3/projects => generated 350 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:11.221144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:11.407700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567394-3f1d-462d-b773-63423989151a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:11.541467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac813-e20c-4b6f-97e3-daf63a2696d9 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:11.595731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:11.620098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:11.625154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:11.628900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:11.628900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:11.628900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:11.647806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:11.684269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:11.685714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:11.686238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:11.687481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:11.688876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:11.695710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:11.952718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2113/4200] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:11 2022] POST /identity/v3/users => generated 347 bytes in 895 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:11.957474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:11.962899 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2088/4201] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:11 2022] POST /identity/v3/projects => generated 350 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:11.968766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:12.006247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:12.025088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8af8-93d3-45f0-8320-4e0416159367 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.393893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.395022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.395577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.396085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.397343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.406526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.411781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d856-fbc1-4e93-ab19-35b8ec526151 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.419919 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.server.flask.common [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 20:48:12.460822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.462082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.462572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.463362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/users/f9ae1b191aae4fe6bab48b85431f677f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.472465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:get_user(user_id=f9ae1b191aae4fe6bab48b85431f677f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.477461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.501229 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2089/4202] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:48:11 2022] GET /identity/v3/users/f9ae1b191aae4fe6bab48b85431f677f => generated 287 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:12.506058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:12.553289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718577e-3046-42b7-a825-64f1281280b7 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.583802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.584901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.586755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.588876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.590241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.594280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.679825 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2114/4203] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:11 2022] POST /identity/v3/users => generated 323 bytes in 724 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:12.694016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:12.754054 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2090/4204] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 4 20:48:12 2022] POST /identity/v3/credentials => generated 430 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:12.762666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9110-9d2b-46f4-b433-3f1bbc9beb35 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.773015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:12.806083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.809099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.813327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.813835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users/ec4108db42cf4ddeb95604d7df25a98d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.833766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e339331-512d-416b-a557-a6cc2a2d074c tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.871104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.872582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.872975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.873497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.876780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.879010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.887747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:get_user(user_id=ec4108db42cf4ddeb95604d7df25a98d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.891103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.895847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.898644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:12.904068 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2115/4205] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:48:12 2022] GET /identity/v3/users/ec4108db42cf4ddeb95604d7df25a98d => generated 347 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:12.909340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:12.942272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf0e4d-930c-4b06-a6b9-ad7ea0c186b0 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:12.967439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:12.968589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:12.969379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:12.970322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:12.972133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Adding query filter params (domain_id=534c7dd7d0974b5f94fe1ef3d917b8cf) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:12.973870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:12.979932 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:12.979932 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:48:12.979932 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:48:12.982544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.039092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2116/4206] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 4 20:48:12 2022] GET /identity/v3/users?domain_id=534c7dd7d0974b5f94fe1ef3d917b8cf => generated 484 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:13.063602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.067220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2091/4207] 10.222.0.78 () {60 vars in 1358 bytes} [Tue Oct 4 20:48:12 2022] PATCH /identity/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9 => generated 437 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:13.071583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.112526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00028106-36aa-4023-bab8-121e81f1a9b5 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.114342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756027-bf09-422f-9162-3f04e3458977 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.145019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.145650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.149488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.152049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.153351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.156983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.157937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.158188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.165582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.172162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.177795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.182270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.213072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2092/4208] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 4 20:48:13 2022] GET /identity/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9 => generated 437 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:13.221550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.312649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f43a64-7379-4050-829a-aec6978286ed tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.344552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.345742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.346255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.346759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.362801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.379750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.449540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2117/4209] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:13 2022] GET /identity/v3/users => generated 8568 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:13.458722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.519518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0bcaf-67da-443c-8b7b-b62c8807582b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.524017 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2093/4210] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 4 20:48:13 2022] DELETE /identity/v3/credentials/39318f672ccb1b383dc35b9782b7544ce61d923e1991a0f37b6b77dcb2e2f0f9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:13.543946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.564494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.565685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.566181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.568290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.576957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1590418059) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:13.580170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.586634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.645795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc2b0-ca69-46e1-af8c-1b08705db33a tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.689690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.690803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.691315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.698840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.701348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.712825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.748688 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2118/4211] 10.222.0.78 () {58 vars in 1189 bytes} [Tue Oct 4 20:48:13 2022] GET /identity/v3/users?name=tempest-test_user-1590418059 => generated 475 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:48:13.756558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.787158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45365a-c63c-4fd1-b264-c384bfccee02 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.807228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.807907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.808242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.808629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.810430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:13.810885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:13.813463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:13.907083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2119/4212] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 4 20:48:13 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:13.915322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.946851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59ade3-bed9-4d02-9059-f7b9dc7754e9 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:13.949038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2094/4213] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 4 20:48:13 2022] POST /identity/v3/credentials => generated 430 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:13.953266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:13.970372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:13.972063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:13.972456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:13.972850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users/56f1cd7bdd504bcd9d2586de26e535a0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:13.997945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a649c-10eb-44af-a590-1824dac51b57 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:14.024205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:14.028764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:14.031940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:delete_user(user_id=56f1cd7bdd504bcd9d2586de26e535a0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.036857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:14.039373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.041347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:14.051487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.053777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.132566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:14.191426 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2095/4214] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 4 20:48:13 2022] POST /identity/v3/credentials => generated 431 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:14.194291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:14.233548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73b3f-28f9-43ff-b843-bfb81a6f56af tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:14.246243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:14.248997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:14.249815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:14.250557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:14.251768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.256338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.273561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.277365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.286239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.291566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.302389 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2096/4215] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 4 20:48:14 2022] GET /identity/v3/credentials => generated 946 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:14.304097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:14.337826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d46ba8-6916-4962-a24b-fb1d398ded97 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:14.351801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:14.353265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:14.353920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:14.354967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials/e59dbca496a163cd571893c3f966be757490b85c5b1e2f47cb30888d181827fb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:14.358814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f1cd7bdd504bcd9d2586de26e535a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:14.359875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=e59dbca496a163cd571893c3f966be757490b85c5b1e2f47cb30888d181827fb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:14.362753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f1cd7bdd504bcd9d2586de26e535a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:14.365558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:14.491990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f1cd7bdd504bcd9d2586de26e535a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:14.569872 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2097/4216] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 4 20:48:14 2022] DELETE /identity/v3/credentials/e59dbca496a163cd571893c3f966be757490b85c5b1e2f47cb30888d181827fb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:14.571352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:14.604080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f1cd7bdd504bcd9d2586de26e535a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:14.628805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f1cd7bdd504bcd9d2586de26e535a0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:14.644218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2120/4217] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:13 2022] DELETE /identity/v3/users/56f1cd7bdd504bcd9d2586de26e535a0 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:14.648231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:14.658476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:14.663318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d081-f097-4d5d-ba12-96763039e4ee tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:14.968052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfb76-fa9b-4947-8422-f4dfd06c621b tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:14.984934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:14.989418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:14.994096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:14.994096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/credentials/deab263c350d063808fa372c98bacb15306a2c658e9850f38c0c051c622de149` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:14.996542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:14.999745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:15.008816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=deab263c350d063808fa372c98bacb15306a2c658e9850f38c0c051c622de149)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:15.011775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:15.013014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/users/ec4108db42cf4ddeb95604d7df25a98d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:15.016699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:15.021566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec4108db42cf4ddeb95604d7df25a98d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:15.045611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:15.220008 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2098/4218] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 4 20:48:14 2022] DELETE /identity/v3/credentials/deab263c350d063808fa372c98bacb15306a2c658e9850f38c0c051c622de149 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:15.227948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:15.233443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:15.269998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:15.290456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e3bb-0648-4a84-8ebb-81de2f83f483 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:15.371250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:15.373031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:15.375668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:15.377815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/projects/4a5706e2cdea499087a28749670e7855` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:15.382545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a5706e2cdea499087a28749670e7855)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:15.393591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:15.453136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4108db42cf4ddeb95604d7df25a98d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.456489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4108db42cf4ddeb95604d7df25a98d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.542142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4108db42cf4ddeb95604d7df25a98d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.598893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4108db42cf4ddeb95604d7df25a98d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.662969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4108db42cf4ddeb95604d7df25a98d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.722965 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2121/4219] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:14 2022] DELETE /identity/v3/users/ec4108db42cf4ddeb95604d7df25a98d => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:15.725937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:15.735929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:15.772263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5706e2cdea499087a28749670e7855', 'request_id': 'req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.803731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5706e2cdea499087a28749670e7855', 'request_id': 'req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.820082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5706e2cdea499087a28749670e7855', 'request_id': 'req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.872515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:15.956904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] The token cache is being invalidate because project 4a5706e2cdea499087a28749670e7855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:15.957603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.959825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:15.964026 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2099/4220] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:15 2022] DELETE /identity/v3/projects/4a5706e2cdea499087a28749670e7855 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:15.972136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:15.975199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:16.007531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d707713-d085-410d-82ad-24bb46c4274c tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:16.214911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec2c31-a556-4fb6-a0d7-909e5bdddea4 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:16.239045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23513120a5a4ea4b1f1b09674e7dd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19104120f10b4143a5304bc6eafc9d23', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:16.240691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:16.241499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:16.242018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] PATH_INFO: `/v3/projects/87f4e24ba7bb4b918c4d4d7d80a0070d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:16.247819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87f4e24ba7bb4b918c4d4d7d80a0070d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:16.251043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:16.262058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:16.262988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:16.263086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:16.263086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/domains/534c7dd7d0974b5f94fe1ef3d917b8cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:16.263086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=534c7dd7d0974b5f94fe1ef3d917b8cf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:16.263086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:16.371959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.375063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.515025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f4e24ba7bb4b918c4d4d7d80a0070d', 'request_id': 'req-339320b6-f3d0-484d-b707-37218d0df467'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.551573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f4e24ba7bb4b918c4d4d7d80a0070d', 'request_id': 'req-339320b6-f3d0-484d-b707-37218d0df467'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.587785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f4e24ba7bb4b918c4d4d7d80a0070d', 'request_id': 'req-339320b6-f3d0-484d-b707-37218d0df467'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.626748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.627807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.636503 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2122/4221] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:48:15 2022] PATCH /identity/v3/domains/534c7dd7d0974b5f94fe1ef3d917b8cf => generated 278 bytes in 908 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:16.639580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:16.645138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:16.736423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] The token cache is being invalidate because project 87f4e24ba7bb4b918c4d4d7d80a0070d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:16.737048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.743220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:16.750906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2100/4222] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:15 2022] DELETE /identity/v3/projects/87f4e24ba7bb4b918c4d4d7d80a0070d => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:16.752534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:16.760207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:16.862286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:16.992549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c3b8-38e2-4de2-82e8-b1c914dcd2a8 tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:17.052723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339320b6-f3d0-484d-b707-37218d0df467 tempest-CredentialsTestJSON-1440988711 tempest-CredentialsTestJSON-1440988711-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:17.056931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:17.057955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:17.058307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:17.058650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] PATH_INFO: `/v3/users/f9ae1b191aae4fe6bab48b85431f677f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:17.060282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ae1b191aae4fe6bab48b85431f677f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:17.062821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:17.173342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7761a17fd4214ce98e5668190cb5aaf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707a15a090d421fadc14564d2ef3764', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:17.174130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:17.175359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:17.176121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] PATH_INFO: `/v3/domains/534c7dd7d0974b5f94fe1ef3d917b8cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:17.205588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=534c7dd7d0974b5f94fe1ef3d917b8cf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:17.209193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:17.276861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.317877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:17.321276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.436122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ae1b191aae4fe6bab48b85431f677f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.531562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ae1b191aae4fe6bab48b85431f677f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.558513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ae1b191aae4fe6bab48b85431f677f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.593626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.606069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ae1b191aae4fe6bab48b85431f677f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.607821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-adb0d12f-b680-4d79-a340-d89995a23080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ae1b191aae4fe6bab48b85431f677f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.642212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2101/4223] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:16 2022] DELETE /identity/v3/users/f9ae1b191aae4fe6bab48b85431f677f => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:17.650609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:17.651778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:17.653735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:17.715162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:17.719609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.736650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:17.743880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.785798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] The token cache is being invalidate because project 534c7dd7d0974b5f94fe1ef3d917b8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:17.786112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.787531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.822142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.822967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.823987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '534c7dd7d0974b5f94fe1ef3d917b8cf', 'request_id': 'req-1accfd34-a222-472a-898b-42897aef233d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:17.856725 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2123/4224] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:48:16 2022] DELETE /identity/v3/domains/534c7dd7d0974b5f94fe1ef3d917b8cf => generated 0 bytes in 1218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:17.862111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:17.864193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:18.054858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2102/4225] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:18.079660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accfd34-a222-472a-898b-42897aef233d tempest-UsersV3TestJSON-336367907 tempest-UsersV3TestJSON-336367907-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:18.093637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:18.098485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:18.100523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:18.103560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] PATH_INFO: `/v3/users/222dadea6f0e4bc29b07947cb0d225c9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:18.108625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222dadea6f0e4bc29b07947cb0d225c9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:18.115347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:18.125047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:18.129423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:18.292447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:18.400846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54dcf1-79c6-4230-a5fb-376ef99e86cd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:18.421910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:18.425629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:18.425629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:18.426053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:18.439709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222dadea6f0e4bc29b07947cb0d225c9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:18.441499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222dadea6f0e4bc29b07947cb0d225c9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:18.475775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:18.480538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470ffd-255b-45d0-9939-d85dac50c0dc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:18.513236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2103/4226] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:48:18.620068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222dadea6f0e4bc29b07947cb0d225c9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:18.656244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222dadea6f0e4bc29b07947cb0d225c9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:18.688302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222dadea6f0e4bc29b07947cb0d225c9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:18.712662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2124/4227] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:17 2022] DELETE /identity/v3/users/222dadea6f0e4bc29b07947cb0d225c9 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:18.714733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:18.715089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:18.719411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:18.753631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:18.755411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:18.870667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:19.076679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:19.078709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:19.085652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2104/4228] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:19.119514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e48cd-bb54-4762-b30d-2f6c559af629 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:19.143060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:19.146004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:19.146608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:19.148529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] PATH_INFO: `/v3/users/3b15e8c511234609ac4c8549a748f73b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:19.152070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b15e8c511234609ac4c8549a748f73b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:19.156989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:19.229303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:19.231608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:19.568476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e2e4-c221-4d9d-8ba9-94110b11ef68 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:19.591280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:19.593508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:19.594856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:19.597413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:19.641384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:19.657782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:19.679811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b15e8c511234609ac4c8549a748f73b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:19.684492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b15e8c511234609ac4c8549a748f73b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:19.702169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2105/4229] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:19.880222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b15e8c511234609ac4c8549a748f73b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:19.919308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b15e8c511234609ac4c8549a748f73b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:19.969686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b15e8c511234609ac4c8549a748f73b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:20.005083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2125/4230] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:19 2022] DELETE /identity/v3/users/3b15e8c511234609ac4c8549a748f73b => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:21.660104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:21.666879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:21.749329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e90a9-1997-4993-af83-ed6c1e7c2ed0 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:22.046607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:22.048340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:22.049093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:22.049763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] PATH_INFO: `/v3/projects/daded8d01de747ecb1500cba48234bb3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:22.052540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daded8d01de747ecb1500cba48234bb3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:22.059515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:22.205467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:22.402494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daded8d01de747ecb1500cba48234bb3', 'request_id': 'req-984d2b38-4ae0-4f49-925a-98a6411da7c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:22.450093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daded8d01de747ecb1500cba48234bb3', 'request_id': 'req-984d2b38-4ae0-4f49-925a-98a6411da7c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:22.480350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daded8d01de747ecb1500cba48234bb3', 'request_id': 'req-984d2b38-4ae0-4f49-925a-98a6411da7c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:22.643089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] The token cache is being invalidate because project daded8d01de747ecb1500cba48234bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:22.645082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:22.659381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:22.664723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2106/4231] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:21 2022] DELETE /identity/v3/projects/daded8d01de747ecb1500cba48234bb3 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:22.671781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:22.677293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:22.826741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6987a-9a18-4d6f-8e61-22f5f070b7ee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:22.888495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:22.891584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:23.203314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:23.208878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:23.209417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:23.215745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] PATH_INFO: `/v3/users/f23513120a5a4ea4b1f1b09674e7dd15` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:23.226105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23513120a5a4ea4b1f1b09674e7dd15)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:23.257349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:23.292328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:23.323840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2b38-4ae0-4f49-925a-98a6411da7c6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:23.358147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:23.365740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:23.365740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:23.365740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] PATH_INFO: `/v3/projects/2afc6ef8dc874ff5ad52048c0ea409e2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:23.365740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afc6ef8dc874ff5ad52048c0ea409e2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:23.388085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:23.681788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23513120a5a4ea4b1f1b09674e7dd15'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.689655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23513120a5a4ea4b1f1b09674e7dd15'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.695536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afc6ef8dc874ff5ad52048c0ea409e2', 'request_id': 'req-c06cafba-6c10-4820-987d-2c78b32837fe'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.727445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afc6ef8dc874ff5ad52048c0ea409e2', 'request_id': 'req-c06cafba-6c10-4820-987d-2c78b32837fe'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.760947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afc6ef8dc874ff5ad52048c0ea409e2', 'request_id': 'req-c06cafba-6c10-4820-987d-2c78b32837fe'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.828180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23513120a5a4ea4b1f1b09674e7dd15'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.872155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23513120a5a4ea4b1f1b09674e7dd15'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.890749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23513120a5a4ea4b1f1b09674e7dd15'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.907727 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2126/4232] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:22 2022] DELETE /identity/v3/users/f23513120a5a4ea4b1f1b09674e7dd15 => generated 0 bytes in 1237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:23.911893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:23.915070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:23.972018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] The token cache is being invalidate because project 2afc6ef8dc874ff5ad52048c0ea409e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:23.973835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.977489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c06cafba-6c10-4820-987d-2c78b32837fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:23.983786 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2107/4233] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:22 2022] DELETE /identity/v3/projects/2afc6ef8dc874ff5ad52048c0ea409e2 => generated 0 bytes in 1097 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:24.001505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6eaf1-bf2d-43ca-8072-81e9fec3f6e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:24.002141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6eaf1-bf2d-43ca-8072-81e9fec3f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:24.002904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6eaf1-bf2d-43ca-8072-81e9fec3f6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:24.066061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ea6eaf1-bf2d-43ca-8072-81e9fec3f6e9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:24.072085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ea6eaf1-bf2d-43ca-8072-81e9fec3f6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:24.228501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:24.359239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2108/4234] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:24.359537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f12cb-631d-4a79-b2ad-73f43922df1a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:24.365854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:24.366432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:24.366734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:24.375738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:24.378717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:24.380550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:24.381891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] PATH_INFO: `/v3/projects/d0920d2dd14e4228a97a1c49ad5eb688` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:24.388721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0920d2dd14e4228a97a1c49ad5eb688)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:24.394793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:24.453061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:24.456780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:24.510264 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2109/4235] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:24.517362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:24.539305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b7e12-a2a1-4f6f-9f63-cc353172df45 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:24.552004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:24.553279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:24.553839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:24.554398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:24.560665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:24.561537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:24.565414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:24.613454 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2110/4236] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:24.615432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:24.652668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4396b-a21f-404d-8f13-1a6e29de2700 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:24.663127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:24.664491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:24.664996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:24.678445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:24.686759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:24.693550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:24.762177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0920d2dd14e4228a97a1c49ad5eb688', 'request_id': 'req-3ea0e2af-26e4-42a5-807a-97eb53528dc1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:24.886395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2111/4237] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:48:24.894113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:24.895753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0920d2dd14e4228a97a1c49ad5eb688', 'request_id': 'req-3ea0e2af-26e4-42a5-807a-97eb53528dc1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:24.933781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0920d2dd14e4228a97a1c49ad5eb688', 'request_id': 'req-3ea0e2af-26e4-42a5-807a-97eb53528dc1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:25.007406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] The token cache is being invalidate because project d0920d2dd14e4228a97a1c49ad5eb688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:25.009196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:25.015093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:25.031724 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2127/4238] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:23 2022] DELETE /identity/v3/projects/d0920d2dd14e4228a97a1c49ad5eb688 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:25.041592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:25.045250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:25.131993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:25.154980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48058d-9ffd-4c39-adc5-a9d0761ecf46 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:25.181018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:25.182428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.184256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.186733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.195875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:25.200261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:25.300287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0e2af-26e4-42a5-807a-97eb53528dc1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:25.314319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:25.315480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.316185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.318213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] PATH_INFO: `/v3/users/7761a17fd4214ce98e5668190cb5aaf8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.319726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7761a17fd4214ce98e5668190cb5aaf8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:25.327441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:25.444380 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2112/4239] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:24 2022] POST /identity/v3/users => generated 287 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:25.447483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:25.468498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:25.520194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a736a-62d6-4028-b248-f461677a4854 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:25.532274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:25.533464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.534057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.534609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.535879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:25.538891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:25.570117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2113/4240] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:25.572783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:25.607662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072009e-add4-4737-bf91-016286a8c2be admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:25.619500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:25.621035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.621913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.622690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.629907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:25.629907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:25.668935 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2114/4241] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:25.668935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:25.709714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a6d7-63bc-402f-afb0-c935507f3028 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:25.720329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:25.721525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.722010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.722490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] PATH_INFO: `/v3/projects/0ab943ca7b4f4ad3ac63ee0067fa6376/users/9c7d0e3889e34fa1b24d19f7f68bc56c/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.766757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab943ca7b4f4ad3ac63ee0067fa6376, user_id=9c7d0e3889e34fa1b24d19f7f68bc56c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:25.783985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d08ba-003d-43f5-ba25-8726e3fbf457 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:25.811311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7761a17fd4214ce98e5668190cb5aaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:25.813928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7761a17fd4214ce98e5668190cb5aaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:25.910668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2115/4242] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:25 2022] PUT /identity/v3/projects/0ab943ca7b4f4ad3ac63ee0067fa6376/users/9c7d0e3889e34fa1b24d19f7f68bc56c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:25.923271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:25.923911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:25.924350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:25.941004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7761a17fd4214ce98e5668190cb5aaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:26.016870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:26.020336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:26.030455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7761a17fd4214ce98e5668190cb5aaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:26.094222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7761a17fd4214ce98e5668190cb5aaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:26.130955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2128/4243] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:25 2022] DELETE /identity/v3/users/7761a17fd4214ce98e5668190cb5aaf8 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:26.286640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:26.408971 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2116/4244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:26.651910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:26.662846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:26.924518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de152851-6cb6-4d92-9c36-39c735370dcd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:26.946837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:26.948568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:26.951431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:26.952336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:27.012762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:27.016571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:27.067031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec09255-6d61-418b-8358-10f4589e973f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:27.177926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:27.227972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:27.231749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a52c6c-0403-42d1-9ba3-2b263cb5016e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:27.266946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2129/4245] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:48:27.374430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:27.375217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:27.375510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:27.375880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] PATH_INFO: `/v3/projects/19104120f10b4143a5304bc6eafc9d23` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:27.380371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19104120f10b4143a5304bc6eafc9d23)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:27.383641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:27.725430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19104120f10b4143a5304bc6eafc9d23', 'request_id': 'req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:27.785777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19104120f10b4143a5304bc6eafc9d23', 'request_id': 'req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:27.829483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19104120f10b4143a5304bc6eafc9d23', 'request_id': 'req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:27.964625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] The token cache is being invalidate because project 19104120f10b4143a5304bc6eafc9d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:27.966703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:27.973501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82bebcf2-deb5-49d6-a5da-f8bccb6eb43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:27.996559 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2117/4246] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:27 2022] DELETE /identity/v3/projects/19104120f10b4143a5304bc6eafc9d23 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:28.004901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:28.006615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:28.007547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:28.125174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:28.128135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:28.379519 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2130/4247] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:28.395086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:28.396011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:28.396578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:28.457906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:28.460353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:28.484592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:28.493402 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2118/4248] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:28.504880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e82e-5f79-41d4-aeb3-4c574f6c4e41 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:28.518088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:28.518088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:28.518088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:28.518088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:28.518939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:28.519482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:28.524159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:28.569385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:28.578265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2131/4249] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:28.607106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3e40-43e9-47c7-946a-abb0f81da923 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:28.623607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:28.625840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:28.629263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:28.630342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:28.631942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:28.638199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:28.817794 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2119/4250] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:28 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:28.820014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:28.840470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782b1ec-ea4f-42e0-acc6-6beb25b16f59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:29.150369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:29.153789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.154689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.155470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.157245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:29.164598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:29.319738 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2132/4251] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:28 2022] POST /identity/v3/users => generated 295 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:29.322207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:29.372202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35d4b-725f-4261-8291-4619179a7b9d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:29.401967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:29.403017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:29.404752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.405614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:29.406266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.407205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.409163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:29.418494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:29.453442 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2120/4252] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:29.456214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:29.473280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f8702-4d9d-4dc9-a433-a3e878bfc934 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:29.484331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f40ee5-18ce-407e-8d63-382caa96fbb9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:29.495863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:29.498638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.500397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.501488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.503536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:29.508709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:29.509448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:29.521649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.522134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.522638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] PATH_INFO: `/v3/projects/d707a15a090d421fadc14564d2ef3764` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.533792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d707a15a090d421fadc14564d2ef3764)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:29.537598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:29.553731 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2121/4253] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:29.555062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:29.578945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80743f4-9034-41ba-aa87-c0be32d38227 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:29.590715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:29.593594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.595043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.595909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] PATH_INFO: `/v3/projects/5f237a5e0966447a9dec01717ee02981/users/2d749150a9504fbd8260007e46f6d807/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.641849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f237a5e0966447a9dec01717ee02981, user_id=2d749150a9504fbd8260007e46f6d807, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:29.664403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a6b9c-49fa-49d1-96f0-f851a233bd88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:29.790273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:29.804765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2122/4254] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:29 2022] PUT /identity/v3/projects/5f237a5e0966447a9dec01717ee02981/users/2d749150a9504fbd8260007e46f6d807/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:29.825874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:29.826904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:29.827500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:29.889119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd707a15a090d421fadc14564d2ef3764', 'request_id': 'req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:29.946831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] MFA Rules not processed for user `2d749150a9504fbd8260007e46f6d807`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:29.949421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:30.006228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd707a15a090d421fadc14564d2ef3764', 'request_id': 'req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:30.014345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:30.038076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd707a15a090d421fadc14564d2ef3764', 'request_id': 'req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:30.108234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] The token cache is being invalidate because project d707a15a090d421fadc14564d2ef3764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:30.108736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:30.113723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19927f53-1d0d-4adf-bb2e-4643d3e21ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:30.130775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2133/4255] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:29 2022] DELETE /identity/v3/projects/d707a15a090d421fadc14564d2ef3764 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:30.135029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5999c6-4265-428c-a321-3a6f5a05d185 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:30.135582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5999c6-4265-428c-a321-3a6f5a05d185 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:30.136075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5999c6-4265-428c-a321-3a6f5a05d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:30.270503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0b5999c6-4265-428c-a321-3a6f5a05d185 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:30.281909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0b5999c6-4265-428c-a321-3a6f5a05d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:30.367258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2123/4256] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:30.374569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:30.381924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:30.630918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2134/4257] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:30.648594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:30.650611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:30.650945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:30.708107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:30.710961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:30.744493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2135/4258] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:30.750466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:30.781568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc99da-7b49-46c0-815d-96d407b94b75 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:30.808670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:30.814129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:30.814129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:30.814129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:30.814129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:30.818315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:30.827471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:30.837430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb68e2c-0244-4fbe-aa6d-c6fe3574c2f1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:30.865451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:30.866758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:30.867398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:30.867863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:30.869270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:30.873041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:30.932629 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2136/4259] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:30.934830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:31.001672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489735-0674-4faf-9229-22c9564c54b5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:31.034530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:31.035760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:31.036270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:31.043747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:31.048569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:31.066372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:31.079447 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2124/4260] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:30 2022] POST /identity/v3/projects => generated 389 bytes in 708 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:31.086326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:31.387719 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2137/4261] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:30 2022] POST /identity/v3/projects => generated 367 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:31.394353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:31.447368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca4e7-3c60-4736-a709-ac3499337cbd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:31.561691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:31.768526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:31.769542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:31.770066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:31.770586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:31.771918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:31.782308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:31.788588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48441-0199-4fc8-b399-3433fb06c377 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:31.801212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:31.802985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:31.803881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:31.804704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:31.806094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:31.812335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:31.944183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2125/4262] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:31 2022] POST /identity/v3/users => generated 301 bytes in 855 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:31.946431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:31.984393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1422-32a9-4440-b81a-b28e120a3128 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.010714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.012469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.012961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.013448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.014633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.016531 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2138/4263] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:31 2022] POST /identity/v3/users => generated 284 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:32.023791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.030868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.079252 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2126/4264] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:32.082961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.126144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72813eac-c541-4d73-8b35-f8b821e711b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.147041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09645-819f-40b8-b30c-bb9d90785501 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.170228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.171302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.171737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.172164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.173245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.181469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.184299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.184808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.189601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.191465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] PATH_INFO: `/v3/projects/57844bd2fc324d8485de5e477195f104/users/e5898b3e19d24c53800c395845caae54/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.285054 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2139/4265] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:32.293264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.313755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57844bd2fc324d8485de5e477195f104, user_id=e5898b3e19d24c53800c395845caae54, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.328421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.351246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aeddf-e85c-4ab9-bc9c-b2c4dbe85e9c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.371322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.372750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.373280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.373811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.385289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.385289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.436987 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2140/4266] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:32.451374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.467201 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2127/4267] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:32 2022] PUT /identity/v3/projects/57844bd2fc324d8485de5e477195f104/users/e5898b3e19d24c53800c395845caae54/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:32.475073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.498830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eedc1f-4f5b-4820-9e27-16f9996fedae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.534368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:32.762947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.767505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.768012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.768530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] PATH_INFO: `/v3/projects/c05e6a12cb3f4ca4845af3353d86f6c9/users/b3f584852f27458aaccab3cac007ffb0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.821580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfde3-c1a6-41a3-90b7-61f6872d0d8c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:32.843773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:32.845129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:32.845414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:32.845914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:32.847216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.856377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.886521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05e6a12cb3f4ca4845af3353d86f6c9, user_id=b3f584852f27458aaccab3cac007ffb0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:32.904037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf40aab-de6d-46e2-ab9c-cb72c78b3512 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:32.921872 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2128/4268] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:32.925928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:32.992834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b88d-d8fd-4043-9b3a-b22bdf50a5af admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:33.036629 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2141/4269] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:32 2022] PUT /identity/v3/projects/c05e6a12cb3f4ca4845af3353d86f6c9/users/b3f584852f27458aaccab3cac007ffb0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:33.043578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:33.045336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:33.045336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:33.211100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] MFA Rules not processed for user `b3f584852f27458aaccab3cac007ffb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:33.213865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:33.262999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:33.269364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:33.273058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:33.278238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] PATH_INFO: `/v3/projects/57844bd2fc324d8485de5e477195f104/users/e5898b3e19d24c53800c395845caae54/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:33.287069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57844bd2fc324d8485de5e477195f104, user_id=e5898b3e19d24c53800c395845caae54, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:33.313101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bd8d4-17b8-4ac8-84dc-a011c0e7ce57 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:33.385220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2129/4270] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:32 2022] PUT /identity/v3/projects/57844bd2fc324d8485de5e477195f104/users/e5898b3e19d24c53800c395845caae54/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:33.404237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:33.409980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:33.409980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:33.460571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:33.520668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] MFA Rules not processed for user `e5898b3e19d24c53800c395845caae54`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:33.524850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:33.547197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2142/4271] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:33.559796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:33.640412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789180a7-a11e-4c66-a8b4-6fd04fa80ad8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:33.910404 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2130/4272] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:33.913267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:33.931878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b18ccf-7d94-4a1b-9a8c-154869e630b1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:33.944102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:33.945696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:33.946680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:33.947450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects/5f237a5e0966447a9dec01717ee02981` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:33.950668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f237a5e0966447a9dec01717ee02981)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:33.956200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:33.960117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2131/4273] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:48:33 2022] GET /identity/v3/projects/5f237a5e0966447a9dec01717ee02981 => generated 389 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:33.966875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:33.986334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:33.989411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:33.993704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:33.994355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:33.997478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:34.007249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:34.022425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97ea7-d9d5-47ff-ac9d-86e3db4a5484 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:34.045348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:34.051371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:34.054937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:34.061743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:34.071411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:34.096008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:34.212237 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2143/4274] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:33 2022] POST /identity/v3/projects => generated 369 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:34.219300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:34.276331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:34.497011 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2132/4275] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:48:33 2022] POST /identity/v3/projects => generated 338 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:34.509440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:34.522636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70b6dd-76da-43ec-bf54-8249b6ef2214 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:34.869360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3d64-b97f-4cb2-b381-293a74cbe275 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:34.905266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:34.909741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:34.910832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:34.913305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:34.914770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:34.916464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:34.918841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:34.921885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:34.921885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:34.931687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:34.931847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:34.940179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.043197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2133/4276] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:48:34 2022] GET /identity/v3/projects => generated 6533 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:35.046723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:35.050768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:35.108555 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2144/4277] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:34 2022] POST /identity/v3/users => generated 291 bytes in 890 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:35.112433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339f7d-daee-4821-968c-ab7f0d3e89fc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:35.115272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:35.148864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:35.154979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:35.154979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:35.154979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] PATH_INFO: `/v3/users/806303426c474dbda5f6d91022dce7cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:35.165684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806303426c474dbda5f6d91022dce7cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:35.188311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.193355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90909ab6-6dd2-43f0-88f6-404d9a3cbe8e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:35.239310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:35.253095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:35.253501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:35.257070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects/5f237a5e0966447a9dec01717ee02981` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:35.272710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:get_project(project_id=5f237a5e0966447a9dec01717ee02981)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:35.286903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.298169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2145/4278] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:48:35 2022] GET /identity/v3/projects/5f237a5e0966447a9dec01717ee02981 => generated 389 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:35.306600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:35.408223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e564d-c3bf-4b1f-beb7-4e251a82bae7 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:35.454526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:35.460935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:35.464640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:35.464640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:35.474538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:35.490102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.542850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2146/4279] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:35.542850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:35.585107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ea65-2139-477d-9ff7-caf0865419a3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:35.637292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:35.641182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:35.641635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:35.642103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects/d7afb1e949ac4ed18c5cc4c9823a6cf4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:35.651758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:get_project(project_id=d7afb1e949ac4ed18c5cc4c9823a6cf4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:35.664554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.680320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2147/4280] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:48:35 2022] GET /identity/v3/projects/d7afb1e949ac4ed18c5cc4c9823a6cf4 => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:35.683977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:35.697210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806303426c474dbda5f6d91022dce7cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:35.746578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e42052-f5ee-471e-b3cc-f8e02a746f51 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:35.768792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:35.770570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:35.771975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:35.771975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] PATH_INFO: `/v3/projects/2864d9742b54497d9c90842361857324/users/1581844cacdb411e864d757c4a3d94e1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:35.852298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2864d9742b54497d9c90842361857324, user_id=1581844cacdb411e864d757c4a3d94e1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:35.869012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:35.874928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806303426c474dbda5f6d91022dce7cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:35.878255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:35.916469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806303426c474dbda5f6d91022dce7cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:35.976495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806303426c474dbda5f6d91022dce7cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:35.979575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806303426c474dbda5f6d91022dce7cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:36.013351 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2148/4281] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:35 2022] PUT /identity/v3/projects/2864d9742b54497d9c90842361857324/users/1581844cacdb411e864d757c4a3d94e1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:36.026562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:36.040936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:36.050739 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2134/4282] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:35 2022] DELETE /identity/v3/users/806303426c474dbda5f6d91022dce7cb => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:36.057282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:36.076682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:36.404610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7400-f97b-409c-9d6d-84b5738be452 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:36.425395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:36.432457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:36.433299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:36.435827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:36.439035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:36.445408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:36.480205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2135/4283] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:36.487465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:36.516230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eadce8-f090-4440-8540-e6a6afcf9980 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:36.527572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:36.530270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:36.530270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:36.537052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] PATH_INFO: `/v3/projects/2864d9742b54497d9c90842361857324/users/1581844cacdb411e864d757c4a3d94e1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:36.537052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2864d9742b54497d9c90842361857324, user_id=1581844cacdb411e864d757c4a3d94e1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:36.542636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7c57-d28c-4a14-a8fc-be139540e9ed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:36.601518 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2136/4284] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:36 2022] PUT /identity/v3/projects/2864d9742b54497d9c90842361857324/users/1581844cacdb411e864d757c4a3d94e1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:36.604688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1dddc-b15a-4655-9eed-889eecc743ca admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:36.609488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:36.610276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:36.610881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:36.693134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:36.766153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] MFA Rules not processed for user `1581844cacdb411e864d757c4a3d94e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:36.770235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:37.006555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.007868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.008467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.008970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.011402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.013470 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:37.013470 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:48:37.013470 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:48:37.016354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.099474 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2149/4285] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:48:36 2022] GET /identity/v3/projects => generated 6533 bytes in 1086 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:37.111081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.156900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714da1b-fde4-42e8-9daa-4c90ee322701 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.180943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.184963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.184963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.184963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.188440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:37.189123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.214142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.230005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2137/4286] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:37.238937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.285944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363276a9-9225-40d7-a229-88bf10a056c1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.309773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.310933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.313715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.314331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.316269 n-d-852085-12 devstack@keystone.service[82439]: WARNING oslo_log.versionutils [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:37.323075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.330276 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:37.330276 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:48:37.330276 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:37.334232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.346173 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2150/4287] 10.222.0.78 () {58 vars in 1166 bytes} [Tue Oct 4 20:48:37 2022] GET /identity/v3/projects?domain_id=default => generated 6202 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:37.361841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.451047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf569705-2400-434b-8a91-85a8b78468bc tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.509068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.509068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.509429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2138/4288] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:48:37 2022] POST /identity/v3/policies => generated 230 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:37.512319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.513395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.517469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.519534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.537974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.556263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e718-7878-43dd-9e5a-b5cc1777b441 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.581600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.583037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.584945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.585433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.589926 n-d-852085-12 devstack@keystone.service[82439]: WARNING oslo_log.versionutils [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:37.594608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=a2f33fa6f4314f7ba73747240f17c8cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.607794 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:37.607794 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:48:37.607794 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:37.611091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.654778 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2151/4289] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:48:37 2022] GET /identity/v3/projects => generated 6533 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:37.658705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.719033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d829-ac41-4c20-8172-a918ff2dd45e tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.736822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.738365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.738884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.739684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.744128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:37.746252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.758115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.813486 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2139/4290] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:48:37 2022] PATCH /identity/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb => generated 236 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:48:37.821741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.885413 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2152/4291] 10.222.0.78 () {58 vars in 1166 bytes} [Tue Oct 4 20:48:37 2022] GET /identity/v3/projects?domain_id=default => generated 6202 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:37.895127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:37.918372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f562-6c02-458a-8246-0adfd603b701 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.941916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261849d-6239-412f-9978-f04c47867702 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:37.952973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.958639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.962770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:37.967411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:37.968399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.969121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.973735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.977219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:37.980435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:37.982681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:37.984833 n-d-852085-12 devstack@keystone.service[82439]: WARNING oslo_log.versionutils [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:37.986156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=a2f33fa6f4314f7ba73747240f17c8cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:37.994541 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:37.994541 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:48:37.994541 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:37.996801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842e9eb-ac5f-4dae-b255-8e34ee52907e tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:38.036233 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2140/4292] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:48:37 2022] GET /identity/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb => generated 236 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:38.041598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:38.063357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:38.063357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:38.083175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:38.091265 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2153/4293] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:48:37 2022] GET /identity/v3/projects => generated 6533 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:38.096441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:38.148628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257980ad-e5ea-478d-9433-842e35bb6b92 tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:38.170525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] MFA Rules not processed for user `d7cd5eb1f46c402393ddbd5bcd92c1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:38.176434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:38.178572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:38.180171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:38.180696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:38.181200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:38.183350 n-d-852085-12 devstack@keystone.service[82440]: WARNING oslo_log.versionutils [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:38.183934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a2f33fa6f4314f7ba73747240f17c8cb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:38.187082 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:38.187082 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:48:38.187082 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:48:38.189376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:38.352281 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2154/4294] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:38 2022] DELETE /identity/v3/policies/a2f33fa6f4314f7ba73747240f17c8cb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:38.362754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:38.453816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff08f-1be4-4d04-ad13-18370a02cff8 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:38.493155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:38.496920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:38.500257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:38.503580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:38.508651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1915274767) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:38.516261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:38.518807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:38.529709 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2141/4295] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:38.560454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:38.628768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a929f3-50e9-4e96-8553-91748d8e277b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:38.674030 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2155/4296] 10.222.0.78 () {58 vars in 1232 bytes} [Tue Oct 4 20:48:38 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1915274767 => generated 537 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:38.680430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:38.686122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:38.687374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:38.687822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:38.691485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:38.697731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:38.697980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:38.701211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:38.874204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2142/4297] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:48:38 2022] POST /identity/v3/policies => generated 229 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:38.876884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:38.893673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:39.177558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6bff0-e2ea-44a4-b49a-e6ad21e1e67b tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:39.190859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab06e-338d-43db-b557-1b0ff4c58f45 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:39.202644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:39.205966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:39.205966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:39.205966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] PATH_INFO: `/v3/projects/ce3823a32e454504b467aa845688fc46` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:39.208407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3823a32e454504b467aa845688fc46)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:39.213544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:39.219817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:39.223753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:39.224274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:39.224772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:39.260760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:39.264961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:39.315802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2156/4298] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:39.319482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:39.391079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72977e04-21d3-4d81-800c-da8ce1510435 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:39.418502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5898b3e19d24c53800c395845caae54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57844bd2fc324d8485de5e477195f104', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:39.431876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:39.431876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:39.431876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] PATH_INFO: `/v3/projects/d7afb1e949ac4ed18c5cc4c9823a6cf4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:39.431876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d7afb1e949ac4ed18c5cc4c9823a6cf4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:39.440472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:39.455127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:39.536049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3823a32e454504b467aa845688fc46', 'request_id': 'req-c4ed0533-b27c-4124-986e-2585682ab7e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.587190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3823a32e454504b467aa845688fc46', 'request_id': 'req-c4ed0533-b27c-4124-986e-2585682ab7e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.625182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3823a32e454504b467aa845688fc46', 'request_id': 'req-c4ed0533-b27c-4124-986e-2585682ab7e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.801900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7afb1e949ac4ed18c5cc4c9823a6cf4', 'request_id': 'req-bab60d89-4666-4c5a-bf02-260ac2fab4ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.859412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] The token cache is being invalidate because project ce3823a32e454504b467aa845688fc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:39.864001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.868039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.883363 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2143/4299] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:38 2022] DELETE /identity/v3/projects/ce3823a32e454504b467aa845688fc46 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:39.895483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:39.908139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:39.929855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7afb1e949ac4ed18c5cc4c9823a6cf4', 'request_id': 'req-bab60d89-4666-4c5a-bf02-260ac2fab4ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:39.954745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7afb1e949ac4ed18c5cc4c9823a6cf4', 'request_id': 'req-bab60d89-4666-4c5a-bf02-260ac2fab4ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:40.023820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] The token cache is being invalidate because project d7afb1e949ac4ed18c5cc4c9823a6cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:40.024348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:40.034912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab60d89-4666-4c5a-bf02-260ac2fab4ed tempest-ListProjectsStaticTestJSON-1651127381 tempest-ListProjectsStaticTestJSON-1651127381-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:40.046182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2157/4300] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:39 2022] DELETE /identity/v3/projects/d7afb1e949ac4ed18c5cc4c9823a6cf4 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:40.051478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:40.052011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:40.067745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:40.069885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:40.335893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed0533-b27c-4124-986e-2585682ab7e7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:40.348982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:40.368686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:40.616279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:40.617449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:40.617937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:40.618346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:40.620894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:40.631731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c80df-a70d-4bc9-be99-e47ce0b0d2a2 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:40.791754 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2158/4301] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 749 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:40.793413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:40.809464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:40.841729 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2144/4302] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:48:39 2022] POST /identity/v3/policies => generated 228 bytes in 955 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:40.848147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:40.855263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:40.855263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:40.870000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35bea-13f2-42f2-88e7-ea446fb26011 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:40.894725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:40.905457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:40.907698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:40.917078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] PATH_INFO: `/v3/users/2d749150a9504fbd8260007e46f6d807` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:40.922798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d749150a9504fbd8260007e46f6d807)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:40.932643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:40.938086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:40.940620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:40.983846 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2145/4303] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:40.983846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:40.991074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:41.057692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654d526-f0d5-4a5c-aefd-a75bbdc677ec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:41.090031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:41.098589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:41.113290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:41.113888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:41.123219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:41.128978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:41.303856 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2146/4304] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:48:40 2022] POST /identity/v3/policies => generated 230 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:41.305944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:41.348003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d749150a9504fbd8260007e46f6d807'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:41.350035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d749150a9504fbd8260007e46f6d807'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:41.393846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08271-bb2b-49c1-b733-63cf71279b89 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:41.408748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:41.410448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:41.411103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:41.411683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:41.413546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:41.414254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:41.418683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:41.470713 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2147/4305] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:41.473352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:41.541158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8df55-4143-4ea6-8af0-dc79ce740988 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:41.552828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d749150a9504fbd8260007e46f6d807'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:41.574976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:41.578574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:41.579073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:41.579605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:41.590378 n-d-852085-12 devstack@keystone.service[82439]: WARNING oslo_log.versionutils [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:41.595979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:41.605331 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:41.605331 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:48:41.605331 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:41.610246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:41.631783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d749150a9504fbd8260007e46f6d807'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:41.655051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2148/4306] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:48:41 2022] GET /identity/v3/policies => generated 763 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:41.655051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:41.664025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d749150a9504fbd8260007e46f6d807'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:41.710320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2159/4307] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:40 2022] DELETE /identity/v3/users/2d749150a9504fbd8260007e46f6d807 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:41.712244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:41.719407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:41.721702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10a3be-50c8-42da-9f30-20be81d7f21f tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:41.736751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:41.985203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5028e-9183-41de-87cf-f78b80f040d1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:42.012604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:42.018635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:42.021499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:42.022478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/1831b5f2e30a46a99d08cb300522683d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:42.025355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1831b5f2e30a46a99d08cb300522683d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:42.031580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b58a5c-3a7b-4c58-b828-44854fd9a6fb tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:42.083278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:42.084806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:42.085363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:42.085820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:42.086721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:42.090723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:42.122165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:42.265671 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2160/4308] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:41 2022] DELETE /identity/v3/policies/1831b5f2e30a46a99d08cb300522683d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:42.272993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:42.278170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2149/4309] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:41 2022] POST /identity/v3/projects => generated 389 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:42.281661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:42.282052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:42.283512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:42.414144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:42.420582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:42.614023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b577-8ab5-4d71-8d53-ab0d2a975b9f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:42.624159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:42.625317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:42.625824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:42.626329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/e468919d9d24487b923aa4e27de16a16` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:42.628053 n-d-852085-12 devstack@keystone.service[82439]: WARNING oslo_log.versionutils [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 04 20:48:42.629729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e468919d9d24487b923aa4e27de16a16)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:42.633480 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:48:42.633480 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:48:42.633480 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:42.635367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:42.832458 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2161/4310] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:42.834644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:42.842342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:42.875526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2150/4311] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:42 2022] DELETE /identity/v3/policies/e468919d9d24487b923aa4e27de16a16 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:42.882853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:42.893942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6207d2e-a601-4afc-a07d-1f3c3551d68c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:42.916343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:42.921522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:42.934233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:42.934233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:42.934233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:42.948407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:42.972061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592e2c6-be9e-4657-b333-505114c826d0 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:43.006313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1581844cacdb411e864d757c4a3d94e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2864d9742b54497d9c90842361857324', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:43.008220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:43.012852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:43.013436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] PATH_INFO: `/v3/policies/dafffca7599f48d2a8fece2ba228ffb3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:43.018057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=dafffca7599f48d2a8fece2ba228ffb3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:43.024763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:43.550986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2151/4312] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:42 2022] DELETE /identity/v3/policies/dafffca7599f48d2a8fece2ba228ffb3 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:43.561189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:43.566988 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2162/4313] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:42 2022] POST /identity/v3/users => generated 295 bytes in 733 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:43.569265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:43.572609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:43.585518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:43.677768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fa328-bf4b-44a3-8592-d17fc4949a5f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:43.735260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:43.738702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:43.739107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:43.744056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] PATH_INFO: `/v3/users/b3f584852f27458aaccab3cac007ffb0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:43.749828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f584852f27458aaccab3cac007ffb0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:43.762875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:44.045756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ede4-e2bd-4d22-80f7-4f8f13bc1be9 tempest-PoliciesTestJSON-1173157079 tempest-PoliciesTestJSON-1173157079-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:44.094985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:44.098887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:44.100922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:44.102663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:44.152852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:44.174553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:44.300076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f584852f27458aaccab3cac007ffb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:44.300927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2152/4314] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:44.302474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f584852f27458aaccab3cac007ffb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:44.302750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:44.385310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bf47a-982c-4aa6-b39e-b04fa3d1dbe4 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:44.425533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:44.431075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:44.431075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:44.431540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:44.438294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f584852f27458aaccab3cac007ffb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:44.442743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:44.458299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:44.530450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f584852f27458aaccab3cac007ffb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:44.541928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:44.576199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-77b3dcca-19b0-4e6b-82ef-22055d701b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f584852f27458aaccab3cac007ffb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:44.585251 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2153/4315] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:44.593136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:44.614512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:44.624937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2163/4316] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:43 2022] DELETE /identity/v3/users/b3f584852f27458aaccab3cac007ffb0 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:44.632692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:44.633704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:44.634215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:44.683795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9cbe-8aee-4465-adef-b4abb898d6ff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:44.783342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:44.793978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:45.006480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:45.010504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:45.013460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:45.014315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:45.018991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:45.022757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4b85a-fa75-4c04-99ed-d1d189794e36 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:45.039377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:45.092749 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2154/4317] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:45.097214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:45.097692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:45.098781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:45.174244 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2164/4318] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:45.176140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:45.197598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] MFA Rules not processed for user `d7cd5eb1f46c402393ddbd5bcd92c1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:45.200779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:45.211695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126597e-e63b-4374-8a5b-aab325e4527b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:45.234219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:45.237130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:45.240554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:45.241086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] PATH_INFO: `/v3/projects/b2e6812055b3473db24481cdd7504bd6/users/5521d99f7d6d4432acf47388c0a0c93a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:45.343270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e6812055b3473db24481cdd7504bd6, user_id=5521d99f7d6d4432acf47388c0a0c93a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:45.361680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ae0d-d395-4dd2-9bb4-682c4ddcddee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:45.475274 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2155/4319] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:45.477965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:45.481316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:45.544344 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2165/4320] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:45 2022] PUT /identity/v3/projects/b2e6812055b3473db24481cdd7504bd6/users/5521d99f7d6d4432acf47388c0a0c93a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:45.552866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:45.560087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:45.560649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:45.684117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:45.694347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:45.825649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c15c8a-0432-4a59-8fdd-87d3a6e3c2b4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:46.033533 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2166/4321] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:46.035708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:46.042098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:46.047110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:46.052124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:46.054874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:46.055556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:46.081671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7635-aee8-4dc6-af5f-7603c6389f36 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:46.092551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:46.094090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:46.094862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:46.096037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] PATH_INFO: `/v3/projects/5f237a5e0966447a9dec01717ee02981` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:46.099644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f237a5e0966447a9dec01717ee02981)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:46.100139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:46.102974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:46.105553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:46.151825 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2156/4322] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:46.153912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:46.186846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323223-ef0f-457b-9f2d-20a16ef36d20 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:46.205067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:46.206176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:46.206663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:46.207172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:46.259993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:46.263777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:46.317386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2157/4323] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:46.475114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f237a5e0966447a9dec01717ee02981', 'request_id': 'req-697b8af8-d31b-4f8a-92f6-f5c166c81531'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:46.612216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f237a5e0966447a9dec01717ee02981', 'request_id': 'req-697b8af8-d31b-4f8a-92f6-f5c166c81531'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:46.646490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f237a5e0966447a9dec01717ee02981', 'request_id': 'req-697b8af8-d31b-4f8a-92f6-f5c166c81531'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:46.654985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:46.720685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] The token cache is being invalidate because project 5f237a5e0966447a9dec01717ee02981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:46.720685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:46.721765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-697b8af8-d31b-4f8a-92f6-f5c166c81531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:46.728898 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2167/4324] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:46 2022] DELETE /identity/v3/projects/5f237a5e0966447a9dec01717ee02981 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:46.735866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:46.763329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81040f67-51e0-4960-ba61-5578453c3316 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:47.011790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:47.092341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:47.097212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:47.100584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:47.101500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] PATH_INFO: `/v3/users/e5898b3e19d24c53800c395845caae54` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:47.105388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5898b3e19d24c53800c395845caae54)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:47.118941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:47.596155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5898b3e19d24c53800c395845caae54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:47.731362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5898b3e19d24c53800c395845caae54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:47.755457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5898b3e19d24c53800c395845caae54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:47.803491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5898b3e19d24c53800c395845caae54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:47.805565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5898b3e19d24c53800c395845caae54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:47.826655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2158/4325] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:46 2022] DELETE /identity/v3/users/e5898b3e19d24c53800c395845caae54 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:48.625756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:48.628775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:48.629637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:48:48.643952 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:48:48.645662 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:48:48.650540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2168/4326] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:48:48 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:48:49.358094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:49.361601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:49.799651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6362a8-f710-4b59-a7aa-9676d73bc551 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:49.822098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:49.836259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:49.837260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:49.838066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] PATH_INFO: `/v3/projects/c05e6a12cb3f4ca4845af3353d86f6c9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:49.845902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05e6a12cb3f4ca4845af3353d86f6c9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:49.849641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:50.128287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05e6a12cb3f4ca4845af3353d86f6c9', 'request_id': 'req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:50.165844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05e6a12cb3f4ca4845af3353d86f6c9', 'request_id': 'req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:50.215223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05e6a12cb3f4ca4845af3353d86f6c9', 'request_id': 'req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:50.397512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:50.414930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] The token cache is being invalidate because project c05e6a12cb3f4ca4845af3353d86f6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:50.416917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:50.421061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:50.434206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2159/4327] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:49 2022] DELETE /identity/v3/projects/c05e6a12cb3f4ca4845af3353d86f6c9 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:50.445769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:50.447553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:50.749592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c739-27c4-4dfa-ba6d-b54c8cb1f374 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:50.780217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:50.781880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:50.782638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:50.788231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] PATH_INFO: `/v3/users/1581844cacdb411e864d757c4a3d94e1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:50.798979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1581844cacdb411e864d757c4a3d94e1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:50.808610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:51.066509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:51.071436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:51.125896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5508dc-5932-4c9c-a075-f0a6c5f5c263 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:51.147469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:51.149292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:51.150227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:51.152410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] PATH_INFO: `/v3/projects/57844bd2fc324d8485de5e477195f104` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:51.157469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57844bd2fc324d8485de5e477195f104)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:51.165941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:51.209176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1581844cacdb411e864d757c4a3d94e1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.210617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1581844cacdb411e864d757c4a3d94e1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.342596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1581844cacdb411e864d757c4a3d94e1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.404850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1581844cacdb411e864d757c4a3d94e1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdbdff64-a119-4e1e-8099-52332677dcf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1581844cacdb411e864d757c4a3d94e1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.462955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2169/4328] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:48:50 2022] DELETE /identity/v3/users/1581844cacdb411e864d757c4a3d94e1 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:51.477208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57844bd2fc324d8485de5e477195f104', 'request_id': 'req-3433c4ea-4c60-47dd-abcc-35c97018461c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.509270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57844bd2fc324d8485de5e477195f104', 'request_id': 'req-3433c4ea-4c60-47dd-abcc-35c97018461c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.532104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57844bd2fc324d8485de5e477195f104', 'request_id': 'req-3433c4ea-4c60-47dd-abcc-35c97018461c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.710413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] The token cache is being invalidate because project 57844bd2fc324d8485de5e477195f104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:51.714844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.717495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3433c4ea-4c60-47dd-abcc-35c97018461c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:51.741406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2160/4329] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:51 2022] DELETE /identity/v3/projects/57844bd2fc324d8485de5e477195f104 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:51.741831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:51.741831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:51.741831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:51.816920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:51.820068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:52.179402 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2170/4330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:52.196665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:52.197632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:52.198795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:52.305923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:52.309997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:52.356393 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2161/4331] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:52.362358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:52.385251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c021ca-e95f-48f7-871d-7f5764b8a1a7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:52.400346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:52.408904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:52.408904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:52.408904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:52.408904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:52.408904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:52.412148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:52.434084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:52.452020 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2171/4332] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:52.459425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:52.491104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed3dc-3ed2-407c-885a-abc0d1f224af None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:52.503006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:52.504808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:52.506260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:52.507480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:52.509342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:52.533417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:52.727862 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2162/4333] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:52 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:52.730622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:52.830999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c903574-87bb-4541-9c19-5f76168e6c48 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:53.017392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:53.018610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:53.019214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:53.019818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:53.021218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:53.027438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:53.259633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:53.260179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2172/4334] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:52 2022] POST /identity/v3/users => generated 293 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:53.304663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfdd60-70fd-4272-a52a-0d518a00f951 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:53.330055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:53.331199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:53.331956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:53.332441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:53.333728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:53.337024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:53.386614 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2163/4335] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:53.394125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:53.426632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fefe5-b15d-45f1-a5cb-9e99938f426f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:53.447540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:53.453052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:53.453609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:53.454120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:53.455572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:53.459050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048edc7-380d-4e38-a7af-1214dd457260 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:53.487538 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2173/4336] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:53.490233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:53.532775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4cf1-263b-4ac8-bfcd-8b0c56b64bb1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:53.570138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:53.570138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:53.570138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:53.570138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] PATH_INFO: `/v3/projects/e569e0c63e47419cb9b0a2cbc45f29a8/users/e0b86bd925d24264aa2743e4dca937e9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:53.620359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e569e0c63e47419cb9b0a2cbc45f29a8, user_id=e0b86bd925d24264aa2743e4dca937e9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:53.629568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:53.799370 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2164/4337] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:53 2022] PUT /identity/v3/projects/e569e0c63e47419cb9b0a2cbc45f29a8/users/e0b86bd925d24264aa2743e4dca937e9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:53.823939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:53.824888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:53.824888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:53.928347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] MFA Rules not processed for user `e0b86bd925d24264aa2743e4dca937e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:53.930167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:54.186679 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2174/4338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:54.194664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:54.452971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35b361-2078-4f7d-b310-1dfc27370915 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:54.467839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:54.469393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:54.470206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:54.471074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:54.474139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:54.478405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:54.686928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2165/4339] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:54 2022] POST /identity/v3/projects => generated 385 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:54.693651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:54.733467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db989-d4f8-4113-b7e1-ca2c3438e3ba None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:54.892973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:54.896810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:54.914546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:55.029080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:55.030162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:55.030652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:55.031120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:55.032424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:55.042264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:55.094899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:55.214668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2175/4340] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:54 2022] POST /identity/v3/users => generated 299 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:55.222117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:55.231021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241604e6-368b-42f4-93d1-5759983d6918 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:55.251978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:55.256976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:55.258316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:55.259057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] PATH_INFO: `/v3/projects/2864d9742b54497d9c90842361857324` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:55.259491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744e43-c6b8-4a96-b566-d9633f5aeb06 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:55.262277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2864d9742b54497d9c90842361857324)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:55.266179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:55.289183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:55.290672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:55.293698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:55.294563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:55.304204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:55.311939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:55.362280 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2176/4341] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:48:55.370940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:55.415896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a38104-cd73-4b1e-86f8-6f2c116b8d58 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:55.429324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:55.430810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:55.431555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:55.432276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] PATH_INFO: `/v3/projects/5a5206a8e6b14452b513b5befdfdc23e/users/bc82f54616c44345a2c0d1aadbeaa945/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:55.479099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5206a8e6b14452b513b5befdfdc23e, user_id=bc82f54616c44345a2c0d1aadbeaa945, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:55.490376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:55.615561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2864d9742b54497d9c90842361857324', 'request_id': 'req-db0f503f-1113-423f-ac2c-b554e86d6e16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:55.662588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2177/4342] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:55 2022] PUT /identity/v3/projects/5a5206a8e6b14452b513b5befdfdc23e/users/bc82f54616c44345a2c0d1aadbeaa945/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:48:55.675685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:55.683011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2864d9742b54497d9c90842361857324', 'request_id': 'req-db0f503f-1113-423f-ac2c-b554e86d6e16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:55.731354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2864d9742b54497d9c90842361857324', 'request_id': 'req-db0f503f-1113-423f-ac2c-b554e86d6e16'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:55.924374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] The token cache is being invalidate because project 2864d9742b54497d9c90842361857324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:48:55.928755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:55.933043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0f503f-1113-423f-ac2c-b554e86d6e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:48:55.937047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2166/4343] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:54 2022] DELETE /identity/v3/projects/2864d9742b54497d9c90842361857324 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:55.955840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:55.956762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:55.957211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.058475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:56.062185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fdc74-db05-4443-9a41-f5230af9abf9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:56.068541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:56.084176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:56.085112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.085627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.086118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.090408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:56.100407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fe54e-aa0f-4064-a0f4-4fc0a0416233 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:56.148438 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2167/4344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:56.157870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:56.169462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:56.169776 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2178/4345] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:56.219604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ca48-3495-461e-aaf4-517704bd34d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:56.236320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:56.237485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.237959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.238706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] PATH_INFO: `/v3/projects/5a5206a8e6b14452b513b5befdfdc23e/users/bc82f54616c44345a2c0d1aadbeaa945/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.252224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5206a8e6b14452b513b5befdfdc23e, user_id=bc82f54616c44345a2c0d1aadbeaa945, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:56.263013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180670f5-4643-4d45-9d73-fb0ddebf5695 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:56.274290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.274661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.275520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.345841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:56.350690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:56.352601 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2168/4346] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:56 2022] PUT /identity/v3/projects/5a5206a8e6b14452b513b5befdfdc23e/users/bc82f54616c44345a2c0d1aadbeaa945/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:56.366845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.372721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.372721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.486209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] MFA Rules not processed for user `bc82f54616c44345a2c0d1aadbeaa945`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:56.492922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:56.704532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2179/4347] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:48:56.715220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:56.754288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751861b9-bdab-4066-8fba-aaeabd232e74 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:56.774845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:56.776578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.777095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.777612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.778911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:48:56.779871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:56.782517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:56.808829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:56.827399 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2169/4348] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:56.830361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:56.843627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2180/4349] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:56.845169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:56.869187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04cfac-78f3-4f17-9784-bd11c309ac9a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:56.873797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baaff7-cd21-4ccb-a16e-10df8ae2d818 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:56.886639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:56.888980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:56.901618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.901618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.902156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:56.902294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.902437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:56.902437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:56.902667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:56.902819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:56.902958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:56.903088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:57.153131 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2181/4350] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:56 2022] POST /identity/v3/projects => generated 371 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:57.160158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:57.189314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2170/4351] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:56 2022] POST /identity/v3/projects => generated 360 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:48:57.202092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:57.297485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:57.499231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2a43-914a-45ed-b2bd-6aead2c2a111 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:57.501413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6bdcc-d6ff-4f76-a248-0e8c7f75c637 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:57.526234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:57.527521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:57.528043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:57.528560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-1802253344` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:57.532652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=6391072ab74a48c9a9bf4113c3e29941, value=tempest-tag-1802253344)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:57.537571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:57.875675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:57.882602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:57.882846 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1802253344. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:48:57.882846 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:48:57.882846 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:57.884019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:57.884019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:57.884019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:57.887789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:57.943562 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2171/4352] 10.222.0.78 () {60 vars in 1333 bytes} [Tue Oct 4 20:48:57 2022] PUT /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-1802253344 => generated 0 bytes in 744 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 04 20:48:57.945857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.005676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a615c-30af-4f5c-9774-010b2caa880e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.021565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.023442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.025320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.026629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-1802253344` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.102524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2182/4353] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:48:57 2022] POST /identity/v3/users => generated 286 bytes in 943 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:48:58.107267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6391072ab74a48c9a9bf4113c3e29941, value=tempest-tag-1802253344)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.109982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.110715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.147594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a8d7-c98c-46f2-b21c-ec9ad01cb64e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.178614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.180390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.181067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.182709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.186041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.211235 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2172/4354] 10.222.0.78 () {58 vars in 1314 bytes} [Tue Oct 4 20:48:57 2022] GET /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-1802253344 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:58.218317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.218655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.263363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2183/4355] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:58.280581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53d26-0cac-4141-916c-7690e7d4ae2c tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.281281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.316602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.317888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.318556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.318776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.336698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=6391072ab74a48c9a9bf4113c3e29941)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.341407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdbd-7488-4581-ae3c-9cc5525e9e75 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.342900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.378926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.380229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.381893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.382440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.383768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.406106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.466254 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2184/4356] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:48:58.468448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.545135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1686392-665c-41b2-acaf-a34bb76c4874 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.584457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.586120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.586639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.597857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] PATH_INFO: `/v3/projects/8edf2e3c40da4848a8d7ab3a4edb5fec/users/380b0bb0caf14055a12faaa7e230d4af/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.688053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edf2e3c40da4848a8d7ab3a4edb5fec, user_id=380b0bb0caf14055a12faaa7e230d4af, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.707591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f328f8-ee1d-44f9-8d35-17ff89f28c48 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.717651 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2173/4357] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 4 20:48:58 2022] PUT /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags => generated 139 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:58.719928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:58.776888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d327-d9a9-4274-bba6-a0d89a926f0e tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:58.797824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:58.799584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.801282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.803254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.893816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2185/4358] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:48:58 2022] PUT /identity/v3/projects/8edf2e3c40da4848a8d7ab3a4edb5fec/users/380b0bb0caf14055a12faaa7e230d4af/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:58.911365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:58.911870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:58.912161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:58.915380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6391072ab74a48c9a9bf4113c3e29941)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:58.918482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:58.977099 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2174/4359] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:48:58 2022] GET /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags => generated 139 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:48:58.985797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:59.028018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211afb20-7b50-4fa1-8f1e-8895577c018d tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:59.038379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:59.043381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] MFA Rules not processed for user `380b0bb0caf14055a12faaa7e230d4af`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:48:59.044016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:59.264583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:59.265876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:59.266310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:59.266829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-2043641153` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:59.282509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=6391072ab74a48c9a9bf4113c3e29941, value=tempest-tag-2043641153)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:59.286700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:59.370336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2186/4360] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:48:59.372105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:59.379952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:59.389203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:59.613597 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2043641153. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:48:59.613597 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:48:59.613597 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:48:59.671727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2175/4361] 10.222.0.78 () {58 vars in 1317 bytes} [Tue Oct 4 20:48:58 2022] DELETE /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-2043641153 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:48:59.673469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:59.745735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8462aa-fa75-4749-8201-45867229a5b3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:59.757841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:59.759567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:59.761857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:59.762555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:48:59.767812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:48:59.807546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:48:59.818513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:48:59.889139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2187/4362] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:48:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:48:59.891047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:48:59.944526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad43d5-6b90-49cb-9c78-01ef48325bd0 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:48:59.986560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:48:59.986560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:48:59.986560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:48:59.987171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-2043641153` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:00.032089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6391072ab74a48c9a9bf4113c3e29941, value=tempest-tag-2043641153)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:00.036297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:00.060140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83f00-9a67-4e4a-a252-eb48adf82f58 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:00.092519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:00.095356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:00.096163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:00.099883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:00.101292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Could not find project tag: tempest-tag-2043641153.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2043641153. Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 04 20:49:00.102402 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2043641153. Oct 04 20:49:00.105115 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:00.106058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2188/4363] 10.222.0.78 () {58 vars in 1314 bytes} [Tue Oct 4 20:48:59 2022] GET /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags/tempest-tag-2043641153 => generated 107 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:49:00.113674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:00.130238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:00.172126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913edf7e-0896-484c-9364-6095e61f0028 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:00.210317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:00.211722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:00.212264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:00.212756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:00.215597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=6391072ab74a48c9a9bf4113c3e29941)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:00.220137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:00.308180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2176/4364] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:48:59 2022] POST /identity/v3/projects => generated 369 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:00.315768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:00.501872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2189/4365] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:49:00 2022] DELETE /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:00.507667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:00.583803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae770-0c17-4f6e-8238-cbf87b7bdbbd tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:00.774483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd32a6-bbb7-464a-beb9-c83bd70c5ea9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:00.803662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:00.805731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:00.805731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:00.806102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:00.812024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:00.827264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:00.883013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:01.024205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2177/4366] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:00 2022] POST /identity/v3/users => generated 291 bytes in 709 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:01.030806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:01.058878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:01.061831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:01.062868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:01.063787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:01.072374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a8cd-9e6c-4eb1-84f7-e4e974e8808b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:01.107118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:01.108058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:01.108555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:01.109022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:01.109897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:01.132120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:01.140718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6391072ab74a48c9a9bf4113c3e29941)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:01.151939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:01.200244 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2178/4367] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:01.219623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:01.241908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2190/4368] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 20:49:00 2022] GET /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941/tags => generated 66 bytes in 739 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 04 20:49:01.248503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:01.283842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d9a9-c865-4c87-999f-46306eb46394 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:01.323028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634b00e-33b1-4272-a4bb-4b9dcc5bc6d0 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:01.325072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:01.326231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:01.326698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:01.327181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] PATH_INFO: `/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07/users/25dcd3448ff246f7afdf268f14ec4592/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:01.349260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc82f54616c44345a2c0d1aadbeaa945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5206a8e6b14452b513b5befdfdc23e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:01.351053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:01.351575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:01.358260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] PATH_INFO: `/v3/projects/6391072ab74a48c9a9bf4113c3e29941` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:01.362021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6391072ab74a48c9a9bf4113c3e29941)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:01.366661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:01.374327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:01.398793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e79d7f175f4d4a81f5074bdf19ac07, user_id=25dcd3448ff246f7afdf268f14ec4592, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:01.410123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:01.593987 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2179/4369] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:01 2022] PUT /identity/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07/users/25dcd3448ff246f7afdf268f14ec4592/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:01.596084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:01.825762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6391072ab74a48c9a9bf4113c3e29941', 'request_id': 'req-0804c981-1e76-4a24-8616-91ff33e01797'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:01.898562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449550d-5b72-4f1e-91b2-8d374edcc685 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:02.004566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6391072ab74a48c9a9bf4113c3e29941', 'request_id': 'req-0804c981-1e76-4a24-8616-91ff33e01797'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:02.052608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6391072ab74a48c9a9bf4113c3e29941', 'request_id': 'req-0804c981-1e76-4a24-8616-91ff33e01797'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:02.169047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] The token cache is being invalidate because project 6391072ab74a48c9a9bf4113c3e29941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:02.169652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:02.180924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:02.199259 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2191/4370] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:01 2022] DELETE /identity/v3/projects/6391072ab74a48c9a9bf4113c3e29941 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:02.209478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:02.214222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:02.268595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:02.269793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:02.270277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:02.270778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:02.272064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:02.286755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:02.362360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2180/4371] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 767 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:02.364432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:02.372406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:02.422757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872c49-8e3c-4c6e-8f81-3618af61c792 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:02.472007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:02.473358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:02.473853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:02.474358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] PATH_INFO: `/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07/users/25dcd3448ff246f7afdf268f14ec4592/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:02.490269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e79d7f175f4d4a81f5074bdf19ac07, user_id=25dcd3448ff246f7afdf268f14ec4592, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:02.497517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71b95-7a65-45ad-96ad-7537c83464ad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:02.552943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2181/4372] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:02 2022] PUT /identity/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07/users/25dcd3448ff246f7afdf268f14ec4592/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:02.564389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:02.564921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:02.565417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:02.570631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804c981-1e76-4a24-8616-91ff33e01797 tempest-IdentityV3ProjectTagsTest-854827354 tempest-IdentityV3ProjectTagsTest-854827354-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:02.689201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] MFA Rules not processed for user `25dcd3448ff246f7afdf268f14ec4592`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:02.691374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:02.868880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:02.879961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:02.886984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:02.890085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:02.890857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] PATH_INFO: `/v3/users/e0b86bd925d24264aa2743e4dca937e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:02.897424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b86bd925d24264aa2743e4dca937e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:02.902423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:03.051291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2182/4373] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:03.056585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:03.078760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f456c-08dd-4fbb-89f9-9cd1541eb9a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:03.101144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:03.101144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:03.117229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:03.118433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:03.119991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:03.123999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:03.328348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:03.366067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b86bd925d24264aa2743e4dca937e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:03.367049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b86bd925d24264aa2743e4dca937e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:03.412882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2183/4374] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:03 2022] POST /identity/v3/projects => generated 360 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:03.416147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:03.577665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b86bd925d24264aa2743e4dca937e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:03.642552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b86bd925d24264aa2743e4dca937e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:03.708402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-72597e76-f855-40ef-9277-6f2556d47fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b86bd925d24264aa2743e4dca937e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:03.741001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2192/4375] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:02 2022] DELETE /identity/v3/users/e0b86bd925d24264aa2743e4dca937e9 => generated 0 bytes in 1530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:03.743925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:03.745104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:03.745642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:03.782023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2bc9-d0ad-4665-9c23-ce14597cb328 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:03.825250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:03.827821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:04.078822 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2193/4376] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:04.089712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:04.095466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:04.096456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:04.097198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:04.104446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:04.114439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:04.332516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:04.335086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:04.353049 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2184/4377] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:03 2022] POST /identity/v3/users => generated 373 bytes in 916 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:04.388410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b17e-1a0b-4b1f-9380-2245683ac6e7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:04.410948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:04.426977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:04.426977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:04.426977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:04.426977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:04.426977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:04.427836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:04.592431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:04.604717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2194/4378] 10.222.0.78 () {58 vars in 1157 bytes} [Tue Oct 4 20:49:04 2022] GET /identity/v3/users?domain_id=default => generated 7729 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:04.623245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363b005-e4ff-4a4b-9262-1174235f2882 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:04.654124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:04.655920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:04.657358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:04.658155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/users/9afbfdf515814149b66c71c83432e12f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:04.731019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:update_user(user_id=9afbfdf515814149b66c71c83432e12f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:04.734112 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:49:04.734112 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:49:04.734112 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:49:04.738443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:04.741559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:04.741957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:04.997408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66f44-c939-40cf-8feb-0b5aa52a179c tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:05.000795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:05.016438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:05.018365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:05.018901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:05.020668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:05.070312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:05.074918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa0850-d7d9-4d33-ad8e-73b5a2434f1d service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:05.099120 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2195/4379] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:49:05.170444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invalidating the token cache because user 9afbfdf515814149b66c71c83432e12f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:05.170999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:05.172407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:05.182285 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2185/4380] 10.222.0.78 () {60 vars in 1244 bytes} [Tue Oct 4 20:49:04 2022] PATCH /identity/v3/users/9afbfdf515814149b66c71c83432e12f => generated 488 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:05.190436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcafe-40ad-4e2a-aa67-85cb0dd89fff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:05.193120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcafe-40ad-4e2a-aa67-85cb0dd89fff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:05.194321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcafe-40ad-4e2a-aa67-85cb0dd89fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:05.281601 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.auth.plugins.core [None req-2f2fcafe-40ad-4e2a-aa67-85cb0dd89fff None None] User is disabled: 9afbfdf515814149b66c71c83432e12f: AssertionError: User is disabled: 9afbfdf515814149b66c71c83432e12f Oct 04 20:49:05.309939 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.server.flask.application [None req-2f2fcafe-40ad-4e2a-aa67-85cb0dd89fff None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:49:05.313841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2196/4381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 131 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 04 20:49:05.320860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:05.324480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:05.363783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:05.383498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31424704-c045-4f2c-8b82-651e99840d5d tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:05.406439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:05.408991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:05.411613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:05.411953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/users/9afbfdf515814149b66c71c83432e12f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:05.486432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9afbfdf515814149b66c71c83432e12f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:05.491079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:05.816945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:05.948696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:05.951390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:05.952019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:05.952618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:05.973838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.046062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.052130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afbfdf515814149b66c71c83432e12f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.093054 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2186/4382] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:05 2022] DELETE /identity/v3/users/9afbfdf515814149b66c71c83432e12f => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:06.100702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:06.105572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:06.109330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] MFA Rules not processed for user `9c7d0e3889e34fa1b24d19f7f68bc56c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:06.115525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:06.291819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:06.377239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71529-07c2-4588-8799-d131718db292 tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:06.392179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:06.393786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:06.394270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:06.394969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/projects/f68cdc9fe99349e3a6dfc421890eb21c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:06.397764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f68cdc9fe99349e3a6dfc421890eb21c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:06.403671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:06.444860 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2197/4383] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:06.513341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:06.528976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:06.747082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68cdc9fe99349e3a6dfc421890eb21c', 'request_id': 'req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.754986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ecef0-c6b7-4784-9e45-88a580e2bab8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:06.783223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68cdc9fe99349e3a6dfc421890eb21c', 'request_id': 'req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.818192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68cdc9fe99349e3a6dfc421890eb21c', 'request_id': 'req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:06.848067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:06.918434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:06.919620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:06.920074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:06.920583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:07.014523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] The token cache is being invalidate because project f68cdc9fe99349e3a6dfc421890eb21c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:07.015018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:07.021284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:07.025947 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2187/4384] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:06 2022] DELETE /identity/v3/projects/f68cdc9fe99349e3a6dfc421890eb21c => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:07.027627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:07.057246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:07.194864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:07.197920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:07.219486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2198/4385] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:07.221602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:07.287423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d4b6-5c26-4e5b-9b69-9cd32fb8a37a tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:07.298450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:07.300660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:07.301191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:07.301809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] PATH_INFO: `/v3/projects/e569e0c63e47419cb9b0a2cbc45f29a8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:07.304587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e569e0c63e47419cb9b0a2cbc45f29a8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:07.309845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:07.357954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:07.419461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe14eb-5396-4240-af17-3cbfd8539900 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:07.430973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25dcd3448ff246f7afdf268f14ec4592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:07.432655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:07.433217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:07.433646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:07.434787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:07.438626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Could not find domain: 8d6f2a0eed5241efb31cc2a617f7a6e8.: keystone.exception.DomainNotFound: Could not find domain: 8d6f2a0eed5241efb31cc2a617f7a6e8. Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8d6f2a0eed5241efb31cc2a617f7a6e8. Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:07.467257 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 04 20:49:07.469420 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:49:07.471560 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:49:07.473767 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:49:07.473767 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8d6f2a0eed5241efb31cc2a617f7a6e8. Oct 04 20:49:07.473767 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:07.473767 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2199/4386] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:07 2022] POST /identity/v3/users => generated 112 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:49:07.485040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:07.487121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:07.534949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ccad8-0f47-4d72-94d8-421746723afe tempest-UsersNegativeTest-536393605 tempest-UsersNegativeTest-536393605-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:07.550664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:07.551943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:07.552498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:07.578728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] PATH_INFO: `/v3/users/380b0bb0caf14055a12faaa7e230d4af` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:07.589353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380b0bb0caf14055a12faaa7e230d4af)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:07.611004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:07.669327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e569e0c63e47419cb9b0a2cbc45f29a8', 'request_id': 'req-7745728b-8511-49e5-b761-36eea7823688'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:07.713848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e569e0c63e47419cb9b0a2cbc45f29a8', 'request_id': 'req-7745728b-8511-49e5-b761-36eea7823688'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:07.752764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e569e0c63e47419cb9b0a2cbc45f29a8', 'request_id': 'req-7745728b-8511-49e5-b761-36eea7823688'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.036580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] The token cache is being invalidate because project e569e0c63e47419cb9b0a2cbc45f29a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:08.037644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.038381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.042107 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2188/4387] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:07 2022] DELETE /identity/v3/projects/e569e0c63e47419cb9b0a2cbc45f29a8 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:08.048195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:08.051505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:08.258247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745728b-8511-49e5-b761-36eea7823688 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:08.280515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380b0bb0caf14055a12faaa7e230d4af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.283575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380b0bb0caf14055a12faaa7e230d4af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.284373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:08.286006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:08.286567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:08.291060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] PATH_INFO: `/v3/users/bc82f54616c44345a2c0d1aadbeaa945` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:08.301029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc82f54616c44345a2c0d1aadbeaa945)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:08.305351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:08.508476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380b0bb0caf14055a12faaa7e230d4af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.566463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380b0bb0caf14055a12faaa7e230d4af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.582664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:08.600469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-31c1b93f-99d2-498f-bcac-391e74d8c202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380b0bb0caf14055a12faaa7e230d4af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:08.629649 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2200/4388] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:07 2022] DELETE /identity/v3/users/380b0bb0caf14055a12faaa7e230d4af => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:08.632707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:08.632707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:08.632707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:08.683398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:08.683398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:08.840523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc82f54616c44345a2c0d1aadbeaa945'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:09.000990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc82f54616c44345a2c0d1aadbeaa945'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:09.003600 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2201/4389] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:09.024832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc82f54616c44345a2c0d1aadbeaa945'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:09.059031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:09.062019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:09.165462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc82f54616c44345a2c0d1aadbeaa945'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:09.177841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc82f54616c44345a2c0d1aadbeaa945'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:09.242969 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2189/4390] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:08 2022] DELETE /identity/v3/users/bc82f54616c44345a2c0d1aadbeaa945 => generated 0 bytes in 1191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:09.471492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bf304-0b1f-42fe-a1f4-6dde6a1d0c15 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:09.485549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:09.732993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:09.734153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:09.734675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:09.735179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:09.752081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:10.066251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:10.074932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad791-9dd4-4307-8299-019dac6803b2 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:10.124322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2202/4391] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1066 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:12.379556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:12.381953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:12.433674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea674bc1-b6f4-4b1b-bc78-e4f54d3d953f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:12.461031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:12.462762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:12.464070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:12.464809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] PATH_INFO: `/v3/projects/5a5206a8e6b14452b513b5befdfdc23e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:12.471379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5206a8e6b14452b513b5befdfdc23e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:12.475926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:12.929096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5206a8e6b14452b513b5befdfdc23e', 'request_id': 'req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:12.975083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5206a8e6b14452b513b5befdfdc23e', 'request_id': 'req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:13.023551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5206a8e6b14452b513b5befdfdc23e', 'request_id': 'req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:13.194057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] The token cache is being invalidate because project 5a5206a8e6b14452b513b5befdfdc23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:13.194584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:13.195949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:13.217016 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2190/4392] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:12 2022] DELETE /identity/v3/projects/5a5206a8e6b14452b513b5befdfdc23e => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:13.221517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:13.222306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:13.224009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:13.328007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:13.335231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:13.493912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:13.497426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:13.622615 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2203/4393] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:13.625984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:13.629695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:13.678247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f7be3-4ed4-4331-96a7-10839e27dc77 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:13.697615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:13.700261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:13.701978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:13.703580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] PATH_INFO: `/v3/projects/8edf2e3c40da4848a8d7ab3a4edb5fec` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:13.708255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edf2e3c40da4848a8d7ab3a4edb5fec)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:13.731818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:13.861926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7a6b-afe2-4038-8f81-3484cd3a09e1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:13.895710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:13.897030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:13.897548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:13.898050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] PATH_INFO: `/v3/users/d7cd5eb1f46c402393ddbd5bcd92c1c6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:13.902053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cd5eb1f46c402393ddbd5bcd92c1c6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:13.909046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:14.139206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edf2e3c40da4848a8d7ab3a4edb5fec', 'request_id': 'req-2e9b70c2-e636-491d-a669-06f621808f95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.156516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:14.297017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edf2e3c40da4848a8d7ab3a4edb5fec', 'request_id': 'req-2e9b70c2-e636-491d-a669-06f621808f95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.324206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edf2e3c40da4848a8d7ab3a4edb5fec', 'request_id': 'req-2e9b70c2-e636-491d-a669-06f621808f95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.372130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] The token cache is being invalidate because project 8edf2e3c40da4848a8d7ab3a4edb5fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:14.373349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.375220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e9b70c2-e636-491d-a669-06f621808f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.378790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2204/4394] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:13 2022] DELETE /identity/v3/projects/8edf2e3c40da4848a8d7ab3a4edb5fec => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:14.385594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:14.385594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:14.385594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:14.416206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:14.437591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:14.443431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:14.480940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cd5eb1f46c402393ddbd5bcd92c1c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.695230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2205/4395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:14.697028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:14.699819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:14.732340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f02e9-0621-45d1-946d-bbc5653a809b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:14.744415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:14.747887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:14.748057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:14.749180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] PATH_INFO: `/v3/users/25dcd3448ff246f7afdf268f14ec4592` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:14.752528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dcd3448ff246f7afdf268f14ec4592)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:14.769519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:14.776583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cd5eb1f46c402393ddbd5bcd92c1c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.844186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cd5eb1f46c402393ddbd5bcd92c1c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.920808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cd5eb1f46c402393ddbd5bcd92c1c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.922558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cd5eb1f46c402393ddbd5bcd92c1c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:14.953780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2191/4396] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:13 2022] DELETE /identity/v3/users/d7cd5eb1f46c402393ddbd5bcd92c1c6 => generated 0 bytes in 1456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:14.955514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:14.967710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:15.306193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315e066-b967-4731-a726-cf610d1d5e63 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:15.324022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:15.325002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:15.328124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:15.329893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:15.331581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:15.332166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:15.351165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:15.366838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dcd3448ff246f7afdf268f14ec4592'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:15.368388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dcd3448ff246f7afdf268f14ec4592'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:15.423863 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2192/4397] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:15.425671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:15.467695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64425-3cd2-4206-b58e-5c1fd3ac6719 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:15.490481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:15.491753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:15.492274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:15.492902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:15.494426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:15.498854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:15.545495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dcd3448ff246f7afdf268f14ec4592'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:15.646703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dcd3448ff246f7afdf268f14ec4592'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:15.671060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dcd3448ff246f7afdf268f14ec4592'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:15.714128 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2206/4398] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:14 2022] DELETE /identity/v3/users/25dcd3448ff246f7afdf268f14ec4592 => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:15.867232 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2193/4399] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:15 2022] POST /identity/v3/projects => generated 363 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:15.871582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:15.876092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:16.109223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6d65-0823-496c-8f82-60c7e2793d99 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:16.284076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:16.286102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:16.286725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:16.287101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:16.288633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:16.296653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:16.503611 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2207/4400] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:15 2022] POST /identity/v3/users => generated 282 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:16.512376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:16.562258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa801bb-7fc9-460a-9f5b-99820e319eaa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:16.581545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:16.582868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:16.583671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:16.585647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:16.587379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:16.607507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:16.646766 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2194/4401] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:16.651941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:16.706228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7e71b-2ffa-464b-be06-88c7b3165e02 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:16.736080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:16.740350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:16.741348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:16.744911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:16.755889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:16.759119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90302011-7380-4ebc-a805-7596c86cd3e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:16.807113 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2208/4402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:16.812211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:16.852364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bef57d-594b-4680-a0ec-32ce5136b783 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:16.879673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:16.882265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:16.888073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:16.889275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] PATH_INFO: `/v3/projects/739fbcb5ed2244948c79494953752ad5/users/7ffcd8256556441e89d2f8aa1e7cf0bb/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:16.961401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=739fbcb5ed2244948c79494953752ad5, user_id=7ffcd8256556441e89d2f8aa1e7cf0bb, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:16.973983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:17.067980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:17.204090 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2195/4403] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:16 2022] PUT /identity/v3/projects/739fbcb5ed2244948c79494953752ad5/users/7ffcd8256556441e89d2f8aa1e7cf0bb/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:17.231093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:17.231093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:17.231650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:17.341979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] MFA Rules not processed for user `7ffcd8256556441e89d2f8aa1e7cf0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:17.345396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:17.463317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:17.468102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:17.593572 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2209/4404] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:17.629102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:17.635592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:17.749777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:17.879830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d6df-8e40-4b1b-b6d8-396b154ca30c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:17.913300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:17.914839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:17.917684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:17.918220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] PATH_INFO: `/v3/projects/21485db3d9e240e0927cd9c3bcf0ed1f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:17.926224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21485db3d9e240e0927cd9c3bcf0ed1f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:17.937116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:17.981335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015ea0-fcbd-4a15-af04-96bbd3a1a663 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:17.994178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:17.996674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:17.997880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:17.999327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:18.026870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:18.030419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fcefc-9028-49d3-92bc-e76c25fb13b5 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:18.066189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2210/4405] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:18.370838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21485db3d9e240e0927cd9c3bcf0ed1f', 'request_id': 'req-1d072c08-e613-491f-b863-993d6ba00960'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:18.410814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21485db3d9e240e0927cd9c3bcf0ed1f', 'request_id': 'req-1d072c08-e613-491f-b863-993d6ba00960'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:18.431889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21485db3d9e240e0927cd9c3bcf0ed1f', 'request_id': 'req-1d072c08-e613-491f-b863-993d6ba00960'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:18.755808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] The token cache is being invalidate because project 21485db3d9e240e0927cd9c3bcf0ed1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:18.756486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:18.766014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d072c08-e613-491f-b863-993d6ba00960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:18.785939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2196/4406] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:17 2022] DELETE /identity/v3/projects/21485db3d9e240e0927cd9c3bcf0ed1f => generated 0 bytes in 1314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:18.790645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:18.791382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:18.791665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:18.880874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:18.888970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:19.145367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2211/4407] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:19.162573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:19.163589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:19.163743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:19.237698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:19.242322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:19.270507 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2197/4408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:19.284464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:19.320188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4528-3a80-4b9d-9d9c-2e1f2eb543b8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:19.334154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:19.337827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:19.374778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:19.383746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:19.388110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:19.389088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:19.391796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:19.392747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:19.401487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:19.407561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe38c-565a-46f7-b190-bcaff928c682 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:19.434224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:19.434224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:19.434224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:19.434224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] PATH_INFO: `/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:19.434901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e79d7f175f4d4a81f5074bdf19ac07)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:19.434901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:19.469381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2212/4409] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:19.471308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:19.512916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e266c3-cbe0-4daf-94b4-dec02470e9a3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:19.537082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:19.538804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:19.538804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:19.544245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:19.545775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:19.554867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.030229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2213/4410] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:19 2022] POST /identity/v3/projects => generated 387 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:20.030229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.033041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'request_id': 'req-51255632-7b25-4139-8506-b13bc8348e43'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:20.075038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'request_id': 'req-51255632-7b25-4139-8506-b13bc8348e43'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:20.102251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e79d7f175f4d4a81f5074bdf19ac07', 'request_id': 'req-51255632-7b25-4139-8506-b13bc8348e43'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:20.289492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d68ca-4ef2-4472-813e-5bc75fc0f44e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.300588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.301698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.302237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.302653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.304425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:20.312318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e17905-3229-47c8-8345-8afbacdceb0b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.383128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] The token cache is being invalidate because project c6e79d7f175f4d4a81f5074bdf19ac07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:20.386491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:20.389398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51255632-7b25-4139-8506-b13bc8348e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:20.403997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2198/4411] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:19 2022] DELETE /identity/v3/projects/c6e79d7f175f4d4a81f5074bdf19ac07 => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:20.416655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.419051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.422197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.528993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:20.533547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:20.597140 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2199/4412] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:20.608573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2214/4413] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:20 2022] POST /identity/v3/users => generated 294 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:20.611985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.612319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.612781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.613563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.617536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:20.646855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cb6ec-4124-4031-95ea-705dec445c34 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.661013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.662772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.664165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.664879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.667007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:20.668795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:20.671426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.672619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:20.694356 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2215/4414] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:20.701469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.723048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2200/4415] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:20.730569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.738997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1c6fb-f492-4f38-8e09-f7293096cbf4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.753326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.755173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.760236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.760975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.763114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:20.763982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:20.769773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925a04-e212-4287-a31f-7d153bdc0232 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.771626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.780220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.781061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.781579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.782193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.784238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:20.788604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.823252 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2216/4416] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:49:20.839294 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2201/4417] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:20.842699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.854826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:20.869242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c0f78-6bc7-4a3c-8781-e017a240115a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.876510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.878209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:20.878810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:20.879388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] PATH_INFO: `/v3/projects/c158dac976d04c289ac71653feb4ca36/users/6ee1d48c308e49249a3ead3dc9ec9d94/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:20.938192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c158dac976d04c289ac71653feb4ca36, user_id=6ee1d48c308e49249a3ead3dc9ec9d94, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:20.941424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a8be-637a-4fc7-aa21-325aa71e85e6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:20.943179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89fd3c-17da-41c0-b250-693ed90586ad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:20.987522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:20.999689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:21.000814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:21.001945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:21.009948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:21.017022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:21.110335 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2202/4418] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:20 2022] PUT /identity/v3/projects/c158dac976d04c289ac71653feb4ca36/users/6ee1d48c308e49249a3ead3dc9ec9d94/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:21.114568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:21.115067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:21.115612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:21.280686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:21.284194 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2217/4419] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:20 2022] POST /identity/v3/projects => generated 391 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:21.285058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:21.299251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:21.304816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:21.654596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:21.675309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7012578-3527-4587-964a-cf52eac936c7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:21.691630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2203/4420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:21.696374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:21.700399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:21.712887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:21.717906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:21.726659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] PATH_INFO: `/v3/users/7ffcd8256556441e89d2f8aa1e7cf0bb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:21.728718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffcd8256556441e89d2f8aa1e7cf0bb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:21.737629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:21.770850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8f263-60b5-42bb-b2c4-8dc141a5eea9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:21.805198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:21.806636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:21.809428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:21.810374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:21.813934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:21.826574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:22.022817 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2204/4421] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:21 2022] POST /identity/v3/users => generated 296 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:22.025244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:22.038554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:22.309717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffcd8256556441e89d2f8aa1e7cf0bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:22.312110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffcd8256556441e89d2f8aa1e7cf0bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:22.349045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:22.394324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ad64b-9ce1-47a9-ba03-a1d4f42061d3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:22.433057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:22.434552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:22.434552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:22.434552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:22.439296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffcd8256556441e89d2f8aa1e7cf0bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:22.476835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:22.479812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:22.489511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffcd8256556441e89d2f8aa1e7cf0bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:22.538397 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2205/4422] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:22.540062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:22.563542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26cdb956-399a-42bb-bc4f-ac271a3ba524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffcd8256556441e89d2f8aa1e7cf0bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:22.577731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c1417-e963-40ce-966d-3136e542e01c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:22.596850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2218/4423] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:21 2022] DELETE /identity/v3/users/7ffcd8256556441e89d2f8aa1e7cf0bb => generated 0 bytes in 1305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:22.607995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b64-1935-438a-80d3-61b39104e6ef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:22.608701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b64-1935-438a-80d3-61b39104e6ef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:22.609384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69b64-1935-438a-80d3-61b39104e6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:22.642149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:22.642649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:22.643868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:22.643868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:22.644812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:22.664815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:22.688544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ddf69b64-1935-438a-80d3-61b39104e6ef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:22.693846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ddf69b64-1935-438a-80d3-61b39104e6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:22.744905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2206/4424] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:22.749485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:22.762815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:22.836300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3391-fe37-4b34-94a2-26d5e0743170 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:23.097476 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2219/4425] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:23.116212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:23.117294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:23.118137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:23.181954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:23.184293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:23.185317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:23.187346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:23.189153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:23.193695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6ec87-86c4-4e69-a9c3-10764c35404f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:23.230142 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2207/4426] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:23.233005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:23.233502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:23.233971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:23.315327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] MFA Rules not processed for user `5521d99f7d6d4432acf47388c0a0c93a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:23.317742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:23.350369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] MFA Rules not processed for user `9c7d0e3889e34fa1b24d19f7f68bc56c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:23.357176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:23.744306 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2208/4427] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:23.746077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:23.767421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:23.767421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2220/4428] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 666 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:23.768577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:23.768757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:23.853914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804f5d-ea2c-47e7-82f3-7db43d0e558f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:23.883085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:23.886226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:23.887463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:23.890272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] PATH_INFO: `/v3/projects/59598145da49457993b17fc7f426420c/users/bf17dd94bf2547a5b3db24c9eefac41f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:24.001962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59598145da49457993b17fc7f426420c, user_id=bf17dd94bf2547a5b3db24c9eefac41f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:24.014138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:24.142176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f740fe0-a258-42f3-a4de-27075dd8c268 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:24.147486 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2221/4429] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:23 2022] PUT /identity/v3/projects/59598145da49457993b17fc7f426420c/users/bf17dd94bf2547a5b3db24c9eefac41f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:24.156077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:24.166418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:24.430878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba37db-7d5f-448b-913b-1ca58901cc12 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:24.445487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:24.446829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:24.450885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:24.450885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:24.461133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:24.462767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:24.465091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:24.469169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] PATH_INFO: `/v3/users/124ee4952519479f95536e976a096335` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:24.481478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124ee4952519479f95536e976a096335)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:24.496569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:24.496892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:24.499414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d412c-8f05-4a8c-b697-2805bfc91140 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:24.540703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2209/4430] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:24.554661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc16da-909d-43f2-ae16-a67f65553c3b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:24.554661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc16da-909d-43f2-ae16-a67f65553c3b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:24.554661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc16da-909d-43f2-ae16-a67f65553c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:24.669619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-05fc16da-909d-43f2-ae16-a67f65553c3b None None] MFA Rules not processed for user `5521d99f7d6d4432acf47388c0a0c93a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:24.692752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05fc16da-909d-43f2-ae16-a67f65553c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:24.934597 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2210/4431] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:24.946636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:24.948583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:24.948583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:24.960706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:24.999102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124ee4952519479f95536e976a096335'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:25.002981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124ee4952519479f95536e976a096335'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:25.031774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] MFA Rules not processed for user `bf17dd94bf2547a5b3db24c9eefac41f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:25.035539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:25.132898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124ee4952519479f95536e976a096335'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:25.169776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124ee4952519479f95536e976a096335'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:25.202375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7c4a8a2-7ffa-454f-8d55-f7aecd2c5886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124ee4952519479f95536e976a096335'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:25.230511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2222/4432] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:24 2022] DELETE /identity/v3/users/124ee4952519479f95536e976a096335 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:25.244795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:25.244795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:25.244795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:25.267883 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:25.269681 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:25.309166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2223/4433] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:49:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:49:25.309166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:25.309166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:25.357510 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2211/4434] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:25.359019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:25.366644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:25.383773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f9942-6d1d-4334-880d-d174d0c40ccd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:25.617218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:25.618933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:25.619504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:25.620025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:25.621315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:25.624100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:25.784246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c058-94cc-4c1b-822a-c0ad4800e516 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:25.806325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:25.807510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:25.807979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:25.810741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:25.823639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:26.050144 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2212/4435] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 4 20:49:25 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 789 bytes in 692 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:26.058075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:26.099026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d1414-ee97-49ea-8d9d-21832287615a tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:26.124419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:26.127595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:26.128206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:26.134546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:26.134546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/20bb3b073cda49e5a738df20257e84ce` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:26.135975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20967c69-56cd-476d-ac6d-a03a1091264e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:26.185237 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2224/4436] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:26.210779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:get_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=20bb3b073cda49e5a738df20257e84ce)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:26.216911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:26.222063 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2213/4437] 10.222.0.78 () {58 vars in 1392 bytes} [Tue Oct 4 20:49:26 2022] GET /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/20bb3b073cda49e5a738df20257e84ce => generated 689 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:49:26.229053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:26.229655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:26.230070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:26.283572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] MFA Rules not processed for user `bf17dd94bf2547a5b3db24c9eefac41f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:26.285829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:26.564044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:26.576827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:26.657951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2225/4438] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 04 20:49:26.660733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:26.700786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d9ea8-4503-4f39-8797-ded6eb015d9f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:26.721290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:26.722613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:26.724984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:26.724984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/20bb3b073cda49e5a738df20257e84ce` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:26.733462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=20bb3b073cda49e5a738df20257e84ce)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:26.737605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:26.927641 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2226/4439] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:26 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/20bb3b073cda49e5a738df20257e84ce => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:26.936661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:26.985809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d74b2-e770-44d3-8502-7a8eb32c98e3 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:27.003555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:27.008432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:27.009723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:27.010653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:27.015459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:27.021474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597324ed-1f3d-4b63-b5c9-c0dba74fa1da tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:27.123780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd7e82-f714-4184-9322-2c1064f56c61 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:27.139065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:27.163449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:27.189105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:27.191329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:27.193147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] PATH_INFO: `/v3/projects/e7e1ecd83e39483281a9b6b3db59648e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:27.207740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e1ecd83e39483281a9b6b3db59648e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:27.218710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:27.469471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:27.519521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e1ecd83e39483281a9b6b3db59648e', 'request_id': 'req-04579036-7d79-4957-b6f6-f1c110a6c4c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:27.554791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e1ecd83e39483281a9b6b3db59648e', 'request_id': 'req-04579036-7d79-4957-b6f6-f1c110a6c4c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:27.598594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e1ecd83e39483281a9b6b3db59648e', 'request_id': 'req-04579036-7d79-4957-b6f6-f1c110a6c4c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:27.637293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2227/4440] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:49:26 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 920 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:27.647857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:27.648952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:27.650501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:27.673418 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:27.675354 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:27.713850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2228/4441] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:49:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:49:27.722516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:27.759797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] The token cache is being invalidate because project e7e1ecd83e39483281a9b6b3db59648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:27.759797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:27.759797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-04579036-7d79-4957-b6f6-f1c110a6c4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:27.771072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2214/4442] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:26 2022] DELETE /identity/v3/projects/e7e1ecd83e39483281a9b6b3db59648e => generated 0 bytes in 1209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:27.779611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353ed3-815e-43e8-adbb-d8639386a618 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:27.780924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353ed3-815e-43e8-adbb-d8639386a618 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:27.780924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353ed3-815e-43e8-adbb-d8639386a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:27.867755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:27.886637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-53353ed3-815e-43e8-adbb-d8639386a618 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:27.889369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-53353ed3-815e-43e8-adbb-d8639386a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:28.122460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c9e5-f070-4314-a3f6-ae9a4d1d9b7c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:28.155121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:28.156333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:28.156802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:28.157313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/ab21e28e3746496b8512d934230db01e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:28.161238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2215/4443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:28.177771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:28.180604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:28.181669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:28.267286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=ab21e28e3746496b8512d934230db01e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:28.270550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:28.294838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:28.297708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:28.345927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2216/4444] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:28.352468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:28.394254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8e39-eef2-475c-ab7c-16ae35eff9ad None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:28.444362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:28.459505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:28.461580 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2229/4445] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:27 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/ab21e28e3746496b8512d934230db01e => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:28.465016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:28.469667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:28.469989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:28.471935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:28.474099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:28.476117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:28.483073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:28.549421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179f921-1f69-49a4-83eb-1c9bc151a443 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:28.573237 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2217/4446] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:49:28.578693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:28.578908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:28.578908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:28.578908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:28.579425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:28.580568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:28.585583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f7f80-d872-4446-bee1-bd3f953de565 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:28.625852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4e88-de39-46a1-8e38-caf04b4765ad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:28.650504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:28.652501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:28.653380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:28.654094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:28.655682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:28.659382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:28.897022 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2218/4447] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:28 2022] POST /identity/v3/projects => generated 359 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:28.905560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:29.106384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2230/4448] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:49:28 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 813 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:29.109624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:29.126939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:29.127890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:29.156202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:29.166340 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:29.168330 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:29.173492 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2231/4449] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:49:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:49:29.177890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:29.353535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:29.413377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1cbc7-e172-47cc-a2aa-7558f299e8a9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:29.444691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:29.445887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:29.446959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:29.447480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:29.453784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:29.458373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:29.567786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c20ba-ec3e-4868-9cf4-0b6ff7295284 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:29.602097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:29.604117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:29.604638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:29.605791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/b909cce367824969b99155f6e6df5be0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:29.645394 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2219/4450] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:28 2022] POST /identity/v3/users => generated 280 bytes in 742 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:29.661671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:29.694710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=b909cce367824969b99155f6e6df5be0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:29.702636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:29.758819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7d0b-7bb3-4907-91e8-0601449d6034 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:29.813615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:29.820177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:29.820825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:29.821374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:29.823100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:29.827504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:29.890569 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2220/4451] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:29.898936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:29.939329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207d86-908f-4d7d-a871-13c43f46d390 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:29.957083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:29.967174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:29.971530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:29.984126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:29.990996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:29.994064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:30.010972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:30.025705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2232/4452] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:29 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/b909cce367824969b99155f6e6df5be0 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:30.036932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:30.077580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd46dc-d0d9-4e79-a957-eeaa0e1f6297 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:30.080494 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2221/4453] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:30.088323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:30.121561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:30.125935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:30.125935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:30.125935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:30.125935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:30.140513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24882046-0662-4a16-8146-0bb6f1adc767 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:30.145069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:30.164303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:30.168583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:30.171577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:30.172791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] PATH_INFO: `/v3/projects/88320c09659846b298ad9ecfbd27e195/users/754435f4cd8345bdbfe097d70570682f/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:30.257164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88320c09659846b298ad9ecfbd27e195, user_id=754435f4cd8345bdbfe097d70570682f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:30.278557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff14d1a-fb4a-4d64-8470-0afda86d247f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:30.389020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2222/4454] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:30 2022] PUT /identity/v3/projects/88320c09659846b298ad9ecfbd27e195/users/754435f4cd8345bdbfe097d70570682f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:30.414625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:30.416147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:30.416490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:30.538355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] MFA Rules not processed for user `754435f4cd8345bdbfe097d70570682f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:30.544205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:30.643700 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2233/4455] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 4 20:49:30 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 788 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:30.653347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:30.720255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713cf14-4286-4770-b01f-60bf10652d4c tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:30.968442 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2223/4456] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:30.993704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:30.996524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:31.031935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:31.033666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:31.034389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:31.035081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:31.036695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:31.039384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:31.156470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:31.444830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:31.478740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d849-027a-4c1d-95ce-507ecac9508d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:31.490715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2234/4457] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 4 20:49:30 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 788 bytes in 838 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:31.492208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:31.510237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:31.512137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:31.513758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:31.514761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:31.547560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:31.553859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d915d4-504b-42e0-b525-ef4e7f188027 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:31.557226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:31.580543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:31.581703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:31.582179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:31.582672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:31.582878 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2224/4458] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:31.584808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:31.593424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:31.699552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2235/4459] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:49:31 2022] GET /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 1500 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:31.706569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:31.756001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92371-e14a-49b8-94a0-d87258a73521 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:31.772881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:31.813998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:31.813998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:31.813998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:31.815265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/c4dc04fea99c4f47ad102ae1840d1ed6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:31.853695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=c4dc04fea99c4f47ad102ae1840d1ed6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:31.858269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:32.015243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de7d8-5567-401b-8ed8-e4681ef5fbb8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:32.037451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:32.040814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:32.043652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:32.044572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] PATH_INFO: `/v3/users/754435f4cd8345bdbfe097d70570682f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:32.071099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754435f4cd8345bdbfe097d70570682f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:32.078716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:32.080825 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2225/4460] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:31 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/c4dc04fea99c4f47ad102ae1840d1ed6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:32.082912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:32.106832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:32.235789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b781-5e73-4bee-a907-3239f9bdd02d tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:32.267530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:32.272525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:32.277239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:32.280199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] PATH_INFO: `/v3/projects/739fbcb5ed2244948c79494953752ad5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:32.286539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=739fbcb5ed2244948c79494953752ad5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:32.293924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:32.696785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754435f4cd8345bdbfe097d70570682f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.698093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754435f4cd8345bdbfe097d70570682f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.707510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739fbcb5ed2244948c79494953752ad5', 'request_id': 'req-f12276e5-5dae-455f-909e-2250cced67d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.726013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739fbcb5ed2244948c79494953752ad5', 'request_id': 'req-f12276e5-5dae-455f-909e-2250cced67d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.740829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739fbcb5ed2244948c79494953752ad5', 'request_id': 'req-f12276e5-5dae-455f-909e-2250cced67d0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.819655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754435f4cd8345bdbfe097d70570682f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.883797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754435f4cd8345bdbfe097d70570682f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.917056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754435f4cd8345bdbfe097d70570682f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:32.948951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2236/4461] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:31 2022] DELETE /identity/v3/users/754435f4cd8345bdbfe097d70570682f => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:32.951167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:32.958357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:33.006052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:33.072100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] The token cache is being invalidate because project 739fbcb5ed2244948c79494953752ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:33.072969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:33.077080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f12276e5-5dae-455f-909e-2250cced67d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:33.087745 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2226/4462] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:32 2022] DELETE /identity/v3/projects/739fbcb5ed2244948c79494953752ad5 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:33.092124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f44bf-c2d0-4e17-87e5-bad3e70baff6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.093131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f44bf-c2d0-4e17-87e5-bad3e70baff6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.094237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f44bf-c2d0-4e17-87e5-bad3e70baff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:33.187482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c06f44bf-c2d0-4e17-87e5-bad3e70baff6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:33.189905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c06f44bf-c2d0-4e17-87e5-bad3e70baff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:33.280827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4642f-be18-4f06-8ae2-9e2f9c205798 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:33.292853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:33.294599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.295912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.302310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/bb1398467cbe4578a01df47923527142` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:33.325673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=bb1398467cbe4578a01df47923527142)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:33.333550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:33.464020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2227/4463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:33.466827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.467765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.468472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:33.514878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2237/4464] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:32 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/bb1398467cbe4578a01df47923527142 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:33.522837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:33.529819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:33.549808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:33.556512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:33.592402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33366092-7291-4cb0-a636-3ef3928c0481 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:33.607378 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2228/4465] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:33.614790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:33.615646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:33.616949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.617442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.618164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:33.618367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:33.619574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:33.622303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:33.768712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:33.819192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529135-2bea-4898-aec6-210f82d7378c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:33.828917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:33.830335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.831096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.831810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:33.876578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:33.879763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a6aff-0471-40a6-8077-5a13300c0619 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:33.924142 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2229/4466] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:33.926538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:33.927035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:33.927556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.005658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:34.013490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:34.052776 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2230/4467] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:34.060261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.093127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e028-f6db-4196-8b3f-49cebd3636a4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.096162 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2238/4468] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 4 20:49:33 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 788 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:34.103520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.122964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb664d-ceb7-4a65-865e-5e968106c720 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.123754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.125071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.127027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.128188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.133203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:34.134649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.135102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.136697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.137294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.137815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.139185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.150827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:34.151072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:34.182717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2231/4469] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:34.189842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.240558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb1e5-b8e8-443b-8eca-d3b015a13aec admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.264624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.265684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.266187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.266679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.270931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.282481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:34.486828 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2232/4470] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:34 2022] POST /identity/v3/projects => generated 411 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:34.495279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.518846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2239/4471] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 4 20:49:34 2022] POST /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials => generated 789 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:34.526079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.561960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231eaf-f0a0-43d8-8eae-901644ab9da6 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.640502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:34.780021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.781339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.781959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.782549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.788553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Adding query filter params (name=tempest-application_credential-1562624263) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:34.789278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.793210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:34.837465 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2240/4472] 10.222.0.78 () {58 vars in 1386 bytes} [Tue Oct 4 20:49:34 2022] GET /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials?name=tempest-application_credential-1562624263 => generated 887 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:34.843833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:34.877334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559b33-58c0-402d-b571-f49b756537ab admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.884765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901f585-e897-4588-a919-ea3e6f65a668 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:34.900654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.901062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:34.902318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.902990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.903632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/a563171938304f6199c54a10278e63d1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.908414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:34.908845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:34.909317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:34.911058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.915344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:34.939419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=a563171938304f6199c54a10278e63d1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:34.945198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:35.143267 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2233/4473] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:34 2022] POST /identity/v3/users => generated 306 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:35.145207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:35.149229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2241/4474] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:34 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/a563171938304f6199c54a10278e63d1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:35.156660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:35.186192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681138-076f-4f08-916a-a294b6c874c8 tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:35.189213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51178979-d161-4f5e-82a0-6c64288bb9d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:35.204587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf17dd94bf2547a5b3db24c9eefac41f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59598145da49457993b17fc7f426420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:35.205990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:35.206745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:35.207416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/c22a70adb8d146faaa1cd6954c0e99ef` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:35.209808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:35.210917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:35.211435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:35.212513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:35.213730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:35.217794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:35.261072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf17dd94bf2547a5b3db24c9eefac41f, application_credential_id=c22a70adb8d146faaa1cd6954c0e99ef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:35.264430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:35.273939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2234/4475] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:35.276642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:35.320389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770834-2bed-49d5-97c5-19874edcd821 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:35.352602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:35.358990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:35.359908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:35.364617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:35.366760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:35.381676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:35.424322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2242/4476] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:49:35 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f/application_credentials/c22a70adb8d146faaa1cd6954c0e99ef => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:35.432044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:35.440699 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2235/4477] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:35.441013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:35.451009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:35.518004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717aac-f483-4215-9b6a-ff71adffc75c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:35.535039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9c2c-019e-4b08-8e2a-9de9011f7bfb tempest-ApplicationCredentialsV3Test-765273243 tempest-ApplicationCredentialsV3Test-765273243-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:35.554359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:35.556195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:35.556692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:35.557184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] PATH_INFO: `/v3/projects/23af9d74a1c644688ccc2ef3aaf6ad86/users/006b771662564bafab6e1bade033a234/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:35.562116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:35.563648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:35.564351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:35.569524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] PATH_INFO: `/v3/users/bf17dd94bf2547a5b3db24c9eefac41f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:35.574069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf17dd94bf2547a5b3db24c9eefac41f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:35.583492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:35.657030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af9d74a1c644688ccc2ef3aaf6ad86, user_id=006b771662564bafab6e1bade033a234, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:35.667952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c19bf-d443-4427-9169-8be30b580cd3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:36.113762 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2236/4478] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:35 2022] PUT /identity/v3/projects/23af9d74a1c644688ccc2ef3aaf6ad86/users/006b771662564bafab6e1bade033a234/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:36.144298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:36.145417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:36.147923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:36.302615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf17dd94bf2547a5b3db24c9eefac41f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:36.305414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] MFA Rules not processed for user `006b771662564bafab6e1bade033a234`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:36.307264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf17dd94bf2547a5b3db24c9eefac41f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:36.314403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:36.454956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:36.467378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf17dd94bf2547a5b3db24c9eefac41f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:36.617630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2237/4479] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:36.624514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf17dd94bf2547a5b3db24c9eefac41f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:36.627701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:36.684626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efcd88e3-4688-44f2-8fc5-da4cf446eeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf17dd94bf2547a5b3db24c9eefac41f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:36.714113 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2243/4480] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:35 2022] DELETE /identity/v3/users/bf17dd94bf2547a5b3db24c9eefac41f => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:36.721340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:36.722226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:36.725714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:36.802992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:36.805506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:36.905430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:36.960969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c4d3-00ee-4c4f-8046-9c58ad5cea6d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:37.099731 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2244/4481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:37.223010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:37.224393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:37.224905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:37.225405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:37.226706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:37.241994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:37.401257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:37.405666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:37.437761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2238/4482] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:36 2022] POST /identity/v3/projects => generated 409 bytes in 811 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:37.447477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:37.454753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:37.570848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387613-603d-4cab-81ea-c44af4e4d2b7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:37.676094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fa975-b365-4f10-a948-cbe031d7686d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:37.690507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:37.692716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:37.693510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:37.694280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:37.695762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:37.701370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:37.722943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:37.867537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:37.869367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:37.870241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:37.871084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:37.911448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2239/4483] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:37 2022] POST /identity/v3/users => generated 311 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:37.920911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:37.926716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:37.929999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:38.005793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2245/4484] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:38.021615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043854a5-6c70-42dc-a5bf-b81934168d16 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:38.041443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:38.043310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:38.044716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:38.045649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:38.047570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:38.051721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:38.100376 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2240/4485] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:38.108242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:38.155926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb83353-6b3a-450c-8a37-3fcfd4ecc21e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:38.175063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:38.176770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:38.177725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:38.178416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] PATH_INFO: `/v3/projects/002df809b8354f4a94b26e5a119e27a3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:38.242440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] RBAC: Authorizing `identity:create_grant(project_id=002df809b8354f4a94b26e5a119e27a3, user_id=e37d63ff8b0a4fc8b7a4f4adf4b4e243, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:38.262988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:38.379904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:38.380744 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2246/4486] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:38 2022] PUT /identity/v3/projects/002df809b8354f4a94b26e5a119e27a3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:38.419976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2660-9957-4011-92d7-0c75d5e19050 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:38.665872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:38.669387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:38.669921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:38.670401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:38.674460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:38.688959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8d1ab-635a-4ab5-b980-4cc32b150fc8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:38.733986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2241/4487] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:38.734211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:38.767533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac319c0-057a-4c0b-8c2b-c6b79712154c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:38.793032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:38.794273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:38.794832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:38.795636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] PATH_INFO: `/v3/projects/002df809b8354f4a94b26e5a119e27a3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:38.809663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=002df809b8354f4a94b26e5a119e27a3, user_id=e37d63ff8b0a4fc8b7a4f4adf4b4e243, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:38.816132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:38.860106 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2247/4488] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:38 2022] PUT /identity/v3/projects/002df809b8354f4a94b26e5a119e27a3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:38.893047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:38.894095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:38.897746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:39.103933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] MFA Rules not processed for user `e37d63ff8b0a4fc8b7a4f4adf4b4e243`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:39.125436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:39.407976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2242/4489] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:38 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:39.478166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:39.482129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:39.749011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:39.763300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:39.765899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:39.777709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96308f7-f4cb-4686-a311-2d0e9c782bad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:39.799599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:39.834944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:39.840580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:39.842093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:39.886449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:39.889628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d5af9-e86d-4591-ac11-3984a1b492b6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:39.930591 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2248/4490] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:40.041105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00555-782c-4829-a965-95c988b0ad20 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:40.076619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:40.082559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:40.084282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:40.085216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] PATH_INFO: `/v3/projects/88320c09659846b298ad9ecfbd27e195` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:40.089895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88320c09659846b298ad9ecfbd27e195)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:40.095714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:40.109822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:40.373574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88320c09659846b298ad9ecfbd27e195', 'request_id': 'req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:40.400613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88320c09659846b298ad9ecfbd27e195', 'request_id': 'req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:40.423826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88320c09659846b298ad9ecfbd27e195', 'request_id': 'req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:40.607081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] The token cache is being invalidate because project 88320c09659846b298ad9ecfbd27e195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:40.607726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:40.610458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a8f2d7-d258-4b2a-8bb4-b65ebc5e3769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:40.621727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2243/4491] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:39 2022] DELETE /identity/v3/projects/88320c09659846b298ad9ecfbd27e195 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:40.626156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:40.626716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:40.631266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:40.768308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:40.775357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:41.071626 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2249/4492] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:41.086295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:41.087441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:41.089056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:41.175216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:41.177843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:41.216552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2244/4493] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:41.223576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:41.259083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e012b-3ea2-4466-b627-d0d81f0fa974 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:41.266832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:41.268532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:41.268838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:41.269447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:41.270887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:41.271805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:41.276111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:41.312849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:41.315333 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2250/4494] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:41.335314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf9ec9-35b9-4900-80cf-b9d692b55a05 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:41.346505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:41.347767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:41.348244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:41.348859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:41.350076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:41.365122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:41.619223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2245/4495] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:41 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:41.621822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:41.644883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e569-2e48-45ae-9f7a-a36cc9dc0ae6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:41.790858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:41.800157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:41.804340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:41.807956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:41.816629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:41.820589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:41.939545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:41.943335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:41.978639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fc5f1-c0e8-4b76-af40-679717d99fec admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:41.998790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:41.998790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:41.998790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:41.998790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] PATH_INFO: `/v3/projects/59598145da49457993b17fc7f426420c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:41.999621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59598145da49457993b17fc7f426420c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:42.007860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:42.047038 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2251/4496] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:41 2022] POST /identity/v3/users => generated 289 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:42.050405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:42.090679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360504c-2245-4abe-ad59-1ef4bd7b9fad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:42.103906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:42.105783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.107829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.108981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.123060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:42.128878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:42.176078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2252/4497] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:42.183054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:42.220991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfe171-2c21-4ea7-aef8-9ab3af680fb3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:42.234739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:42.236278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.236961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.237722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.239658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:42.272735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:42.328052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2253/4498] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:42.334744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:42.355623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59598145da49457993b17fc7f426420c', 'request_id': 'req-0225ee01-db4c-4a39-a584-eee8c1c77ad9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:42.365474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a1854-2924-432f-864d-ba38c02bd270 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:42.373599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59598145da49457993b17fc7f426420c', 'request_id': 'req-0225ee01-db4c-4a39-a584-eee8c1c77ad9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:42.401720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59598145da49457993b17fc7f426420c', 'request_id': 'req-0225ee01-db4c-4a39-a584-eee8c1c77ad9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:42.515199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:42.544909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:42.545853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.546279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.546814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] PATH_INFO: `/v3/projects/bd8adb1a7e034cbeb6d40757ae7cf31b/users/3fb1f6f1b6c24316bb09ff23ae0a9252/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.587605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8adb1a7e034cbeb6d40757ae7cf31b, user_id=3fb1f6f1b6c24316bb09ff23ae0a9252, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:42.592075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debfe91-883a-49f9-9f75-91823e009a5a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:42.614697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] The token cache is being invalidate because project 59598145da49457993b17fc7f426420c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:42.616247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:42.617835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0225ee01-db4c-4a39-a584-eee8c1c77ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:42.621895 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2246/4499] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:41 2022] DELETE /identity/v3/projects/59598145da49457993b17fc7f426420c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:42.630133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170073b-d180-4943-9bf1-9db68466635c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.630639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170073b-d180-4943-9bf1-9db68466635c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.631169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170073b-d180-4943-9bf1-9db68466635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.691128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1170073b-d180-4943-9bf1-9db68466635c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:42.693904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1170073b-d180-4943-9bf1-9db68466635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:42.725560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2247/4500] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:42.729529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.730159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.730524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.757208 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2254/4501] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:42 2022] PUT /identity/v3/projects/bd8adb1a7e034cbeb6d40757ae7cf31b/users/3fb1f6f1b6c24316bb09ff23ae0a9252/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:42.770733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:42.771269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:42.771854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:42.815557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:42.817820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:42.834992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:42.839852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:42.968696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:43.072453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2255/4502] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:43.094101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2248/4503] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:43.100798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:43.126303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36aafa-baa9-4494-ac2b-0ec06d930d47 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:43.138517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:43.140707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:43.140707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:43.141245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:43.143335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:43.144869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:43.148877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:43.190133 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2256/4504] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:43.193846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:43.218385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6316-8e62-4b2d-a8d5-d04ac8fad9d5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:43.242206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:43.244014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:43.248572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:43.249370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:43.250675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:43.264194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:43.425165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:43.428642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:43.518521 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2249/4505] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:43 2022] POST /identity/v3/projects => generated 373 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:43.525223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:43.661974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1fcf-7bd2-4128-83c3-82ffa44ae6d1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:43.839658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa4231-f6d7-41f7-9140-f914eeb4d2fe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:43.849859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:43.851383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:43.852595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:43.853081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:43.854793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:43.859547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:43.909820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:43.911346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:43.911589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:43.912254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:43.935106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:43.940163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:43.975726 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2257/4506] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:49:44.002756 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2250/4507] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:43 2022] POST /identity/v3/users => generated 287 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:44.016305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:44.061262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c80f8-367f-4f41-a809-a4fdc665eb03 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:44.076972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:44.078226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:44.079496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:44.079967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:44.081367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:44.085303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:44.112769 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2258/4508] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:44.119211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:44.140213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcdb5-0090-4a30-91cc-ba4b72de1f93 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:44.149579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:44.150743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:44.151247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:44.151703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:44.153053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:44.156461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e44cd-3cf5-4b46-b2fc-a0abc95a2996 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:44.184565 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2251/4509] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:44.185775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:44.197074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:44.210176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66dd2-d4f5-4e21-bfac-5daf16643e02 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:44.221528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:44.223640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:44.224226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:44.225106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] PATH_INFO: `/v3/projects/e947186882c440019094e95652dccec9/users/18fe18e703eb442aadede44628c127cd/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:44.271603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e947186882c440019094e95652dccec9, user_id=18fe18e703eb442aadede44628c127cd, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:44.278915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:44.411452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2259/4510] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:44 2022] PUT /identity/v3/projects/e947186882c440019094e95652dccec9/users/18fe18e703eb442aadede44628c127cd/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:44.430683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:44.431193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:44.431692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:44.489585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] MFA Rules not processed for user `18fe18e703eb442aadede44628c127cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:44.490954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:44.692134 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2252/4511] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:44.701811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:44.729881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aff13-a11a-4e6b-8531-ac75b1dd4eec admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:44.746606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18fe18e703eb442aadede44628c127cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e947186882c440019094e95652dccec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:44.747657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:44.748077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:44.748516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:44.749503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:44.751658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12f01c-f95d-4572-add1-716f4bd30535 tempest-IdentityCatalogTest-691209061 tempest-IdentityCatalogTest-691209061-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:44.763339 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2260/4512] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:49:44 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:44.785339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:44.885041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:45.075970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e2bb-909d-4c9b-a993-2b7d42fcf99e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:45.090549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:45.091665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:45.092196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:45.093522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] PATH_INFO: `/v3/users/18fe18e703eb442aadede44628c127cd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:45.097730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fe18e703eb442aadede44628c127cd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:45.103310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:45.553963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fe18e703eb442aadede44628c127cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:45.706981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fe18e703eb442aadede44628c127cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:45.736463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fe18e703eb442aadede44628c127cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:45.782627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fe18e703eb442aadede44628c127cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:45.785520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fe18e703eb442aadede44628c127cd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:45.808316 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2253/4513] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:44 2022] DELETE /identity/v3/users/18fe18e703eb442aadede44628c127cd => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:45.813587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:45.814307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:45.814825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:45.866343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:45.869654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:46.148079 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2261/4514] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:46.173901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:46.177669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:46.369639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b8c0f-51eb-4a9d-aefd-9fb215027513 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:46.386967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:46.390111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:46.390111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:46.390111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:46.426795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:46.434322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140102ed-d660-48d8-b1b3-204218f7c6a7 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:46.464658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2254/4515] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:49.003434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:49.006068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:49.051501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5314-4d29-4130-80d3-feadbd349550 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:49.072724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:49.074324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:49.075108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:49.076792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] PATH_INFO: `/v3/projects/e947186882c440019094e95652dccec9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:49.080582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e947186882c440019094e95652dccec9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:49.084768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:49.462873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e947186882c440019094e95652dccec9', 'request_id': 'req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:49.563011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e947186882c440019094e95652dccec9', 'request_id': 'req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:49.594726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e947186882c440019094e95652dccec9', 'request_id': 'req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:49.639564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] The token cache is being invalidate because project e947186882c440019094e95652dccec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:49.640354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:49.642219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b0c83152-b7c9-49d4-8c7b-6a2eeac90ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:49.648425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2262/4516] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:49 2022] DELETE /identity/v3/projects/e947186882c440019094e95652dccec9 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:49.655878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:49.657797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:49.658407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:49.717200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:49.722475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:49.919206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:50.001281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2255/4517] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:50.005742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:50.007438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:50.007438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:50.108008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:50.112787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:50.157463 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2263/4518] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:50.160125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:50.184821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2685c-91eb-462e-bd90-ccb3adf31e0b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:50.197183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:50.198797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:50.199663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:50.200487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:50.204312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:50.205412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:50.209350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:50.251371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2256/4519] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:49:50.252890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:50.282252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d95b4-275d-41c0-9215-3b9a10290909 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:50.293730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:50.295677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:50.296630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:50.297401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:50.299267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:50.304106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:50.730843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2264/4520] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:50 2022] POST /identity/v3/projects => generated 381 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:50.749781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:50.781829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949cb60-4dff-405d-b2e6-836f43aa7869 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:51.077997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:51.080195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.080892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.082009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:51.084518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:51.094002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:51.217051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:51.221187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:51.312985 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2257/4521] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:50 2022] POST /identity/v3/users => generated 291 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:51.315888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:51.328059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:51.367128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7817e-97e9-4c5e-b87e-365dff8df95d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:51.392933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:51.398114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.400251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.402581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:51.407210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:51.422509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:51.479312 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2258/4522] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:51.481547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:51.505426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99866f5-7f1d-46e9-adf5-ee1c6c07f10b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:51.519658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:51.521587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.522432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.523393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:51.526135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:51.530252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:51.539723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350fe62-24a8-47d1-9619-4fa4996d5c6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:51.562550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:51.567477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2259/4523] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:51.568190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.569281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.569791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:51.571924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:51.585498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:51.595186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebd0d-e6e0-4757-b0fb-80e4c5632442 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:51.606626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:51.609886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.610996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.611887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] PATH_INFO: `/v3/projects/4bdd8744354142758e43e1c1cad66eb5/users/bb75de40cff041f5b952b8152a1e23ce/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:51.630143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:51.635862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb926de-f6ea-4944-8edc-05ed72ca075f service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:51.674653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdd8744354142758e43e1c1cad66eb5, user_id=bb75de40cff041f5b952b8152a1e23ce, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:51.712072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:51.713077 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2265/4524] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:49:51.878299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2260/4525] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:51 2022] PUT /identity/v3/projects/4bdd8744354142758e43e1c1cad66eb5/users/bb75de40cff041f5b952b8152a1e23ce/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:51.900030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:51.901173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:51.901967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:52.011930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] MFA Rules not processed for user `bb75de40cff041f5b952b8152a1e23ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:52.014230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:52.267216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2266/4526] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:49:52.272513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:52.656037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2aee-2115-4e10-9857-fd349e1232be admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:52.692221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:52.692221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:52.692221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:52.692221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:52.692659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:52.700410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:52.864327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2261/4527] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:52 2022] POST /identity/v3/projects => generated 379 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:49:52.872774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:52.912410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d368d-73ee-48b1-aa93-61e9de77a770 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:53.169139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:53.173533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:53.174192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:53.175726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:53.179270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:53.200681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:53.405543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2267/4528] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:49:52 2022] POST /identity/v3/users => generated 290 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:49:53.411580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:53.435271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:53.450803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2eda3-3169-441f-aa99-5efeac95c241 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:53.468336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:53.468336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:53.468336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:53.468336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:53.469452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:53.479231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:53.520262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2262/4529] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:49:53.528557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:53.576782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82331e8f-f865-4d78-979c-b5cd535a7ede admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:53.577373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:53.578522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:53.579021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:53.579554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:53.580857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:53.584570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9fe7a-2b56-43ee-9780-d037f4a4da19 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:53.623297 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2268/4530] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:49:53.628748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:53.661712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20c6c7-c4db-4656-9dcc-499717d6dcd1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:53.701206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:53.702609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:53.703070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:53.703671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] PATH_INFO: `/v3/projects/ce5a5697c20c43a5bf48b9cd2328f102/users/af3e2ee1a425412481010898e774599d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:53.757227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5a5697c20c43a5bf48b9cd2328f102, user_id=af3e2ee1a425412481010898e774599d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:53.763089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:53.962105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2263/4531] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:49:53 2022] PUT /identity/v3/projects/ce5a5697c20c43a5bf48b9cd2328f102/users/af3e2ee1a425412481010898e774599d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:53.985181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789349b-112c-4841-9584-ab34ee6f78d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:53.985519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789349b-112c-4841-9584-ab34ee6f78d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:53.986093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789349b-112c-4841-9584-ab34ee6f78d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:54.130640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7789349b-112c-4841-9584-ab34ee6f78d4 None None] MFA Rules not processed for user `af3e2ee1a425412481010898e774599d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:54.140688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7789349b-112c-4841-9584-ab34ee6f78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:54.202189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:54.399122 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2269/4532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:54.406761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:54.685618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d8f2f-d9bf-4ee8-9394-7d730692ad2e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:54.704666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb75de40cff041f5b952b8152a1e23ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bdd8744354142758e43e1c1cad66eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:54.705814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:54.706345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:54.706802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] PATH_INFO: `/v3/users/bb75de40cff041f5b952b8152a1e23ce/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:54.723743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] RBAC: Authorizing `identity:list_user_projects(user_id=bb75de40cff041f5b952b8152a1e23ce)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:54.729313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100db36-8bb8-4d52-8d86-248fad6cf26c tempest-IdentityV3ProjectsTest-1124944718 tempest-IdentityV3ProjectsTest-1124944718-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:54.966798 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2264/4533] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:49:54 2022] GET /identity/v3/users/bb75de40cff041f5b952b8152a1e23ce/projects => generated 517 bytes in 561 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:49:54.974404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:54.975459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:54.976144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:55.108331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] MFA Rules not processed for user `bb75de40cff041f5b952b8152a1e23ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:55.110787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:55.150082 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2270/4534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:55.153470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:55.154008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:55.154923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:55.225359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] MFA Rules not processed for user `bb75de40cff041f5b952b8152a1e23ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:55.234530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:55.405328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.models.token_model [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] User bb75de40cff041f5b952b8152a1e23ce has no access to project ce5a5697c20c43a5bf48b9cd2328f102 {{(pid=82439) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 04 20:49:55.419298 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.application [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:49:55.424588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2265/4535] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 274 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 04 20:49:55.433175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:55.671811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:55.683846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:55.810819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e23de-cbc6-4152-9953-63236c92c161 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:55.835004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:55.836773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:55.837653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:55.839041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] PATH_INFO: `/v3/users/bb75de40cff041f5b952b8152a1e23ce` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:55.842267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb75de40cff041f5b952b8152a1e23ce)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:55.848002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:55.951450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:56.004646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918c53-6630-4fdc-b477-13c8cb8141ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:56.016590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:56.018529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:56.018529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:56.019010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] PATH_INFO: `/v3/users/895545f1707940e4a10fbfc84253d705` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:56.022083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895545f1707940e4a10fbfc84253d705)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:56.029732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:56.328077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb75de40cff041f5b952b8152a1e23ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.336982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb75de40cff041f5b952b8152a1e23ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.472451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb75de40cff041f5b952b8152a1e23ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.516367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895545f1707940e4a10fbfc84253d705'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.552631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb75de40cff041f5b952b8152a1e23ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.598812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45abee8b-5c6c-436e-9d1f-f4c5386707a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb75de40cff041f5b952b8152a1e23ce'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.614736 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2271/4536] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:55 2022] DELETE /identity/v3/users/bb75de40cff041f5b952b8152a1e23ce => generated 0 bytes in 1183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:56.622644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:56.623586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:56.624327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:56.641771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895545f1707940e4a10fbfc84253d705'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.677188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895545f1707940e4a10fbfc84253d705'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.745009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] MFA Rules not processed for user `9c7d0e3889e34fa1b24d19f7f68bc56c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:56.746005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895545f1707940e4a10fbfc84253d705'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.754241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7dd5331-f509-46e0-8e09-7ee89dcc3469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895545f1707940e4a10fbfc84253d705'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:56.755082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:56.783774 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2266/4537] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:55 2022] DELETE /identity/v3/users/895545f1707940e4a10fbfc84253d705 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:49:56.790367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:56.792294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:56.792857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:56.856561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:56.878346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:56.893492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:57.027044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2272/4538] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:57.189305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2267/4539] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:57.356454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:57.361680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:57.611397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4a5ba-d806-411e-a1b9-97e2e75d7a9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:57.836648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:57.838876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:57.842554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:57.843736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:57.874185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:57.883969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:57.915041 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2273/4540] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:57.938402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:57.941940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:58.036329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fe2ec-464c-454f-9704-0a0e059cdc86 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:58.049274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:58.053530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:58.055088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:58.056336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] PATH_INFO: `/v3/projects/cfa8bdf2eb414417a0ee4e64f7932019` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:58.078331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa8bdf2eb414417a0ee4e64f7932019)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:58.084473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:58.246969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:58.250023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:58.318361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee01ee-cf5a-4637-bd3a-caf64f9afd4e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:58.341138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:58.342384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:58.342911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:58.366330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] PATH_INFO: `/v3/users/5521d99f7d6d4432acf47388c0a0c93a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:58.397054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5521d99f7d6d4432acf47388c0a0c93a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:58.400478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:58.481109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa8bdf2eb414417a0ee4e64f7932019', 'request_id': 'req-4ac9df1d-ba38-40f5-9a63-7449ee900f79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.523679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa8bdf2eb414417a0ee4e64f7932019', 'request_id': 'req-4ac9df1d-ba38-40f5-9a63-7449ee900f79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.569785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa8bdf2eb414417a0ee4e64f7932019', 'request_id': 'req-4ac9df1d-ba38-40f5-9a63-7449ee900f79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.582319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:58.699906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] The token cache is being invalidate because project cfa8bdf2eb414417a0ee4e64f7932019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:49:58.700827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.703881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ac9df1d-ba38-40f5-9a63-7449ee900f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.710319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2268/4541] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:57 2022] DELETE /identity/v3/projects/cfa8bdf2eb414417a0ee4e64f7932019 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:58.713446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:58.718472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:58.721013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:58.821236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5521d99f7d6d4432acf47388c0a0c93a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.822344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5521d99f7d6d4432acf47388c0a0c93a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.831526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] MFA Rules not processed for user `6ee1d48c308e49249a3ead3dc9ec9d94`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:58.833842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:58.930137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5521d99f7d6d4432acf47388c0a0c93a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:58.975941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5521d99f7d6d4432acf47388c0a0c93a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:59.004221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61488168-f45a-4fd5-90cd-aa2b2a09664c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5521d99f7d6d4432acf47388c0a0c93a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:49:59.036537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:59.060600 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2274/4542] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:58 2022] DELETE /identity/v3/users/5521d99f7d6d4432acf47388c0a0c93a => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:49:59.064486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5142d2-3e97-4e0c-9347-b50778d9d618 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.065489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5142d2-3e97-4e0c-9347-b50778d9d618 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.069565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5142d2-3e97-4e0c-9347-b50778d9d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.160465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fe5142d2-3e97-4e0c-9347-b50778d9d618 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:59.163271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe5142d2-3e97-4e0c-9347-b50778d9d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:59.176196 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2269/4543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:59.182814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:59.191786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:59.459111 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2275/4544] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:59.468135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5476a9-80d1-4401-96a7-739498516335 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.468642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5476a9-80d1-4401-96a7-739498516335 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.469254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5476a9-80d1-4401-96a7-739498516335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1c5476a9-80d1-4401-96a7-739498516335 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:49:59.498375 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:49:59.500489 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:49:59.534352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9aba-9d27-4a3a-97e9-611d91ff1d3f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:59.547072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2276/4545] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:49:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:49:59.553386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:59.554514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.555918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.556578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.559371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.559371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] PATH_INFO: `/v3/users/006b771662564bafab6e1bade033a234` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.559660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.595026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=006b771662564bafab6e1bade033a234)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:59.608118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:59.651429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:49:59.654970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:49:59.674044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2277/4546] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:49:59.681520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:59.725522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5e4c-bccf-4c1c-9803-932106d75621 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:59.737965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:59.740421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.741405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.742533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.744447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:49:59.745489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:59.750960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:59.795779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2278/4547] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:49:59.806070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:49:59.847192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281e17f-b74b-414d-8e55-b519753f3005 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:49:59.857681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:49:59.859320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:49:59.860100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:49:59.860894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:49:59.862717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:49:59.868534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:49:59.999907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006b771662564bafab6e1bade033a234'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:00.052418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2279/4548] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:49:59 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:00.065231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:00.110723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006b771662564bafab6e1bade033a234'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:00.136687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006b771662564bafab6e1bade033a234'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:00.195501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006b771662564bafab6e1bade033a234'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:00.199038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-91895471-3d83-44e3-8691-750917ad96fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006b771662564bafab6e1bade033a234'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:00.233318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2270/4549] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:49:59 2022] DELETE /identity/v3/users/006b771662564bafab6e1bade033a234 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:00.242987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:00.243824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:00.244678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:00.282972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:00.348505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:00.352675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:00.441967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9235ec-fb6d-4355-a793-3091214850be admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:00.713228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2271/4550] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:00.837655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:00.838826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:00.839610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:00.840299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:00.845220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:00.850200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:00.853481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:00.853859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:00.890887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:01.018833 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2280/4551] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:00 2022] POST /identity/v3/users => generated 284 bytes in 955 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:50:01.020692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:01.025899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:01.073725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc454b1-92fa-4754-af5f-8a9fdfbd908c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:01.104035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:01.105154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:01.105730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:01.106297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:01.112675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:01.122600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:01.193812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7afc03-3757-4991-bb30-17cded0d3e2e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:01.197588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2281/4552] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:01.204219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:01.219541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:01.221012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:01.221831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:01.222552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:01.247046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee304c-dbc3-42f2-af92-f4c795caaeb3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:01.270814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:01.288030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0efe2-f661-4714-8f46-67c195ad08d2 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:01.292513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:01.293751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:01.295860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:01.296515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:01.297796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:01.302614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:01.347066 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2282/4553] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:01.347954 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2272/4554] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:01.354492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:01.402641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5cac-ee48-4ccc-a0fc-e99d833bc704 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:01.432577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:01.444987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:01.448004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:01.448846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] PATH_INFO: `/v3/projects/4387f90f1ad8429bb47aaabfe531871b/users/d22886ebf2b34276a9369ee93f9e5457/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:01.531497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4387f90f1ad8429bb47aaabfe531871b, user_id=d22886ebf2b34276a9369ee93f9e5457, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:01.545168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:01.717209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2283/4555] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:01 2022] PUT /identity/v3/projects/4387f90f1ad8429bb47aaabfe531871b/users/d22886ebf2b34276a9369ee93f9e5457/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:01.720467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:01.721859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:01.722578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:01.845228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:01.858114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:02.218351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2273/4556] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:02.258308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:02.262657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:02.424205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:02.424205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:02.480671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1d487-0ec9-428b-92bb-f3746f550c32 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:02.502223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:02.504144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:02.505119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:02.505994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] PATH_INFO: `/v3/projects/4bdd8744354142758e43e1c1cad66eb5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:02.509415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898dab-9b86-4f14-90de-a21d7e5d082f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:02.513920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdd8744354142758e43e1c1cad66eb5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:02.518627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:02.539737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:02.542315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:02.543343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:02.559080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:02.602292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:02.606092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:02.659743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2284/4557] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:02.838707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:02.844983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdd8744354142758e43e1c1cad66eb5', 'request_id': 'req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:02.876758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdd8744354142758e43e1c1cad66eb5', 'request_id': 'req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:02.905721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdd8744354142758e43e1c1cad66eb5', 'request_id': 'req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:03.067184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] The token cache is being invalidate because project 4bdd8744354142758e43e1c1cad66eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:03.067848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:03.076028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:03.079007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2274/4558] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:02 2022] DELETE /identity/v3/projects/4bdd8744354142758e43e1c1cad66eb5 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:03.086354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:03.118355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c191e-3afc-4980-96bd-75e5e4d3da44 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:03.352657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:03.353862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:03.354382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:03.354880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] PATH_INFO: `/v3/users/af3e2ee1a425412481010898e774599d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:03.368686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3e2ee1a425412481010898e774599d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:03.372248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:03.699285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:03.702346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:03.769373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750cd7d-9ea8-4ea6-b11c-b77753ce4658 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:03.791076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:03.792883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:03.794065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:03.794842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] PATH_INFO: `/v3/projects/b2e6812055b3473db24481cdd7504bd6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:03.805467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e6812055b3473db24481cdd7504bd6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:03.825983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:03.832075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3e2ee1a425412481010898e774599d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:03.833863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3e2ee1a425412481010898e774599d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:03.856287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:03.968983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3e2ee1a425412481010898e774599d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.070942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3e2ee1a425412481010898e774599d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.096167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-990dfa74-241a-4095-a25d-a22a377fd4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3e2ee1a425412481010898e774599d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.123605 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2285/4559] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:03 2022] DELETE /identity/v3/users/af3e2ee1a425412481010898e774599d => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:04.217580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e6812055b3473db24481cdd7504bd6', 'request_id': 'req-781390a1-6a6f-4098-bae6-03a689dab4f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.261263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e6812055b3473db24481cdd7504bd6', 'request_id': 'req-781390a1-6a6f-4098-bae6-03a689dab4f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.276185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e6812055b3473db24481cdd7504bd6', 'request_id': 'req-781390a1-6a6f-4098-bae6-03a689dab4f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.474385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] The token cache is being invalidate because project b2e6812055b3473db24481cdd7504bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:04.474385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.475408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-781390a1-6a6f-4098-bae6-03a689dab4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:04.488987 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2275/4560] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:03 2022] DELETE /identity/v3/projects/b2e6812055b3473db24481cdd7504bd6 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:04.510430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:04.511247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:04.511545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:04.615367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:04.627517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:04.952469 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2286/4561] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:04.955016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:04.955932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:04.956732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:05.040459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:05.043351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:05.085170 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2276/4562] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:05.093628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:05.165210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ee4fa-f236-4d46-bbc4-b1484a2d7039 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:05.199523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:05.209858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:05.211760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:05.213395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:05.216088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:05.217291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:05.221799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:05.283814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2287/4563] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:05.284743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:05.320534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a45a0-f47b-421e-a090-7f9bbb4a1a69 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:05.371819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:05.373804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:05.374696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:05.376008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:05.377644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:05.382829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:05.649121 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2277/4564] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:05 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:50:05.656313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:05.701618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e64cd-a0c6-4e2a-abf4-4d1962c9a732 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:05.969362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:05.970926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:05.980668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:05.980668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:05.980668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:05.980668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:06.144813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:06.149412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2288/4565] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:05 2022] POST /identity/v3/users => generated 294 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:06.196214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4242c4-3403-401b-8f36-6020d46db9fe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:06.209869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:06.212143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:06.212863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:06.213458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:06.214934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:06.219581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:06.259223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2278/4566] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:06.264515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:06.301618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550a54-7e5b-4f2e-9ce8-e316e9ba4c83 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:06.320743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:06.322431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:06.323122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:06.324445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:06.326767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:06.333574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:06.374459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:06.378400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:06.391213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2289/4567] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:50:06.398999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:06.460938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d5644-c740-4c1b-bb9a-f516b96b26bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:06.476189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:06.477565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:06.483025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:06.483025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] PATH_INFO: `/v3/projects/23af9d74a1c644688ccc2ef3aaf6ad86` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:06.483025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23af9d74a1c644688ccc2ef3aaf6ad86)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:06.485752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecf634-cf5a-451e-ae32-adc9aa5a3704 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:06.486029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:06.510955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:06.514674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:06.515242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:06.516139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] PATH_INFO: `/v3/projects/d442b7e0ae274bc4aed2f6f4df39de74/users/b2430b59055e4d9a96bbb38829887f94/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:06.572959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d442b7e0ae274bc4aed2f6f4df39de74, user_id=b2430b59055e4d9a96bbb38829887f94, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:06.579414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145a6c-046a-40c9-9c90-3f5c4e144779 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:06.803172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2290/4568] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:06 2022] PUT /identity/v3/projects/d442b7e0ae274bc4aed2f6f4df39de74/users/b2430b59055e4d9a96bbb38829887f94/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:06.831294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:06.831294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:06.831294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:06.872360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23af9d74a1c644688ccc2ef3aaf6ad86', 'request_id': 'req-f8b77d9a-5f47-4a23-aeaf-439797e307c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:06.905507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23af9d74a1c644688ccc2ef3aaf6ad86', 'request_id': 'req-f8b77d9a-5f47-4a23-aeaf-439797e307c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:06.929619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:06.936033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23af9d74a1c644688ccc2ef3aaf6ad86', 'request_id': 'req-f8b77d9a-5f47-4a23-aeaf-439797e307c6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:06.938515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:06.967471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:07.048543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=78,keystone:DELETE=18,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:07.062929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] The token cache is being invalidate because project 23af9d74a1c644688ccc2ef3aaf6ad86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:07.064110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:07.067458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:07.072415 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2279/4569] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:06 2022] DELETE /identity/v3/projects/23af9d74a1c644688ccc2ef3aaf6ad86 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:07.086085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:07.096095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:07.211607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2291/4570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:07.344810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:07.347553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:07.416490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b77d9a-5f47-4a23-aeaf-439797e307c6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:07.435944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:07.437538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:07.447046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:07.447834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] PATH_INFO: `/v3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:07.453110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37d63ff8b0a4fc8b7a4f4adf4b4e243)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:07.466861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:07.621967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252a08-7f72-461a-a98c-01769bec4dfd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:07.637027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:07.638267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:07.638770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:07.639547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:07.665256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:07.670159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:07.705887 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2292/4571] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:07.839588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37d63ff8b0a4fc8b7a4f4adf4b4e243'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:07.966736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37d63ff8b0a4fc8b7a4f4adf4b4e243'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:08.042957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37d63ff8b0a4fc8b7a4f4adf4b4e243'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:08.099444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37d63ff8b0a4fc8b7a4f4adf4b4e243'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:08.100863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6d005f56-1844-4087-be24-703df620e949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37d63ff8b0a4fc8b7a4f4adf4b4e243'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:08.146244 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2280/4572] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:07 2022] DELETE /identity/v3/users/e37d63ff8b0a4fc8b7a4f4adf4b4e243 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:08.625682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:08.629699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:08.709533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa422-400b-497e-adc4-620b483bbc60 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:08.966094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:08.970576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:08.976540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:08.980165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] PATH_INFO: `/v3/projects/ce5a5697c20c43a5bf48b9cd2328f102` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:08.993353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5a5697c20c43a5bf48b9cd2328f102)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:09.014608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:09.271808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5a5697c20c43a5bf48b9cd2328f102', 'request_id': 'req-2778f637-15c9-4de9-8411-5fade86cc6b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:09.362230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5a5697c20c43a5bf48b9cd2328f102', 'request_id': 'req-2778f637-15c9-4de9-8411-5fade86cc6b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:09.364815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:09.413723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5a5697c20c43a5bf48b9cd2328f102', 'request_id': 'req-2778f637-15c9-4de9-8411-5fade86cc6b2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:09.453137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] The token cache is being invalidate because project ce5a5697c20c43a5bf48b9cd2328f102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:09.454620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:09.456035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2778f637-15c9-4de9-8411-5fade86cc6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:09.463011 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2293/4573] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:08 2022] DELETE /identity/v3/projects/ce5a5697c20c43a5bf48b9cd2328f102 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:09.471964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:09.472775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:09.472775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:09.543394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:09.547828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:09.859584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2281/4574] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:09.875218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:09.876140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:09.876140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:09.934809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:09.939088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:09.974519 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2294/4575] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:09.975089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:10.001869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1215d-2bb1-4c5b-bbe5-5f3457949534 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:10.013345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:10.015259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:10.016292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:10.017003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:10.019345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:10.020048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:10.024685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:10.065552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2282/4576] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:50:10.072689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:10.104526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40769a4-9601-44a0-89e8-efa83e6435a8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:10.116460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:10.118134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:10.121207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:10.122251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:10.124181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:10.129190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:10.186460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:10.190964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:10.222092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:10.237869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd30aa6-d3de-48b9-929c-f64c88ca3fc3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:10.253914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:10.255902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:10.257733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:10.258648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] PATH_INFO: `/v3/projects/002df809b8354f4a94b26e5a119e27a3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:10.262519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=002df809b8354f4a94b26e5a119e27a3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:10.267055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:10.328852 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2295/4577] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:10 2022] POST /identity/v3/projects => generated 359 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:10.333977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:10.704241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002df809b8354f4a94b26e5a119e27a3', 'request_id': 'req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:10.735319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002df809b8354f4a94b26e5a119e27a3', 'request_id': 'req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:10.773093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002df809b8354f4a94b26e5a119e27a3', 'request_id': 'req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:10.830954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b93b8a-cf15-4002-afd5-a81b23a2f820 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:10.910896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] The token cache is being invalidate because project 002df809b8354f4a94b26e5a119e27a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:10.911590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:10.917911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4058922e-c12a-46e8-8fb6-a7691c1e0d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:10.930837 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2283/4578] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:10 2022] DELETE /identity/v3/projects/002df809b8354f4a94b26e5a119e27a3 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:10.940507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11d2e-58b5-4342-9f4c-b893bb4df4be None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:10.946302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11d2e-58b5-4342-9f4c-b893bb4df4be None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:10.946302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11d2e-58b5-4342-9f4c-b893bb4df4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.033658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0eb11d2e-58b5-4342-9f4c-b893bb4df4be None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:11.037205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0eb11d2e-58b5-4342-9f4c-b893bb4df4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:11.155443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.158121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.160513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.163312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.166062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.183624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.321262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2284/4579] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:11.346921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2296/4580] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:10 2022] POST /identity/v3/users => generated 280 bytes in 1010 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:11.347455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.347455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.347455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.351527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.353902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:11.391632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864621ce-2781-49c3-b982-1645dbdf3203 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:11.427727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.429271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.431047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.431631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.438669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.439311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:11.445719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:11.450780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.473069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2285/4581] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:11.475924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.498185 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2297/4582] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:11.504811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3a5b-7013-476d-a11a-7a09a211cd85 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:11.505432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.521459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.522868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.523959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.528083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.530522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:11.534087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a828b8-ffcb-4ce1-aaaf-7421227d3cbd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:11.535038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.538582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.552768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.560917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.561793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.562250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.563394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.565610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.589137 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2286/4583] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:11.599352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.609576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2298/4584] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:11.620013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.636541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c4c-9309-48b1-8c7f-ade9ca1b15b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:11.653294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddbfa-4e5e-4447-8a32-b0234de08d7c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:11.655751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.657076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.657402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.659950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.661185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.673172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.674014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:11.689360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.690148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.690643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] PATH_INFO: `/v3/projects/5e331299371b495ebee7d64fca9cb807/users/40ad559b744f40938e7f31794128ac76/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:11.768282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e331299371b495ebee7d64fca9cb807, user_id=40ad559b744f40938e7f31794128ac76, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:11.782487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cad97-35a0-402c-b52c-91fc5c07adc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:11.870879 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2287/4585] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:11 2022] POST /identity/v3/projects => generated 355 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:11.874159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:11.965124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2299/4586] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:11 2022] PUT /identity/v3/projects/5e331299371b495ebee7d64fca9cb807/users/40ad559b744f40938e7f31794128ac76/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:11.994671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7ff3-cc92-44d6-96de-0a97530559d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:11.995581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7ff3-cc92-44d6-96de-0a97530559d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:11.996345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e7ff3-cc92-44d6-96de-0a97530559d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.060106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:12.080012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:12.088863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80cdf1-fa54-49c9-988e-9ae470a5978b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:12.155710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-681e7ff3-cc92-44d6-96de-0a97530559d8 None None] MFA Rules not processed for user `40ad559b744f40938e7f31794128ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:12.159275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-681e7ff3-cc92-44d6-96de-0a97530559d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:12.300325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:12.301471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.301987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.302491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.307971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:12.312517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:12.446018 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2300/4587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:12.455044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991e8f-1b0d-404e-836c-a5843c2c3f2d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.455606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991e8f-1b0d-404e-836c-a5843c2c3f2d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.456120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49991e8f-1b0d-404e-836c-a5843c2c3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.526525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-49991e8f-1b0d-404e-836c-a5843c2c3f2d None None] MFA Rules not processed for user `40ad559b744f40938e7f31794128ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:12.528811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-49991e8f-1b0d-404e-836c-a5843c2c3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:12.545828 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2301/4588] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:12 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:12.548867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.549430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.549946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.563529 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2288/4589] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:11 2022] POST /identity/v3/users => generated 278 bytes in 690 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:12.571594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:12.628570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] MFA Rules not processed for user `40ad559b744f40938e7f31794128ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:12.630943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:12.637702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb42841-9055-41a4-b7f6-fcbc68746f9c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:12.650001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2302/4590] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:12 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:12.656621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:12.664175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:12.667769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.667769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.667769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.668804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:12.672367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:12.710699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada5536-66b2-46bf-94b5-e5f106fd7dea None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:12.711891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2289/4591] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:12.719188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:12.726120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:12.727263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.727725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.729296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.768461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee431-7a93-43ee-954b-e7183d95709d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:12.768801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorizing `identity:check_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:12.772320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82ea1-1ced-4116-8fe1-ba993d0de3ad tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:12.784393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:12.785518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.785931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.786437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.787756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:12.792071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:12.802867 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2303/4592] 10.222.0.78 () {56 vars in 1264 bytes} [Tue Oct 4 20:50:12 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:12.812607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7376ffe-132b-4c38-af70-4977aa6e8ff0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.813120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7376ffe-132b-4c38-af70-4977aa6e8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.813620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7376ffe-132b-4c38-af70-4977aa6e8ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.849552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2290/4593] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:12.852467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:12.879121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374ce5-88ce-4104-b38d-972810c7a63b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:12.898212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:12.901492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:12.902017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:12.902530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:12.919507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:12.924744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:12.941495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2291/4594] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 4 20:50:12 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:12.942352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e7376ffe-132b-4c38-af70-4977aa6e8ff0 None None] MFA Rules not processed for user `b2430b59055e4d9a96bbb38829887f94`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:12.943341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:12.950254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7376ffe-132b-4c38-af70-4977aa6e8ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:12.974985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1b76-af0d-4292-9f13-5828288c3aa1 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:13.001376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:13.003771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:13.005074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:13.006629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] PATH_INFO: `/v3/projects/62046e452ae743558315aefdfd8b7391/users/3e34187d73664621b89c62bae6ddbc47/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:13.083095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62046e452ae743558315aefdfd8b7391, user_id=3e34187d73664621b89c62bae6ddbc47, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:13.096315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:13.266796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2292/4595] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:12 2022] PUT /identity/v3/projects/62046e452ae743558315aefdfd8b7391/users/3e34187d73664621b89c62bae6ddbc47/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:13.274721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:13.330326 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2304/4596] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:13.333281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da474c-2efc-4708-87f3-f1fbc6861dac None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:13.333712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da474c-2efc-4708-87f3-f1fbc6861dac None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:13.334149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da474c-2efc-4708-87f3-f1fbc6861dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:13.487387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-93da474c-2efc-4708-87f3-f1fbc6861dac None None] MFA Rules not processed for user `3e34187d73664621b89c62bae6ddbc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:13.490522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-93da474c-2efc-4708-87f3-f1fbc6861dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:13.581827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373a73-af8f-48bf-9c54-49bcb22cc859 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:13.627552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:13.631313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:13.635729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:13.636665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:13.693765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:13.697831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:13.741137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:13.805738 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2305/4597] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:13.807928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:13.808435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:13.808961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:13.810189 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2293/4598] 10.222.0.78 () {56 vars in 1266 bytes} [Tue Oct 4 20:50:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:13.825046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:13.866796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:13.880302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] MFA Rules not processed for user `b2430b59055e4d9a96bbb38829887f94`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:13.885819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:14.143871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3f7bb-d3d1-4d75-98d2-88eaf37c6543 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:14.158994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2306/4599] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:14.171501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:14.177224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:14.180346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:14.180887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:14.181384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:14.182671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:14.196717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75baacb-1b89-4344-b08a-61836b825cc7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:14.224956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899db24-926b-4e39-bafc-43d97d9a3c1f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:14.247012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:14.248167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:14.248657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:14.249146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:14.263120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 04 20:50:14.332656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 04 20:50:14.337452 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2307/4600] 10.222.0.78 () {56 vars in 1264 bytes} [Tue Oct 4 20:50:14 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 04 20:50:14.339437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:14.344101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:14.479424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2294/4601] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:13 2022] POST /identity/v3/projects => generated 357 bytes in 662 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:14.495801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:14.496102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:14.496435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:14.595219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] MFA Rules not processed for user `40ad559b744f40938e7f31794128ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:14.603658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:14.614205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2295/4602] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:14 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:14.616443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:14.760350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5002ebb-614b-48aa-9a21-a1c62510a8e2 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:14.967406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e7cb-75dc-4163-a4c0-0736ae5f60c5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:14.982606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:14.985319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:14.985953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:14.987341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:14.993224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:15.004161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:15.080362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:15.082676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:15.083505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:15.084234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:15.136366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:15.204892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2296/4603] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:14 2022] POST /identity/v3/users => generated 285 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:15.207719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:15.297092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:15.306844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:15.343684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2308/4604] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 1007 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:15.349547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:15.401193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1576333-b3f1-49c6-8beb-151e1bd8bcb2 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:15.432868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:15.434277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:15.434840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:15.435811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:15.437146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:15.441067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:15.482401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2309/4605] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:15.492796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:15.518426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911012c7-846e-48e8-ae00-fd9d6015eab4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:15.535035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:15.536544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:15.537004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:15.537528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] PATH_INFO: `/v3/projects/9413f2837b35458daff53dc867033535/users/c8e431aced6e44ba88bce1f46b62b4ef/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:15.615734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9413f2837b35458daff53dc867033535, user_id=c8e431aced6e44ba88bce1f46b62b4ef, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:15.623507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:15.649797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95915c-37bb-4c3c-add5-d89e078500ef admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:15.668456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:15.672538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:15.675247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:15.681068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:15.732136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:15.747001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2310/4606] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:15 2022] PUT /identity/v3/projects/9413f2837b35458daff53dc867033535/users/c8e431aced6e44ba88bce1f46b62b4ef/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:15.747339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:15.749648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:15.784112 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2297/4607] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 4 20:50:15 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:15.792139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:15.831635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec2d80-7184-489c-a5ae-c9d53f833127 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:15.914030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:16.016137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979a22-cd60-47bb-929d-6147cb15962d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:16.041347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:16.045336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.047606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.048477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.050712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:16.059726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:16.082356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:16.086070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.088428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.088993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.114455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2311/4608] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:16.117380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:16.121875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:16.131051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:16.170026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e98ac-d95a-4da7-bdaa-9b85f2c86f29 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:16.187719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:16.189701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.190348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.191003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] PATH_INFO: `/v3/projects/9413f2837b35458daff53dc867033535/users/c8e431aced6e44ba88bce1f46b62b4ef/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.196835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9413f2837b35458daff53dc867033535, user_id=c8e431aced6e44ba88bce1f46b62b4ef, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:16.202787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9b51d-721c-4748-82c4-4b3f03a2ce8f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:16.243191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2312/4609] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:16 2022] PUT /identity/v3/projects/9413f2837b35458daff53dc867033535/users/c8e431aced6e44ba88bce1f46b62b4ef/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:16.253353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.254309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.254925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.277069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2298/4610] 10.222.0.78 () {56 vars in 1266 bytes} [Tue Oct 4 20:50:15 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:16.283376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:16.347962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783645ce-d52c-4a5d-956c-d2dbe615fe22 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:16.433961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] MFA Rules not processed for user `c8e431aced6e44ba88bce1f46b62b4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:16.448613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:16.628279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40ad559b744f40938e7f31794128ac76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e331299371b495ebee7d64fca9cb807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:16.631099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.633033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.635296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.642716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 04 20:50:16.701908 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 04 20:50:16.716608 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:50:16.718644 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2299/4611] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 4 20:50:16 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:50:16.725039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:16.756155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:16.787505 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2313/4612] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:16.795116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:16.829732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5026d-34ad-40fe-a35b-3006b3515069 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:16.851007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8e431aced6e44ba88bce1f46b62b4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413f2837b35458daff53dc867033535', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:16.855333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:16.856040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:16.856625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:16.857926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:16.858413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:16.863970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:16.937235 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2314/4613] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:50:16.939985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:16.982230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3be8e-5259-4e58-96ec-f2389f39b631 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:17.000477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050373-3fec-4c31-82b2-8cb61aa3ca92 tempest-TokensV3Test-570694427 tempest-TokensV3Test-570694427-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:17.009626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8e431aced6e44ba88bce1f46b62b4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413f2837b35458daff53dc867033535', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:17.012568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:17.014311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:17.016179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:17.017994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:17.023684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:17.026254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:17.029054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:17.029979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] PATH_INFO: `/v3/users/40ad559b744f40938e7f31794128ac76` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:17.030818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:17.036469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ad559b744f40938e7f31794128ac76)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:17.042285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:17.373949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2315/4614] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:16 2022] POST /identity/v3/projects => generated 349 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:17.377512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:17.543128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ad559b744f40938e7f31794128ac76'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:17.695206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ad559b744f40938e7f31794128ac76'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:17.709181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:17.727343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ad559b744f40938e7f31794128ac76'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:17.786788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3670e8-4447-4a6f-90ac-735f6f90d262 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:17.805805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ad559b744f40938e7f31794128ac76'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:17.807710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3f2394-55fc-411c-a6f2-6a15b927de8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ad559b744f40938e7f31794128ac76'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:17.812767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8e431aced6e44ba88bce1f46b62b4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413f2837b35458daff53dc867033535', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:17.813717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:17.814245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:17.814776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:17.816150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:17.816695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:17.825236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:17.848993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2300/4615] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:16 2022] DELETE /identity/v3/users/40ad559b744f40938e7f31794128ac76 => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:17.852821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:17.853391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:17.854020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:17.862478 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2316/4616] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:17.904024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:17.906692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:17.952524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:17.958880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:18.135297 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2301/4617] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:18.254055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d833-2868-4ce4-b3b5-864c2cf09280 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:18.308123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:18.543310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:18.544636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:18.545629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:18.545915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:18.554830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:18.653440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c95ee-0f30-45dc-baca-81c20118af5c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:18.666250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:18.692973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:18.693676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:18.694536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:18.694963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:18.768629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:18.770259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acd83e-4470-4774-856b-790253b8582b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:18.815849 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2302/4618] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:18.927193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:18.933365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:18.992569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2317/4619] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 1041 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:21.912245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:21.913210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:21.913210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:22.017611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] MFA Rules not processed for user `3fb1f6f1b6c24316bb09ff23ae0a9252`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:22.020928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:22.053769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:22.084485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36272a00-f4c1-4675-b7be-f7f17b4bbb3a service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:22.106505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8e431aced6e44ba88bce1f46b62b4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413f2837b35458daff53dc867033535', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:22.112259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:22.113648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:22.116804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] PATH_INFO: `/v3/projects/d178d76c8dca4ec4ac605d5774ac1533` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:22.127626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d178d76c8dca4ec4ac605d5774ac1533)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:22.134324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:22.267834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2303/4620] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:22.275991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:22.278584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:22.343767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1648fb9-0e48-4215-80aa-11d845505af5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:22.370967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:22.374296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:22.374792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:22.382258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:22.386699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:22.395319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:22.423967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:22.447550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd178d76c8dca4ec4ac605d5774ac1533', 'request_id': 'req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:22.611514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd178d76c8dca4ec4ac605d5774ac1533', 'request_id': 'req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:22.635474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd178d76c8dca4ec4ac605d5774ac1533', 'request_id': 'req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:22.696203 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2304/4621] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:22 2022] POST /identity/v3/projects => generated 377 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:50:22.713469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:22.722545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:22.724473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] The token cache is being invalidate because project d178d76c8dca4ec4ac605d5774ac1533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:22.726292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:22.728320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:22.760444 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2318/4622] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:22 2022] DELETE /identity/v3/projects/d178d76c8dca4ec4ac605d5774ac1533 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:22.763027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:22.779569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:23.013630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc361-fcde-46fa-8fb5-17c6b2e8566e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:23.026726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:23.028465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:23.031108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:23.033175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] PATH_INFO: `/v3/users/b2430b59055e4d9a96bbb38829887f94` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:23.038653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2430b59055e4d9a96bbb38829887f94)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:23.046626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0d335-8266-4f7a-a34d-e1c49edfcdd0 tempest-QuotasTest-1692377611 tempest-QuotasTest-1692377611-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:23.049768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:23.070535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:23.074766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:23.075361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:23.075852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:23.079307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:23.096889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:23.417749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2319/4623] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:22 2022] POST /identity/v3/users => generated 295 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:23.423475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:23.431315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:23.480796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2430b59055e4d9a96bbb38829887f94'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.488808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ae95d-1d6c-4860-bcf4-4f695d4bf208 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:23.518618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:23.520078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:23.520726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:23.521370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] PATH_INFO: `/v3/projects/5e331299371b495ebee7d64fca9cb807` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:23.532680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e331299371b495ebee7d64fca9cb807)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:23.537053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:23.625023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2430b59055e4d9a96bbb38829887f94'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.669500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2430b59055e4d9a96bbb38829887f94'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.735681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:23.743182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2430b59055e4d9a96bbb38829887f94'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.745444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2430b59055e4d9a96bbb38829887f94'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.796158 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2305/4624] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:22 2022] DELETE /identity/v3/users/b2430b59055e4d9a96bbb38829887f94 => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:23.797825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:23.799750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e331299371b495ebee7d64fca9cb807', 'request_id': 'req-026fd55b-963f-42b6-bee8-1c282541056a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.804730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:23.899908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e331299371b495ebee7d64fca9cb807', 'request_id': 'req-026fd55b-963f-42b6-bee8-1c282541056a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.924281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e331299371b495ebee7d64fca9cb807', 'request_id': 'req-026fd55b-963f-42b6-bee8-1c282541056a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.983882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] The token cache is being invalidate because project 5e331299371b495ebee7d64fca9cb807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:23.990400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.990400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-026fd55b-963f-42b6-bee8-1c282541056a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:23.996005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2320/4625] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:23 2022] DELETE /identity/v3/projects/5e331299371b495ebee7d64fca9cb807 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:24.006952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12ca6-7489-412d-9895-83124300022e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:24.022853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12ca6-7489-412d-9895-83124300022e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:24.024356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf12ca6-7489-412d-9895-83124300022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:24.118066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4bf12ca6-7489-412d-9895-83124300022e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:24.121648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4bf12ca6-7489-412d-9895-83124300022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:24.153789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7026676-d45c-4773-9b2b-78e281dfbe77 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:24.158800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2321/4626] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:24.171908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:24.173914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:24.174643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:24.192694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:24.194736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:24.197612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:24.197612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:24.201539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:24.205116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:24.251067 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2306/4627] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:24.261992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:24.265591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:24.267605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:24.280170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:24.326503 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2322/4628] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:24.326503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:24.333860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:24.334927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:24.355402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03e55-2b62-46bf-aa74-91f40d136280 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:24.376694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:24.377914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:24.378424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:24.378942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] PATH_INFO: `/v3/projects/0d0dc488153a43779aabb1dc0774eda1/users/b1ba82c63ee1445f919d1a736c1c9df2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:24.390933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f707f-9666-4397-9fe2-d1487b9a2b72 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:24.421788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:24.425497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:24.426563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:24.427659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] PATH_INFO: `/v3/users/3e34187d73664621b89c62bae6ddbc47` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:24.431187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e34187d73664621b89c62bae6ddbc47)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:24.437317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:24.458118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0dc488153a43779aabb1dc0774eda1, user_id=b1ba82c63ee1445f919d1a736c1c9df2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:24.463820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:24.627367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2307/4629] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:24 2022] PUT /identity/v3/projects/0d0dc488153a43779aabb1dc0774eda1/users/b1ba82c63ee1445f919d1a736c1c9df2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:24.633292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:24.880064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e34187d73664621b89c62bae6ddbc47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:24.881487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e34187d73664621b89c62bae6ddbc47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:25.000351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4640-c970-4ac9-ad7b-05731247b642 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:25.019887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e34187d73664621b89c62bae6ddbc47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:25.021490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:25.023803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:25.024595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:25.025358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:25.028093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:25.035973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:25.038649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:25.076871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e34187d73664621b89c62bae6ddbc47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:25.101694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2308/4630] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:25.103520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:25.110427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e34187d73664621b89c62bae6ddbc47'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:25.140798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055e8c-eb54-4dcd-83f2-8529402640d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:25.145865 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2323/4631] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:24 2022] DELETE /identity/v3/users/3e34187d73664621b89c62bae6ddbc47 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:25.150389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:25.160299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:25.422755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:25.424513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:25.429225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:25.430281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:25.432028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:25.437504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:25.442062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415c26-e102-4cd7-8f29-9c45a021ecff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:25.455488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:25.461193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:25.461711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:25.462413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] PATH_INFO: `/v3/users/6ee1d48c308e49249a3ead3dc9ec9d94` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:25.468404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee1d48c308e49249a3ead3dc9ec9d94)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:25.472814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:25.473267 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2309/4632] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:25.475568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:25.478886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:25.546213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963062c-be18-4743-acce-338675b5e409 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:25.553940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:25.561329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:25.568134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:25.568134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:25.568134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:25.568134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:25.574674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2041-a8a6-48c0-a126-b7ac384af42f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:25.791410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2310/4633] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:25 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:25.793158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:25.793592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:25.793955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:25.858816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:25.860530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:25.935919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee1d48c308e49249a3ead3dc9ec9d94'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:25.937117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee1d48c308e49249a3ead3dc9ec9d94'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:26.014238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee1d48c308e49249a3ead3dc9ec9d94'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:26.035027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:26.070832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee1d48c308e49249a3ead3dc9ec9d94'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:26.093532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2311/4634] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:26.103813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:26.108123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:26.112732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee1d48c308e49249a3ead3dc9ec9d94'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:26.138666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8db64-f3b8-4dff-bb33-59caadffeea0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:26.145195 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2324/4635] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:25 2022] DELETE /identity/v3/users/6ee1d48c308e49249a3ead3dc9ec9d94 => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:26.147519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:26.163768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:26.396258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:26.401367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:26.401367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:26.401367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] PATH_INFO: `/v3/projects/0d0dc488153a43779aabb1dc0774eda1/users/b1ba82c63ee1445f919d1a736c1c9df2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:26.406244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0dc488153a43779aabb1dc0774eda1, user_id=b1ba82c63ee1445f919d1a736c1c9df2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:26.413175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:26.444754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2312/4636] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:26 2022] PUT /identity/v3/projects/0d0dc488153a43779aabb1dc0774eda1/users/b1ba82c63ee1445f919d1a736c1c9df2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:26.450134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:26.453326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:26.533134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295bb-f7f7-457e-bb5b-7cb4a6509fa3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:26.654453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdb829-431e-4f44-9ac7-fb412ebb7ec4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:26.705058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:26.708413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:26.709189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:26.709770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] PATH_INFO: `/v3/projects/d442b7e0ae274bc4aed2f6f4df39de74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:26.712222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d442b7e0ae274bc4aed2f6f4df39de74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:26.717678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:26.845916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:26.847409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:26.848242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:26.848961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:26.854764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:26.878083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:27.042873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd442b7e0ae274bc4aed2f6f4df39de74', 'request_id': 'req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:27.067100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2325/4637] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:26 2022] POST /identity/v3/users => generated 288 bytes in 917 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:27.067100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:27.071677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:27.076703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd442b7e0ae274bc4aed2f6f4df39de74', 'request_id': 'req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:27.107446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd442b7e0ae274bc4aed2f6f4df39de74', 'request_id': 'req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:27.167381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:27.244974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fa39-5f64-4a90-874b-e108501c0349 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:27.260042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] The token cache is being invalidate because project d442b7e0ae274bc4aed2f6f4df39de74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:27.260618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:27.267057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:27.269991 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2313/4638] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:26 2022] DELETE /identity/v3/projects/d442b7e0ae274bc4aed2f6f4df39de74 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:27.273003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:27.287707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:27.370893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:27.370893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.370893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.370893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.371317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:27.374775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:27.541367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:27.556134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e035e-575a-405e-aa7e-8923207de87e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:27.589782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2326/4639] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:27.591534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3f5b-e432-4758-a5bd-5ecba5f767c3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.591891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3f5b-e432-4758-a5bd-5ecba5f767c3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.592175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3f5b-e432-4758-a5bd-5ecba5f767c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.618763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ff52-bfd7-47fd-8421-1a3cc21eecfb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:27.628975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:27.630047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.630209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.630537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.631298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:27.633848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:27.682961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-87be3f5b-e432-4758-a5bd-5ecba5f767c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:27.686362 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2314/4640] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:27.687282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87be3f5b-e432-4758-a5bd-5ecba5f767c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:27.687693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:27.719750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7ee8a-d4be-46c8-8ed6-a0c4f5b0b085 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:27.731469 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2327/4641] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:27.742364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:27.757867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.757867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.757867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.757867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:27.767957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:27.775537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.776033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.776540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.819992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2315/4642] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:27.822102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:27.850438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:27.853026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:27.871873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a1c2-b329-47d1-a34f-aba5220fbabe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:27.891502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2328/4643] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:27.893557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:27.895097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.899610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.900290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:27.900494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] PATH_INFO: `/v3/projects/5969c60a08114f9ebb0bbc3f2194d0fd/users/3ee7446ed3d64f46995a747e29e603bf/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.934153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec4581-be9f-4287-a07a-f37231c8633d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:27.955460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:27.970348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:27.970348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:27.970348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:27.970348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:27.970348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:27.975741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:27.988871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5969c60a08114f9ebb0bbc3f2194d0fd, user_id=3ee7446ed3d64f46995a747e29e603bf, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:28.000061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:28.058487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2329/4644] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:28.058487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:28.060604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:28.097032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77540-4afd-4ea0-99ac-0b6f35dd470e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:28.125826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:28.127177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:28.127774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:28.128401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] PATH_INFO: `/v3/projects/c158dac976d04c289ac71653feb4ca36` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:28.148097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c158dac976d04c289ac71653feb4ca36)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:28.159020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:28.244845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2316/4645] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:27 2022] PUT /identity/v3/projects/5969c60a08114f9ebb0bbc3f2194d0fd/users/3ee7446ed3d64f46995a747e29e603bf/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:28.251440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:28.564537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eda3-29fc-4635-a1fc-c41bfa770912 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:28.570588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c158dac976d04c289ac71653feb4ca36', 'request_id': 'req-ae7ff124-b669-4111-94a7-42fe7cd3da92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:28.738679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c158dac976d04c289ac71653feb4ca36', 'request_id': 'req-ae7ff124-b669-4111-94a7-42fe7cd3da92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:28.771504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c158dac976d04c289ac71653feb4ca36', 'request_id': 'req-ae7ff124-b669-4111-94a7-42fe7cd3da92'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:28.786207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:28.809517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:28.811281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:28.811281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:28.811641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:28.812995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:28.819684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57211da-293f-4f1b-838a-7981c0029443 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:28.825916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] The token cache is being invalidate because project c158dac976d04c289ac71653feb4ca36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:28.829356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:28.833343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ae7ff124-b669-4111-94a7-42fe7cd3da92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:28.851362 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2330/4646] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:28 2022] DELETE /identity/v3/projects/c158dac976d04c289ac71653feb4ca36 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:28.860170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d415b-1180-49be-b615-66131a190dad None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:28.860170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d415b-1180-49be-b615-66131a190dad None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:28.860794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d415b-1180-49be-b615-66131a190dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:28.989125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-912d415b-1180-49be-b615-66131a190dad None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:28.992268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-912d415b-1180-49be-b615-66131a190dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:29.025087 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2317/4647] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:28 2022] POST /identity/v3/projects => generated 375 bytes in 779 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:29.029248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:29.035389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:29.035389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:29.061661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:29.111626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:29.114567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:29.287292 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2331/4648] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:29.289755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d415b-1180-49be-b615-66131a190dad None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:29.294399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-912d415b-1180-49be-b615-66131a190dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:29.357114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d415b-1180-49be-b615-66131a190dad None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:29.401787 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2318/4649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:29.403772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:29.567681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:29.570284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:29.570890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:29.574476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:29.574476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:29.579467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6bf5-2ad3-4c37-a86f-affc3868588b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:29.710203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e653b-f3ba-4a94-8dcf-1eb4fff18aed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:29.719083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:29.720382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:29.720882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:29.721360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:29.786537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2332/4650] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:29 2022] POST /identity/v3/users => generated 288 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:29.788780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:29.789310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:29.789826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:29.867887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:29.870359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:29.890509 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2333/4651] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:29.892182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:29.919701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13310-5bd4-4201-bff2-eb54e65b0557 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:29.931666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:29.933158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:29.933686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:29.936103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:29.942751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:29.942751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:29.945888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:29.980098 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2334/4652] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:29.980098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.005442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d77fb-6368-426b-8eca-7fa2afb915f8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:30.015117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:30.016222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.016857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.017085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.018575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:30.019833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:30.024253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:30.057479 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2335/4653] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:30.058535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.098716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3970-b456-4fc3-8366-846ef0dace8d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:30.123311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2319/4654] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:29 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:30.125733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.127851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:30.135072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.137117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.139931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.141881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:30.153250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:30.191166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0fd04-8d59-470a-b106-6fec6e6ee8d1 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:30.220292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:30.221659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.222175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.222686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.224216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2336/4655] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:30.226540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.228500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:30.237510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:30.275108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0794-7af6-4b3c-b97c-0cb114ec14c3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:30.305652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:30.310367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.310367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.310367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] PATH_INFO: `/v3/projects/6006071429214a518602cecf8646892a/users/0e25ddb6c2b944b695d4e3e29ede847f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.383648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6006071429214a518602cecf8646892a, user_id=0e25ddb6c2b944b695d4e3e29ede847f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:30.390350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b5b13-c63d-41d2-9537-9f785f520879 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:30.447958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2320/4656] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:30 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:30.462546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.554789 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2337/4657] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:30 2022] PUT /identity/v3/projects/6006071429214a518602cecf8646892a/users/0e25ddb6c2b944b695d4e3e29ede847f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:30.565103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.565581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.566015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.585463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:30.613524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:30.615502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:30.819995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502b3e-5006-40d9-ac27-8bb514c2f9bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:30.835872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:30.840262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:30.840262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:30.840262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:30.840935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2338/4658] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:30.841091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:30.845090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:30.905436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:30.930435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:30.933271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:31.073697 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2321/4659] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:30 2022] POST /identity/v3/users => generated 293 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:31.076468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:31.141862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf28940-7769-42cd-bf03-26af60a84902 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.147334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ca3e-9d11-4aba-9368-4feaa0bb3de9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.153274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:31.153274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.153274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.153274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.173600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:31.176825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607853-3017-4b27-9c79-c0bcf41f2156 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:31.179869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:31.181010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.181514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.182004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.183465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:31.186718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:31.199013 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2339/4660] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:31.202586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed560e-848a-419a-a8d5-bded154e4474 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.202586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed560e-848a-419a-a8d5-bded154e4474 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.202952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed560e-848a-419a-a8d5-bded154e4474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.252916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2322/4661] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:31.256806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:31.274063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0a2d2-d5c6-4288-97a3-105677c73da8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.282108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:31.282990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.283442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.283972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.286927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:31.291373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:31.302409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-55ed560e-848a-419a-a8d5-bded154e4474 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:31.305754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-55ed560e-848a-419a-a8d5-bded154e4474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:31.325178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2340/4662] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:31.330197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2323/4663] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:31.331282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748752-7f48-4612-a506-c22be13da32d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.331767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748752-7f48-4612-a506-c22be13da32d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.332264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748752-7f48-4612-a506-c22be13da32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.333310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:31.367369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d9e7-0862-477f-81ce-f5bf29dbcbdf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.388707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-19748752-7f48-4612-a506-c22be13da32d None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:31.390878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:31.392038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19748752-7f48-4612-a506-c22be13da32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:31.392457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.392959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.393455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] PATH_INFO: `/v3/projects/72a4f1e433a6427ab380248125ebc5b6/users/6d11c1b7cf444372a6baeb027c455d5a/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.465547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a4f1e433a6427ab380248125ebc5b6, user_id=6d11c1b7cf444372a6baeb027c455d5a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:31.472990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8a0f2-afa0-4d20-bd86-586960bed6b5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:31.551203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2341/4664] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:31.557750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748752-7f48-4612-a506-c22be13da32d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:31.586707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748752-7f48-4612-a506-c22be13da32d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.597145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:31.609592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.610068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.610675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.633741 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2324/4665] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:31 2022] PUT /identity/v3/projects/72a4f1e433a6427ab380248125ebc5b6/users/6d11c1b7cf444372a6baeb027c455d5a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:31.670347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:31.671682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:31.677993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:31.768710 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 04 20:50:31.770563 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:50:31.782381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2342/4666] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:31 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 188 bytes in 217 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:50:31.782548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:31.782706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:31.784585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:31.827559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020869c-532b-421e-8abc-a443eb3acf60 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:31.908879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:32.045303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:32.048758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:32.052058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:32.055971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:32.104552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2325/4667] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:32.143311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:32.149051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:32.164559 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 04 20:50:32.166531 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:50:32.170413 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2343/4668] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:31 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 188 bytes in 391 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:50:32.176482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:32.219933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c251d-4eeb-422f-bd3d-98ade74b7c63 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:32.241339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c47fd-4296-4733-bbf2-6d70aac4a84b tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:32.246525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c47fd-4296-4733-bbf2-6d70aac4a84b tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:32.254490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c47fd-4296-4733-bbf2-6d70aac4a84b tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:32.254490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c47fd-4296-4733-bbf2-6d70aac4a84b tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:32.429094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d53c1-58d3-4dce-b1d6-94e01c7d93a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:32.441494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:32.445520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:32.453345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:32.456104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:32.497672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a1c47fd-4296-4733-bbf2-6d70aac4a84b tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:32.510316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:32.514489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:32.565261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2326/4669] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:50:32.682646 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2344/4670] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:32 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:33.051118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:33.059577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:33.111432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ecf3-8449-442a-88b4-6ee1d8cd38fc service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:33.126768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:33.128682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:33.130652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:33.130652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] PATH_INFO: `/v3/projects/62046e452ae743558315aefdfd8b7391` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:33.137582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=62046e452ae743558315aefdfd8b7391)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:33.144906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:33.551782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:33.573935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62046e452ae743558315aefdfd8b7391', 'request_id': 'req-84834ae5-dbb5-4eaa-90d1-518e838acdaf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:33.617425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62046e452ae743558315aefdfd8b7391', 'request_id': 'req-84834ae5-dbb5-4eaa-90d1-518e838acdaf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:33.683878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62046e452ae743558315aefdfd8b7391', 'request_id': 'req-84834ae5-dbb5-4eaa-90d1-518e838acdaf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:33.689194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b08c-81f3-407d-b88d-e8478be42737 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:33.689822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b08c-81f3-407d-b88d-e8478be42737 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:33.690240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b08c-81f3-407d-b88d-e8478be42737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:33.766867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a999b08c-81f3-407d-b88d-e8478be42737 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:33.774431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a999b08c-81f3-407d-b88d-e8478be42737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:33.791266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2345/4671] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:50:33.800913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:33.801919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:33.802674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:33.850224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] The token cache is being invalidate because project 62046e452ae743558315aefdfd8b7391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:33.850929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:33.852325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:33.857157 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2327/4672] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:33 2022] DELETE /identity/v3/projects/62046e452ae743558315aefdfd8b7391 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:33.862133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:33.867226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:33.891082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:33.897284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:34.129137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84834ae5-dbb5-4eaa-90d1-518e838acdaf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:34.152632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:34.153760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:34.154245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:34.154749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] PATH_INFO: `/v3/users/c8e431aced6e44ba88bce1f46b62b4ef` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:34.157285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e431aced6e44ba88bce1f46b62b4ef)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:34.163816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2346/4673] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:34.165315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:34.166008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:34.196989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff41d8-c894-488b-aa27-44a550ad6e3b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:34.221043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96561791-fd2d-4a61-8c2f-fb5e536c7470 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:34.222128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561791-fd2d-4a61-8c2f-fb5e536c7470 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:34.222580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561791-fd2d-4a61-8c2f-fb5e536c7470 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:34.227721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561791-fd2d-4a61-8c2f-fb5e536c7470 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:34.542990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96561791-fd2d-4a61-8c2f-fb5e536c7470 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:34.632812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e431aced6e44ba88bce1f46b62b4ef'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:34.762239 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2347/4674] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:34 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:34.925293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e431aced6e44ba88bce1f46b62b4ef'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:34.993133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e431aced6e44ba88bce1f46b62b4ef'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:35.056345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e431aced6e44ba88bce1f46b62b4ef'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:35.067604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a94b856f-2994-4856-9396-7098f3a3ca7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e431aced6e44ba88bce1f46b62b4ef'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:35.122670 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2328/4675] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:33 2022] DELETE /identity/v3/users/c8e431aced6e44ba88bce1f46b62b4ef => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:35.685316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:35.687554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:35.690039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:35.772590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851a26-1510-432f-b1b6-2d4d61ae89b6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:35.774241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851a26-1510-432f-b1b6-2d4d61ae89b6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:35.775449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57851a26-1510-432f-b1b6-2d4d61ae89b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:35.814872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] MFA Rules not processed for user `d22886ebf2b34276a9369ee93f9e5457`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:35.824314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:35.901193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-57851a26-1510-432f-b1b6-2d4d61ae89b6 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:35.909528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57851a26-1510-432f-b1b6-2d4d61ae89b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:35.928337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2329/4676] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:35.935887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:35.937355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:35.938231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:36.010929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:36.031912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:36.039692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:36.174751 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2348/4677] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:36.192850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:36.196701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:36.270266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:36.362114 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2330/4678] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:36.371530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:36.438679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257462c5-0086-424e-a884-9c3f3c417798 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:36.470635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6136056-b175-483f-897c-4473023dddc6 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:36.479920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6136056-b175-483f-897c-4473023dddc6 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:36.487680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6136056-b175-483f-897c-4473023dddc6 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:36.489958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6136056-b175-483f-897c-4473023dddc6 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:36.514845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991b90-dd14-4a0a-955f-f418916bc30e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:36.535953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:36.538938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:36.540327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:36.543429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:36.582440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:36.586841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:36.630526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2349/4679] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:50:36.790342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c6136056-b175-483f-897c-4473023dddc6 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:36.987296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2331/4680] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:36 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:37.022766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:37.026332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:37.430395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc485-4d14-4206-adda-0d29eb7043c7 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:37.444842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:37.446375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:37.446890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:37.448170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] PATH_INFO: `/v3/users/9c7d0e3889e34fa1b24d19f7f68bc56c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:37.451073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7d0e3889e34fa1b24d19f7f68bc56c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:37.456134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:37.921203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7d0e3889e34fa1b24d19f7f68bc56c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:37.923982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7d0e3889e34fa1b24d19f7f68bc56c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.011489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:38.012321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:38.012691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:38.113963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:38.117990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:38.130144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7d0e3889e34fa1b24d19f7f68bc56c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.138063 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2332/4681] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:38.140629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:38.150383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:38.168543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:38.202061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f6f0-d4cb-492e-a230-8c0461e6ca8b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:38.214194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7d0e3889e34fa1b24d19f7f68bc56c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.219951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:38.221845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:38.222929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:38.228179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] PATH_INFO: `/v3/projects/9413f2837b35458daff53dc867033535` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:38.231446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9413f2837b35458daff53dc867033535)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:38.239034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:38.239306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c300a438-90a5-4ccc-a395-1658d215799b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7d0e3889e34fa1b24d19f7f68bc56c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.265874 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2350/4682] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:50:37 2022] DELETE /identity/v3/users/9c7d0e3889e34fa1b24d19f7f68bc56c => generated 0 bytes in 1244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:38.268416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:38.269317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:38.270024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:38.356993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:38.359706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:38.566339 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2351/4683] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:38.573779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:38.588459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9413f2837b35458daff53dc867033535', 'request_id': 'req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.611970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9413f2837b35458daff53dc867033535', 'request_id': 'req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.618667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e922c9-a6d8-4a0a-901c-7415fe962e96 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:38.639221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9413f2837b35458daff53dc867033535', 'request_id': 'req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.767380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] The token cache is being invalidate because project 9413f2837b35458daff53dc867033535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:38.768432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.770037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-55b9fe11-13f3-4ff6-9572-2ba4c9f3f587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:38.773403 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2333/4684] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:38 2022] DELETE /identity/v3/projects/9413f2837b35458daff53dc867033535 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:38.786240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fefd-d995-493b-afb5-ca4a990a4cc6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:38.788161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fefd-d995-493b-afb5-ca4a990a4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:38.788786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8fefd-d995-493b-afb5-ca4a990a4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:38.885363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-94e8fefd-d995-493b-afb5-ca4a990a4cc6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:38.894037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94e8fefd-d995-493b-afb5-ca4a990a4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:38.911020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:38.916765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:38.918436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:38.921744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:39.172759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:39.222729 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2334/4685] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:39.236886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:39.237578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:39.238753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:39.317330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2352/4686] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:38 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:39.367419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:39.374095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:39.441360 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2335/4687] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:39.443220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:39.480315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf23c9-79b6-471a-9c11-8f84db16a07f tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:39.508589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:39.510262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:39.511286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:39.512189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:39.513815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:39.521117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:39.525053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:39.569467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2353/4688] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:50:39.577882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:39.621571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf99d4b-c7f7-4973-ac3a-6d7071dfe06d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:39.658683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:39.659935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:39.660428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:39.660880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:39.662626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:39.692551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:39.920577 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2336/4689] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:39 2022] POST /identity/v3/projects => generated 367 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:39.927799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:39.943326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:39.946060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:39.963957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:40.010395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbfb25-485c-4740-b94f-5ed6b00cafad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:40.268686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eec6e7-0a31-4e34-9df6-e7a0bc718ac1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:40.300967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:40.304504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:40.305172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:40.305631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] PATH_INFO: `/v3/projects/0ab943ca7b4f4ad3ac63ee0067fa6376` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:40.328302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab943ca7b4f4ad3ac63ee0067fa6376)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:40.340251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:40.415278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:40.510264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:40.514535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:40.516688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:40.516688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:40.519626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:40.528028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec0cc-6af6-4c6e-a87d-4a99a6c89864 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:40.703871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab943ca7b4f4ad3ac63ee0067fa6376', 'request_id': 'req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:40.743815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab943ca7b4f4ad3ac63ee0067fa6376', 'request_id': 'req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:40.776462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab943ca7b4f4ad3ac63ee0067fa6376', 'request_id': 'req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:40.811306 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2354/4690] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:39 2022] POST /identity/v3/users => generated 284 bytes in 886 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:40.814224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:40.814872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:40.815906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:40.869164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:40.873147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:40.887236 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2355/4691] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:40 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:40.888647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:40.972762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] The token cache is being invalidate because project 0ab943ca7b4f4ad3ac63ee0067fa6376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:50:40.973270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:40.984165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-33ece661-47f1-4cb7-917c-4bb4b4bf05ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:40.994916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2337/4692] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:39 2022] DELETE /identity/v3/projects/0ab943ca7b4f4ad3ac63ee0067fa6376 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:40.997732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503888d-b366-44b9-ae83-659b9948f439 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:40.998187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503888d-b366-44b9-ae83-659b9948f439 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:40.998622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503888d-b366-44b9-ae83-659b9948f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.042788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b503888d-b366-44b9-ae83-659b9948f439 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:41.045044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b503888d-b366-44b9-ae83-659b9948f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:41.164780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863091e5-1f82-4c73-b81e-10d0b7926384 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:41.179922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:41.181264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.181959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.188409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.188409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:41.188409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:41.224010 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2356/4693] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:41.232032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:41.236615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:41.285666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2338/4694] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:41.295942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.301224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.302848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.345013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f94b8-af41-4190-b707-e94d452745f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:41.394441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:41.396500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.397910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.402448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.415295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:41.420058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:41.454155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:41.468205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:41.503793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2357/4695] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:41.509297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:41.527317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2339/4696] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:41.535417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:41.562031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a33f54-a001-4e24-b4d4-9478394b07c3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:41.569908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d159-d96b-492b-bd53-78cb2c304b73 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:41.587072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:41.594016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:41.594338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.594649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.595617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] PATH_INFO: `/v3/projects/223d432ff6a643f39235b9d5774265c1/users/49e15ecb7d8e4dad9d20620ac755ef7a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.597993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.601067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.603718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.612044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:50:41.617581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:41.629356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:41.697923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223d432ff6a643f39235b9d5774265c1, user_id=49e15ecb7d8e4dad9d20620ac755ef7a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:41.711684 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2340/4697] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:50:41.714536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:41.733191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028782-f585-4c05-9d27-1b71a6541944 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:41.796759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbeae-f8d6-4603-a7a6-69fc010e966d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:41.836154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:41.837260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:41.837735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:41.838223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:41.839525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:41.857787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0064c-b8a3-4009-a9b0-e53e01c95d6e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:41.999554 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2358/4698] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:41 2022] PUT /identity/v3/projects/223d432ff6a643f39235b9d5774265c1/users/49e15ecb7d8e4dad9d20620ac755ef7a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:42.004723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:42.004723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:42.004723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:42.095650 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2341/4699] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:50:41 2022] POST /identity/v3/projects => generated 395 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:42.101633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b050d1-f37f-46e4-8e1b-f91fc064702f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:42.102054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b050d1-f37f-46e4-8e1b-f91fc064702f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:42.106089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b050d1-f37f-46e4-8e1b-f91fc064702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:42.116481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:42.125694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:42.240105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b8b050d1-f37f-46e4-8e1b-f91fc064702f None None] MFA Rules not processed for user `49e15ecb7d8e4dad9d20620ac755ef7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:42.242511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b8b050d1-f37f-46e4-8e1b-f91fc064702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:42.268024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2359/4700] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:42.270372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:42.562087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761ac1-6817-4e97-acf2-b7e991cfb3ae None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:42.575263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2342/4701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:42.576393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:42.577412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:42.577858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0535-7fc6-45fb-b5f9-2b7106eb6e86 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:42.578032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:42.578347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0535-7fc6-45fb-b5f9-2b7106eb6e86 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:42.578538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:42.578836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c0535-7fc6-45fb-b5f9-2b7106eb6e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:42.579618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:42.608588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:42.649247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-277c0535-7fc6-45fb-b5f9-2b7106eb6e86 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:42.653860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-277c0535-7fc6-45fb-b5f9-2b7106eb6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:42.672137 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2343/4702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:42.679491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:42.680028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:42.680573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:42.811050 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2360/4703] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:50:42 2022] POST /identity/v3/users => generated 298 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:50:42.812861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:42.818679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:43.035998 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.application [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:50:43.054799 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2344/4704] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 372 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 04 20:50:43.054799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:43.064037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d64d-765d-4202-af71-bb86379bb950 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:43.091500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:43.095450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.095981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.096499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.120448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7373d8c-b4cc-40d1-91b1-50ce61a497c8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:43.135040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:43.136754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.137768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.138539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.140084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:43.145351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70549a3e-046f-4f2b-844c-88619f2027c5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:43.155482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:43.158514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:43.168212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2345/4705] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:43.171247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646d936-1ee3-46c2-929c-295dd7045baa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.172046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646d936-1ee3-46c2-929c-295dd7045baa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.175181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646d936-1ee3-46c2-929c-295dd7045baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.196706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2361/4706] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:43.198421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:43.240641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8410-e1dc-4a58-b8f3-c725b31b0f61 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:43.263904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:43.264881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.265338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.265831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.267062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:43.270303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:43.320937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2362/4707] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:50:43.349042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:43.372852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f782f-0f02-477e-b007-b4724eaf8b43 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:43.390728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:43.394984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.395582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.398951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] PATH_INFO: `/v3/projects/54d1c146b5ce415cb43490a0ae2130cb/users/f40ddba37a5b491f81b9ed09fd577f19/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.475568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d1c146b5ce415cb43490a0ae2130cb, user_id=f40ddba37a5b491f81b9ed09fd577f19, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:43.491285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:43.492559 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.application [None req-6646d936-1ee3-46c2-929c-295dd7045baa None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:50:43.501910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2346/4708] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:43 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 333 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 04 20:50:43.525321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911989-2587-438b-ab88-e3f2c61aa3e1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.525851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911989-2587-438b-ab88-e3f2c61aa3e1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.526431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911989-2587-438b-ab88-e3f2c61aa3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.655055 n-d-852085-12 devstack@keystone.service[82439]: WARNING keystone.server.flask.application [None req-e7911989-2587-438b-ab88-e3f2c61aa3e1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:50:43.662046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2347/4709] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:43 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 153 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 04 20:50:43.726638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2363/4710] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:50:43 2022] PUT /identity/v3/projects/54d1c146b5ce415cb43490a0ae2130cb/users/f40ddba37a5b491f81b9ed09fd577f19/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:50:43.735297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd885-661d-467f-8fc4-ce1400fe998c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:43.736631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd885-661d-467f-8fc4-ce1400fe998c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:43.737580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd885-661d-467f-8fc4-ce1400fe998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:43.827322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4f1fd885-661d-467f-8fc4-ce1400fe998c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:43.833805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f1fd885-661d-467f-8fc4-ce1400fe998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:44.140311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2348/4711] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:44.163615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:44.167464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:44.429630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9800-24e6-4f53-a8fd-a5e412615e0c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:44.445372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:44.453222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:44.453759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:44.454275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:44.498116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:44.514192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13d157-b3bd-47c0-9854-e61e35b0ae45 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:44.544355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2364/4712] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:45.185255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:46.000227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:52.620167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:52.620884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:52.621096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:52.738945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] MFA Rules not processed for user `d22886ebf2b34276a9369ee93f9e5457`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:52.749082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:52.791565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:53.026199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2349/4713] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:54.681394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce28ae-ed54-4fda-b5e1-44c84ac3d7e0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:54.682190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce28ae-ed54-4fda-b5e1-44c84ac3d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:54.682528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce28ae-ed54-4fda-b5e1-44c84ac3d7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:54.950696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73ce28ae-ed54-4fda-b5e1-44c84ac3d7e0 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:54.957507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73ce28ae-ed54-4fda-b5e1-44c84ac3d7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:54.989795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:54.995585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2365/4714] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:55.568507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c403e1-28ac-4d87-9817-cadfcf7a9f75 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:55.608452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8a9d8-4d23-4703-9c62-10ad341e8ecf tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:55.609735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a9d8-4d23-4703-9c62-10ad341e8ecf tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:55.625702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a9d8-4d23-4703-9c62-10ad341e8ecf tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:55.626237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8a9d8-4d23-4703-9c62-10ad341e8ecf tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:55.681031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4bee-e839-44de-8270-65107b81e989 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:55.682002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4bee-e839-44de-8270-65107b81e989 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:55.684664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4bee-e839-44de-8270-65107b81e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-245b4bee-e839-44de-8270-65107b81e989 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:55.718242 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:50:55.720639 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:50:55.730330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2366/4715] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:50:55 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (3 switches on core 0) Oct 04 20:50:55.993960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ad8a9d8-4d23-4703-9c62-10ad341e8ecf tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:56.137803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2350/4716] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:54 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:57.146250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ecd51-5530-43b5-ab2d-f7dee4fd9403 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:57.152243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ecd51-5530-43b5-ab2d-f7dee4fd9403 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:57.153585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ecd51-5530-43b5-ab2d-f7dee4fd9403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:57.209212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-871ecd51-5530-43b5-ab2d-f7dee4fd9403 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:57.212738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-871ecd51-5530-43b5-ab2d-f7dee4fd9403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:57.231197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2367/4717] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:57.241094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7c00-d2f1-4241-b2bd-52204b2c5efb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:57.242658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7c00-d2f1-4241-b2bd-52204b2c5efb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:57.244365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7c00-d2f1-4241-b2bd-52204b2c5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-86ea7c00-d2f1-4241-b2bd-52204b2c5efb None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:50:57.294529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:57.296857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 04 20:50:57.302494 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:50:57.309065 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2351/4718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:57 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:50:57.309334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:57.309334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:57.309334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:57.375696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:57.599092 n-d-852085-12 devstack@keystone.service[82440]: WARNING keystone.server.flask.application [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 04 20:50:57.608094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2368/4719] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:57 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 301 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 04 20:50:57.621377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504f482-cf78-4b11-9b57-93906703a52d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:57.621377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504f482-cf78-4b11-9b57-93906703a52d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:57.625269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504f482-cf78-4b11-9b57-93906703a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:57.867632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0504f482-cf78-4b11-9b57-93906703a52d None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:57.871551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0504f482-cf78-4b11-9b57-93906703a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:57.899383 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2352/4720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:57.904279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:57.956573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4579969-cf58-4e1d-ad79-e570e7c623f2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:57.981268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:57.983360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:57.987773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:57.988742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:58.331668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:50:58.443767 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2369/4721] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:57 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:50:58.448099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e372cb-4d42-4b6b-bd8f-255d84f9c553 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:58.448099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e372cb-4d42-4b6b-bd8f-255d84f9c553 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:58.448099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e372cb-4d42-4b6b-bd8f-255d84f9c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:58.582849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e8e372cb-4d42-4b6b-bd8f-255d84f9c553 None None] MFA Rules not processed for user `b1ba82c63ee1445f919d1a736c1c9df2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:58.589381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e8e372cb-4d42-4b6b-bd8f-255d84f9c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:58.988605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:59.003681 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2353/4722] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:50:59.025496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:59.030537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:59.456058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14aa48-69f3-4317-893e-644730ffb26e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:59.456825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14aa48-69f3-4317-893e-644730ffb26e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:59.457550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14aa48-69f3-4317-893e-644730ffb26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:59.509605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7d14aa48-69f3-4317-893e-644730ffb26e None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:59.509903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677244d0-ff2c-4070-bcef-bc7e6b374c07 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:59.512184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7d14aa48-69f3-4317-893e-644730ffb26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:59.521527 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2354/4723] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:59.529895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:59.530562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:59.531091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:59.537375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:59.538524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:59.540592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:59.540592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:59.548581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:59.608221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:50:59.610723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:50:59.631078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2355/4724] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:50:59.632982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:50:59.669630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75549e-9b38-400f-bb55-b0c020f4ad5e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:50:59.694341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995d62-f25c-420c-bbb2-fe8bddc1a403 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:50:59.695481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995d62-f25c-420c-bbb2-fe8bddc1a403 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:50:59.695938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995d62-f25c-420c-bbb2-fe8bddc1a403 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:50:59.696578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995d62-f25c-420c-bbb2-fe8bddc1a403 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:50:59.836532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:50:59.839726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ba44-d042-4c7b-a326-e931c716b825 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:50:59.886437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2370/4725] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:50:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:50:59.946304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a995d62-f25c-420c-bbb2-fe8bddc1a403 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:00.112658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2356/4726] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:50:59 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:01.119088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:01.127664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:01.130924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:01.229793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:01.235377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:01.276850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6b40-d574-429d-a845-840afbabfe46 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:01.276850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6b40-d574-429d-a845-840afbabfe46 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:01.279193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6b40-d574-429d-a845-840afbabfe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:01.280832 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2371/4727] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:51:01.363950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ecc6b40-d574-429d-a845-840afbabfe46 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:01.368310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ecc6b40-d574-429d-a845-840afbabfe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:01.402128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:01.425744 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2357/4728] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:01.463670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb60b0-1883-45e5-882f-fc99fb29c2a1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:01.473200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b09abd-ee29-424d-963c-e95ca5086274 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee7446ed3d64f46995a747e29e603bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5969c60a08114f9ebb0bbc3f2194d0fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:01.474691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b09abd-ee29-424d-963c-e95ca5086274 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:01.475237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b09abd-ee29-424d-963c-e95ca5086274 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:01.475820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b09abd-ee29-424d-963c-e95ca5086274 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:01.800091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c9b09abd-ee29-424d-963c-e95ca5086274 tempest-IdentityV3UsersTest-1511420625 tempest-IdentityV3UsersTest-1511420625-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:01.982513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2372/4729] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:51:01 2022] POST /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf/password => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:02.990601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:02.992193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:02.993347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:03.118404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:03.122659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:03.154247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2358/4730] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:51:04.153810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819aacb-8c31-4cdd-aed3-57f4a2722ea6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:04.154617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819aacb-8c31-4cdd-aed3-57f4a2722ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:04.154816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819aacb-8c31-4cdd-aed3-57f4a2722ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:04.275119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7819aacb-8c31-4cdd-aed3-57f4a2722ea6 None None] MFA Rules not processed for user `3ee7446ed3d64f46995a747e29e603bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:04.277810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7819aacb-8c31-4cdd-aed3-57f4a2722ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:04.339421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:04.342085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2373/4731] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:04.343680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:04.438809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70a9d-f7ca-4bb3-8167-7aa01924be22 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:04.480179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:04.489391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:04.497621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:04.499813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] PATH_INFO: `/v3/users/3ee7446ed3d64f46995a747e29e603bf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:04.504750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee7446ed3d64f46995a747e29e603bf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:04.514502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:05.025396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:05.127088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:05.159239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:05.233550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:05.237312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee7446ed3d64f46995a747e29e603bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:05.269118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2359/4732] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:04 2022] DELETE /identity/v3/users/3ee7446ed3d64f46995a747e29e603bf => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:51:05.277401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c55-2eb5-4740-a1a3-17ac0ce2fc10 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:05.278251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c55-2eb5-4740-a1a3-17ac0ce2fc10 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:05.281981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c55-2eb5-4740-a1a3-17ac0ce2fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:05.359745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e0138c55-2eb5-4740-a1a3-17ac0ce2fc10 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:05.362070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e0138c55-2eb5-4740-a1a3-17ac0ce2fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:05.401698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:05.706598 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2374/4733] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:05.788402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:05.791038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:05.917158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:05.920666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:05.920666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:06.052415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] MFA Rules not processed for user `0e25ddb6c2b944b695d4e3e29ede847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:06.060670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:06.086966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db08320-6956-4ff6-9d3e-00091faefb38 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:06.118684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:06.119833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:06.120343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:06.120846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:06.185179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:06.189002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:06.242254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2360/4734] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:06.418570 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2375/4735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:06.446573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:06.449607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:06.529564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:06.898029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd5bdb-8255-4f61-a47b-dde9732b72a5 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:06.936582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:06.937848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:06.938713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:06.939513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:06.991794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:07.011954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0d1d-0732-4de8-b67f-d7fbfabe6982 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:07.089506 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2361/4736] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:11.128579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:11.132119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:11.253511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259f22-d183-49ae-ba84-8617cc2c5e91 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:11.281414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:11.283262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:11.284501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:11.285329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] PATH_INFO: `/v3/projects/5969c60a08114f9ebb0bbc3f2194d0fd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:11.291534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5969c60a08114f9ebb0bbc3f2194d0fd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:11.311462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:11.608582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5969c60a08114f9ebb0bbc3f2194d0fd', 'request_id': 'req-36f4eb78-eda0-4533-b566-0ffb000601fe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:11.733712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5969c60a08114f9ebb0bbc3f2194d0fd', 'request_id': 'req-36f4eb78-eda0-4533-b566-0ffb000601fe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:11.762913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5969c60a08114f9ebb0bbc3f2194d0fd', 'request_id': 'req-36f4eb78-eda0-4533-b566-0ffb000601fe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:11.811901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] The token cache is being invalidate because project 5969c60a08114f9ebb0bbc3f2194d0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:11.818780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:11.821490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-36f4eb78-eda0-4533-b566-0ffb000601fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:11.832301 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2376/4737] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:11 2022] DELETE /identity/v3/projects/5969c60a08114f9ebb0bbc3f2194d0fd => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:11.842865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:11.843726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:11.843920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:11.954083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:11.956606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:12.477275 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2362/4738] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:12.478291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:12.479046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:12.479474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:12.567827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:12.578857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:12.630214 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2377/4739] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:12.637892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:12.705606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e1f5-278b-4cad-8faf-ce88bb5e4db4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:12.750442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:12.760196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:12.763014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:12.765212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:12.768936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:51:12.773562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:12.792342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:12.856582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2363/4740] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:51:12.859948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:12.900476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df0a06-a266-4383-9229-4c7b32c8b131 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:12.930841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:12.934725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:12.935446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:12.938025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:12.939635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:12.948509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:13.023190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:13.207048 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2378/4741] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:12 2022] POST /identity/v3/projects => generated 397 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:51:13.214002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:13.266100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a405-0488-4463-9dae-7b1e7a496b3c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:13.748474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:13.750357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:13.752875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:13.754603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:13.756915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:13.763816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:13.899768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2364/4742] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:13 2022] POST /identity/v3/users => generated 305 bytes in 687 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:13.905035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:13.938011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a2d5-b3e1-4889-bb33-bf75b6dc2432 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:13.960220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:13.960220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:13.962538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:13.965850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:13.968687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:13.973443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:14.018005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2379/4743] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:14.048712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:14.101229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19963ace-2c4c-40bf-81ce-6feb6cae6bb6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:14.147952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:14.150175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:14.151219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:14.152271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] PATH_INFO: `/v3/projects/e0218f64dbab4aeb90de8b2b129e7001/users/13dca3207e0645778cd17482f03a2dc0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:14.218824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:14.233855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0218f64dbab4aeb90de8b2b129e7001, user_id=13dca3207e0645778cd17482f03a2dc0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:14.257505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b910e-1f9a-4bc5-8a7d-4aecc471acdc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:14.568780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2365/4744] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:14 2022] PUT /identity/v3/projects/e0218f64dbab4aeb90de8b2b129e7001/users/13dca3207e0645778cd17482f03a2dc0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:14.570787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:14.612345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861842f2-6ff1-4692-8d07-e734699c165f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:14.862903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:14.864289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:14.864797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:14.922919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:14.927359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:14.931327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:14.933816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:14.941003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:14.954137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:15.008577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] MFA Rules not processed for user `6d11c1b7cf444372a6baeb027c455d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:15.015033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:15.029446 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2380/4745] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:15.032994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:15.076280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75e89a-1736-42ff-9a6d-673b17bef651 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:15.093696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:15.096654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:15.097672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:15.099361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] PATH_INFO: `/v3/projects/e0218f64dbab4aeb90de8b2b129e7001/users/13dca3207e0645778cd17482f03a2dc0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:15.112796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0218f64dbab4aeb90de8b2b129e7001, user_id=13dca3207e0645778cd17482f03a2dc0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:15.112796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6f867-9e63-4098-b03e-c30193e8d9a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:15.151650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2381/4746] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:15 2022] PUT /identity/v3/projects/e0218f64dbab4aeb90de8b2b129e7001/users/13dca3207e0645778cd17482f03a2dc0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:15.175982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:15.178647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:15.179495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:15.528731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] MFA Rules not processed for user `13dca3207e0645778cd17482f03a2dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:15.528731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:15.534705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2366/4747] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:15.534705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:15.534705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:15.772167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2382/4748] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:15.779467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:15.901339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d88c-f89a-4c4c-a749-fdefea1ab541 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:16.014179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:16.059540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de289a-b2d4-41b8-81ca-290678176b84 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:16.088628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:16.093133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:16.095498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:16.097181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:16.104707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:16.114647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:16.418145 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2383/4749] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:15 2022] POST /identity/v3/projects => generated 399 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:16.419848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:16.471671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:16.474347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:16.475561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:16.476717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:16.540473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:16.684782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:16.688311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:16.732350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2367/4750] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 1247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:16.843624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5c57-44de-4484-af8d-83fc887646c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:16.884132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:16.886785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:16.887393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:16.891515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:16.895620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:16.915589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:17.087829 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2384/4751] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:16 2022] POST /identity/v3/users => generated 300 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:17.095699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:17.159454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeecc5-97da-4173-b2d4-4ae8cb5b0c25 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:17.177970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:17.179394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:17.179898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:17.180377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:17.181287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:17.188691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:17.229141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:17.240178 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2368/4752] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:51:17.289139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b489e-6010-4e63-b086-b6dd0b7dd892 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:17.354090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:17.354090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:17.354090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:17.354090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:17.354993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:17.354993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2559023-81b6-4417-b658-08415357f75d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:17.409663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:17.423740 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2385/4753] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:17.453119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba559d-df1e-4d83-9677-bfd3f0eec4bc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:17.497523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:17.500047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:17.500521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:17.501008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] PATH_INFO: `/v3/projects/f81040d96856453a9b7c9ecdbd989470/users/14b2f13a53cc4425a5bc6f004874ff95/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:17.579553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81040d96856453a9b7c9ecdbd989470, user_id=14b2f13a53cc4425a5bc6f004874ff95, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:17.593580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:17.737562 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2369/4754] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:17 2022] PUT /identity/v3/projects/f81040d96856453a9b7c9ecdbd989470/users/14b2f13a53cc4425a5bc6f004874ff95/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:17.759781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:17.760316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:17.760731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:17.820979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] MFA Rules not processed for user `14b2f13a53cc4425a5bc6f004874ff95`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:17.823585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:18.161979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2386/4755] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:18.192800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:18.193498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:18.517647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ead-4632-4e70-b1ff-e52b5d653d39 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:18.534573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:18.536798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:18.538624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:18.539184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:18.897553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:18.901942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e05305-a6b8-484a-b7f7-15a539fdc4ff service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:18.936424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2370/4756] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:21.993434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:22.173536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:22.221009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b6885-cf91-4b6e-b734-31aef83fbc14 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:22.233567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:22.236068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:22.237012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:22.241875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] PATH_INFO: `/v3/users/13dca3207e0645778cd17482f03a2dc0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:22.248866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dca3207e0645778cd17482f03a2dc0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:22.256880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:22.807258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dca3207e0645778cd17482f03a2dc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:22.808523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dca3207e0645778cd17482f03a2dc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:22.944539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dca3207e0645778cd17482f03a2dc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:23.011960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dca3207e0645778cd17482f03a2dc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:23.047504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dca3207e0645778cd17482f03a2dc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:23.080443 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2387/4757] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:21 2022] DELETE /identity/v3/users/13dca3207e0645778cd17482f03a2dc0 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:23.083752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9061-2834-4b1c-b8c6-b797d24399e2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:23.085032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9061-2834-4b1c-b8c6-b797d24399e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:23.085810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9061-2834-4b1c-b8c6-b797d24399e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:23.206869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b12f9061-2834-4b1c-b8c6-b797d24399e2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:23.214783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b12f9061-2834-4b1c-b8c6-b797d24399e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:23.387865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:23.544638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2371/4758] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:23.636917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:23.640391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:23.966300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30ac1-f383-4941-a3b7-b5303cce66e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:23.980014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:23.980824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:23.981349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:23.981885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:24.041215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:24.049795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02679-505c-4a78-9b59-6673feb1ed2c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:24.090788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a38-144d-40ab-8113-4a0c19b4d662 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:24.091630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a38-144d-40ab-8113-4a0c19b4d662 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:24.092526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a38-144d-40ab-8113-4a0c19b4d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:24.106889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2388/4759] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:24.218047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-154c1a38-144d-40ab-8113-4a0c19b4d662 None None] MFA Rules not processed for user `0e25ddb6c2b944b695d4e3e29ede847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:24.220209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-154c1a38-144d-40ab-8113-4a0c19b4d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:24.450761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2372/4760] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:24.462504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:24.463119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:24.463869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:24.620528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] MFA Rules not processed for user `f40ddba37a5b491f81b9ed09fd577f19`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:24.631976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:24.873064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.928839 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2389/4761] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:24.956940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:24.959943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:24.961136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:25.032953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] MFA Rules not processed for user `f40ddba37a5b491f81b9ed09fd577f19`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:25.038688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:25.066428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2373/4762] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:25.087236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:25.089785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:25.391053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc9b6-20e8-4ac0-b301-c6edcf673373 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:25.429285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:25.431587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:25.436799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:25.436799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:25.459089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:25.462992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:25.507089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2390/4763] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:26.685683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:26.687879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:26.752242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0a83e-a0e2-4be7-98ba-fd252032d548 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:26.771330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:26.773123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:26.773927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:26.774930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] PATH_INFO: `/v3/projects/e0218f64dbab4aeb90de8b2b129e7001` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:26.786228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0218f64dbab4aeb90de8b2b129e7001)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:26.793371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:27.088961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0218f64dbab4aeb90de8b2b129e7001', 'request_id': 'req-f6e44281-74d6-4457-a559-99717c16e2a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:27.127075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0218f64dbab4aeb90de8b2b129e7001', 'request_id': 'req-f6e44281-74d6-4457-a559-99717c16e2a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:27.157068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0218f64dbab4aeb90de8b2b129e7001', 'request_id': 'req-f6e44281-74d6-4457-a559-99717c16e2a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:27.336793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] The token cache is being invalidate because project e0218f64dbab4aeb90de8b2b129e7001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:27.344976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:27.344976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f6e44281-74d6-4457-a559-99717c16e2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:27.357056 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2374/4764] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:26 2022] DELETE /identity/v3/projects/e0218f64dbab4aeb90de8b2b129e7001 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:27.358540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:27.440163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b637-cc7f-42f7-ac7e-e6d783ca51bc service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:27.821218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:27.823296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:27.824424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:27.826955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] PATH_INFO: `/v3/users/14b2f13a53cc4425a5bc6f004874ff95` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:27.831246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b2f13a53cc4425a5bc6f004874ff95)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:27.837414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:28.085032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:28.086277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:28.086831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:51:28.098103 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:28.099832 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:51:28.130755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2375/4765] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:51:28 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:51:28.315586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b2f13a53cc4425a5bc6f004874ff95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:28.321685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b2f13a53cc4425a5bc6f004874ff95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:28.464635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b2f13a53cc4425a5bc6f004874ff95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:28.547593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b2f13a53cc4425a5bc6f004874ff95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:28.630342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-af04cc41-6dba-44a0-a002-f6a0bfcdd3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b2f13a53cc4425a5bc6f004874ff95'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:28.642677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:28.653975 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2391/4766] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:27 2022] DELETE /identity/v3/users/14b2f13a53cc4425a5bc6f004874ff95 => generated 0 bytes in 1296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:29.755581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:29.759181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:30.082450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c1d8c-51f2-49c1-9fe6-81ff1547f37b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:30.102489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:30.103699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:30.104203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:30.105007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:30.114374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:30.148580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:30.235072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:30.236949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:30.237741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:51:30.270656 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:30.272665 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:51:30.296062 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2392/4767] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:51:30 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:51:30.458545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:30.478106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcce990-0a93-4bb9-9d50-6d04530bbabd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:30.498574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2376/4768] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:51:32.642359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:32.646026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:32.996904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fbf06-745e-4e89-97b6-431221a07ca1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:33.039715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:33.040529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:33.041066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:33.041604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] PATH_INFO: `/v3/projects/f81040d96856453a9b7c9ecdbd989470` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:33.044146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81040d96856453a9b7c9ecdbd989470)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:33.058570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:33.372905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81040d96856453a9b7c9ecdbd989470', 'request_id': 'req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:33.704101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81040d96856453a9b7c9ecdbd989470', 'request_id': 'req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:33.729238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81040d96856453a9b7c9ecdbd989470', 'request_id': 'req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:33.770140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] The token cache is being invalidate because project f81040d96856453a9b7c9ecdbd989470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:33.792279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:33.792279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-33f945c6-dd46-49f7-a9b2-7c2ab521bef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:33.792279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2393/4769] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:32 2022] DELETE /identity/v3/projects/f81040d96856453a9b7c9ecdbd989470 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:33.793927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:33.795537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:33.796193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:33.923974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:33.929332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:34.201779 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2377/4770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:34.216988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:34.218368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:34.218987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:34.292822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:34.299364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:34.363390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:34.368376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2394/4771] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:34.403857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c689-59b5-41e0-ae06-464b0053443d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:34.426205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:34.427975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:34.434263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:34.434263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:34.434263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:51:34.435784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:34.439431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:34.507400 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2378/4772] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:51:34.509334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:34.572293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdbae-c4fd-499d-af33-c57b1cd0de4f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:34.606315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:34.607629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:34.620810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:34.622222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:34.624189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:34.630837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:34.891008 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2395/4773] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:34 2022] POST /identity/v3/projects => generated 387 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:34.896332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:34.935787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0649be5-bd06-4207-b7a3-2751e1644ed3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:35.271831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:35.278356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:35.294383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:35.297328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:35.302902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:35.318447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:35.568184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2379/4774] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:34 2022] POST /identity/v3/users => generated 300 bytes in 675 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:35.575310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:35.636512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eba456-d97f-482f-b47e-55ab4337201c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:35.677736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:35.678837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:35.679368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:35.679852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:35.681083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:35.697530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1dfde-3083-4335-911a-f44085afbf88 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:35.785088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2396/4775] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:35.785281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:35.789552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:35.790536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:35.792346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:35.824293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653443dd-fe66-4b69-b547-22fc439defd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:35.857293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:35.858798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:35.859920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:35.860584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] PATH_INFO: `/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6/users/82c6b9645972479aa6bbe4683a9b0f95/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:35.892777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] MFA Rules not processed for user `6d11c1b7cf444372a6baeb027c455d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:35.900756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:35.940815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfe4ac0dfb1411a9f2b989528eadde6, user_id=82c6b9645972479aa6bbe4683a9b0f95, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:35.967425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:36.113373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:36.133433 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2380/4776] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:35 2022] PUT /identity/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6/users/82c6b9645972479aa6bbe4683a9b0f95/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:36.148248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:36.248334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:36.315909 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2397/4777] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:36.456995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77c7e-adf1-47e1-a2e8-96868ce7f2b4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:36.470491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:36.487649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:36.491014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:36.519567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:36.521827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:36.528139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:36.534412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:36.534658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:36.609641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2381/4778] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:36.623498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:36.637380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:36.946966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f1a4-efcc-46ae-87aa-cf36611cbcaf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:37.168351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45291fe3-a81e-465e-a8b7-d535e9e84ba0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:37.204175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:37.205333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:37.205848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:37.209435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:37.215688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:37.249597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:37.260921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:37.260921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:37.263752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:37.278173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:37.365135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:37.365135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:37.447977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2382/4779] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:37.447977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:37.525497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c1358-c127-4fa8-af39-0e0ff5225d26 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:37.577252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:37.616372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:37.617318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:37.618076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] PATH_INFO: `/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6/users/82c6b9645972479aa6bbe4683a9b0f95/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:37.639841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfe4ac0dfb1411a9f2b989528eadde6, user_id=82c6b9645972479aa6bbe4683a9b0f95, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:37.665698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:37.756826 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2383/4780] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:37 2022] PUT /identity/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6/users/82c6b9645972479aa6bbe4683a9b0f95/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:37.762469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:37.774895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:37.977857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:37.980769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efab76d-76e2-46b5-a0d0-56b60c60ffac service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:38.102417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2398/4781] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 1575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:51:38.111657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:38.112244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:38.114202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:38.175439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719c7c-f7dd-4c00-87d4-15e4e3d0060a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:38.212979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:38.214073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:38.215639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:38.218538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] PATH_INFO: `/v3/users/d22886ebf2b34276a9369ee93f9e5457` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:38.223125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22886ebf2b34276a9369ee93f9e5457)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:38.234038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:38.290494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] MFA Rules not processed for user `82c6b9645972479aa6bbe4683a9b0f95`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:38.299083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:38.334382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:38.496273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:38.848806 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2399/4782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 746 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:38.863678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:38.919855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf1980-587d-4a16-9f2e-18d4373afa35 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:38.949161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:38.951431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:38.951431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:38.953194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:38.965475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:38.974428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:39.224461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2400/4783] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:38 2022] POST /identity/v3/projects => generated 385 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:39.228341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:39.318722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22886ebf2b34276a9369ee93f9e5457'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:39.450676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22886ebf2b34276a9369ee93f9e5457'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:39.488545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22886ebf2b34276a9369ee93f9e5457'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:39.561442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22886ebf2b34276a9369ee93f9e5457'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:39.561442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22886ebf2b34276a9369ee93f9e5457'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:39.571589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed699fb-6eef-4ca0-b5bb-7f4645fb0de6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:39.584187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:39.585332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:39.585852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:39.586346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:39.587723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:39.602812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:39.611905 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2384/4784] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:37 2022] DELETE /identity/v3/users/d22886ebf2b34276a9369ee93f9e5457 => generated 0 bytes in 1854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:39.769094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2401/4785] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:39 2022] POST /identity/v3/users => generated 293 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:51:39.781481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:39.784494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:40.210734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07eee-d12b-46a8-a5ec-50485eb8c980 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:40.239592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:40.241948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:40.244555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:40.247883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:40.249527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:40.258776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:40.303907 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2385/4786] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:40.309811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:40.349505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7425-83df-4f00-816a-2b8d670d8479 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:40.372432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:40.373155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:40.375348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:40.375348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:40.378579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:40.392864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5bca0-865f-4c7d-94ad-94cddfb425de admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:40.451408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:40.460808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2402/4787] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:40.478097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720824d-9e5a-4fc4-8146-d98584aaf525 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:40.478630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720824d-9e5a-4fc4-8146-d98584aaf525 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:40.479178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720824d-9e5a-4fc4-8146-d98584aaf525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3720824d-9e5a-4fc4-8146-d98584aaf525 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:51:40.493786 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:40.495800 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:51:40.538009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b91f-aff8-4580-b0ff-e6fd8e1af570 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:40.544702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2403/4788] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:51:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:51:40.545028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:40.545028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:40.545028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:40.545028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] PATH_INFO: `/v3/projects/de0c4e1b5708472ea635d53dbf60bf90/users/1514a2d70e544da3b2c2af9318462bf3/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:40.583713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0c4e1b5708472ea635d53dbf60bf90, user_id=1514a2d70e544da3b2c2af9318462bf3, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:40.593065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:40.720741 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2386/4789] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:40 2022] PUT /identity/v3/projects/de0c4e1b5708472ea635d53dbf60bf90/users/1514a2d70e544da3b2c2af9318462bf3/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:40.749951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:40.750671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:40.751256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:40.896127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] MFA Rules not processed for user `1514a2d70e544da3b2c2af9318462bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:40.899729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:41.145763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:41.149457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2404/4790] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:41.156592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:41.214254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:41.217526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:41.301959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:41.504193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c7f6-4cf8-499f-9bae-240962a2d7d9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:41.545603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:41.547476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:41.548320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:41.549060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] PATH_INFO: `/v3/projects/4387f90f1ad8429bb47aaabfe531871b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:41.555770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4387f90f1ad8429bb47aaabfe531871b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:41.577902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:41.588129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016e34-bc24-4219-99b9-322c0a0acea3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:41.600428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:41.622347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:41.626936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:41.628822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:41.629636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:41.639925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:41.889444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4387f90f1ad8429bb47aaabfe531871b', 'request_id': 'req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:41.921271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4387f90f1ad8429bb47aaabfe531871b', 'request_id': 'req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:41.946125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4387f90f1ad8429bb47aaabfe531871b', 'request_id': 'req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:41.993356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:41.999476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960e17d-e2d7-4691-990d-6599cd6fe84b service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:42.026386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2405/4791] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:42.055215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] The token cache is being invalidate because project 4387f90f1ad8429bb47aaabfe531871b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:42.055215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:42.057284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e78f5e5-eb16-41d4-99b9-3b0ca426431f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:42.068258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2387/4792] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:41 2022] DELETE /identity/v3/projects/4387f90f1ad8429bb47aaabfe531871b => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:42.084096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:42.084891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:42.085572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:42.172893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:42.182324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:42.583518 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2406/4793] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:42.587635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:42.590381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:42.591564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:42.721411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:42.725326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:42.811700 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2388/4794] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:42.813929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:42.847541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76031cf-35ca-4f2d-9413-b62b12082071 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:42.899934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:42.905911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:42.906414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:42.916431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:42.934136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:51:42.934991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:42.943651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:43.018652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2407/4795] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:51:43.025557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:43.076596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b00a2e-00ca-41db-a0e6-356dc8be73ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:43.101895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:43.106865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:43.107457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:43.110011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:43.111241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:43.123933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:43.382443 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2389/4796] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:43 2022] POST /identity/v3/projects => generated 395 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:43.382654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:43.461105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461925b-4d7e-4eda-9687-422cec4db40b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:43.580191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:43.585495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:43.630792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:43.673885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:43.674892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:43.681059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:43.692337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:43.692337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:43.692337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:43.896744 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2408/4797] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:43 2022] POST /identity/v3/users => generated 298 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:51:43.902950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:44.024991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9f4a9-086a-4296-b545-2eda4093cedd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:44.035849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369270f6-4201-49d6-81b3-f651e3c9d1bc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:44.049840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:44.051544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:44.052327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.052704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.053263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.053747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:44.054176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.054985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:44.055575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] PATH_INFO: `/v3/users/82c6b9645972479aa6bbe4683a9b0f95` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:44.058216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:44.058846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c6b9645972479aa6bbe4683a9b0f95)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:44.064043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:44.095311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2409/4798] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:44.099689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:44.159402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f62e-3c3e-4313-99bb-f9a61502d7b6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:44.188215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:44.189345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.189891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.191223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:44.193018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:44.196752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:44.220873 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2410/4799] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:44.244128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:44.269722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efadc8-0d79-443f-8ce9-3e2e90634364 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:44.286916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:44.292447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.295010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.296874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] PATH_INFO: `/v3/projects/43040c4dc3cc4a30a242acaf3630c1b0/users/fc8d97966f144d609bc40298fb9b9f9a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:44.394444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43040c4dc3cc4a30a242acaf3630c1b0, user_id=fc8d97966f144d609bc40298fb9b9f9a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:44.421346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833f0ec-14af-4bed-bb43-c17f2a912af8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:44.572982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c6b9645972479aa6bbe4683a9b0f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:44.671640 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2411/4800] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:44 2022] PUT /identity/v3/projects/43040c4dc3cc4a30a242acaf3630c1b0/users/fc8d97966f144d609bc40298fb9b9f9a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:44.693743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec212f-20f5-4108-8407-f18a195d5b5a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.696977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec212f-20f5-4108-8407-f18a195d5b5a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.698803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec212f-20f5-4108-8407-f18a195d5b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:44.750738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c6b9645972479aa6bbe4683a9b0f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:44.808354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c6b9645972479aa6bbe4683a9b0f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:44.812789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-32ec212f-20f5-4108-8407-f18a195d5b5a None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:44.826348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-32ec212f-20f5-4108-8407-f18a195d5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:44.834544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:44.893597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c6b9645972479aa6bbe4683a9b0f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:44.896187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5bf422e0-6925-41bc-8704-23509f0afdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c6b9645972479aa6bbe4683a9b0f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:44.941873 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2390/4801] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:43 2022] DELETE /identity/v3/users/82c6b9645972479aa6bbe4683a9b0f95 => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:44.942704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:44.943343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:44.944775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:45.081331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:45.090865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:45.141870 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2412/4802] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:45.165412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:45.165933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:45.166441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:45.253315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:45.258998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:45.447610 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2391/4803] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:45.540518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:45.543422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:45.563402 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2413/4804] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:45.583184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:45.589657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:45.780493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:45.808001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7449e4-645f-47ac-97d1-33328572064d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:45.826369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:45.827978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:45.828785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:45.829499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:45.877806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:45.881264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98278ee0-07a0-4bb7-bab2-b6000b5a4b01 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:45.945451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2392/4805] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:51:46.041213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6846d-62ae-4397-a4d4-b445aaa401d4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:46.061290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:46.062451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:46.062962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:46.063508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:46.097089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:46.100129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c55a-7ebf-4ea8-93b5-5e077a561418 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:46.154771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2414/4806] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:51:46.233808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d3f-5792-4e39-b09e-de8b04154353 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:46.234703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d3f-5792-4e39-b09e-de8b04154353 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:46.234895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac5d3f-5792-4e39-b09e-de8b04154353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:46.363469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f9ac5d3f-5792-4e39-b09e-de8b04154353 None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:46.363469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f9ac5d3f-5792-4e39-b09e-de8b04154353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:46.409201 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2393/4807] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:46.523001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b0-0dc9-4d3d-bd27-8179b9746928 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:46.523746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b0-0dc9-4d3d-bd27-8179b9746928 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:46.524195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe45b0-0dc9-4d3d-bd27-8179b9746928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:46.617458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ebe45b0-0dc9-4d3d-bd27-8179b9746928 None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:46.620304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ebe45b0-0dc9-4d3d-bd27-8179b9746928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:46.636739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2415/4808] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:46.761842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:46.762348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:46.762842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:46.853227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:46.855862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:46.904936 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2394/4809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:47.018531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cd06a-20fe-4055-a439-307b55d58883 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:47.018976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cd06a-20fe-4055-a439-307b55d58883 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:47.027805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cd06a-20fe-4055-a439-307b55d58883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:47.111001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f9cd06a-20fe-4055-a439-307b55d58883 None None] MFA Rules not processed for user `fc8d97966f144d609bc40298fb9b9f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:47.131432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f9cd06a-20fe-4055-a439-307b55d58883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:47.170398 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2416/4810] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:47.236716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:47.237568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:47.298879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b7f76-cc33-461b-9f36-ad689fa81118 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:47.344964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:47.346185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:47.346675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:47.347188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] PATH_INFO: `/v3/users/fc8d97966f144d609bc40298fb9b9f9a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:47.352034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8d97966f144d609bc40298fb9b9f9a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:47.363460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:47.739708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8d97966f144d609bc40298fb9b9f9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:47.955445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8d97966f144d609bc40298fb9b9f9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:47.988908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8d97966f144d609bc40298fb9b9f9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:48.012353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:48.050093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8d97966f144d609bc40298fb9b9f9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:48.052008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8d97966f144d609bc40298fb9b9f9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:48.094365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2395/4811] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:47 2022] DELETE /identity/v3/users/fc8d97966f144d609bc40298fb9b9f9a => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:48.102928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:48.103111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:48.103647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:48.187385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:48.191471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:48.542723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2417/4812] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:48.623757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:48.628319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:48.842004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e285f2-4cf6-4509-976a-6a06abb2c027 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:48.863923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:48.867279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:48.869564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:48.872796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:48.914431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:48.918459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:48.968538 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2396/4813] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:50.309580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:50.310637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:50.353571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00500bb-7035-4953-981c-32079a84fb46 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:50.374431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:50.375922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:50.376740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:50.378019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] PATH_INFO: `/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:50.385566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfe4ac0dfb1411a9f2b989528eadde6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:50.400243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:50.741055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfe4ac0dfb1411a9f2b989528eadde6', 'request_id': 'req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:50.859747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfe4ac0dfb1411a9f2b989528eadde6', 'request_id': 'req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:50.920767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfe4ac0dfb1411a9f2b989528eadde6', 'request_id': 'req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:50.993170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] The token cache is being invalidate because project ddfe4ac0dfb1411a9f2b989528eadde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:50.994886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:50.996497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.000283 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2418/4814] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:50 2022] DELETE /identity/v3/projects/ddfe4ac0dfb1411a9f2b989528eadde6 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:51.006994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:51.037195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a61c7-61bf-41a8-986a-dbdc203d09ef service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:51.276512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:51.280966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:51.280966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:51.280966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] PATH_INFO: `/v3/users/1514a2d70e544da3b2c2af9318462bf3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:51.280966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1514a2d70e544da3b2c2af9318462bf3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:51.284624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:51.639960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1514a2d70e544da3b2c2af9318462bf3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.820165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1514a2d70e544da3b2c2af9318462bf3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.858379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1514a2d70e544da3b2c2af9318462bf3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.860496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:51.866739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:51.900431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1514a2d70e544da3b2c2af9318462bf3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.903906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eed5527c-cb25-4cc6-8cc4-4081adaa6ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1514a2d70e544da3b2c2af9318462bf3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:51.928943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2397/4815] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:51 2022] DELETE /identity/v3/users/1514a2d70e544da3b2c2af9318462bf3 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:51.949311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1997d-61c9-477e-a0dc-9ca1a0b4ad97 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:52.051815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:52.227232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:52.229017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:52.229540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:52.230264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] PATH_INFO: `/v3/projects/43040c4dc3cc4a30a242acaf3630c1b0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:52.233738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43040c4dc3cc4a30a242acaf3630c1b0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:52.242558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:52.610623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43040c4dc3cc4a30a242acaf3630c1b0', 'request_id': 'req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:52.753216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43040c4dc3cc4a30a242acaf3630c1b0', 'request_id': 'req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:52.789732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43040c4dc3cc4a30a242acaf3630c1b0', 'request_id': 'req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:52.857279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] The token cache is being invalidate because project 43040c4dc3cc4a30a242acaf3630c1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:52.857966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:52.860132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3ebc5c7-1e17-4b0a-b238-9aa015db51f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:52.873879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2419/4816] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:51 2022] DELETE /identity/v3/projects/43040c4dc3cc4a30a242acaf3630c1b0 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:51:52.883783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:52.885422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:52.886170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:52.983741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:52.989950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:53.013829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:53.287243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2398/4817] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:53.302694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:53.303535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:53.304062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:53.393600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:53.395973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:53.427816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2420/4818] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:53.436094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:53.480657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438c6f-62f9-4768-90f1-c06e1ca66371 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:53.514357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:53.521768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:53.521768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:53.521768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:53.521768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:51:53.521768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:53.529155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:53.645633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:53.658725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2399/4819] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:51:53.671981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e21b-2b07-4e2f-83da-451c719843fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:53.699637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:53.700829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:53.701523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:53.701844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:53.703129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:53.716798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:53.972854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:53.991722 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2421/4820] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:53 2022] POST /identity/v3/projects => generated 381 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:54.002824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3921f6-d5f4-4ebb-b7bf-a7abe355e196 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:54.266861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:54.269216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:54.269761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:54.270262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:54.271551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:54.280530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dead6e8-b2f0-4944-8936-435f0b43d969 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:54.466992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:54.483921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2400/4821] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:53 2022] POST /identity/v3/users => generated 291 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:51:54.507196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230123a-df52-4103-a503-848de1f77738 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:54.528324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:54.529533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:54.530033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:54.530547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:54.534907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:54.541033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:54.621310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:54.622247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:54.623778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:54.635327 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2422/4822] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:54.641383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:54.702344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] MFA Rules not processed for user `0e25ddb6c2b944b695d4e3e29ede847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:54.709315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:54.714906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d913b-7c5b-4a92-9b6e-ac9d9ee79735 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:54.735357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:54.742197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:54.743003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:54.743787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:54.745354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:54.753232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:54.812732 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2423/4823] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:51:54.816939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:54.854109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3639-78cb-44bd-81e3-653d4277e623 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:54.869290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:54.884118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:54.884787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:54.885294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] PATH_INFO: `/v3/projects/a64b7e8684dc4deabb72e98df57411a2/users/ea9d8a6969e749fa957419b94b98fe90/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:54.959937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64b7e8684dc4deabb72e98df57411a2, user_id=ea9d8a6969e749fa957419b94b98fe90, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:54.978082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5d84e-b130-4473-80eb-9473c330fe68 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:55.006848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2401/4824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:51:55.085310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:55.088073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:55.173594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2424/4825] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:51:54 2022] PUT /identity/v3/projects/a64b7e8684dc4deabb72e98df57411a2/users/ea9d8a6969e749fa957419b94b98fe90/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:51:55.186760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:55.191410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:55.192071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:55.222511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:55.322530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:55.324937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:55.389381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96e4e9-e61c-46c1-a440-7713e6f5d4c9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:55.535743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:55.733684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2425/4826] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:55.734250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:55.735343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:55.735946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:55.736497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:55.740734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:55.936080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:55.941030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:56.031015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:56.049747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:56.134910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2402/4827] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 1050 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:51:56.221742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ae959-6885-44bf-837f-0cfcc0bf79af None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:56.231590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:56.234548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:56.234991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:56.236089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:56.286271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:56.294893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50ae1-c92a-4e8b-8fb4-64a2cdc53fd5 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:56.351260 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2426/4828] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:57.500693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:57.505799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:57.563579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89c1e-dc27-43dd-a949-19baa053cf1d service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:57.578172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:57.580314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:57.581128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:57.581921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] PATH_INFO: `/v3/projects/de0c4e1b5708472ea635d53dbf60bf90` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:57.587091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0c4e1b5708472ea635d53dbf60bf90)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:57.594101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:58.006647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0c4e1b5708472ea635d53dbf60bf90', 'request_id': 'req-9911175f-b679-4bef-b40c-defd7414d1f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:58.020984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1978fb-c723-42bd-a962-33f89715013e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.023266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1978fb-c723-42bd-a962-33f89715013e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.024541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1978fb-c723-42bd-a962-33f89715013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.043519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0c4e1b5708472ea635d53dbf60bf90', 'request_id': 'req-9911175f-b679-4bef-b40c-defd7414d1f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-db1978fb-c723-42bd-a962-33f89715013e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:51:58.052158 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:51:58.054009 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:51:58.089073 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2427/4829] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:51:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:51:58.105534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0c4e1b5708472ea635d53dbf60bf90', 'request_id': 'req-9911175f-b679-4bef-b40c-defd7414d1f1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:58.276730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] The token cache is being invalidate because project de0c4e1b5708472ea635d53dbf60bf90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:51:58.277887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:58.279420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:58.282457 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2403/4830] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:57 2022] DELETE /identity/v3/projects/de0c4e1b5708472ea635d53dbf60bf90 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:51:58.294247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823649-27cd-456a-bac6-4f327356dfb6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.294852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823649-27cd-456a-bac6-4f327356dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.295687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823649-27cd-456a-bac6-4f327356dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.361960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-53823649-27cd-456a-bac6-4f327356dfb6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:58.366734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-53823649-27cd-456a-bac6-4f327356dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:58.619355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:58.619355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:58.635948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2428/4831] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:58.662887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.663948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.664855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.670672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911175f-b679-4bef-b40c-defd7414d1f1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:58.706798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:58.708434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.708926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.709420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] PATH_INFO: `/v3/users/f40ddba37a5b491f81b9ed09fd577f19` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.712003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40ddba37a5b491f81b9ed09fd577f19)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:58.716241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:58.718551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:51:58.724307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:51:58.743791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:58.763677 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2429/4832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:51:58.770928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:58.819863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d449ff4-bcf6-44f6-8990-1a0adcd85e10 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:58.837445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:58.838622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.840177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.840802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.842419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:51:58.844584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:58.848554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:58.891617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2430/4833] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:51:58.893302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:58.918604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a91bc-7cac-4265-aa1e-f4aabcd23242 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:58.937802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:58.939912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:58.940521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:58.940965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:58.943499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:58.949535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:59.233850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2431/4834] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:51:58 2022] POST /identity/v3/projects => generated 367 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:51:59.244523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:59.342763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40ddba37a5b491f81b9ed09fd577f19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:59.453693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:59.514668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e130e9-6832-4f1a-a85e-803ccb9f3c6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:51:59.527795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:51:59.529174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:51:59.529760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:51:59.530257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:51:59.534200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:51:59.539983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40ddba37a5b491f81b9ed09fd577f19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:59.562822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:51:59.575029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40ddba37a5b491f81b9ed09fd577f19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:59.691853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40ddba37a5b491f81b9ed09fd577f19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:59.694515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40ddba37a5b491f81b9ed09fd577f19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:51:59.717578 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2404/4835] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:51:58 2022] DELETE /identity/v3/users/f40ddba37a5b491f81b9ed09fd577f19 => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:51:59.818544 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2432/4836] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:51:59 2022] POST /identity/v3/users => generated 284 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:51:59.825506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:51:59.830553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:00.072446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b1a5-8f1e-4dc4-9162-bb8b03d9aed8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:00.085842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:00.087438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:00.088629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:00.089874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:00.092016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:00.095803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:00.130998 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2405/4837] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:00.137218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:00.169441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0676-d2be-46b7-996a-fc321945a7c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:00.187821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:00.190326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:00.191467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:00.192301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:00.195454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:00.200474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678b77a-937f-4b10-96d6-5190ed9d583b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:00.238918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2433/4838] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:52:00.242506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:00.272083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0a35-3457-4096-a007-f9e02a9d0b13 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:00.282472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:00.284073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:00.284903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:00.285579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] PATH_INFO: `/v3/projects/0ba238923ab44c4bb4f02649df182699/users/33ff40d01d584148b04aeff37b21f9a1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:00.322533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba238923ab44c4bb4f02649df182699, user_id=33ff40d01d584148b04aeff37b21f9a1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:00.330080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:00.545654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2406/4839] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:00 2022] PUT /identity/v3/projects/0ba238923ab44c4bb4f02649df182699/users/33ff40d01d584148b04aeff37b21f9a1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:52:00.556689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:00.556689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:00.557137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:00.654880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] MFA Rules not processed for user `33ff40d01d584148b04aeff37b21f9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:00.660656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:00.859334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:00.865738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:00.964180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2434/4840] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:00.969541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:01.225878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:01.260057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104732-9325-4e62-92d1-e14f283254be admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:01.274459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:01.276736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:01.277653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:01.278600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] PATH_INFO: `/v3/projects/54d1c146b5ce415cb43490a0ae2130cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:01.281759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d1c146b5ce415cb43490a0ae2130cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:01.291192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:01.338561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241403-479e-4b94-b11e-336fb1091737 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:01.383810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:01.385581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:01.388925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:01.397759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:01.402649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:01.419520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:01.701090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d1c146b5ce415cb43490a0ae2130cb', 'request_id': 'req-ac3e529a-706c-4e12-a92e-26be2157fd49'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:01.726439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d1c146b5ce415cb43490a0ae2130cb', 'request_id': 'req-ac3e529a-706c-4e12-a92e-26be2157fd49'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:01.761530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d1c146b5ce415cb43490a0ae2130cb', 'request_id': 'req-ac3e529a-706c-4e12-a92e-26be2157fd49'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:01.767519 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2435/4841] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:00 2022] POST /identity/v3/projects => generated 369 bytes in 795 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:52:01.771518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:01.924916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] The token cache is being invalidate because project 54d1c146b5ce415cb43490a0ae2130cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:01.926592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:01.930497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ac3e529a-706c-4e12-a92e-26be2157fd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:01.938957 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2407/4842] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:00 2022] DELETE /identity/v3/projects/54d1c146b5ce415cb43490a0ae2130cb => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:52:01.939798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:01.963111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60a35-3190-4e2b-8c0e-cb30216b56cc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:01.964365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60a35-3190-4e2b-8c0e-cb30216b56cc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:01.965256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60a35-3190-4e2b-8c0e-cb30216b56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.047829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-82d60a35-3190-4e2b-8c0e-cb30216b56cc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:02.051317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-82d60a35-3190-4e2b-8c0e-cb30216b56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:02.070440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5014f60-1b1b-4625-8b57-f9b3ce72fad2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:02.101235 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2408/4843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:52:02.103638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:02.104761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.105342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.107978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.110245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:02.115482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.115970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.116900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.125577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:02.193977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:02.197019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:02.217307 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2409/4844] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:52:02.224758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:02.272149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04d06c-e9da-4508-b3ef-640cebbc1f76 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:02.289762 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2436/4845] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:01 2022] POST /identity/v3/users => generated 291 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:02.296703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:02.301657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:02.307829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:02.314040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.316151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.318742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.322023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:52:02.324095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:02.336967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:02.358405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be97af-4244-4224-9859-0c4ae27f7010 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:02.379526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:02.380749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.381265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.381897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.383048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:02.391213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:02.438377 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2410/4846] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:52:02.443513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:02.446830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2437/4847] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:52:02.453685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:02.504301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1350a-c440-472c-a432-1b5cf49d8cad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:02.504602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c3e53-1f97-452a-acf6-3f81b70daae6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:02.539196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:02.542060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:02.542375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.543310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.543836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.544302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] PATH_INFO: `/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577/users/9bd1086e2cd146fd97bf82496d1ac198/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.549970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.549970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.549970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:02.562221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:02.586246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae9ee00edfe4b2bb2a368c13adb4577, user_id=9bd1086e2cd146fd97bf82496d1ac198, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:02.593691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a1e1a-a1e3-4c77-a6d1-0875015c6451 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:02.799039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2438/4848] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:02 2022] PUT /identity/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577/users/9bd1086e2cd146fd97bf82496d1ac198/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:02.803886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:02.803886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:02.803886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:02.823635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2411/4849] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:02 2022] POST /identity/v3/projects => generated 381 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:02.825284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:02.901310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] MFA Rules not processed for user `6d11c1b7cf444372a6baeb027c455d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:02.903905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:03.121398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1e96c-6764-49ff-be49-7ccaee2deebf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:03.150994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:03.162067 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2439/4850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:03.163858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.164724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:03.165832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.166368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.167698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:03.175081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:03.216321 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2412/4851] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:03.218365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9038511-4c89-4a1c-bbad-7d018e100cef None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:03.224643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:03.246181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:03.254074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.256935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.257433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.260580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:03.269839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:03.274911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22800-b0fc-4a90-8549-225751a54040 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:03.303536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:03.304717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.311034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.311034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] PATH_INFO: `/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577/users/9bd1086e2cd146fd97bf82496d1ac198/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.323414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae9ee00edfe4b2bb2a368c13adb4577, user_id=9bd1086e2cd146fd97bf82496d1ac198, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:03.333911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7011e-76a8-437f-8a6f-3d3b5aad3159 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:03.380414 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2413/4852] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:03 2022] PUT /identity/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577/users/9bd1086e2cd146fd97bf82496d1ac198/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:52:03.406695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.415192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.415192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.558359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] MFA Rules not processed for user `9bd1086e2cd146fd97bf82496d1ac198`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:03.562641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:03.604727 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2440/4853] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:03 2022] POST /identity/v3/users => generated 291 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:03.614021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:03.641165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3316-1eb5-4323-b897-fb4412feb642 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:03.864120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:03.866871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.871075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.872924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.875185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:03.879880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:03.915355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2441/4854] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:03.921310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:03.945373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb0d3a-db35-4229-945c-d1d763832cbf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:03.958369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:03.960174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:03.960945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:03.972754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:03.974948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:03.978546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:04.011500 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2442/4855] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:04.013561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:04.035591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c7f0-f3c2-4ff3-8fdb-ac4b56a04391 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:04.050839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:04.052383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:04.053015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:04.055564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] PATH_INFO: `/v3/projects/fa8ddddd74fb455ba31fac9874139134/users/7e735f5c6064450fbfc9f400c215bd41/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:04.099214 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2414/4856] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 693 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:52:04.100233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:04.111428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8ddddd74fb455ba31fac9874139134, user_id=7e735f5c6064450fbfc9f400c215bd41, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:04.120024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad548-c6e8-4b55-9895-448dbc1e9fbb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:04.134675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:04.137688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:04.263364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2443/4857] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:04 2022] PUT /identity/v3/projects/fa8ddddd74fb455ba31fac9874139134/users/7e735f5c6064450fbfc9f400c215bd41/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:04.273187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef56ee-8fa1-4815-8fb8-d48de3c98efc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:04.273625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef56ee-8fa1-4815-8fb8-d48de3c98efc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:04.274065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef56ee-8fa1-4815-8fb8-d48de3c98efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:04.364792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8eef56ee-8fa1-4815-8fb8-d48de3c98efc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:04.367422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8eef56ee-8fa1-4815-8fb8-d48de3c98efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:04.372857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68534-874c-4cd8-bacd-3ee884cb7413 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:04.542775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:04.605042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:04.615617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:04.618808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:04.622046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:04.679360 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2444/4858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:04.870227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b931-d097-4331-9895-b2819295640b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:04.872100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b931-d097-4331-9895-b2819295640b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:04.872778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896b931-d097-4331-9895-b2819295640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e896b931-d097-4331-9895-b2819295640b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:52:04.916490 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:04.918479 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:52:04.921433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2445/4859] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:52:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:52:04.966773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:04.975310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:05.040837 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2415/4860] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 907 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:52:05.190993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896b931-d097-4331-9895-b2819295640b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:05.194425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e896b931-d097-4331-9895-b2819295640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:05.248872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896b931-d097-4331-9895-b2819295640b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:05.268960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:05.272612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:05.272612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:05.272612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:05.314834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:05.320149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbd79-8b44-4050-8078-88d88159a008 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:05.365999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2446/4861] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:16.103497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:16.135777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41208d0-63e0-47c3-8745-323a91d51f09 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:16.147495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:16.148755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:16.149332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:16.149962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] PATH_INFO: `/v3/users/33ff40d01d584148b04aeff37b21f9a1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:16.153893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ff40d01d584148b04aeff37b21f9a1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:16.158854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:16.171760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:16.377963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:16.551783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ff40d01d584148b04aeff37b21f9a1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:16.680629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ff40d01d584148b04aeff37b21f9a1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:16.744547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ff40d01d584148b04aeff37b21f9a1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:16.888215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ff40d01d584148b04aeff37b21f9a1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:16.892218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ff40d01d584148b04aeff37b21f9a1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:16.912413 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2416/4862] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:52:16 2022] DELETE /identity/v3/users/33ff40d01d584148b04aeff37b21f9a1 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:16.920886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:16.921330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:16.922294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:16.992080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:16.995969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:17.252596 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2447/4863] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:17.394972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:17.397664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:17.671847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce284beb-1d70-4a87-b0b0-b77f202b6319 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:17.693478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:17.695356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:17.699546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:17.702378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:17.758149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:17.761680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:17.800663 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2417/4864] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:21.440557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:21.445110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:21.500498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0e57-95a0-44f3-b3b9-7309df7826f9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:21.527886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:21.533267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:21.535886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:21.538948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] PATH_INFO: `/v3/projects/0ba238923ab44c4bb4f02649df182699` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:21.544168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba238923ab44c4bb4f02649df182699)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:21.559363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:21.895779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba238923ab44c4bb4f02649df182699', 'request_id': 'req-26ed7860-0561-4b58-bbdd-3dc431c6da3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:21.990303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba238923ab44c4bb4f02649df182699', 'request_id': 'req-26ed7860-0561-4b58-bbdd-3dc431c6da3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:22.014337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba238923ab44c4bb4f02649df182699', 'request_id': 'req-26ed7860-0561-4b58-bbdd-3dc431c6da3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:22.075308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] The token cache is being invalidate because project 0ba238923ab44c4bb4f02649df182699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:22.075844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:22.080212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-26ed7860-0561-4b58-bbdd-3dc431c6da3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:22.086288 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2448/4865] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:21 2022] DELETE /identity/v3/projects/0ba238923ab44c4bb4f02649df182699 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:22.092884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:22.124956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16814-645a-4df9-9325-950b4aa768df service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:22.481087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:22.482877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:22.488046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:22.488813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] PATH_INFO: `/v3/users/9bd1086e2cd146fd97bf82496d1ac198` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:22.494250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd1086e2cd146fd97bf82496d1ac198)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:22.509496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:22.743282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:22.937104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd1086e2cd146fd97bf82496d1ac198'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:23.040095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd1086e2cd146fd97bf82496d1ac198'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:23.078395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd1086e2cd146fd97bf82496d1ac198'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:23.179360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd1086e2cd146fd97bf82496d1ac198'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:23.181478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd1086e2cd146fd97bf82496d1ac198'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:23.212077 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2418/4866] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:52:22 2022] DELETE /identity/v3/users/9bd1086e2cd146fd97bf82496d1ac198 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:28.206154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2cce-6cd9-4913-96d7-b263b1430447 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:28.207059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2cce-6cd9-4913-96d7-b263b1430447 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:28.207496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2cce-6cd9-4913-96d7-b263b1430447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:28.244314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:28.247968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:28.299380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-324f2cce-6cd9-4913-96d7-b263b1430447 None None] MFA Rules not processed for user `6d11c1b7cf444372a6baeb027c455d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:28.305909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-324f2cce-6cd9-4913-96d7-b263b1430447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:28.568226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04721e1-b3ec-46b5-9307-e422b9f68a47 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:28.587345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:28.605440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:28.606486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:28.607258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] PATH_INFO: `/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:28.611107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae9ee00edfe4b2bb2a368c13adb4577)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:28.618430 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2449/4867] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:28.621956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:28.906435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae9ee00edfe4b2bb2a368c13adb4577', 'request_id': 'req-d67e3def-7cb8-404f-a213-a731d3eef10a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:28.937091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae9ee00edfe4b2bb2a368c13adb4577', 'request_id': 'req-d67e3def-7cb8-404f-a213-a731d3eef10a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:28.956722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae9ee00edfe4b2bb2a368c13adb4577', 'request_id': 'req-d67e3def-7cb8-404f-a213-a731d3eef10a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:29.081857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] The token cache is being invalidate because project dae9ee00edfe4b2bb2a368c13adb4577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:29.082224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:29.083075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d67e3def-7cb8-404f-a213-a731d3eef10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:29.085327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2419/4868] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:28 2022] DELETE /identity/v3/projects/dae9ee00edfe4b2bb2a368c13adb4577 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:29.094833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:29.095847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:29.096351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:29.162406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:29.167979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:29.298191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:29.431814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2450/4869] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:29.442293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2d21-2280-4a12-af54-90b797b9d4b5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:29.443303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2d21-2280-4a12-af54-90b797b9d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:29.443551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2d21-2280-4a12-af54-90b797b9d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:29.507270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-70ba2d21-2280-4a12-af54-90b797b9d4b5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:29.510272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-70ba2d21-2280-4a12-af54-90b797b9d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:29.526693 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2420/4870] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:29.533256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:29.555317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95f18-f6a7-4fcf-8e7e-abe3c8aa0204 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:29.567433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:29.569487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:29.571493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:29.572324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:29.574045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:52:29.574982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:29.579912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:29.621423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:29.622548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:29.623458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:29.656122 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2451/4871] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:52:29.660491 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:29.663248 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:52:29.668122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:29.676728 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2421/4872] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:52:29.732416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951f9-1985-4d44-87ea-34dbe3b52fb2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:29.757232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:29.758373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:29.758880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:29.759396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:29.774197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:29.780782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:30.048749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2452/4873] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:29 2022] POST /identity/v3/projects => generated 383 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:30.049224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:30.168095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:30.295466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14ebf-a1c2-4a35-81a2-41a9f01021d5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:30.315205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:30.316961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:30.317725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:30.318449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:30.320333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:30.325170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:30.574483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2422/4874] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:30 2022] POST /identity/v3/users => generated 292 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:30.582224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:30.610008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989830-0f28-4c65-ab4b-12187f7d5307 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:30.623475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:30.624695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:30.625953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:30.627008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:30.629677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:30.640462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:30.664756 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2453/4875] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:30.671293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:30.698184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8056-f6aa-426b-b914-744fef256e43 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:30.710313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:30.714500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:30.715013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:30.715520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:30.716795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:30.732916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132578a4-a6db-445d-9eae-6a616a5b0ec8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:30.752509 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2423/4876] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:30.754071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:30.781682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41c6c-d10e-4187-bcdd-3dfeda62b744 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:30.794717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:30.796189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:30.797587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:30.798396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] PATH_INFO: `/v3/projects/75d41fde9234405ea6611897f9a4bdc0/users/46355569b9cc4b04b989fd141fc7530d/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:30.874028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d41fde9234405ea6611897f9a4bdc0, user_id=46355569b9cc4b04b989fd141fc7530d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:30.881737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:31.051269 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2454/4877] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:30 2022] PUT /identity/v3/projects/75d41fde9234405ea6611897f9a4bdc0/users/46355569b9cc4b04b989fd141fc7530d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:31.069838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed1036-527f-46aa-87df-abae98f7e175 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:31.070346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed1036-527f-46aa-87df-abae98f7e175 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:31.073251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed1036-527f-46aa-87df-abae98f7e175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:31.248884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-61ed1036-527f-46aa-87df-abae98f7e175 None None] MFA Rules not processed for user `46355569b9cc4b04b989fd141fc7530d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:31.256541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-61ed1036-527f-46aa-87df-abae98f7e175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:31.544031 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2424/4878] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:31.586139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:31.589931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:31.862108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa43b-3259-432e-90e4-2c508761ac14 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:31.878557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:31.880342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:31.881125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:31.882124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:31.916176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:31.919490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595242eb-b95f-4e6c-8c0a-e9d7f486f4e7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:31.940577 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2455/4879] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:37.136473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:37.138462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:37.139491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:37.332068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] MFA Rules not processed for user `7e735f5c6064450fbfc9f400c215bd41`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:37.338056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:37.559101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2425/4880] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:37.564106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156a66-b04c-4114-be42-ab2da75289f0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:37.565875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156a66-b04c-4114-be42-ab2da75289f0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:37.566676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156a66-b04c-4114-be42-ab2da75289f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:37.607656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a0156a66-b04c-4114-be42-ab2da75289f0 None None] MFA Rules not processed for user `7e735f5c6064450fbfc9f400c215bd41`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:37.610902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a0156a66-b04c-4114-be42-ab2da75289f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:37.653033 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2456/4881] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:37.690477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:37.696785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:37.696785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:37.700694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:37.711945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:37.886324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:37.888576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] MFA Rules not processed for user `ea9d8a6969e749fa957419b94b98fe90`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:37.897691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:38.026247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc7b7-a321-4243-8009-1eb5468d09cd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:38.039755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:38.041002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:38.042563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:38.043262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:38.064092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:38.068024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:38.089261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2426/4882] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:52:38.128810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:38.293651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2457/4883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:38.332888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:38.345055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:38.444490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21be103-a8fa-4a8a-b612-050227f7cd4a service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:38.476001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:38.477163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:38.477662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:38.478972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:38.516691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:38.519934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f38f-839e-488c-a022-d91e4a879cb2 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:38.569765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2427/4884] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:39.172154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:39.176721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:39.511271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058150c5-2396-4446-aaee-c69c9b4f1fcb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:39.539050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:39.540412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:39.540869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:39.541313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] PATH_INFO: `/v3/users/0e25ddb6c2b944b695d4e3e29ede847f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:39.546533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e25ddb6c2b944b695d4e3e29ede847f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:39.554505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:39.792759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537696-5d46-4f98-941a-807174082192 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:39.793710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537696-5d46-4f98-941a-807174082192 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:39.793710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537696-5d46-4f98-941a-807174082192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-5a537696-5d46-4f98-941a-807174082192 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:52:39.809319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:52:39.812397 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:52:39.840150 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2428/4885] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:52:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 20:52:40.030113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e25ddb6c2b944b695d4e3e29ede847f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:40.032294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e25ddb6c2b944b695d4e3e29ede847f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:40.171129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e25ddb6c2b944b695d4e3e29ede847f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:40.219303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e25ddb6c2b944b695d4e3e29ede847f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:40.258072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3885010e-9386-456c-a920-80206f9a5849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e25ddb6c2b944b695d4e3e29ede847f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:40.282699 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2458/4886] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:52:39 2022] DELETE /identity/v3/users/0e25ddb6c2b944b695d4e3e29ede847f => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:41.875232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a537696-5d46-4f98-941a-807174082192 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:41.881514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a537696-5d46-4f98-941a-807174082192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:42.217970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a537696-5d46-4f98-941a-807174082192 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:42.245255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:42.246429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:42.246931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:42.247533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] PATH_INFO: `/v3/projects/6006071429214a518602cecf8646892a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:42.257111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6006071429214a518602cecf8646892a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:42.261110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:42.602551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6006071429214a518602cecf8646892a', 'request_id': 'req-a9cf4d08-7189-4e90-8a4e-46adc1283e88'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:42.653817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6006071429214a518602cecf8646892a', 'request_id': 'req-a9cf4d08-7189-4e90-8a4e-46adc1283e88'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:42.685885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6006071429214a518602cecf8646892a', 'request_id': 'req-a9cf4d08-7189-4e90-8a4e-46adc1283e88'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:42.797282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] The token cache is being invalidate because project 6006071429214a518602cecf8646892a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:42.801364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:42.806286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a9cf4d08-7189-4e90-8a4e-46adc1283e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:42.830351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2429/4887] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:41 2022] DELETE /identity/v3/projects/6006071429214a518602cecf8646892a => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:42.841794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:42.843459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:42.845472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:42.956692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:42.959761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:43.308156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:43.309115 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2459/4888] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:43.310217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:43.311499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:43.462030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:43.468762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:43.532723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2430/4889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:43.541210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:43.564702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:43.584507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4f66-1adf-404a-b0dc-4f4a19ba3dd2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:43.609661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:43.611506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:43.612230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:43.613018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:43.623504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:52:43.625630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:43.629397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:43.692726 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2460/4890] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:52:43.694858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:43.724270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b8ff5-f212-4319-ba2c-c19929a424ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:43.758281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:43.759685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:43.760338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:43.760885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:43.762349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:43.766553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:43.951984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:43.971212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2431/4891] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:43.975537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:44.027078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772efe20-43e1-4eae-a22f-dbd00e4300d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:44.270809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:44.272402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:44.273388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:44.274161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:44.275679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:44.279461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:44.463219 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2461/4892] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:43 2022] POST /identity/v3/users => generated 287 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:44.466157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:44.536094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f188bf-1a85-4824-9432-afedf19ee0dd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:44.567694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:44.568777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:44.569228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:44.569621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:44.570907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:44.576569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:44.628815 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2432/4893] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:52:44.634321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:44.680589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d348-47b3-49ec-abef-a91225a00bef admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:44.714131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:44.720682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:44.723370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:44.726166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:44.731081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:44.741927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f86b68-ea83-47dd-a051-765a2ac2e8ac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:44.805133 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2462/4894] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:44.812579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:44.846843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875dec-0ed5-4b32-ad43-368fce44ccd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:44.882614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:44.884350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:44.885490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:44.886901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] PATH_INFO: `/v3/projects/d31cc90641634694a29b52dda2392c28/users/b25e38bf6d854e40bbc93ff22664c846/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:44.989106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31cc90641634694a29b52dda2392c28, user_id=b25e38bf6d854e40bbc93ff22664c846, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:45.003273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:45.203211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2433/4895] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:44 2022] PUT /identity/v3/projects/d31cc90641634694a29b52dda2392c28/users/b25e38bf6d854e40bbc93ff22664c846/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:45.214948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:45.215747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:45.216457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:45.349375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] MFA Rules not processed for user `b25e38bf6d854e40bbc93ff22664c846`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:45.352134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:45.654864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2463/4896] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:45.707879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:45.711073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:46.124560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709d37-4eae-485c-851c-63ba46803839 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:46.152527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:46.153464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:46.153912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:46.154335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:46.187866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:46.196541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:46.241350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2434/4897] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:46.998543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:47.177782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fffe9-37ca-4a73-a02d-d3fdbc2dd4b6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:47.194900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:47.196275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:47.196936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:47.197309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] PATH_INFO: `/v3/users/b25e38bf6d854e40bbc93ff22664c846` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:47.199804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25e38bf6d854e40bbc93ff22664c846)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:47.205000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:47.209119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:47.404579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:47.410135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:47.649589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25e38bf6d854e40bbc93ff22664c846'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:47.652989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25e38bf6d854e40bbc93ff22664c846'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:47.769213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254531ff-4d31-42e6-bd90-f000d967d601 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:47.790946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:47.793109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:47.793944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:47.800302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25e38bf6d854e40bbc93ff22664c846'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:47.817185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:47.834762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:47.896464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25e38bf6d854e40bbc93ff22664c846'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:47.928822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:47.940551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-06e447cf-3c04-45c7-9d8d-93b5bf3c7e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25e38bf6d854e40bbc93ff22664c846'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:47.959475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:47.980984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2464/4898] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:52:46 2022] DELETE /identity/v3/users/b25e38bf6d854e40bbc93ff22664c846 => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:52:47.993667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:47.994864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:47.995683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:48.002928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2435/4899] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:52:48.071709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:48.094465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:48.442180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2465/4900] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:52:49.240417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:49.248491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:49.485009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:49.548799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d0bc-001d-4a70-8a8d-8b6dc3f1a0c0 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:49.750270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:49.751685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:49.752407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:49.753217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:49.798347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:49.801784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:49.835717 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2436/4901] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:55.516438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:55.519890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:55.556921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee423de-d210-45fb-8d07-53d0799ff115 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:55.582114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:55.583570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:55.584170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:55.585943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] PATH_INFO: `/v3/users/6d11c1b7cf444372a6baeb027c455d5a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:55.589980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d11c1b7cf444372a6baeb027c455d5a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:55.597759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:55.931663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d11c1b7cf444372a6baeb027c455d5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:55.937146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d11c1b7cf444372a6baeb027c455d5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.039271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d11c1b7cf444372a6baeb027c455d5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.071942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d11c1b7cf444372a6baeb027c455d5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.086179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:56.099574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac201163-195a-4686-b2b1-12242d1c5745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d11c1b7cf444372a6baeb027c455d5a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.104890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:56.108432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:56.128190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2466/4902] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:52:55 2022] DELETE /identity/v3/users/6d11c1b7cf444372a6baeb027c455d5a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:56.146748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04b109-8156-4697-94af-348e4b038348 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:56.308572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:56.309802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:56.310478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:56.312895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] PATH_INFO: `/v3/projects/d31cc90641634694a29b52dda2392c28` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:56.323119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31cc90641634694a29b52dda2392c28)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:56.330129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:56.555889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31cc90641634694a29b52dda2392c28', 'request_id': 'req-cf70363d-3470-4f6e-b642-78ee5131df98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.573760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31cc90641634694a29b52dda2392c28', 'request_id': 'req-cf70363d-3470-4f6e-b642-78ee5131df98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.590232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31cc90641634694a29b52dda2392c28', 'request_id': 'req-cf70363d-3470-4f6e-b642-78ee5131df98'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.714855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] The token cache is being invalidate because project d31cc90641634694a29b52dda2392c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:56.716255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.719997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf70363d-3470-4f6e-b642-78ee5131df98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:56.726737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2437/4903] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:56 2022] DELETE /identity/v3/projects/d31cc90641634694a29b52dda2392c28 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:56.739577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331925c-ed28-438c-893d-977ced7482ab None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:56.745353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331925c-ed28-438c-893d-977ced7482ab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:56.748992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331925c-ed28-438c-893d-977ced7482ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:56.853063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8331925c-ed28-438c-893d-977ced7482ab None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:56.856119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8331925c-ed28-438c-893d-977ced7482ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:57.071576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2467/4904] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:57.086279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:57.086767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:57.087398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:57.222159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:57.225138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:57.267101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2438/4905] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:57.269742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331925c-ed28-438c-893d-977ced7482ab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:57.299819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331925c-ed28-438c-893d-977ced7482ab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:57.314658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:57.316554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:57.319681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:57.320390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:57.324813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:52:57.328251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:57.336403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:57.386058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2468/4906] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:52:57.394480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:57.439984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d700a0b-06a3-467c-8cc1-de52e8bfcc6d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:57.466017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:57.469506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:57.470625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:57.471923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:57.473834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:57.480285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:57.694814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:57.723206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2439/4907] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:57 2022] POST /identity/v3/projects => generated 371 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:57.728527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:57.754620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d7c26-e67c-44b8-a803-b6fd0d116594 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:58.012220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:58.020457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:58.021997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:58.023026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:58.025378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:58.034574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:58.296525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2469/4908] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:57 2022] POST /identity/v3/users => generated 286 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:58.303742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:58.340181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c176-56bb-48a8-a2ae-05f868d94a6b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:58.352907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:58.354229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:58.354932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:58.356966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:58.359029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:58.368601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:58.403898 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2440/4909] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:58.409331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:58.443403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97145acc-9923-4ea6-8d93-689afe890ccb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:58.458277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:58.460293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:58.461367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:58.462056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:58.463622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:58.467658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3726f-44f6-4356-9c4f-1ab0153832c2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:58.504643 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2470/4910] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:52:58.505680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:58.533825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e807f6-ea2c-43b5-a926-cfbc9dde1c4f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:58.547024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:58.549004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:58.549958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:58.550834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] PATH_INFO: `/v3/projects/cdabaebb087f404884ccf3cac0bb058c/users/c2cb12421fb449c0a9b7c5843ad34319/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:58.623595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdabaebb087f404884ccf3cac0bb058c, user_id=c2cb12421fb449c0a9b7c5843ad34319, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:58.630911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:58.741039 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2441/4911] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:52:58 2022] PUT /identity/v3/projects/cdabaebb087f404884ccf3cac0bb058c/users/c2cb12421fb449c0a9b7c5843ad34319/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:52:58.763463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:58.765039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:58.765955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:58.830891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] MFA Rules not processed for user `c2cb12421fb449c0a9b7c5843ad34319`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:52:58.833954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:59.074893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:59.142754 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2471/4912] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:52:59.146328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:59.189293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:59.192070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:52:59.392392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1c13c-fd8b-4f38-a5b5-33cb701d4092 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:59.405507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:59.405507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:59.406024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:59.406420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] PATH_INFO: `/v3/projects/72a4f1e433a6427ab380248125ebc5b6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:59.408643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a4f1e433a6427ab380248125ebc5b6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:59.411380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:59.412492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1372d35-2824-4dde-89c9-1b80dad26dae admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:59.425749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:59.428810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:59.430162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:59.430681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:59.432626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:52:59.439596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:52:59.692346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2442/4913] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:52:59 2022] POST /identity/v3/projects => generated 371 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:52:59.701844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:52:59.742765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a4f1e433a6427ab380248125ebc5b6', 'request_id': 'req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:59.855596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a4f1e433a6427ab380248125ebc5b6', 'request_id': 'req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:59.879760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a4f1e433a6427ab380248125ebc5b6', 'request_id': 'req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:59.934374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] The token cache is being invalidate because project 72a4f1e433a6427ab380248125ebc5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:52:59.934793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:59.940425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a0bcdfae-b657-4362-b698-1b2d3b43b7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:52:59.944273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2472/4914] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:59 2022] DELETE /identity/v3/projects/72a4f1e433a6427ab380248125ebc5b6 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:52:59.953031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b97950-0b01-4fb6-ae4a-d3127dcbfa87 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:59.953533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b97950-0b01-4fb6-ae4a-d3127dcbfa87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:59.953959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b97950-0b01-4fb6-ae4a-d3127dcbfa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:52:59.966249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134866b-c234-410a-9526-c5bda59b8991 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:52:59.985759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:52:59.987218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:52:59.987869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:52:59.988488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.001224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.006178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.033676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-00b97950-0b01-4fb6-ae4a-d3127dcbfa87 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:00.044977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-00b97950-0b01-4fb6-ae4a-d3127dcbfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:00.082884 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2473/4915] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:00.099766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.099766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.100336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.161982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:00.164565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:00.205163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2443/4916] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:52:59 2022] POST /identity/v3/users => generated 292 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:00.214418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2474/4917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:00.218214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.221967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.229704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:00.250984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf998ff-d500-4512-b2b2-c55227b73754 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.267115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:00.268301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.268830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.269897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.271482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:00.272089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.275954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.290567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb155519-31ec-417d-ab25-af4681a316bb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.306314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:00.308831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.309761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.310704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.312947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.313900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2475/4918] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:53:00.317551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.318706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.344588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01d550-e399-4aca-bda1-a195d36621f4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.353448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:00.354583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.355028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.355600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.357951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.361700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.365257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2444/4919] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:00.367961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.390770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37f56-bc20-46f0-9f38-0427e7ce160c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.400759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:00.402449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.403371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.403696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] PATH_INFO: `/v3/projects/e8524cad81824ff7825a468efb5b2b14/users/03fcd4d261be42c3a631c1545cf30d71/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.437594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8524cad81824ff7825a468efb5b2b14, user_id=03fcd4d261be42c3a631c1545cf30d71, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.443607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.531627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2476/4920] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:00 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:00.541969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.606731 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2445/4921] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:00 2022] PUT /identity/v3/projects/e8524cad81824ff7825a468efb5b2b14/users/03fcd4d261be42c3a631c1545cf30d71/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:00.609484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:00.633244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:00.700632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:00.790364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9b55-4dd1-47df-a40e-e7e3920fec8a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.862350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df3ef-7a46-44a0-af09-37991239725a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:00.897501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:00.902441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:00.903014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:00.903605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:00.908488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:00.916247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:00.963506 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2446/4922] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:00.971593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.008467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ec06-acc3-4d68-969c-1e4de4925cc8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.031882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.033118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.033813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.034299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] PATH_INFO: `/v3/projects/e8524cad81824ff7825a468efb5b2b14/users/03fcd4d261be42c3a631c1545cf30d71/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.047581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.048806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.049104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8524cad81824ff7825a468efb5b2b14, user_id=03fcd4d261be42c3a631c1545cf30d71, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.053571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.054052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.057361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.058212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f1628-a1de-46f0-8073-9feae1cecf8f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.066589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.099201 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2447/4923] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:00 2022] PUT /identity/v3/projects/e8524cad81824ff7825a468efb5b2b14/users/03fcd4d261be42c3a631c1545cf30d71/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:01.124515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.124897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.125701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.231811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] MFA Rules not processed for user `03fcd4d261be42c3a631c1545cf30d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:01.234470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:01.278857 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2477/4924] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:00 2022] POST /identity/v3/users => generated 292 bytes in 740 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:01.281313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.331174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae631df-0ef1-44a1-bf88-b47aa589c11c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.553326 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2448/4925] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:01.560780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.582346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e445ca-eca2-403d-b42a-c25a40c2c354 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.596341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.597360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.597880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.598355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.599855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.616771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.625851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.628973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.628973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.628973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.633635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.641487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.681101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2478/4926] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:53:01.690283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.720120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cd36-db81-4073-8de9-dd1216bb3f07 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.730921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.732662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.733693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.734524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.736352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.740591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.765212 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2479/4927] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:01.771805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.798632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df943b-ad47-4bb3-a2f2-c75c20759ca7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.807719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.809473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.810199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.810791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] PATH_INFO: `/v3/projects/d8079f393ff74f5bbbcacb06a26af389/users/bc4d6bfc1c3044db9f56850963ef59cb/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.811543 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2449/4928] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:01 2022] POST /identity/v3/services => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:01.818837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:01.860972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8079f393ff74f5bbbcacb06a26af389, user_id=bc4d6bfc1c3044db9f56850963ef59cb, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.867756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b90ea1-337c-43a4-ba66-e705a8bb50b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:01.905424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475cd5-4c40-4d54-ba9b-d38daeb28b07 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:01.922620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:01.924014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:01.933011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:01.933011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:01.933011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:01.935216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:02.076691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2480/4929] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:01 2022] PUT /identity/v3/projects/d8079f393ff74f5bbbcacb06a26af389/users/bc4d6bfc1c3044db9f56850963ef59cb/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:02.096631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:02.097346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:02.097983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:02.136424 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1249250373. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:02.136424 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:02.136424 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:02.245089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] MFA Rules not processed for user `bc4d6bfc1c3044db9f56850963ef59cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:02.247736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:02.305571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:02.346447 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2450/4930] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:53:01 2022] POST /identity/v3/endpoints => generated 361 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:02.353323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:02.453872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:02.469933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aba88-0a3b-4d57-a470-bf622e98bd41 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:02.635006 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2481/4931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3576 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:02.637238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:02.793886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:02.795287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:02.796158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:02.802990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1249250373` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:02.802990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1249250373)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:02.804482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:02.816455 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2451/4932] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:53:02 2022] GET /identity/v3/regions/tempest-region-1249250373 => generated 180 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:02.818457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:02.871041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170ed0-d904-4142-852e-3520aa31ceb6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:02.894702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:02.896231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:02.896764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:02.897424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:02.901121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:02.904624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:02.992055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a0b96-5dd7-4cf9-9d3a-eae2ad32aabe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:03.015594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:03.018714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:03.022726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:03.023791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:03.025306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:03.035549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2452/4933] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:02 2022] POST /identity/v3/services => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:03.037594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:03.043229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:03.127052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11caad-4360-4430-8a42-79abcfd96738 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:03.146138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:03.147484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:03.148351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:03.149485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:03.153801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:03.161497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:03.258106 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2482/4934] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:02 2022] POST /identity/v3/projects => generated 381 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:03.260637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:03.312627 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1982071172. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:03.312627 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:03.312627 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:03.537714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767177-b277-4ac5-9d66-cd41b3ff616e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:03.538319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2453/4935] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:53:03 2022] POST /identity/v3/endpoints => generated 362 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:03.545129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:03.700048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:03.701338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef31e-3ed2-4008-b8ed-d14edd30e423 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:03.704731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:03.712518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:03.722400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:03.723985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:03.735014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b310b5-7f76-4bd7-9013-0a34dded873d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:03.952480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2483/4936] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:03 2022] POST /identity/v3/users => generated 297 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:03.952806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:03.953537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:03.953537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:03.953911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:03.954085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:03.954256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:03.954256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1982071172` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:03.957736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1982071172)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:03.960805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:03.973852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2454/4937] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:53:03 2022] GET /identity/v3/regions/tempest-region-1982071172 => generated 180 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:03.975633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:04.054471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0acbe-088f-41f7-ae9d-8e1dd6066934 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:04.071632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:04.073394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:04.075853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:04.078945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:04.080914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:04.083098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] MFA Rules not processed for user `3fb1f6f1b6c24316bb09ff23ae0a9252`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:04.086012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:04.094798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:04.133599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2455/4938] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:04.137362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:04.152912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:04.220722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934cbe-6df3-4d0d-a057-d3cb2193dc6f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:04.248525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:04.250110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:04.250537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:04.250991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:04.252430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:04.268816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:04.400196 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2484/4939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3888 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:04.405887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:04.441004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c81e-91b1-4f3d-9581-68837277d5b8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:04.449272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:04.450748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:04.453366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:04.454099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] PATH_INFO: `/v3/projects/5d1e8f5c3b944e59829cb492257f599d/users/a6accd408d4a4251a8bca3dd0c977ba8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:04.499615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1e8f5c3b944e59829cb492257f599d, user_id=a6accd408d4a4251a8bca3dd0c977ba8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:04.501509 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1909902453. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:04.501509 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:04.501509 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:04.507662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff8552-ee93-476b-9c7b-4ab619205366 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:04.536308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:04.654026 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2485/4940] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:04 2022] PUT /identity/v3/projects/5d1e8f5c3b944e59829cb492257f599d/users/a6accd408d4a4251a8bca3dd0c977ba8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:04.663395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:04.664049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:04.664658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:04.722890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] MFA Rules not processed for user `3fb1f6f1b6c24316bb09ff23ae0a9252`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:04.726210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:04.751351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2456/4941] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:53:04 2022] POST /identity/v3/endpoints => generated 360 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:04.754050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:04.804032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde406ff-c6e2-428b-9256-3f8bda5badc5 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:04.935478 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2486/4942] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:04 2022] POST /identity/v3/auth/tokens => generated 4072 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:04.938076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.100626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.102423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.103276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.103976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.105548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.112128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.139784 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2457/4943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:05.146319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.222455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67e12-882d-4234-88f3-8d7a8a1a51f8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.259524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.261106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.261606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.262098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] PATH_INFO: `/v3/projects/5d1e8f5c3b944e59829cb492257f599d/users/a6accd408d4a4251a8bca3dd0c977ba8/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.273363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1e8f5c3b944e59829cb492257f599d, user_id=a6accd408d4a4251a8bca3dd0c977ba8, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.289712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6877d-6d14-46d5-8ebc-e4d18ee49f93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.335369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92011032-d0da-425e-bc7e-6cbbb516da58 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.373327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2458/4944] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:05 2022] PUT /identity/v3/projects/5d1e8f5c3b944e59829cb492257f599d/users/a6accd408d4a4251a8bca3dd0c977ba8/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:05.386313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.386831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.387346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.392743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:05.502528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] MFA Rules not processed for user `a6accd408d4a4251a8bca3dd0c977ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:05.505260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:05.565385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.566576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.567099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.571042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1909902453` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.573928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1909902453)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.582976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.595052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2487/4945] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:53:04 2022] GET /identity/v3/regions/tempest-region-1909902453 => generated 180 bytes in 654 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:05.612433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.664832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ffba7-4ced-4fa1-a2a3-ccb423bd7356 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.688058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.689062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.691703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.692321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.696373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.702646 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:05.702646 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:05.702646 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:05.708372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.744761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2488/4946] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:53:05 2022] GET /identity/v3/endpoints => generated 4397 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:05.754341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.777563 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2459/4947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:05 2022] POST /identity/v3/auth/tokens => generated 4143 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:05.779902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.792047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a6054-a636-4b93-9b44-90d176c64783 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.807806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.811899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.812916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.813583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.819690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef0cd3-9742-4dee-be6c-4c2266e9d4b7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.837525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=49eaddad5e5947b3bf58bc8e91a8325c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.841661 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:05.841661 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:05.841661 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:05.845678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.846096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.849700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.850235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.851953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2489/4948] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:05 2022] GET /identity/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c => generated 360 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:05.852563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.853969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.857252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.859195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.891329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6539-4819-4483-9766-23d81fd35cec tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invalid input for field 'name': '' is too short Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: '' Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application '' Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.893622 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:53:05.896930 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application '' Oct 04 20:53:05.901358 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:05.903814 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2460/4949] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:05 2022] POST /identity/v3/domains => generated 283 bytes in 124 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:53:05.911390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:05.919674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.924962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.924962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.924962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.929362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=49eaddad5e5947b3bf58bc8e91a8325c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.935882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:05.955200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8684f44-863e-4ba3-8538-b35dd5c60959 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:05.971343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:05.973510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:05.974639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:05.975545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:05.977551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:05.984149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:06.007844 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 04 20:53:06.010884 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:53:06.022796 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.032999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2461/4950] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:05 2022] POST /identity/v3/domains => generated 412 bytes in 119 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:53:06.039008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.044791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '49eaddad5e5947b3bf58bc8e91a8325c', 'request_id': 'req-9a27259e-9515-4324-b13f-a5f908e4d317'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:06.106961 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2490/4951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:05 2022] DELETE /identity/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:06.123835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.138744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469acb4-dbe3-4e43-8f15-479b07ec77d8 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:06.261577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:06.265767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27259e-9515-4324-b13f-a5f908e4d317 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:06.266645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:06.267874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:06.268918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:06.271573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:06.277001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:06.287178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:06.288325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:06.288844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:06.290527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:06.290852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:06.304525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:06.330647 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2491/4952] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:53:06 2022] GET /identity/v3/endpoints => generated 4050 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:06.350660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.379353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac42b-8397-418d-a14e-5e34be04dfcb tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:06.400139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:06.405381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:06.406287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:06.410215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:06.414133 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2462/4953] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:06 2022] POST /identity/v3/domains => generated 276 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:06.420034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.432239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Could not find endpoint: 49eaddad5e5947b3bf58bc8e91a8325c.: keystone.exception.EndpointNotFound: Could not find endpoint: 49eaddad5e5947b3bf58bc8e91a8325c. Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._iter().one() Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._only_one_row( Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.462358 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 49eaddad5e5947b3bf58bc8e91a8325c. Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:06.464949 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:53:06.467912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 49eaddad5e5947b3bf58bc8e91a8325c. Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:53:06.475111 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2492/4954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:06 2022] DELETE /identity/v3/endpoints/49eaddad5e5947b3bf58bc8e91a8325c => generated 114 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:53:06.479357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.509492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:06.510890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5ae8-1c4b-4d3f-945f-778c8f3d75a6 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:06.785110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:06.786646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:06.787336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:06.788360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1909902453` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:06.790938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1909902453)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:06.795122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:06.806188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411f2-acd1-4c4d-821b-85d9121a7b2e tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:06.832264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:06.834078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:06.835267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:06.836129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:06.873601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0ddb7ed43d514c808aa82a5b34c9cc4e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:06.877065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 04 20:53:06.912290 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 04 20:53:06.914789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:06.916218 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2463/4955] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:06 2022] DELETE /identity/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e => generated 120 bytes in 497 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:53:06.918606 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1909902453. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:06.918606 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:06.918606 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:06.925940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.942332 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2493/4956] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:53:06 2022] DELETE /identity/v3/regions/tempest-region-1909902453 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:06.952508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:06.958466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655344-e1cc-4e3c-a3ae-631eb300f83b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.030563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.030898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.031790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.034330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.034671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9a435-3c64-45f8-8717-6aa388fedddc tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.037843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0ddb7ed43d514c808aa82a5b34c9cc4e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.048677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.052669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.053686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.054267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.054778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.056105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.061874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.097218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2494/4957] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 4 20:53:06 2022] GET /identity/v3/endpoints => generated 4050 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:53:07.099029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.146078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082e85-274f-48bb-ad0e-ac9779ba1214 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.147719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:07.151794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:07.167538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.168729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.169263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.169786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.174301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Adding query filter params (service_id=8d3e465d3e824fe8867f290da14af1af) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:07.174934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.192575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.218680 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2495/4958] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:53:07 2022] GET /identity/v3/endpoints?service_id=8d3e465d3e824fe8867f290da14af1af => generated 503 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:07.236259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.239681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:07.269298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6335b-8415-4df3-a73d-724dca12c2be tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.308102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:07.309316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:07.326824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:07.377909 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2464/4959] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:53:06 2022] PATCH /identity/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e => generated 277 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:07.377909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.377909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:07.544582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.545282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.545846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.546372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.547881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Adding query filter params (service_id=26254552da14433e9ff4c3eb50c70a76) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:07.548369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.552561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.578001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2496/4960] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:53:07 2022] GET /identity/v3/endpoints?service_id=26254552da14433e9ff4c3eb50c70a76 => generated 504 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:07.580904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.589205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:07.644726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14453d4c-d0af-4520-b077-5d1541604023 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.656492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.659469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.659469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.659469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.661105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:07.661817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.666439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.681249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74756020-c1e0-4896-bc30-828cd251431b tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.706645 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2497/4961] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 4 20:53:07 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:07.709477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.723706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.724991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.725513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.726033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.748128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dbd0c-d2f8-4ca7-9bca-a6f71deaef05 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.778739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.781590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.782199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.782755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.784259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:07.784907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.802081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.805844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0ddb7ed43d514c808aa82a5b34c9cc4e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.811858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.833768 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2498/4962] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 4 20:53:07 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:07.835346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:07.877958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d51-3604-4c2c-8966-89be1c331417 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:07.903028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:07.904391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:07.905798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:07.906471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:07.908054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:07.914319 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:07.914319 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:07.914319 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:07.914319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:07.940993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:07.956286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.033414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:08.105704 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2499/4963] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:07 2022] POST /identity/v3/services => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:08.112594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:08.168854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390c520-20dd-41bb-a227-36282503d302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:08.195812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.235421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.251424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.327886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:08.329147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:08.329678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:08.330188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:08.331798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:08.335194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:08.395583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] The token cache is being invalidate because project 0ddb7ed43d514c808aa82a5b34c9cc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:08.398569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.402637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.437540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.451822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.455466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0ddb7ed43d514c808aa82a5b34c9cc4e', 'request_id': 'req-34ab591b-a79d-470d-8af3-be4edb4b6c68'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:08.466477 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1902270470. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:08.466477 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:08.466477 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:08.480526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2465/4964] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:07 2022] DELETE /identity/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:08.491763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:08.496986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:08.672894 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2500/4965] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 4 20:53:08 2022] POST /identity/v3/endpoints => generated 361 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:08.689947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:08.705219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:08.731306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab591b-a79d-470d-8af3-be4edb4b6c68 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:08.760763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034806be-bf50-491e-9d25-2233f6a0b826 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:08.773024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:08.774413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:08.775056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:08.775801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1902270470` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:08.776705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1902270470)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:08.779373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:08.781999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:08.783760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:08.784648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:08.785446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/91b10c48d67f4097b2dda181b403c047` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:08.794460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2501/4966] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:53:08 2022] GET /identity/v3/regions/tempest-region-1902270470 => generated 180 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:08.798307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:08.806592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Could not find domain: 91b10c48d67f4097b2dda181b403c047.: keystone.exception.DomainNotFound: Could not find domain: 91b10c48d67f4097b2dda181b403c047. Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 91b10c48d67f4097b2dda181b403c047. Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:08.820851 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:08.827732 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:53:08.830045 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 91b10c48d67f4097b2dda181b403c047. Oct 04 20:53:08.833648 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:08.833648 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2466/4967] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:08 2022] DELETE /identity/v3/domains/91b10c48d67f4097b2dda181b403c047 => generated 112 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:53:08.834024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9437ebc-41e9-4005-9cfc-9f0031ea4393 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:08.838953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:08.845356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:08.847550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:08.848171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:08.848766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/7a9a70b5d7c043bfb4575c14697506c9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:08.865589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7a9a70b5d7c043bfb4575c14697506c9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:08.870072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:08.876811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d987b50-4f29-4e26-bc34-aba4accc06ba tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:08.884993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:08.886712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:08.888166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:08.890329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:08.893727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:08.898300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:09.021010 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2063960459. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:09.021010 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:09.021010 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:09.044471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2467/4968] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:08 2022] POST /identity/v3/domains => generated 252 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:09.047124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:09.064248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:09.241475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2502/4969] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 4 20:53:08 2022] PATCH /identity/v3/endpoints/7a9a70b5d7c043bfb4575c14697506c9 => generated 364 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:09.253635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:09.324990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f37fc-4547-4d5c-96f3-bfaf7cadf0f2 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:09.365134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:09.368168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:09.368792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:09.369583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:09.372822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:09.377809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:09.383864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6997441-69bc-4684-9399-7cc0d1090cf4 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:09.410235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:09.461949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.sql.core [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-222603558' for key 'project.ixu_project_name_domain_id'") Oct 04 20:53:09.461949 n-d-852085-12 devstack@keystone.service[82439]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:53:09.461949 n-d-852085-12 devstack@keystone.service[82439]: [parameters: {'id': '6399466cf71e435db33bb729df5e61cf', 'name': 'tempest-domain-dup-222603558', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 04 20:53:09.461949 n-d-852085-12 devstack@keystone.service[82439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-96a544a1-586a-4294-9aff-53d4040a526f tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-222603558.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-222603558. Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:53:09.478860 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-222603558' for key 'project.ixu_project_name_domain_id'") Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 20:53:09.481034 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application yield resource Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise self.value Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application session.commit() Oct 04 20:53:09.484287 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:53:09.486890 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 20:53:09.492223 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:53:09.494585 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-222603558' for key 'project.ixu_project_name_domain_id'") Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [parameters: {'id': '6399466cf71e435db33bb729df5e61cf', 'name': 'tempest-domain-dup-222603558', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.496931 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-222603558. Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:09.502216 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-222603558. Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.511025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2468/4970] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:09 2022] POST /identity/v3/domains => generated 211 bytes in 445 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:53:09.513334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:09.513334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:09.513334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:09.516204 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:53:09.518249 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:09.520299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2469/4971] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:53:09.520299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:09.609241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3095b-7314-4089-87d9-9e33740319a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:09.632466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:09.634000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:09.634541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:09.635055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/ec319ca67c694bbeacca93e13c593c96` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:09.707799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ec319ca67c694bbeacca93e13c593c96)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:09.712841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:09.835660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:09.840509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:09.848562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:09.852241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-2063960459` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:09.854171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2063960459)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:09.886176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:09.888469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:09.893511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:09.904089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2503/4972] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 4 20:53:09 2022] GET /identity/v3/regions/tempest-region-2063960459 => generated 180 bytes in 650 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:09.911674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:09.923454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:09.974619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a523d-6efc-4532-bc54-2940ef371b5b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:10.088006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.090955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.104655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2470/4973] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:53:09 2022] PATCH /identity/v3/domains/ec319ca67c694bbeacca93e13c593c96 => generated 253 bytes in 581 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:10.106815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:10.109302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:10.184077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:10.190942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:10.190942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:10.190942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/7a9a70b5d7c043bfb4575c14697506c9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:10.220507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7a9a70b5d7c043bfb4575c14697506c9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:10.231209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:10.341309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3521b-5d0e-4e69-a79d-7387c92d179c tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:10.352725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:10.353768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:10.354282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:10.354781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/ec319ca67c694bbeacca93e13c593c96` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:10.381029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ec319ca67c694bbeacca93e13c593c96)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:10.385441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:10.415684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7a9a70b5d7c043bfb4575c14697506c9', 'request_id': 'req-47461dda-6f2b-4a72-900f-73be53261816'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.449772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.458468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.491472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2504/4974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:09 2022] DELETE /identity/v3/endpoints/7a9a70b5d7c043bfb4575c14697506c9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:10.497795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:10.503862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:10.632799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461dda-6f2b-4a72-900f-73be53261816 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:10.640181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:10.641341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:10.641831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:10.642317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-2063960459` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:10.643659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2063960459)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:10.646694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:10.763704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.784410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.803687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.825655 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2505/4975] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:53:10 2022] DELETE /identity/v3/regions/tempest-region-2063960459 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:10.834167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:10.900919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e84acf-631b-4bdb-90e7-92730fa6d56b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:10.950742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] The token cache is being invalidate because project ec319ca67c694bbeacca93e13c593c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:10.951294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.953621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.965667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:10.983169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:10.993485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:10.998885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:11.001949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ec319ca67c694bbeacca93e13c593c96', 'request_id': 'req-6ede50fc-9d20-49e4-8425-25d88c106436'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:11.027625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2471/4976] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:10 2022] DELETE /identity/v3/domains/ec319ca67c694bbeacca93e13c593c96 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:11.029657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:11.032652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:11.072321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.073768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.074415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.075028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1902270470` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.076530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1902270470)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:11.083329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:11.205493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede50fc-9d20-49e4-8425-25d88c106436 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:11.237152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2506/4977] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:53:10 2022] DELETE /identity/v3/regions/tempest-region-1902270470 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:11.239624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6accd408d4a4251a8bca3dd0c977ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1e8f5c3b944e59829cb492257f599d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.241092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.241645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.242317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] PATH_INFO: `/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.244793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:11.250944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:11.258511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Could not find domain: 0ddb7ed43d514c808aa82a5b34c9cc4e.: keystone.exception.DomainNotFound: Could not find domain: 0ddb7ed43d514c808aa82a5b34c9cc4e. Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0ddb7ed43d514c808aa82a5b34c9cc4e. Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:11.270538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:11.272774 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:53:11.274918 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0ddb7ed43d514c808aa82a5b34c9cc4e. Oct 04 20:53:11.277115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:11.278509 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2472/4978] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:53:11 2022] PATCH /identity/v3/domains/0ddb7ed43d514c808aa82a5b34c9cc4e => generated 112 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:53:11.286807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:11.290449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:11.343694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d8bf0-f90c-4535-83a4-d49432ae7302 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:11.355491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.358485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.358485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.359386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services/8bcd8b9141bb4065b9f54261b7601d73` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.360666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8bcd8b9141bb4065b9f54261b7601d73)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:11.364024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:11.491248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2507/4979] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:11 2022] DELETE /identity/v3/services/8bcd8b9141bb4065b9f54261b7601d73 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:11.500222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:11.552846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a035-17ab-48bc-ab26-a4f3ef870aca tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:11.583539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdbd17-d735-4492-9f73-9de2db1915a0 tempest-DomainsNegativeTestJSON-626682164 tempest-DomainsNegativeTestJSON-626682164-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:11.584498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.585493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.585991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.586429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/8abffc2008a0425d80f64df72ed2a8f9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.615521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8abffc2008a0425d80f64df72ed2a8f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:11.620814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:11.628216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.629560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.630160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.631926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] PATH_INFO: `/v3/users/bc4d6bfc1c3044db9f56850963ef59cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.635941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4d6bfc1c3044db9f56850963ef59cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:11.645394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:11.729172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8abffc2008a0425d80f64df72ed2a8f9', 'request_id': 'req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:11.753179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2508/4980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:11 2022] DELETE /identity/v3/endpoints/8abffc2008a0425d80f64df72ed2a8f9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:11.759923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:11.806589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ade4f-ceb1-4ad1-9f92-90bc3eaeab8b tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:11.820664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:11.822676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:11.822676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:11.823034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1982071172` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:11.824084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1982071172)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:11.828639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:11.947435 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1982071172. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:11.947435 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:11.947435 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:11.967696 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2509/4981] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:53:11 2022] DELETE /identity/v3/regions/tempest-region-1982071172 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:11.974341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:12.042217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4d6bfc1c3044db9f56850963ef59cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:12.055925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7039-c393-4ab8-a00a-93fb67d15c00 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:12.068142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:12.069276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:12.070448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:12.070448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services/26254552da14433e9ff4c3eb50c70a76` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:12.072236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_service(service_id=26254552da14433e9ff4c3eb50c70a76)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:12.074972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:12.193563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4d6bfc1c3044db9f56850963ef59cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:12.213541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4d6bfc1c3044db9f56850963ef59cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:12.217104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:12.269493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2510/4982] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:11 2022] DELETE /identity/v3/services/26254552da14433e9ff4c3eb50c70a76 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:12.269800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4d6bfc1c3044db9f56850963ef59cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:12.271571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:12.271837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0e7ebac1-62bf-4596-9b5d-8154a20f8de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4d6bfc1c3044db9f56850963ef59cb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:12.281776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:12.299865 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2473/4983] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:11 2022] DELETE /identity/v3/users/bc4d6bfc1c3044db9f56850963ef59cb => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:12.309452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:12.311289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:12.312398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:12.360804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:12.368103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:12.393074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148703-6cd1-45bf-90c2-b0885af4d0c1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:12.504987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:12.597618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:12.598693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:12.599452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:12.599938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/endpoints/a353aaf7f5da4b9588cfc41b2185711e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:12.613884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a353aaf7f5da4b9588cfc41b2185711e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:12.622223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:12.654978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2474/4984] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3555 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:12.657139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:12.660855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:12.716971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25148f2f-c256-4625-9532-2471dc423e54 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:12.744343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:12.746468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:12.747045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:12.747616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] PATH_INFO: `/v3/users/ea9d8a6969e749fa957419b94b98fe90` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:12.751607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9d8a6969e749fa957419b94b98fe90)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:12.756210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:13.187618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a353aaf7f5da4b9588cfc41b2185711e', 'request_id': 'req-a556b84c-445a-479d-8962-d10528ec1bc9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.215442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2511/4985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:12 2022] DELETE /identity/v3/endpoints/a353aaf7f5da4b9588cfc41b2185711e => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:13.218618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:13.225824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:13.451123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b84c-445a-479d-8962-d10528ec1bc9 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:13.475915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:13.477178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:13.477760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:13.483402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:13.501163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9d8a6969e749fa957419b94b98fe90'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.529855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:13.533029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:13.638082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9d8a6969e749fa957419b94b98fe90'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.658274 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2512/4986] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:13.659576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:13.668565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9d8a6969e749fa957419b94b98fe90'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.734889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9d8a6969e749fa957419b94b98fe90'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.745250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9d8a6969e749fa957419b94b98fe90'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:13.763693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d204b-dba9-4b16-8f07-95cddbb1a166 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:13.772585 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2475/4987] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:12 2022] DELETE /identity/v3/users/ea9d8a6969e749fa957419b94b98fe90 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:13.790425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:13.790425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:13.791227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:13.792061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:13.793140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:13.793675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/regions/tempest-region-1249250373` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:13.794715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1249250373)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:13.813597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:13.976045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:13.992971 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1249250373. To ensure interoperability, identifiers should be a valid uuid. Oct 04 20:53:13.992971 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 04 20:53:13.992971 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:14.024119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2513/4988] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 4 20:53:13 2022] DELETE /identity/v3/regions/tempest-region-1249250373 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:14.029131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:14.038249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:14.082585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5eb0e-da64-49ad-8d12-952fcd0554ad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:14.108770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5df7-c58c-4751-b5d2-4ba1f65368b1 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:14.117075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:14.118303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:14.118771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:14.119233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] PATH_INFO: `/v3/users/7e735f5c6064450fbfc9f400c215bd41` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:14.124710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e735f5c6064450fbfc9f400c215bd41)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:14.133003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:14.255201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03fcd4d261be42c3a631c1545cf30d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8524cad81824ff7825a468efb5b2b14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:14.257403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:14.258887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:14.259493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] PATH_INFO: `/v3/services/8d3e465d3e824fe8867f290da14af1af` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:14.260592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8d3e465d3e824fe8867f290da14af1af)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:14.264800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:14.268657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:14.507729 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2514/4989] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:14 2022] DELETE /identity/v3/services/8d3e465d3e824fe8867f290da14af1af => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:14.511716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:14.519859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:14.617928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42aa73-e0fb-499b-af4b-8f36aee01e42 tempest-EndPointsTestJSON-1257241423 tempest-EndPointsTestJSON-1257241423-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:14.630204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:14.632308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:14.633260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:14.634536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] PATH_INFO: `/v3/users/c2cb12421fb449c0a9b7c5843ad34319` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:14.638075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cb12421fb449c0a9b7c5843ad34319)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:14.643273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:14.810931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e735f5c6064450fbfc9f400c215bd41'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:14.958548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e735f5c6064450fbfc9f400c215bd41'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:14.972926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e735f5c6064450fbfc9f400c215bd41'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.016475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e735f5c6064450fbfc9f400c215bd41'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.018167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e735f5c6064450fbfc9f400c215bd41'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.033425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2476/4990] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:13 2022] DELETE /identity/v3/users/7e735f5c6064450fbfc9f400c215bd41 => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:15.036230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:15.039849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:15.163809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cb12421fb449c0a9b7c5843ad34319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.165428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cb12421fb449c0a9b7c5843ad34319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.221654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4047e-1af1-4951-8976-1bbed7c09cb1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:15.232097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:15.233675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:15.234339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:15.234841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] PATH_INFO: `/v3/projects/a64b7e8684dc4deabb72e98df57411a2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:15.237846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64b7e8684dc4deabb72e98df57411a2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:15.243124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:15.289855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cb12421fb449c0a9b7c5843ad34319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.321856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cb12421fb449c0a9b7c5843ad34319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.344835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cb12421fb449c0a9b7c5843ad34319'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.361310 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2515/4991] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:14 2022] DELETE /identity/v3/users/c2cb12421fb449c0a9b7c5843ad34319 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:15.363904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:15.368960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:15.481018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64b7e8684dc4deabb72e98df57411a2', 'request_id': 'req-5834586f-7153-4712-b1cf-48b41cceb841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.497759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64b7e8684dc4deabb72e98df57411a2', 'request_id': 'req-5834586f-7153-4712-b1cf-48b41cceb841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.555761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64b7e8684dc4deabb72e98df57411a2', 'request_id': 'req-5834586f-7153-4712-b1cf-48b41cceb841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.607011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1a3fc-737f-4399-8d2c-14b6e0d1c4c2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:15.617863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:15.713393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] The token cache is being invalidate because project a64b7e8684dc4deabb72e98df57411a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:15.714037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.716089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5834586f-7153-4712-b1cf-48b41cceb841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:15.729343 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2477/4992] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:15 2022] DELETE /identity/v3/projects/a64b7e8684dc4deabb72e98df57411a2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:15.729343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979199ee-8677-4339-a61d-15083e7021ab None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:15.729343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979199ee-8677-4339-a61d-15083e7021ab None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:15.729947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979199ee-8677-4339-a61d-15083e7021ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:15.777115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:15.782505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-979199ee-8677-4339-a61d-15083e7021ab None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:15.785781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-979199ee-8677-4339-a61d-15083e7021ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:15.796235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:15.797901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:15.798965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:15.799807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] PATH_INFO: `/v3/users/46355569b9cc4b04b989fd141fc7530d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:15.803830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=46355569b9cc4b04b989fd141fc7530d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:15.809528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:15.814999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2478/4993] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:15.817890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979199ee-8677-4339-a61d-15083e7021ab None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:15.821104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-979199ee-8677-4339-a61d-15083e7021ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:15.852043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979199ee-8677-4339-a61d-15083e7021ab None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:15.863865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:15.865303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:15.866149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:15.866974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] PATH_INFO: `/v3/projects/fa8ddddd74fb455ba31fac9874139134` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:15.869729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8ddddd74fb455ba31fac9874139134)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:15.875665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:16.240952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8ddddd74fb455ba31fac9874139134', 'request_id': 'req-2aa39219-2701-4a2a-9a0d-f3d95193b33c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.256185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46355569b9cc4b04b989fd141fc7530d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.256483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8ddddd74fb455ba31fac9874139134', 'request_id': 'req-2aa39219-2701-4a2a-9a0d-f3d95193b33c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.257480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46355569b9cc4b04b989fd141fc7530d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.271075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8ddddd74fb455ba31fac9874139134', 'request_id': 'req-2aa39219-2701-4a2a-9a0d-f3d95193b33c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.388054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46355569b9cc4b04b989fd141fc7530d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.415471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46355569b9cc4b04b989fd141fc7530d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.431802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e478f0a8-54a5-4f06-8824-e704a8c297fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46355569b9cc4b04b989fd141fc7530d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.449607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2516/4994] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:15 2022] DELETE /identity/v3/users/46355569b9cc4b04b989fd141fc7530d => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:16.449607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:16.449607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:16.449607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:16.481637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] The token cache is being invalidate because project fa8ddddd74fb455ba31fac9874139134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:16.482339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.484613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:16.486307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:16.487634 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2479/4995] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:15 2022] DELETE /identity/v3/projects/fa8ddddd74fb455ba31fac9874139134 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:16.489526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:16.491064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:16.494145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:16.685686 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2517/4996] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:16.686997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:16.698791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:16.739055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa39219-2701-4a2a-9a0d-f3d95193b33c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:16.745367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753c6b2-ad56-4092-80f5-d8709cd21bbc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:16.768012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:16.770778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:16.771308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:16.773912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] PATH_INFO: `/v3/projects/d8079f393ff74f5bbbcacb06a26af389` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:16.778863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8079f393ff74f5bbbcacb06a26af389)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:16.785723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:16.941921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:16.945026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:16.945606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:16.946092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:16.952450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:16.994087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:16.997616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51025-8916-40d7-a1ff-e7042134da04 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:17.027724 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2480/4997] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:17.031658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2076bd-1584-4cad-a627-3e0c0c8fcae2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.031658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2076bd-1584-4cad-a627-3e0c0c8fcae2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.031658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2076bd-1584-4cad-a627-3e0c0c8fcae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.067444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8079f393ff74f5bbbcacb06a26af389', 'request_id': 'req-9f74e056-54f9-4853-ae9d-a691c7ec635b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.077277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2d2076bd-1584-4cad-a627-3e0c0c8fcae2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:17.080232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2d2076bd-1584-4cad-a627-3e0c0c8fcae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.220886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8079f393ff74f5bbbcacb06a26af389', 'request_id': 'req-9f74e056-54f9-4853-ae9d-a691c7ec635b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.240294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8079f393ff74f5bbbcacb06a26af389', 'request_id': 'req-9f74e056-54f9-4853-ae9d-a691c7ec635b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.246114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:17.274024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2481/4998] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:17.276168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.276980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.286690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.287113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] The token cache is being invalidate because project d8079f393ff74f5bbbcacb06a26af389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:17.287113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.287113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f74e056-54f9-4853-ae9d-a691c7ec635b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.291214 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2518/4999] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:16 2022] DELETE /identity/v3/projects/d8079f393ff74f5bbbcacb06a26af389 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:17.301033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.302022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.302865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.319965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:17.361093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:17.365193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.376027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:17.380370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.396585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2519/5000] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:17.399534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:17.406554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.424284 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2482/5001] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:17.431426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:17.436668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.483643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bc86b-530d-41d5-ae96-7f6a67ad2312 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:17.509309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:17.514444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.515770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.516382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] PATH_INFO: `/v3/users/a6accd408d4a4251a8bca3dd0c977ba8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.522389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6accd408d4a4251a8bca3dd0c977ba8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:17.529349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:17.663690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d471c6-ce3e-4dfd-9f60-1cd9cf39ca45 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:17.673413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:17.674563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.675205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.683560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.683560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.714882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:17.718555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:17.740958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2483/5002] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:17.743015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:17.763019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c6b7-584b-43dd-ba9f-d2b8897d91ec service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:17.772758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:17.774364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.774900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.775541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.776986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:17.777669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:17.781821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbd4a6-d002-4828-89a5-aef77cd2a312 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:17.811211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2484/5003] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:17.813526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.814207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.814876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.865625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:17.868021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:17.886498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2485/5004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:17.888045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:17.910481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea16e2-f2e2-4ed1-80c6-39eb5d152544 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:17.916138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6accd408d4a4251a8bca3dd0c977ba8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.917704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6accd408d4a4251a8bca3dd0c977ba8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:17.921133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:17.922382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:17.922895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:17.923389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:17.924665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:17.928812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:18.044071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6accd408d4a4251a8bca3dd0c977ba8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:18.073483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6accd408d4a4251a8bca3dd0c977ba8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:18.098513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6accd408d4a4251a8bca3dd0c977ba8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:18.103689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2486/5005] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:17 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:18.112201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:18.118765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:18.131083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2520/5006] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:17 2022] DELETE /identity/v3/users/a6accd408d4a4251a8bca3dd0c977ba8 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:18.140373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:18.145051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:18.410179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012283bb-d8d1-4143-8b19-c707b6f7c6f7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:18.412038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6f64-e587-4d29-9712-924317a2eb7c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:18.426851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:18.427911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:18.428230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:18.428725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:18.430225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:18.431022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:18.431970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:18.432232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:18.432709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:18.433177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:18.434384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:18.435355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:18.443706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:18.448748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:18.481530 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2487/5007] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:18.486185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:18.506342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85700c-688b-4f3b-90a6-fe8c5b0d4f63 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:18.520489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:18.522733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:18.528491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:18.528491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:18.537339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:18.551503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:18.648191 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2521/5008] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:18 2022] POST /identity/v3/users => generated 287 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:18.653837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:18.657235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:18.698614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d194c-765f-4977-b0a3-456292ee47e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:18.737999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2488/5009] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:18 2022] POST /identity/v3/projects => generated 403 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:18.737999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:18.742168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:18.748649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:18.749600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:18.750331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] PATH_INFO: `/v3/projects/cdabaebb087f404884ccf3cac0bb058c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:18.758205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdabaebb087f404884ccf3cac0bb058c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:18.766197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.017219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f28e6f-83fa-47ad-81e2-02c23d467e48 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:19.025206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:19.030475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdabaebb087f404884ccf3cac0bb058c', 'request_id': 'req-155f2e40-b9cb-4046-91de-05a38765a1a3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.132627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdabaebb087f404884ccf3cac0bb058c', 'request_id': 'req-155f2e40-b9cb-4046-91de-05a38765a1a3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.149040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdabaebb087f404884ccf3cac0bb058c', 'request_id': 'req-155f2e40-b9cb-4046-91de-05a38765a1a3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.183189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:19.184145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] The token cache is being invalidate because project cdabaebb087f404884ccf3cac0bb058c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:19.184308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.186181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:19.186581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.189365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:19.190361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:19.192024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:19.192428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2522/5010] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:18 2022] DELETE /identity/v3/projects/cdabaebb087f404884ccf3cac0bb058c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:19.194160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:19.195929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.201526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:19.231659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2489/5011] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:19.234215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:19.237698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:19.268996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f9bf-b0da-408e-95d7-b4362592c793 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:19.285229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:19.287362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:19.287996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f2e40-b9cb-4046-91de-05a38765a1a3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:19.288130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:19.288609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] PATH_INFO: `/v3/users/03fcd4d261be42c3a631c1545cf30d71` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:19.291799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fcd4d261be42c3a631c1545cf30d71)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:19.298879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.315761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:19.319329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:19.322955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:19.323545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:19.329831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:19.338583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.522370 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2523/5012] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:19 2022] POST /identity/v3/users => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:19.528640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:19.557097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:19.619246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702626a7-ab93-48ff-8b0f-7c42c6fe96b4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:19.649550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:19.652977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:19.656093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:19.656921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:19.663057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:19.667095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.747357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fcd4d261be42c3a631c1545cf30d71'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.761499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2524/5013] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:19.767239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:19.781111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:19.843484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504910-c61f-4e32-b892-ca784b3e6247 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:19.850107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fcd4d261be42c3a631c1545cf30d71'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.880637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:19.881879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:19.882482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:19.883103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] PATH_INFO: `/v3/projects/75d41fde9234405ea6611897f9a4bdc0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:19.885666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d41fde9234405ea6611897f9a4bdc0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:19.894888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fcd4d261be42c3a631c1545cf30d71'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.896371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:19.933250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:19.987939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fcd4d261be42c3a631c1545cf30d71'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:19.996074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fcd4d261be42c3a631c1545cf30d71'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.027645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2490/5014] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:19 2022] DELETE /identity/v3/users/03fcd4d261be42c3a631c1545cf30d71 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:20.030604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:20.035820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:20.150542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d41fde9234405ea6611897f9a4bdc0', 'request_id': 'req-564deced-5d8d-48fe-958a-556191206275'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.234042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109101-443b-4b77-9832-1e7ba83e40c8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:20.312034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d41fde9234405ea6611897f9a4bdc0', 'request_id': 'req-564deced-5d8d-48fe-958a-556191206275'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.339379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d41fde9234405ea6611897f9a4bdc0', 'request_id': 'req-564deced-5d8d-48fe-958a-556191206275'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.368378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] The token cache is being invalidate because project 75d41fde9234405ea6611897f9a4bdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:20.369105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.370526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.374316 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2525/5015] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:19 2022] DELETE /identity/v3/projects/75d41fde9234405ea6611897f9a4bdc0 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:20.377486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:20.381616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:20.382867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:20.385145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:20.385466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:20.386232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:20.390086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:20.395715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99142b-c1fc-43d1-94c5-99606fe872d5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:20.422863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564deced-5d8d-48fe-958a-556191206275 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:20.433754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:20.435293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:20.456845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:20.459085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] PATH_INFO: `/v3/projects/28d648bc85694df58d795f914acd4843/users/8ca55756d08d40fb8464b859f5945e64/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:20.468594 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2491/5016] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:20.472144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:20.473358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:20.474151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:20.528611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d648bc85694df58d795f914acd4843, user_id=8ca55756d08d40fb8464b859f5945e64, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:20.537027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:20.573063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:20.573063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:20.584932 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2492/5017] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:20.586657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:20.597159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:20.621677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c874-69ab-40a8-9901-3a2ecabd99b7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:20.631576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:20.632952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:20.633565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:20.634247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] PATH_INFO: `/v3/projects/5d1e8f5c3b944e59829cb492257f599d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:20.636661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1e8f5c3b944e59829cb492257f599d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:20.641192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:20.703006 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2526/5018] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:20 2022] PUT /identity/v3/projects/28d648bc85694df58d795f914acd4843/users/8ca55756d08d40fb8464b859f5945e64/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:20.705448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:20.722502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:20.881601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1e8f5c3b944e59829cb492257f599d', 'request_id': 'req-5f076b17-d623-4f6b-9005-dadc5299c2d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.912046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1e8f5c3b944e59829cb492257f599d', 'request_id': 'req-5f076b17-d623-4f6b-9005-dadc5299c2d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.931404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1e8f5c3b944e59829cb492257f599d', 'request_id': 'req-5f076b17-d623-4f6b-9005-dadc5299c2d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:20.961501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21716164-4c64-4cf3-8b7d-8ba5d36946a9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:20.981018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:21.080289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] The token cache is being invalidate because project 5d1e8f5c3b944e59829cb492257f599d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:21.080733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:21.083511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f076b17-d623-4f6b-9005-dadc5299c2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:21.086420 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2493/5019] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:20 2022] DELETE /identity/v3/projects/5d1e8f5c3b944e59829cb492257f599d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:21.094879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ce5-d1ee-4ea7-a225-dbb6143a1f61 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.095354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ce5-d1ee-4ea7-a225-dbb6143a1f61 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.095987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ce5-d1ee-4ea7-a225-dbb6143a1f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.110006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:21.114113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.115180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.115499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.117220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:21.120532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91fed8-ce87-4d26-96ac-debbcc3f0bce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:21.138398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d3271ce5-d1ee-4ea7-a225-dbb6143a1f61 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:21.143954 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2527/5020] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:21.145115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3271ce5-d1ee-4ea7-a225-dbb6143a1f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.147291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.147799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.149560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.170883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2494/5021] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:21.175123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.176092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.176595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.191548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:21.214965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:21.217652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.234315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] MFA Rules not processed for user `8ca55756d08d40fb8464b859f5945e64`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:21.236725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.239949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2495/5022] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:21.242237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:21.244949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.271655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ffc86-6093-4a04-a35c-97088720acb1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:21.284403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:21.284403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.284867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.285685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] PATH_INFO: `/v3/projects/46118121de724c439d844950f5542370/users/f2a38bfe37194b57aeca1a0e11becf17/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.379920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46118121de724c439d844950f5542370, user_id=f2a38bfe37194b57aeca1a0e11becf17, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:21.390139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a030c6-8b82-451c-bb45-ea51df47482c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:21.416783 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2528/5023] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:21.419014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:21.458749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9923b1b-8c5b-487f-8801-7fb426e5f640 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:21.471059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:21.472372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.472964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.473489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.474960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:21.479508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:21.491059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6270a4-b365-4181-9e18-f56094690cf3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:21.521233 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2529/5024] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:21.526813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.526813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.526813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.567126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:21.569499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.587424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2530/5025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:21.591058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:21.594425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.627080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf31c6-2e36-44fd-b028-359aa6044e89 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:21.630176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2496/5026] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:21 2022] PUT /identity/v3/projects/46118121de724c439d844950f5542370/users/f2a38bfe37194b57aeca1a0e11becf17/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:21.632974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.633475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.633973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.683581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] MFA Rules not processed for user `8ca55756d08d40fb8464b859f5945e64`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:21.691553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:21.788089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:21.789550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.789911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.790656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] PATH_INFO: `/v3/projects/e8524cad81824ff7825a468efb5b2b14` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.793173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8524cad81824ff7825a468efb5b2b14)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:21.799429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:21.846824 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2497/5027] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:21.850041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:21.884470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ba2be-f562-43b2-8f48-964d5f0d27d5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:21.897392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:21.898615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:21.899110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:21.899642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:21.901249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:21.906982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:22.028051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8524cad81824ff7825a468efb5b2b14', 'request_id': 'req-14876498-855b-4f4f-93dc-01dcb9c9a553'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:22.043352 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2498/5028] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:21 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:22.043352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:22.152541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8524cad81824ff7825a468efb5b2b14', 'request_id': 'req-14876498-855b-4f4f-93dc-01dcb9c9a553'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:22.177233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8524cad81824ff7825a468efb5b2b14', 'request_id': 'req-14876498-855b-4f4f-93dc-01dcb9c9a553'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:22.223858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] The token cache is being invalidate because project e8524cad81824ff7825a468efb5b2b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:22.226350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:22.228266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14876498-855b-4f4f-93dc-01dcb9c9a553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:22.234248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2531/5029] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:21 2022] DELETE /identity/v3/projects/e8524cad81824ff7825a468efb5b2b14 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:22.237369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.238698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.241800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.258051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c32d8-7a04-416c-a3f2-415b9b7b09e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:22.280057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:22.281181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.281676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.282257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.283605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:22.284135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:22.287437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:22.300849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:22.312431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:22.316302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.352693 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2532/5030] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:22.352693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:22.354525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.355754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2499/5031] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:22.357490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:22.360841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.404935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926dd27-fdb3-4bcf-9cb6-ca39c5c839c8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:22.428430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:22.429451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.429877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.430324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.431574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:22.436497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6161fb-1cfd-464d-8d55-92c40d65004b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:22.636786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edceb32-ed16-4b2f-a82e-438a68bd5f12 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:22.648780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2500/5032] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:22 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:22.652130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.653200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.654035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.654824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:22.656114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.656592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.657084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.671669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.730106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:22.734542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.767975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2501/5033] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:22.769798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:22.773156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:22.802826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c010c2-59a6-47da-bf76-ed1b85b295a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:22.816181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:22.817568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:22.819943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:22.820880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:22.822186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:22.827753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:22.911742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:22.915370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:22.938743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2533/5034] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:22.940572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:22.948212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:23.083068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2502/5035] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:22 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:23.085882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.095675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:23.108446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:23.200725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2a637-1c4e-49c1-b83e-99129d6c2848 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.395711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.397188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.397662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.398863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.421579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.425014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da58bb-f488-44dc-8c10-91bf8a9c3754 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.451710 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2534/5036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:23.455531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.455531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.455954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.457583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952136-8b2e-4320-91e6-8985c0b79623 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.486221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.488588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.489404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.490442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.492034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.496749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.515604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:23.518951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:23.531629 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2503/5037] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:23.533671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.550794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2535/5038] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:23.560525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.568543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bacd39-5e92-4a51-9e50-d387d96df46c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.575981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656f32-d876-4dee-9bf1-00dc99f40028 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.586752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.588623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.589608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.591100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.591729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.593469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.596770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.612776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.612776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.612776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.616108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.635271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.644021 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2536/5039] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:23.647356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.696149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633029-f3f9-4df8-8410-5768b66f63b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.726719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.728524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.728967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.729397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.730655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:23.731228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.741347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.787075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2537/5040] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:23.787075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.807336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1a64-4a17-4b42-ab27-5050dfb7eecf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.816747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.818293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.818862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.819693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] PATH_INFO: `/v3/projects/3809e6c0563e46a2bba84c0b5b2c7ed0/users/1ed0e5e12c494b52bc9f0e93ff7dce74/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.857828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3809e6c0563e46a2bba84c0b5b2c7ed0, user_id=1ed0e5e12c494b52bc9f0e93ff7dce74, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.864545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:23.914707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2504/5041] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:23 2022] POST /identity/v3/users => generated 284 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:23.924395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:23.955714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b45d4f-d9d5-4fc0-b0de-2aa7c7b2a6e3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:23.970017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:23.971920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:23.972835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:23.973324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:23.974576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:23.978531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:24.049673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2538/5042] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:23 2022] PUT /identity/v3/projects/3809e6c0563e46a2bba84c0b5b2c7ed0/users/1ed0e5e12c494b52bc9f0e93ff7dce74/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:24.051277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:24.054272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:24.191108 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2505/5043] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:23 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:24.193079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:24.282928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189637-ddbd-4697-970c-0cc241abfbeb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:24.369580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:24.400300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f0c2-1787-4f62-8e48-afdb5f0fea9a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:24.413601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:24.415325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:24.416094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:24.416828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:24.418697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:24.423234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212675e-877f-4d6f-a6e7-e19dfb189bca admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:24.448869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2506/5044] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:24.451738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:24.453486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:24.454372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:24.493240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:24.494925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:24.495830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:24.496318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:24.501853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:24.561638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] MFA Rules not processed for user `1ed0e5e12c494b52bc9f0e93ff7dce74`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:24.565359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:24.591284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:24.618476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:24.679584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2539/5045] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:24.681483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:24.702232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:24.714052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2e44-6dd8-40fc-a720-b7bef6bc443f service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:24.732831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:24.733606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:24.734145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:24.734808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:24.736472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:24.744083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:24.804901 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2507/5046] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:24.806594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:24.852910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84b1-2933-4323-86a4-c195fc29fbdc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:24.880095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:24.891782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:24.895333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:24.897058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:24.899081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:24.911109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:25.023670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2540/5047] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:24 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:25.041433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:25.059577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:25.099342 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2508/5048] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:25.112548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:25.203186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1882d20-4c78-474e-a948-e45d27981711 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:25.278237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:25.280554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:25.281035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:25.281517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:25.282807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:25.286181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:25.311722 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2509/5049] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:25.313512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:25.338858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d44d5-ad2d-4354-94a1-ed99dce9ebbf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:25.351596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:25.353076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:25.353558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:25.354129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] PATH_INFO: `/v3/projects/28fefd1f19134df791a4bbace2bd1263/users/3ead3c90ace64735975a603dbd9eb885/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:25.409781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fefd1f19134df791a4bbace2bd1263, user_id=3ead3c90ace64735975a603dbd9eb885, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:25.438245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2a8c-0fc9-4ea6-a584-822b6203cda1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:25.458409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8d6e-8885-4231-9367-9cd255a16434 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:25.485575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:25.486961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:25.487651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:25.489262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:25.522361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:25.533291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:25.581019 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2541/5050] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:25.582729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:25.615681 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2510/5051] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:25 2022] PUT /identity/v3/projects/28fefd1f19134df791a4bbace2bd1263/users/3ead3c90ace64735975a603dbd9eb885/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:25.633741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955106a-171b-4d79-bb1b-8327f1a24e0c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:25.639952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:25.640452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:25.641190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:25.726688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] MFA Rules not processed for user `3ead3c90ace64735975a603dbd9eb885`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:25.730146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:25.943688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:25.946390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:25.948254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:25.952410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:25.954453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:25.960402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:25.989392 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2542/5052] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:25.996327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:26.021716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4365b-0e71-4cae-9c12-5158d367e6df admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:26.052826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:26.054777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:26.055833 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2511/5053] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:26.057453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:26.058481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] PATH_INFO: `/v3/projects/fe98366871b44258815674ebd4a7f675/users/40466572d94b4b3f848ed1c2a8d85af1/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:26.063272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:26.106743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a800273-c02d-4b15-9ecf-8057c997d7a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:26.138325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:26.145431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:26.147502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe98366871b44258815674ebd4a7f675, user_id=40466572d94b4b3f848ed1c2a8d85af1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:26.148996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:26.150338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:26.154264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:26.159091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4408888-4843-46ad-a55c-d8f89878677c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:26.165806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:26.319756 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2543/5054] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:25 2022] PUT /identity/v3/projects/fe98366871b44258815674ebd4a7f675/users/40466572d94b4b3f848ed1c2a8d85af1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:26.347938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:26.348264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:26.348648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:26.388626 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2512/5055] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:26 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:26.395108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:26.513512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] MFA Rules not processed for user `40466572d94b4b3f848ed1c2a8d85af1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:26.518156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:26.529051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:26.713440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acd9ed-80df-4cce-a584-3568ec3c50ee admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:26.734038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:26.735213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:26.736233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:26.736233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:26.737333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:26.744822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:26.791494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:26.875577 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2544/5056] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:26.875577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:26.951338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2513/5057] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:26 2022] POST /identity/v3/users => generated 290 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:26.959589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:26.967757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ba588-55db-49e6-a342-b49bfe0e3c19 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:26.985573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:26.986760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:26.987277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:26.989012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:26.989311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:26.998506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.001181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7b085-2cbb-4f2f-9d0f-6ce0fa0994f3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.023335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:27.024946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.025569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.026060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:27.031746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:27.038005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.108201 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2514/5058] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:27.117537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:27.165338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d630-ff7e-44f3-bdde-081a8ac7dba9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.182476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:27.184094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.184717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.185203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] PATH_INFO: `/v3/projects/9d50c06f338341979d4d9f8e18a0666d/users/05b8d87777184ebd80ab4794f25c7ae7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:27.203375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2545/5059] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:26 2022] POST /identity/v3/projects => generated 371 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:27.210054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:27.268727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d50c06f338341979d4d9f8e18a0666d, user_id=05b8d87777184ebd80ab4794f25c7ae7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:27.286840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.422254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2515/5060] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:27 2022] PUT /identity/v3/projects/9d50c06f338341979d4d9f8e18a0666d/users/05b8d87777184ebd80ab4794f25c7ae7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:27.432551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77621f5-febc-424b-9d5d-9d6933b449dc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.437100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:27.611232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:27.612362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.612934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.613687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:27.614917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:27.620624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.678986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3225c0-82bc-4f7c-b266-7011c7d85a60 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.692755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:27.694012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.694677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.695472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:27.701495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:27.701877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.731449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2516/5061] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:27.733150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:27.749376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ca5d-e77d-4275-bc0a-be17d6b75fb5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.757590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:27.759781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.759781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.772612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] PATH_INFO: `/v3/projects/9d50c06f338341979d4d9f8e18a0666d/users/05b8d87777184ebd80ab4794f25c7ae7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:27.791352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d50c06f338341979d4d9f8e18a0666d, user_id=05b8d87777184ebd80ab4794f25c7ae7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:27.792166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2546/5062] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:27 2022] POST /identity/v3/users => generated 292 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:27.795376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:27.801397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a370e2-6c94-4267-a21d-b7552b92ff5e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:27.828974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0e6-c2c8-46a4-acca-4db5d5109644 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:27.852606 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2517/5063] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:27 2022] PUT /identity/v3/projects/9d50c06f338341979d4d9f8e18a0666d/users/05b8d87777184ebd80ab4794f25c7ae7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:27.957428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:27.998575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:27.998917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:27.999295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:28.123271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] MFA Rules not processed for user `05b8d87777184ebd80ab4794f25c7ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:28.124918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:28.125798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:28.125945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:28.126335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:28.134778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:28.138416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:28.152163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:28.214099 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2547/5064] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:28.217729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:28.258498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4dfd-3ec5-428b-9c62-3a14f3d1c884 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:28.270434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:28.271956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:28.272615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:28.273272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] PATH_INFO: `/v3/projects/c34f7f165ff042b78803c807b99bd0da/users/2d4362fe8c644aaca67748004d6ff736/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:28.321618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f7f165ff042b78803c807b99bd0da, user_id=2d4362fe8c644aaca67748004d6ff736, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:28.331541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:28.423025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2518/5065] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:28.427310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:28.455541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd552f4-4dc1-4478-8989-ac70708e036c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:28.467546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:28.468842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:28.469495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:28.470049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:28.490029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:28.490029 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:28.490029 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:28.490029 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:28.490029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:28.555052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2548/5066] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:28 2022] PUT /identity/v3/projects/c34f7f165ff042b78803c807b99bd0da/users/2d4362fe8c644aaca67748004d6ff736/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:28.557161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:28.709541 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2519/5067] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:28 2022] POST /identity/v3/regions => generated 223 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:28.715236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:28.817383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:28.841370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0944-7479-444c-800d-4d8d70a53efc tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:28.907604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753882-699c-4749-9fa9-9d1abb54f31d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:28.979915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:28.981035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:28.981561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:28.988433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:28.989892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:28.997622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:29.053443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:29.055859 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2549/5068] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:29.057116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:29.058232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:29.059007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:29.062781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:29.065266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:29.078283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:29.108944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f077-20b2-4b81-8594-c1bae3b49260 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:29.130296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:29.131597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:29.133122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:29.133122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] PATH_INFO: `/v3/projects/c34f7f165ff042b78803c807b99bd0da/users/2d4362fe8c644aaca67748004d6ff736/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:29.139216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f7f165ff042b78803c807b99bd0da, user_id=2d4362fe8c644aaca67748004d6ff736, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:29.144121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f9c6-65e5-43f4-a652-80a04aca3e2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:29.179425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2550/5069] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:29 2022] PUT /identity/v3/projects/c34f7f165ff042b78803c807b99bd0da/users/2d4362fe8c644aaca67748004d6ff736/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:29.208019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:29.208936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:29.210392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:29.287114 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2520/5070] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:28 2022] POST /identity/v3/regions => generated 223 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:29.295000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] MFA Rules not processed for user `2d4362fe8c644aaca67748004d6ff736`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:29.296908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:29.298869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:29.355871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c46c2-0f37-48bd-bcfc-5855720727b4 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:29.561463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:29.635206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2551/5071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:29.644750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:29.684208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:29.687504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:29.688157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:29.689536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/cd5a09a3-6026-4dff-96a8-86d647ea1514` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:29.692144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:create_region(region_id=cd5a09a3-6026-4dff-96a8-86d647ea1514)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:29.699602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:29.726151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d55b28-5f8b-4db1-95c3-4cc9ddde134b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:29.766896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:29.770559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:29.774426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:29.775313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:29.778620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:29.787643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:29.873695 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2521/5072] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 4 20:53:29 2022] PUT /identity/v3/regions/cd5a09a3-6026-4dff-96a8-86d647ea1514 => generated 231 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:29.877540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:29.902465 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2552/5073] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:53:29 2022] POST /identity/v3/domains => generated 276 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:29.909331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:29.953867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82e3b-f2e8-46ee-ae79-3c3341ee258b tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:30.254376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab6e11-f2d4-4abc-aaac-7d586106f153 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:30.300333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:30.302198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:30.303097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:30.303097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/cd5a09a3-6026-4dff-96a8-86d647ea1514` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:30.311613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cd5a09a3-6026-4dff-96a8-86d647ea1514)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:30.316901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:30.327254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:30.328841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:30.328841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:30.329299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:30.330541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:30.334895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:30.339425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:30.528351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2522/5074] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:53:29 2022] DELETE /identity/v3/regions/cd5a09a3-6026-4dff-96a8-86d647ea1514 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:30.537493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:30.614149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430aa4-0c51-4b26-ae59-1f38f1f491e3 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:30.641051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:30.642317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:30.642798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:30.643331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:30.645929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:30.651389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:30.712995 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2553/5075] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:29 2022] POST /identity/v3/projects => generated 402 bytes in 805 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:30.721671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:30.797231 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2523/5076] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:53:30 2022] POST /identity/v3/regions => generated 253 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:30.812055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:30.925055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0600cec-6707-4ca9-b2a2-1c1fd730fbe8 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.057653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19daa0-abb9-4ed1-9780-f67d563fa94d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.153079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.154287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.154765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.155075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.155305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.156148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.156444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.156628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.156781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/9525c27994a9404383605e8d80549ad4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.157720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:update_region(region_id=9525c27994a9404383605e8d80549ad4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.158322 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:31.158322 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:31.158322 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:31.165515 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:31.165515 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:31.165515 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:31.170110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.171502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.352007 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2554/5077] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:30 2022] POST /identity/v3/groups => generated 300 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:31.355446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.399377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa8ac-17b3-415b-9bb8-ea68e5deb762 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.414560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2524/5078] 10.222.0.78 () {60 vars in 1250 bytes} [Tue Oct 4 20:53:30 2022] PATCH /identity/v3/regions/9525c27994a9404383605e8d80549ad4 => generated 252 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:53:31.418665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.472958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.474151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.476114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.480255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.480255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.492910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.542015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd781-d926-4f39-94ea-7d503f681438 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.567661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.580671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.580671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.580671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/9525c27994a9404383605e8d80549ad4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.580671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:get_region(region_id=9525c27994a9404383605e8d80549ad4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.581136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.614082 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2525/5079] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:53:31 2022] GET /identity/v3/regions/9525c27994a9404383605e8d80549ad4 => generated 252 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:31.615976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.655913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cf0e3-3406-4687-852c-1ce28605e2a0 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.665861 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2555/5080] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:31 2022] POST /identity/v3/users => generated 442 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:31.674502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.675731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.676038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.676507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.676944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/9525c27994a9404383605e8d80549ad4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.678068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9525c27994a9404383605e8d80549ad4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.681068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.702744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:31.727796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f97661-52cc-4875-849d-cc3b3bcab4d4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.752502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.755271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.756160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.756859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.758996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.761849 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:31.761849 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:31.761849 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:31.765225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.818548 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2526/5081] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:31 2022] DELETE /identity/v3/regions/9525c27994a9404383605e8d80549ad4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:31.827048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.893060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea85cc-51b8-4a89-b686-d1c517022abe tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.906109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.907596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.908089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.908575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.910027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.913207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:31.947330 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2527/5082] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:53:31 2022] GET /identity/v3/regions => generated 668 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:31.947330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.967192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3df3-d919-4572-a6d9-6a5011c38c39 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:31.983174 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2556/5083] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:31 2022] POST /identity/v3/roles => generated 239 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:31.985806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:31.985806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:31.985806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:31.986396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/9525c27994a9404383605e8d80549ad4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:31.986396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9525c27994a9404383605e8d80549ad4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:31.986710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:31.986880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Could not find region: 9525c27994a9404383605e8d80549ad4.: keystone.exception.RegionNotFound: Could not find region: 9525c27994a9404383605e8d80549ad4. Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 9525c27994a9404383605e8d80549ad4. Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:53:32.021293 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 9525c27994a9404383605e8d80549ad4. Oct 04 20:53:32.023936 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:53:32.028304 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2528/5084] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:31 2022] DELETE /identity/v3/regions/9525c27994a9404383605e8d80549ad4 => generated 112 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:53:32.037341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.040194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bb728-a9d6-4525-8343-6b8b07d98216 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.066241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e336-b462-41d9-ac7c-25d89982ceb1 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.080225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.082256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.082727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.083354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.084599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.087501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.113820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.114305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2529/5085] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:53:32 2022] GET /identity/v3/regions => generated 668 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:32.115275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.116091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.116283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.116601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.143981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b44a5e-d4cf-4551-a5f0-a1b4cca4ea21 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.152351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=6eb050650394450e8cbc929f8fdd3f19)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.156976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.159417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.160030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.160535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.161901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.166872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.170326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.311081 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2557/5086] 10.222.0.78 () {60 vars in 1585 bytes} [Tue Oct 4 20:53:31 2022] PUT /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:32.317352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.366660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2530/5087] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:53:32 2022] POST /identity/v3/regions => generated 254 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:32.378756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.408876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:32.461259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427ff1-c51f-47f5-8416-b068ce630395 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.529926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2d5c-9c53-4989-8ecc-55915a02508e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.623366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.625629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.626433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.630538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.641603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:check_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=6eb050650394450e8cbc929f8fdd3f19)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.647002 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:32.647002 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:32.647002 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:32.651761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.686005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2558/5088] 10.222.0.78 () {58 vars in 1567 bytes} [Tue Oct 4 20:53:32 2022] HEAD /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:32.695545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.732942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1999dc8-1ac2-4373-abca-bb410d43a137 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.736454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.738739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.739927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.740754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.743049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Adding query filter params (parent_region_id=814fc5d982d94bd9827f82d4aa204eac) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:32.745337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.749090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.759549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.761027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.762416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.766062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.771678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2531/5089] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:53:32 2022] GET /identity/v3/regions?parent_region_id=814fc5d982d94bd9827f82d4aa204eac => generated 400 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:32.776073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:32.778016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=6eb050650394450e8cbc929f8fdd3f19)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.782450 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:32.782450 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:32.782450 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:32.790118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:32.802770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd2d6-f84a-4c68-b464-f2723f3b909d tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:32.820005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:32.821748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:32.822302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:32.826119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/327d120a00bb4bd8938a61a82ec9dbd4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:32.826351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 6eb050650394450e8cbc929f8fdd3f19 was removed from group cb7928744e614eb1a27b05fe5815b878 on project acd1e10a90584faca485eee7e4afd7b8. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:32.826351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:32.826710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=327d120a00bb4bd8938a61a82ec9dbd4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:32.827902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:32.831456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:33.022448 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2559/5090] 10.222.0.78 () {58 vars in 1569 bytes} [Tue Oct 4 20:53:32 2022] DELETE /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/groups/cb7928744e614eb1a27b05fe5815b878/roles/6eb050650394450e8cbc929f8fdd3f19/inherited_to_projects => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:33.026569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:33.032780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:33.047571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2532/5091] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:32 2022] DELETE /identity/v3/regions/327d120a00bb4bd8938a61a82ec9dbd4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:33.057858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:33.066656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:33.244319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7622b7-0939-407d-9fc7-62ab9f046893 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:33.349133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114887ce-1852-46f3-9ad7-3844d7405b3f tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:33.439788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:33.441150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:33.441793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:33.442387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/6eb050650394450e8cbc929f8fdd3f19` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:33.449091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6eb050650394450e8cbc929f8fdd3f19)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:33.453147 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:33.453147 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:33.453147 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:33.460335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:33.533588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:33.557511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:33.559494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:33.560072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:33.562020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/e96a74678ffd4056be1fa073cf41f964` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:33.563191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e96a74678ffd4056be1fa073cf41f964)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:33.572721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:33.755938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 6eb050650394450e8cbc929f8fdd3f19 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:33.756338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:33.761253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:33.767759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2560/5092] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:33 2022] DELETE /identity/v3/roles/6eb050650394450e8cbc929f8fdd3f19 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:33.769682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:33.776718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:33.842463 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2533/5093] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:33 2022] DELETE /identity/v3/regions/e96a74678ffd4056be1fa073cf41f964 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:33.845112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:33.855096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:33.981084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43dc36-8d1d-4ef9-86da-d82c58482e42 tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:33.997644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee2db7-7c83-48ed-9f6d-da307aa8c433 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:34.034372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:34.036004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:34.039129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:34.039943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:34.044724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:34.101556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:34.124852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:34.161984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2561/5094] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:34.163978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:34.166694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:34.172055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:34.264254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:34.269351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:34.270002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:34.270426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:34.271894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:34.280711 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:34.280711 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:34.280711 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:34.287477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:34.474687 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2534/5095] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:33 2022] POST /identity/v3/roles => generated 238 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:34.487259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:34.574192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987fb0-0165-4136-a8c0-d15a4c0c9dcc tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:34.608078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:34.609246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:34.609744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:34.615308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:34.618638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c8d02-4c9b-4b58-b8cb-26a393aab5aa service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:34.688280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b8d87777184ebd80ab4794f25c7ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d50c06f338341979d4d9f8e18a0666d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:34.697548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:34.701023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:34.701632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] PATH_INFO: `/v3/regions/814fc5d982d94bd9827f82d4aa204eac` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:34.709398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorizing `identity:delete_region(region_id=814fc5d982d94bd9827f82d4aa204eac)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:34.722289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:34.776644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=8eb15ea552f94bb2a7c7a51b21ee5dbf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:34.818361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:34.969219 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2562/5096] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:53:34 2022] DELETE /identity/v3/regions/814fc5d982d94bd9827f82d4aa204eac => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:34.971456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:34.980910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:35.008345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2535/5097] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 4 20:53:34 2022] PUT /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:35.017707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:35.270898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:35.327816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4947-20ee-437c-8f89-29ad794e665a tempest-RegionsTestJSON-1617397554 tempest-RegionsTestJSON-1617397554-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:35.328468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ab46-0d33-404c-9ede-513758a589b3 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:35.401444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:35.402801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:35.404018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:35.404527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:35.416830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:check_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=8eb15ea552f94bb2a7c7a51b21ee5dbf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:35.418801 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:35.418801 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:35.418801 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:35.423002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:35.456736 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2536/5098] 10.222.0.78 () {58 vars in 1564 bytes} [Tue Oct 4 20:53:35 2022] HEAD /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:35.458210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:35.515501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f7a1c-af37-43b8-b41f-26655d9319a4 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:35.539566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:35.540890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:35.541626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:35.541812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:35.561875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=8eb15ea552f94bb2a7c7a51b21ee5dbf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:35.564880 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:35.564880 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:35.564880 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:35.586542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:35.620128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 8eb15ea552f94bb2a7c7a51b21ee5dbf was removed from user 6baa8a0434b6489392ae76cb6049a5f9 on project acd1e10a90584faca485eee7e4afd7b8. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:35.620472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:35.627981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:35.669281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:35.671523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:35.672584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:35.673509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] PATH_INFO: `/v3/users/3ead3c90ace64735975a603dbd9eb885` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:35.685002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ead3c90ace64735975a603dbd9eb885)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:35.694450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:35.741638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2537/5099] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 4 20:53:35 2022] DELETE /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf/inherited_to_projects => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:35.752820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:35.772145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:36.089121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ead3c90ace64735975a603dbd9eb885'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.095964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ead3c90ace64735975a603dbd9eb885'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.122721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fe1d-bb39-4d16-b407-35944ed7af7a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:36.176547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:36.177972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:36.178497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:36.178990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:36.197364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8eb15ea552f94bb2a7c7a51b21ee5dbf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:36.199564 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:36.199564 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:36.199564 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:36.201460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:36.227826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ead3c90ace64735975a603dbd9eb885'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.322783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ead3c90ace64735975a603dbd9eb885'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.357795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:36.366239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83fa656a-ccf0-4559-9d2e-8c2f8825ea09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ead3c90ace64735975a603dbd9eb885'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.400065 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2563/5100] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:34 2022] DELETE /identity/v3/users/3ead3c90ace64735975a603dbd9eb885 => generated 0 bytes in 1425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:36.402986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:36.403922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:36.404411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:36.499504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:36.504250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:36.532115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 8eb15ea552f94bb2a7c7a51b21ee5dbf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:36.533113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.534795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:36.541447 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2538/5101] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:35 2022] DELETE /identity/v3/roles/8eb15ea552f94bb2a7c7a51b21ee5dbf => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:36.553348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:36.560990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:36.843610 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2564/5102] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:36.893647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e82a-697b-4c17-9958-66ed6b3a7eaa tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:36.922179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:36.922739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:36.933426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:36.935591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:36.938935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:36.941874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:36.984299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:36.993472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:37.068882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:37.129158 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2539/5103] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:36 2022] POST /identity/v3/roles => generated 240 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:37.134750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:37.180503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9690-1fe1-4a25-ab8e-8e7ff02a68e5 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:37.199512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:37.201506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:37.202277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:37.203032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:37.211218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=12e1bc21825b45969b252c04d598af93)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:37.213604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:37.371707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2540/5104] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 4 20:53:37 2022] PUT /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:37.373686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:37.413850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7d919-901c-4c61-b17d-b785f2aa97e8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:37.619078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:37.643408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:37.643408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:37.643408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:37.790554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45278-0546-415e-9209-02cb9268f92a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:37.811759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:37.812831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:37.813252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:37.813699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:37.826140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2fd25a59501b475b9e944801b9d8bdbd, group_id=cb7928744e614eb1a27b05fe5815b878)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:37.828034 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:37.828034 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:37.828034 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:37.835898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:37.922958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2541/5105] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 4 20:53:37 2022] GET /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/inherited_to_projects => generated 448 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:37.924808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:38.009954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4107d8-9cbf-41c6-abcf-611c00cb8b4b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:38.032689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:38.035733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:38.045855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:38.051263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:38.051859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:38.058800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:38.089023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=12e1bc21825b45969b252c04d598af93)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:38.101090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:38.116449 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2565/5106] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:53:38.148430 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2542/5107] 10.222.0.78 () {58 vars in 1564 bytes} [Tue Oct 4 20:53:37 2022] HEAD /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:38.150476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:38.214716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd19-0e8b-4a43-8426-a2025c4a50f9 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:38.288417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:38.300405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:38.300717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:38.301379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:38.325048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, group_id=cb7928744e614eb1a27b05fe5815b878, role_id=12e1bc21825b45969b252c04d598af93)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:38.340237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:38.372931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 12e1bc21825b45969b252c04d598af93 was removed from group cb7928744e614eb1a27b05fe5815b878 on domain 2fd25a59501b475b9e944801b9d8bdbd. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:38.373671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:38.378611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:38.508236 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2566/5108] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 4 20:53:38 2022] DELETE /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/groups/cb7928744e614eb1a27b05fe5815b878/roles/12e1bc21825b45969b252c04d598af93/inherited_to_projects => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:38.514706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:38.517894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:38.591953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcc27d-22d8-443d-a400-ccc5b4580615 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:38.894847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:38.952804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:38.964052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:38.964879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:38.966709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/12e1bc21825b45969b252c04d598af93` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:38.974908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12e1bc21825b45969b252c04d598af93)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:38.984437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:39.609858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 12e1bc21825b45969b252c04d598af93 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:39.610821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:39.617245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:39.625884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2543/5109] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:38 2022] DELETE /identity/v3/roles/12e1bc21825b45969b252c04d598af93 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:39.643102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:39.679820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420ed19-057a-4f99-a384-de688e55759a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:39.994973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:40.045027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:40.046674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:40.047518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:40.050075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:40.057590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:40.070137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:40.281423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2567/5110] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:39 2022] POST /identity/v3/roles => generated 239 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:40.283365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:40.290075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:40.358794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab096e-509f-44d6-9833-5a41ca733289 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:40.389187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:40.391633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:40.392168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:40.392671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:40.403344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=1798658902504e63b97cbff9ccce05ef)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:40.408415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:40.653735 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2544/5111] 10.222.0.78 () {60 vars in 1579 bytes} [Tue Oct 4 20:53:40 2022] PUT /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:40.660558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:40.732455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145e54-5817-442c-82cd-707fe78f07e6 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:41.183520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:41.187041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:41.191222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:41.191222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:41.202324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:41.204763 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:41.204763 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:41.204763 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:41.216946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:41.280973 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2568/5112] 10.222.0.78 () {58 vars in 1461 bytes} [Tue Oct 4 20:53:40 2022] GET /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/inherited_to_projects => generated 446 bytes in 616 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:53:41.283447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:41.320280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45e56-cd90-4823-8ecd-7fb868d8e357 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:41.342622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:41.344411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:41.346973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:41.347674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:41.358244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=1798658902504e63b97cbff9ccce05ef)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:41.373342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:41.414093 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2545/5113] 10.222.0.78 () {58 vars in 1561 bytes} [Tue Oct 4 20:53:41 2022] HEAD /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:41.421582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:41.471015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca2368-5905-4107-b489-bdc28b60ce61 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:41.509104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:41.517338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:41.518277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:41.519891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:41.532067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=1798658902504e63b97cbff9ccce05ef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:41.550747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:41.627592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 1798658902504e63b97cbff9ccce05ef was removed from user 6baa8a0434b6489392ae76cb6049a5f9 on domain 2fd25a59501b475b9e944801b9d8bdbd. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:41.631720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:41.636489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:41.787491 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2569/5114] 10.222.0.78 () {58 vars in 1563 bytes} [Tue Oct 4 20:53:41 2022] DELETE /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/1798658902504e63b97cbff9ccce05ef/inherited_to_projects => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:41.793930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:41.798768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:41.886841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68507ff1-628f-40f2-8fa1-a58290ba227d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:42.287886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:42.289653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:42.290686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:42.291512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/1798658902504e63b97cbff9ccce05ef` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:42.304457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1798658902504e63b97cbff9ccce05ef)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:42.314772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:42.594828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 1798658902504e63b97cbff9ccce05ef has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:42.595887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:42.598877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:42.613593 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2546/5115] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:41 2022] DELETE /identity/v3/roles/1798658902504e63b97cbff9ccce05ef => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:42.615318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:42.618793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:42.620796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:42.627353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:43.038891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8521e95-5cca-463d-9b93-b3c2cf920765 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:43.042286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cbb36-6ef1-47c3-a9ac-eefd0186b61b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:43.066104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:43.071965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:43.071965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:43.072924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:43.078967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:43.091318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:43.105233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:43.271739 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2547/5116] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:42 2022] POST /identity/v3/roles => generated 240 bytes in 652 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:43.275053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:43.326932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec0b6-e12d-4d40-bb8e-8292a85074c2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:43.351115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:43.356471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:43.356471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:43.356471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:43.357142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:43.366206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:43.374237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:43.375485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:43.378682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:43.379465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] PATH_INFO: `/v3/projects/28fefd1f19134df791a4bbace2bd1263` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:43.386604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fefd1f19134df791a4bbace2bd1263)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:43.396780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:43.457814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:43.700040 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2548/5117] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:43 2022] POST /identity/v3/projects => generated 409 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:43.707075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:43.826773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fefd1f19134df791a4bbace2bd1263', 'request_id': 'req-5a48e33a-7c22-4291-923d-46b9338f4ab9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:43.957152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fefd1f19134df791a4bbace2bd1263', 'request_id': 'req-5a48e33a-7c22-4291-923d-46b9338f4ab9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:44.005254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fefd1f19134df791a4bbace2bd1263', 'request_id': 'req-5a48e33a-7c22-4291-923d-46b9338f4ab9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:44.117275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2634-4035-42ff-9898-30ce32ee277e tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:44.126988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] The token cache is being invalidate because project 28fefd1f19134df791a4bbace2bd1263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:44.128974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:44.132752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:44.144036 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2570/5118] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:42 2022] DELETE /identity/v3/projects/28fefd1f19134df791a4bbace2bd1263 => generated 0 bytes in 1529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:44.149478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:44.155466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:44.508942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e33a-7c22-4291-923d-46b9338f4ab9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:44.522384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:44.523729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:44.529018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:44.529018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] PATH_INFO: `/v3/users/05b8d87777184ebd80ab4794f25c7ae7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:44.529818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b8d87777184ebd80ab4794f25c7ae7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:44.534782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:44.632045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:44.638736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:44.644488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:44.653813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/92605e9a4e0d47c0879c4bab014144de/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:44.673855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=92605e9a4e0d47c0879c4bab014144de)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:44.692444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:44.898556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2549/5119] 10.222.0.78 () {60 vars in 1579 bytes} [Tue Oct 4 20:53:43 2022] PUT /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/92605e9a4e0d47c0879c4bab014144de/inherited_to_projects => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:44.906922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:44.916687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:45.439269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b8d87777184ebd80ab4794f25c7ae7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:45.447967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b8d87777184ebd80ab4794f25c7ae7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:45.453717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df525c-f645-4504-a924-10f087725e97 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:45.504445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:45.510781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:45.519750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:45.524032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:45.535035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=acd1e10a90584faca485eee7e4afd7b8, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:45.542677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:45.553896 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:45.553896 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:53:45.553896 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:53:45.558381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:45.593340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:45.717976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b8d87777184ebd80ab4794f25c7ae7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:45.789452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b8d87777184ebd80ab4794f25c7ae7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:45.866726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b8d87777184ebd80ab4794f25c7ae7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:45.918223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2550/5120] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:44 2022] GET /identity/v3/role_assignments?scope.project.id=acd1e10a90584faca485eee7e4afd7b8&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 648 bytes in 1011 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:53:45.920487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:45.921525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2571/5121] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:44 2022] DELETE /identity/v3/users/05b8d87777184ebd80ab4794f25c7ae7 => generated 0 bytes in 1773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:45.928455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:45.993721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05ab7-f6a4-49ca-b871-15c42934c18c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:46.397185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:46.397185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:46.406896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:46.407664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:46.413027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=997c3bfe21d14ba7bfefdffd64ecfc58, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:46.430190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:46.456653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:46.752352 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2551/5122] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:45 2022] GET /identity/v3/role_assignments?scope.project.id=997c3bfe21d14ba7bfefdffd64ecfc58&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 648 bytes in 828 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:46.754175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:46.802390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c4fd-2347-482a-ac57-11a461241eab admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:46.830821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:46.832946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:46.833965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:46.834998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/92605e9a4e0d47c0879c4bab014144de/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:46.840559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2fd25a59501b475b9e944801b9d8bdbd, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=92605e9a4e0d47c0879c4bab014144de)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:46.847450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:46.862243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 92605e9a4e0d47c0879c4bab014144de was removed from user 6baa8a0434b6489392ae76cb6049a5f9 on domain 2fd25a59501b475b9e944801b9d8bdbd. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:46.863712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:46.865929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:47.008811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:47.034456 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2572/5123] 10.222.0.78 () {58 vars in 1563 bytes} [Tue Oct 4 20:53:46 2022] DELETE /identity/v3/OS-INHERIT/domains/2fd25a59501b475b9e944801b9d8bdbd/users/6baa8a0434b6489392ae76cb6049a5f9/roles/92605e9a4e0d47c0879c4bab014144de/inherited_to_projects => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:47.044158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:47.047853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:47.085772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935f64f-2e71-4f58-9705-c6357df1866c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:47.302956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:47.304589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:47.305136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:47.310735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:47.312415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=acd1e10a90584faca485eee7e4afd7b8, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:47.312996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:47.320158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:47.423433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:47.584310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:47.589056 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2552/5124] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:47 2022] GET /identity/v3/role_assignments?scope.project.id=acd1e10a90584faca485eee7e4afd7b8&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 228 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:47.619359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1c008-c93f-44b1-b88e-3d6625979d8d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:47.631357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:47.636545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:47.636545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:47.636545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:47.636545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=997c3bfe21d14ba7bfefdffd64ecfc58, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:47.637558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:47.640366 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:47.640366 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:47.640366 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:47.643610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:47.906293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2573/5125] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:47 2022] GET /identity/v3/role_assignments?scope.project.id=997c3bfe21d14ba7bfefdffd64ecfc58&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 228 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:53:47.907650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:47.950863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e41b7f-21f2-4e71-a82b-002f43d79902 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:47.977912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:47.979525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:47.980064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:47.980535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects/997c3bfe21d14ba7bfefdffd64ecfc58` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:47.983811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=997c3bfe21d14ba7bfefdffd64ecfc58)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:47.988701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:48.301217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997c3bfe21d14ba7bfefdffd64ecfc58', 'request_id': 'req-860133cd-baf9-4018-8a75-997274f9ee67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:48.326236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997c3bfe21d14ba7bfefdffd64ecfc58', 'request_id': 'req-860133cd-baf9-4018-8a75-997274f9ee67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:48.342612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997c3bfe21d14ba7bfefdffd64ecfc58', 'request_id': 'req-860133cd-baf9-4018-8a75-997274f9ee67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:48.555735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] The token cache is being invalidate because project 997c3bfe21d14ba7bfefdffd64ecfc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:48.556266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:48.557386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:48.571760 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2553/5126] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:47 2022] DELETE /identity/v3/projects/997c3bfe21d14ba7bfefdffd64ecfc58 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:48.573495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:48.576700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:48.634302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada2278-6f45-412a-9ce9-2d892da46dbb tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:48.880062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:48.881951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:48.882832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:48.883635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/92605e9a4e0d47c0879c4bab014144de` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:48.893677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92605e9a4e0d47c0879c4bab014144de)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:48.897724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:49.116468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role 92605e9a4e0d47c0879c4bab014144de has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:49.129725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:49.138132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:49.150349 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2574/5127] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:48 2022] DELETE /identity/v3/roles/92605e9a4e0d47c0879c4bab014144de => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:49.172995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:49.218072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860133cd-baf9-4018-8a75-997274f9ee67 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:49.443984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:49.445443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:49.446104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:49.446726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:49.448292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:49.452354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:49.617008 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2554/5128] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:53:49 2022] POST /identity/v3/roles => generated 240 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:49.625262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:49.630125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:49.678359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ecb9e-da00-4164-aa62-c4f87fb8ca79 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:49.711278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:49.713659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:49.714820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:49.715709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:49.717828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:49.724822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:49.983502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2575/5129] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:49 2022] POST /identity/v3/projects => generated 409 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:49.991300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:50.058675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad5cb-4716-48b7-bbea-7c336eda740b tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:50.462559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:50.472025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:50.472897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:50.473182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:50.473508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/a9a08c73337d4babaa2461f259f669df/inherited_to_projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:50.482800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=a9a08c73337d4babaa2461f259f669df)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:50.495884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be4c6-f66a-4832-a64a-58d43155cba2 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:50.627420 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2555/5130] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 4 20:53:49 2022] PUT /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/a9a08c73337d4babaa2461f259f669df/inherited_to_projects => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:50.634950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:50.697336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e62c-f61e-424e-93ee-7199113986a7 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:50.808255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:50.809682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:50.810411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:50.925603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:50.933028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] MFA Rules not processed for user `f2a38bfe37194b57aeca1a0e11becf17`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:50.938637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:51.011682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:51.015520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:51.016195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:51.017971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:51.020041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=d93493873dd54b20af6b0df8cd8c0ea4, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:51.023184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:51.031817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:51.297723 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2556/5131] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:51.305505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:51.313704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:51.325302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2576/5132] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:50 2022] GET /identity/v3/role_assignments?scope.project.id=d93493873dd54b20af6b0df8cd8c0ea4&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 649 bytes in 691 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:51.332228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:51.381244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daafa0-1dee-4751-b9f0-b0eec9d2849c tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:51.420185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:51.425614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:51.425614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:51.425614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/a9a08c73337d4babaa2461f259f669df/inherited_to_projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:51.435817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=acd1e10a90584faca485eee7e4afd7b8, user_id=6baa8a0434b6489392ae76cb6049a5f9, role_id=a9a08c73337d4babaa2461f259f669df)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:51.450666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:51.468777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role a9a08c73337d4babaa2461f259f669df was removed from user 6baa8a0434b6489392ae76cb6049a5f9 on project acd1e10a90584faca485eee7e4afd7b8. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:51.471714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:51.476348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:51.576048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326eaac-913d-4cd8-a67e-5d4c20eedff7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:51.589484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:51.591126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:51.591942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:51.592566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:51.593749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:51.596807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:51.650432 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2577/5133] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 4 20:53:51 2022] DELETE /identity/v3/OS-INHERIT/projects/acd1e10a90584faca485eee7e4afd7b8/users/6baa8a0434b6489392ae76cb6049a5f9/roles/a9a08c73337d4babaa2461f259f669df/inherited_to_projects => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:51.652643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:51.657222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:51.747999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2557/5134] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:51 2022] POST /identity/v3/projects => generated 403 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:51.752487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:51.762270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:51.966785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7031dc4-816d-42cf-9f50-43c0545d9a95 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:52.185449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6823-3cbb-4cc6-98f8-2ebb8947605f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:52.203807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:52.211502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:52.214400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:52.214400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:52.215182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Adding query filter params (scope.project.id=d93493873dd54b20af6b0df8cd8c0ea4, user.id=6baa8a0434b6489392ae76cb6049a5f9) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:52.216118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:52.220505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:52.254500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:52.294537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:52.294537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:52.294537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:52.295521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] PATH_INFO: `/v3/projects/9d50c06f338341979d4d9f8e18a0666d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:52.297401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d50c06f338341979d4d9f8e18a0666d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:52.301269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:52.420144 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2558/5135] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:53:51 2022] GET /identity/v3/role_assignments?scope.project.id=d93493873dd54b20af6b0df8cd8c0ea4&user.id=6baa8a0434b6489392ae76cb6049a5f9&effective => generated 228 bytes in 671 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:52.422255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:52.432130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:52.497400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733e9c-7f9e-4a49-a670-193c8a5a8d1a tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:52.517266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:52.518875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:52.519794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:52.520432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:52.521462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:52.525006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:52.553849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:52.626993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d50c06f338341979d4d9f8e18a0666d', 'request_id': 'req-f71da130-3673-4a05-988b-940c19d1dfb2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:52.751024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2559/5136] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:52 2022] POST /identity/v3/users => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:52.757999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:52.798108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d50c06f338341979d4d9f8e18a0666d', 'request_id': 'req-f71da130-3673-4a05-988b-940c19d1dfb2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:52.806116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a66a0-8063-4d07-af1d-158640416434 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:52.827466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d50c06f338341979d4d9f8e18a0666d', 'request_id': 'req-f71da130-3673-4a05-988b-940c19d1dfb2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:52.889471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] The token cache is being invalidate because project 9d50c06f338341979d4d9f8e18a0666d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:52.892606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:52.897354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:52.906213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2578/5137] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:51 2022] DELETE /identity/v3/projects/9d50c06f338341979d4d9f8e18a0666d => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:52.911398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:52.919517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:53.103666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:53.106985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:53.109896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:53.111296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects/d93493873dd54b20af6b0df8cd8c0ea4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:53.118142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d93493873dd54b20af6b0df8cd8c0ea4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:53.127991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:53.279292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71da130-3673-4a05-988b-940c19d1dfb2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:53.297254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:53.300750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:53.304546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:53.305295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:53.306851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:53.311495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8ae0b-1942-40d0-a335-cca52626d56d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:53.345727 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2579/5138] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:52 2022] GET /identity/v3/roles => generated 1651 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:53.351927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:53.352403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:53.356340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:53.450943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:53.452687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:53.454394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93493873dd54b20af6b0df8cd8c0ea4', 'request_id': 'req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:53.482088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93493873dd54b20af6b0df8cd8c0ea4', 'request_id': 'req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:53.513051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93493873dd54b20af6b0df8cd8c0ea4', 'request_id': 'req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:53.739490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2580/5139] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:53.750160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] The token cache is being invalidate because project d93493873dd54b20af6b0df8cd8c0ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:53.750686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:53.753023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:53.758653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49b6d1e6-32ea-40d6-b5c5-e2341a59b9af tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:53.771643 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2560/5140] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:52 2022] DELETE /identity/v3/projects/d93493873dd54b20af6b0df8cd8c0ea4 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:53.779850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:53.780212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:53.781769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:53.800952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549fd48-1530-4380-b482-cf75c2ccb9c5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:53.830660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:53.831829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:53.832334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:53.832832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:53.834081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:53.837337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:53.890335 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2581/5141] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:53 2022] GET /identity/v3/roles => generated 1651 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:53.891789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:53.892029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:53.894118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:53.897695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:53.934258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2561/5142] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:53.935790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:53.942581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:53.994957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4708-b902-4e11-9265-a8f4c3156405 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:54.017830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:54.019210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:54.023046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:54.023694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] PATH_INFO: `/v3/projects/bf7c559faf714f8395ef38d122e31e8d/users/89ac095cfc354ca2beb4289baf11fb2b/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:54.092855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7c559faf714f8395ef38d122e31e8d, user_id=89ac095cfc354ca2beb4289baf11fb2b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:54.103511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:54.202273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:54.274282 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2562/5143] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:53 2022] PUT /identity/v3/projects/bf7c559faf714f8395ef38d122e31e8d/users/89ac095cfc354ca2beb4289baf11fb2b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:54.277083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:54.304355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c092fb-d1a3-4c0f-bec9-852ff1979cbf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:54.309548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:54.631301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:54.632515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:54.633001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:54.633512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/roles/a9a08c73337d4babaa2461f259f669df` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:54.638512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbdd2-0319-41f5-90ca-dbf203d8531b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:54.638809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a9a08c73337d4babaa2461f259f669df)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:54.642038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:54.651613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:54.656666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:54.657278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:54.657734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:54.661477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:53:54.667277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:54.676629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:54.729403 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2563/5144] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:54.736529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:54.770956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f45c-1e41-4fe0-8f9c-00133e2dc009 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:54.792550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:54.792889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:54.794267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:54.794495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:54.795687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:54.807844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:54.872980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invalidating the token cache because role a9a08c73337d4babaa2461f259f669df has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:54.875740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:54.877974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:54.885139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2582/5145] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:53 2022] DELETE /identity/v3/roles/a9a08c73337d4babaa2461f259f669df => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:54.895105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:54.899090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:55.018938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2564/5146] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:54 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:55.024229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:55.029155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:55.375799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abbcd7-6936-4a2d-89cb-3f2672cfa3d1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:55.420130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4317f0-e9c8-4a72-9054-8fd911c7a984 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:55.432713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:55.435678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:55.436689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:55.437502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:55.439798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:55.454108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:55.599213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:55.599213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:55.599213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:55.599783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/users/6baa8a0434b6489392ae76cb6049a5f9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:55.608821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6baa8a0434b6489392ae76cb6049a5f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:55.612927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:55.624025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:55.778337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2565/5147] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:55 2022] POST /identity/v3/users => generated 283 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:53:55.785684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:55.838412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd99719-51cf-4f07-a933-1b2f0e86817d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:55.870367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:55.870367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:55.870367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:55.870367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:55.875569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:55.881927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:55.926116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6baa8a0434b6489392ae76cb6049a5f9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:55.927542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6baa8a0434b6489392ae76cb6049a5f9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:55.937526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2566/5148] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:55.939946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:55.975931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23febf4b-8152-46bf-bc51-eb358bb42739 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:55.991018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:55.993538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:55.996690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:55.996690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:55.998190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:56.009389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:56.067126 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2567/5149] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:56.069148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:56.087246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6baa8a0434b6489392ae76cb6049a5f9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:56.122318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad435-506c-47e7-baf5-b6d724346c3e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:56.149935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:56.151721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:56.152275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:56.160448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6baa8a0434b6489392ae76cb6049a5f9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:56.160692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] PATH_INFO: `/v3/projects/6c4495b6d0284d208f4c4c3ad8682182/users/7712edaf73e94aec8ca6d40b917496b3/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:56.188381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6baa8a0434b6489392ae76cb6049a5f9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:56.215087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2583/5150] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:54 2022] DELETE /identity/v3/users/6baa8a0434b6489392ae76cb6049a5f9 => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:56.225297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:56.229195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:56.241866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4495b6d0284d208f4c4c3ad8682182, user_id=7712edaf73e94aec8ca6d40b917496b3, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:56.257801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e78fcf-7c58-4e7d-a3af-c1b973eccfec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:56.413382 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2568/5151] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:56 2022] PUT /identity/v3/projects/6c4495b6d0284d208f4c4c3ad8682182/users/7712edaf73e94aec8ca6d40b917496b3/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:56.428271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:56.429363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:56.430203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:56.451791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9841e-52cf-42e1-9e08-4031a222600d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:56.544008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] MFA Rules not processed for user `7712edaf73e94aec8ca6d40b917496b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:56.546936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:56.566653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:56.658486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:56.680867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:56.680867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:56.680867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/groups/cb7928744e614eb1a27b05fe5815b878` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:56.680867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cb7928744e614eb1a27b05fe5815b878)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:56.681644 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:53:56.681644 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:53:56.681644 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:53:56.681644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:56.857029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2569/5152] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:53:56.862829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:56.865670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:56.991223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:57.030169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2584/5153] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:53:56 2022] DELETE /identity/v3/groups/cb7928744e614eb1a27b05fe5815b878 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:57.036343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:57.171546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a4c3-c3f8-45df-8dd9-313665ab3367 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:57.375984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59746-1586-4fd4-9d1e-89e1008fd1a1 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:57.390557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:57.395277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:57.396564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:57.397373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/projects/acd1e10a90584faca485eee7e4afd7b8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:57.402086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=acd1e10a90584faca485eee7e4afd7b8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:57.404643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:57.406009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:57.406736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:57.407483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:57.409141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:57.413673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:57.433634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:57.670700 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2570/5154] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:53:56 2022] POST /identity/v3/projects => generated 367 bytes in 809 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:57.672463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:57.686589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:57.778995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd1e10a90584faca485eee7e4afd7b8', 'request_id': 'req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:57.879626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:57.911281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd1e10a90584faca485eee7e4afd7b8', 'request_id': 'req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:57.936759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cca5-f36c-443e-a55e-3704947811a5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:57.937883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd1e10a90584faca485eee7e4afd7b8', 'request_id': 'req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:57.993850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] The token cache is being invalidate because project acd1e10a90584faca485eee7e4afd7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:53:57.994880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:58.001306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:58.010576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2585/5155] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:53:57 2022] DELETE /identity/v3/projects/acd1e10a90584faca485eee7e4afd7b8 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:53:58.012634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:58.025062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:58.175539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:58.177489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:58.178425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:58.179457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] PATH_INFO: `/v3/users/5e1a29eabafc477f8a764285142ce61a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:58.182858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1a29eabafc477f8a764285142ce61a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:58.187896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:58.386701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e0e3a-be0c-4de1-8d79-63d512b3c4a8 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:58.408583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:58.408583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:58.408583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:58.408583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:58.410632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:58.419027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:58.691918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2586/5156] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:53:58 2022] POST /identity/v3/users => generated 290 bytes in 681 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:53:58.693585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:58.709271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:58.725439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1a29eabafc477f8a764285142ce61a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:58.893845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1a29eabafc477f8a764285142ce61a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:58.936337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1a29eabafc477f8a764285142ce61a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:58.960283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:59.017556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1a29eabafc477f8a764285142ce61a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.030207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1a29eabafc477f8a764285142ce61a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.051958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2571/5157] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:53:57 2022] DELETE /identity/v3/users/5e1a29eabafc477f8a764285142ce61a => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:53:59.053951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:59.063073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:59.082672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b025cd-5ff8-4a18-85c4-1ae26ab711a7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:59.329679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69887ec2-eb73-4655-8a6b-71e06c3dd247 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:59.350510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:59.350510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:59.351824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:59.352898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:59.354894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:59.359610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f202bd-7b41-4f2d-853e-968b1b0dfc7e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:59.393396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2572/5158] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:53:59.396589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:59.397742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:59.398562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:59.426541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:59.458547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:53:59.461882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:53:59.474738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:59.476193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:59.481348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:59.481348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/domains/2fd25a59501b475b9e944801b9d8bdbd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:59.483792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2fd25a59501b475b9e944801b9d8bdbd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:59.491772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:59.494768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2573/5159] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:53:59.505211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:59.583300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7ae6e-5350-468a-8d8c-262f2dd5bb10 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:53:59.622402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.628638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:53:59.629811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.633565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:53:59.637052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:53:59.645754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] PATH_INFO: `/v3/projects/9de937e7299e453fb5202a0beb8377f9/users/f6503ebffc4f4dbe892c4d1e03b209ac/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:53:59.773451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de937e7299e453fb5202a0beb8377f9, user_id=f6503ebffc4f4dbe892c4d1e03b209ac, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:53:59.783015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:53:59.899043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.903816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:53:59.915651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2587/5160] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:53:58 2022] PATCH /identity/v3/domains/2fd25a59501b475b9e944801b9d8bdbd => generated 277 bytes in 1223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:53:59.917600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:53:59.921348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:00.035055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2574/5161] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:53:59 2022] PUT /identity/v3/projects/9de937e7299e453fb5202a0beb8377f9/users/f6503ebffc4f4dbe892c4d1e03b209ac/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:00.042597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:00.050597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:00.169334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74754a1c-3b79-47d4-9851-7b80694c5046 tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:00.308161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee458-ec73-4c3d-a59c-abe8791cecad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:00.319671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d4362fe8c644aaca67748004d6ff736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c34f7f165ff042b78803c807b99bd0da', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:00.320719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:00.321161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:00.321675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] PATH_INFO: `/v3/domains/2fd25a59501b475b9e944801b9d8bdbd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:00.331832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:00.348684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2fd25a59501b475b9e944801b9d8bdbd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:00.352209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:00.406216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:00.411476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:00.414335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:00.414938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:00.424235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:00.442685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:00.459951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:00.650179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:00.654966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:00.677724 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2588/5162] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:00.679516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:00.682253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:00.707747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311ff5-8ecc-4663-bc8d-33ab7c65190c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:00.717717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:00.718961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:00.719536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:00.720021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:00.721287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:00.730027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:00.765781 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2589/5163] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:00.771884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:00.815094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b01427-3a5c-41fd-afd7-6dbff3b378c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:00.857264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:00.876075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:00.894044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:00.998727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:01.000180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:01.000710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:01.001265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] PATH_INFO: `/v3/projects/9de937e7299e453fb5202a0beb8377f9/users/f6503ebffc4f4dbe892c4d1e03b209ac/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:01.006810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de937e7299e453fb5202a0beb8377f9, user_id=f6503ebffc4f4dbe892c4d1e03b209ac, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:01.013673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56589fa3-9025-4b63-b496-b1ca4dd3f890 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:01.071176 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2590/5164] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:00 2022] PUT /identity/v3/projects/9de937e7299e453fb5202a0beb8377f9/users/f6503ebffc4f4dbe892c4d1e03b209ac/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:01.077305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] The token cache is being invalidate because project 2fd25a59501b475b9e944801b9d8bdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:01.077305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.077305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.086675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:01.087733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:01.088566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:01.094537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.116240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.116240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2fd25a59501b475b9e944801b9d8bdbd', 'request_id': 'req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.144918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2575/5165] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:54:00 2022] DELETE /identity/v3/domains/2fd25a59501b475b9e944801b9d8bdbd => generated 0 bytes in 1104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:01.149378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:01.153703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:01.195923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7edc6d-18a7-45be-b12b-2ecd62485f7d tempest-InheritsV3TestJSON-973871238 tempest-InheritsV3TestJSON-973871238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:01.223622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:01.260055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] MFA Rules not processed for user `f6503ebffc4f4dbe892c4d1e03b209ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:01.262837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:01.425734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:01.427288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:01.430133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:01.430762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] PATH_INFO: `/v3/users/40466572d94b4b3f848ed1c2a8d85af1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:01.434497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40466572d94b4b3f848ed1c2a8d85af1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:01.443511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:01.565695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:01.612941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2591/5166] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:01.612941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:01.640989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e3ada-2fef-42df-ac48-e007672638ff None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:01.655008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:01.664191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:01.664191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:01.664191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:01.664191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:01.664191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:01.875517 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2592/5167] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:54:01 2022] POST /identity/v3/services => generated 239 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:01.881340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:01.946669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193322-76dd-4de8-921b-20a1a5baedc2 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:01.973731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40466572d94b4b3f848ed1c2a8d85af1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:01.991336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:01.998774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:01.999698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:02.002106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/a774f039d99646aea378527fbba7b17f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:02.006419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a774f039d99646aea378527fbba7b17f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:02.013174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:02.096645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40466572d94b4b3f848ed1c2a8d85af1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.115891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40466572d94b4b3f848ed1c2a8d85af1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.155530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40466572d94b4b3f848ed1c2a8d85af1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.156905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f779c305-11ce-40ee-914d-0dd47e6b6c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40466572d94b4b3f848ed1c2a8d85af1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.179947 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2576/5168] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:01 2022] DELETE /identity/v3/users/40466572d94b4b3f848ed1c2a8d85af1 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:02.190790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:02.191351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:02.191911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:02.245644 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2593/5169] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:01 2022] DELETE /identity/v3/services/a774f039d99646aea378527fbba7b17f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:02.247988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:02.252362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:02.260102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:02.265876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:02.330064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0651-e4d2-49d1-a316-0bc749a133f1 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:02.451338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2577/5170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:02.453219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:02.456501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:02.532740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2209aa4-ee85-49a3-9519-a093338d10b7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:02.553050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:02.555102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:02.555686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:02.557311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] PATH_INFO: `/v3/projects/869ac0b5366d400d99edf8b0539f2d2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:02.557531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:02.559767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:02.560568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:02.560754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869ac0b5366d400d99edf8b0539f2d2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:02.561064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:02.562553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:02.565426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:02.565973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:02.718693 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2594/5171] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:02 2022] POST /identity/v3/services => generated 289 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:02.721327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:02.727428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:02.861121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869ac0b5366d400d99edf8b0539f2d2d', 'request_id': 'req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.914986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869ac0b5366d400d99edf8b0539f2d2d', 'request_id': 'req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:02.934680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869ac0b5366d400d99edf8b0539f2d2d', 'request_id': 'req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:03.049176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c84f-8c6a-4dda-b058-9eab1afce740 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:03.095556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] The token cache is being invalidate because project 869ac0b5366d400d99edf8b0539f2d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:03.096938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:03.101028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:03.117751 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2578/5172] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:02 2022] DELETE /identity/v3/projects/869ac0b5366d400d99edf8b0539f2d2d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:03.121834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:03.129070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:03.232355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:03.233814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.235813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.236646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.241759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:03.361833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7960e-1fbe-4944-bed8-8a3a17c8ab93 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:03.422115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:03.424855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:03.426181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.426717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.427323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/d239b7f94917438d9789e406d1021ce1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.428881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:update_service(service_id=d239b7f94917438d9789e406d1021ce1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:03.439416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:03.442418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd575f-19c8-4796-92cf-ff5dfd4865ad service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:03.446915 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:03.446915 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:54:03.446915 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:54:03.450343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:03.497692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2595/5173] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:03.512637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe8fa-4479-490f-b49d-8ac8f9471c1c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.513181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe8fa-4479-490f-b49d-8ac8f9471c1c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.513710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe8fa-4479-490f-b49d-8ac8f9471c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.593775 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2579/5174] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:54:03 2022] PATCH /identity/v3/services/d239b7f94917438d9789e406d1021ce1 => generated 283 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:03.595859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:03.626996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-853fe8fa-4479-490f-b49d-8ac8f9471c1c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:03.630405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-853fe8fa-4479-490f-b49d-8ac8f9471c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:03.705594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2596/5175] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:03.710571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c65aa-d483-47a6-b1c2-2463df88982a tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:03.721718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:03.723832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.724638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.724978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.726172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.726524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/d239b7f94917438d9789e406d1021ce1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.727589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.728564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:get_service(service_id=d239b7f94917438d9789e406d1021ce1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:03.731784 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:03.731784 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:54:03.731784 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:54:03.738836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:03.787760 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2580/5176] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:54:03 2022] GET /identity/v3/services/d239b7f94917438d9789e406d1021ce1 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:03.795722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:03.796857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:03.799567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:03.817248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2597/5177] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:03.826577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:03.850423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316cbf-3811-406a-b635-afbc59a0dd38 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:03.866885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cc483-b80c-47a0-8ce9-930dfcf42b23 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:03.880672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:03.882607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.883442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.883996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/d239b7f94917438d9789e406d1021ce1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.887598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d239b7f94917438d9789e406d1021ce1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:03.890161 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:03.890161 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:54:03.890161 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:54:03.890774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:03.892970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:03.895197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:03.895803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:03.896289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:03.900060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:03.900742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:03.908126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:03.986353 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2598/5178] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:03.989849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:04.001842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:04.011181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:04.094254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2581/5179] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:03 2022] DELETE /identity/v3/services/d239b7f94917438d9789e406d1021ce1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:04.100474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:04.230028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95119a1a-0d5d-4a97-92fd-fe95625fcfc3 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:04.250197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:04.253632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:04.256454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:04.257256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:04.258655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:04.266989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:04.473074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422c37-25d2-44d0-93e1-527fc46dd5b8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:04.504526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2582/5180] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:04 2022] POST /identity/v3/projects => generated 375 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:04.506683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:04.606586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:04.611294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:04.611294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:04.611790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:04.626682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:04.683435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:04.693572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:04.736330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2599/5181] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:04.757294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:04.827766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713c909-1f16-453b-a9b5-fc72b42d362b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:04.828335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a14284-5115-4dc1-9855-9b490d0564ba service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:04.830519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:04.832621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:04.833319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:04.833933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/d239b7f94917438d9789e406d1021ce1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:04.835519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:get_service(service_id=d239b7f94917438d9789e406d1021ce1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:04.840174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Could not find service: d239b7f94917438d9789e406d1021ce1.: keystone.exception.ServiceNotFound: Could not find service: d239b7f94917438d9789e406d1021ce1. Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d239b7f94917438d9789e406d1021ce1. Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:54:04.865558 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:54:04.868535 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d239b7f94917438d9789e406d1021ce1. Oct 04 20:54:04.872047 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:54:04.874526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2583/5182] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:54:04 2022] GET /identity/v3/services/d239b7f94917438d9789e406d1021ce1 => generated 113 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:54:04.886035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:04.939657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423d01-9f91-46b7-b295-2bb95d5e0782 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:04.961769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:04.963891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:04.965563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:04.966434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:04.968070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:04.972116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.123555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.125725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.127680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.129808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.131839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.136200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.187949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2584/5183] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:04 2022] POST /identity/v3/services => generated 274 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:05.190383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.270306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5762-1337-4057-a002-58184286bae7 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.287040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.288263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.288922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.289651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.291273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.297028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.319270 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2600/5184] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:04 2022] POST /identity/v3/users => generated 288 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:05.327849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.350039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ccdc3-58eb-48fe-9a57-6c72630a60cb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.402162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.403501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.404096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.404697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.406157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.410604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.442163 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2601/5185] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:05.448141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.471868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12080ee6-08ea-44a2-9d9b-1c4698825515 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.474967 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2585/5186] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:05 2022] POST /identity/v3/services => generated 275 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:05.481891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.514654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.515826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.516520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.517010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.518213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.522743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.567298 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2602/5187] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:05.574861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.575251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908c6aa-9f92-42cf-aa95-e3317dcf2165 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.588551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.599255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.599255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.599255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.599255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.600020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.615221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073ae85-d266-4cf6-ae6f-aa17e9bc3e6d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.627045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:05.628611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.629239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.629842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] PATH_INFO: `/v3/projects/7293bb41bd38438db52b687bd0b0e941/users/4ed2a563a2ab4a788e75ee1af5cd252d/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.663730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7293bb41bd38438db52b687bd0b0e941, user_id=4ed2a563a2ab4a788e75ee1af5cd252d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:05.670015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd0dd8-4c91-4603-ba87-52175a6ef87e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:05.751038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2586/5188] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:05 2022] POST /identity/v3/services => generated 274 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:05.764400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:05.797225 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2603/5189] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:05 2022] PUT /identity/v3/projects/7293bb41bd38438db52b687bd0b0e941/users/4ed2a563a2ab4a788e75ee1af5cd252d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:05.818639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:05.819173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:05.819889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:05.861788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802afd-4265-41f8-bd0b-d31c927e9048 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:05.936266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:05.942144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] MFA Rules not processed for user `4ed2a563a2ab4a788e75ee1af5cd252d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:05.947444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:06.130751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:06.143010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.145599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.148361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.148878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.154908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.158742 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:06.158742 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:54:06.158742 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:54:06.160782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.190663 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2587/5190] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:54:05 2022] GET /identity/v3/services => generated 2978 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:06.194314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.242625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49480b-92aa-4c42-85f4-cb4cf32adc7d tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.268213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.269276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.269781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.270340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.271620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1107266941) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:06.272168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.283847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.294720 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2604/5191] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3754 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:06.311831 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2588/5192] 10.222.0.78 () {58 vars in 1222 bytes} [Tue Oct 4 20:54:06 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1107266941 => generated 417 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:06.320406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.362869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a1723-ad66-4fc8-b747-4a929691263c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.373185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.376426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:06.399564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.405278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.410547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.411434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.415617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1553509890) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:06.418974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.426485 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:06.426485 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:54:06.426485 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:54:06.435536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.459715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2605/5193] 10.222.0.78 () {58 vars in 1222 bytes} [Tue Oct 4 20:54:06 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1553509890 => generated 418 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:06.461996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.511383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f681bc-ac96-4c20-a708-1f54735b6482 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.540535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.543567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.543567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.544431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.547356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-118370727) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:06.548484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.559228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.586692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2606/5194] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Oct 4 20:54:06 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-118370727 => generated 416 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:06.589242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.632258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ecd27-1704-40ef-8434-04acc8fc02a8 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.661854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.663184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.663714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.664226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/2331229d52bf40b090977babffe21f04` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.665404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2331229d52bf40b090977babffe21f04)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.676110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.723918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:06.724264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b7131-f4b9-47f0-ac6a-adb9723b954e tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.736229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.738538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.739176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.739939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:06.765539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:06.780863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:06.805810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2589/5195] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3754 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:06.892665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2607/5196] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:06 2022] DELETE /identity/v3/services/2331229d52bf40b090977babffe21f04 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:06.899558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:06.922605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5304-4c04-4679-9a2b-3127d25871fd service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:06.997329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:06.998728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:06.999259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:06.999997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/6283d9324ae64cc38b87db49cd7e9d6b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:07.001377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6283d9324ae64cc38b87db49cd7e9d6b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:07.005215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:07.193381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2590/5197] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:06 2022] DELETE /identity/v3/services/6283d9324ae64cc38b87db49cd7e9d6b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:07.200942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:07.231274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59727e24-8e56-4785-88ec-07780e79fab0 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:07.279963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6503ebffc4f4dbe892c4d1e03b209ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de937e7299e453fb5202a0beb8377f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:07.282866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:07.283984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:07.284942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] PATH_INFO: `/v3/services/0221a75221fe46698b84afaeea60e7ad` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:07.286623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0221a75221fe46698b84afaeea60e7ad)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:07.292048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801c59f-7cea-4cb1-b7aa-509c2d94c2df tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:07.418254 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2608/5198] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:07 2022] DELETE /identity/v3/services/0221a75221fe46698b84afaeea60e7ad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:07.427650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:07.431704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:07.722861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:07.763574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f3f38-783e-4841-b7dc-7ee941c0b3d4 tempest-ServicesTestJSON-685287978 tempest-ServicesTestJSON-685287978-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:07.827127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:07.829692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:07.831093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:07.833223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] PATH_INFO: `/v3/users/7712edaf73e94aec8ca6d40b917496b3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:07.836456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7712edaf73e94aec8ca6d40b917496b3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:07.842238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:08.228110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7712edaf73e94aec8ca6d40b917496b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:08.346112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7712edaf73e94aec8ca6d40b917496b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:08.374285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7712edaf73e94aec8ca6d40b917496b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:08.415891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7712edaf73e94aec8ca6d40b917496b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:08.421919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7712edaf73e94aec8ca6d40b917496b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:08.444562 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2591/5199] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:07 2022] DELETE /identity/v3/users/7712edaf73e94aec8ca6d40b917496b3 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:08.452746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:08.453674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:08.453852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:08.622167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:08.622167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:08.623452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:08.623452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:08.824643 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2609/5200] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:08.852717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9081fe-cbac-4a26-b4fb-f0aa7a844012 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:08.878962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:08.880538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:08.885199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:08.885842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] PATH_INFO: `/v3/projects/fe98366871b44258815674ebd4a7f675` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:08.892790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe98366871b44258815674ebd4a7f675)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:08.903086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:08.946141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:08.951265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:09.297462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:09.299464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1833e0-23b4-4118-bb2e-3eedf12e1e9c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:09.336206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe98366871b44258815674ebd4a7f675', 'request_id': 'req-4ba8b099-fe2c-4730-a4de-0f01debae32d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:09.365891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe98366871b44258815674ebd4a7f675', 'request_id': 'req-4ba8b099-fe2c-4730-a4de-0f01debae32d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:09.392056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe98366871b44258815674ebd4a7f675', 'request_id': 'req-4ba8b099-fe2c-4730-a4de-0f01debae32d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:09.493047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:09.494554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:09.495100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:09.496945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:09.535526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] The token cache is being invalidate because project fe98366871b44258815674ebd4a7f675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:09.536839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:09.539750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:09.550703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2592/5201] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:08 2022] DELETE /identity/v3/projects/fe98366871b44258815674ebd4a7f675 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:09.554960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:09.557606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:09.568840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:09.729696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:09.735999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:09.772958 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2610/5202] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:09.824351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b099-fe2c-4730-a4de-0f01debae32d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:09.835587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:09.841628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:09.841628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:09.841628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] PATH_INFO: `/v3/users/2d4362fe8c644aaca67748004d6ff736` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:09.842326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4362fe8c644aaca67748004d6ff736)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:09.846777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:10.206393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4362fe8c644aaca67748004d6ff736'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:10.346336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4362fe8c644aaca67748004d6ff736'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:10.379820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4362fe8c644aaca67748004d6ff736'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:10.424007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4362fe8c644aaca67748004d6ff736'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:10.429536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4362fe8c644aaca67748004d6ff736'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:10.482569 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2593/5203] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:09 2022] DELETE /identity/v3/users/2d4362fe8c644aaca67748004d6ff736 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:11.136752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:11.501071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:11.504467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:11.541357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f5dfc-8c79-4970-93ab-e7daf831ec4e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:11.715446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:11.718173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:11.718953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:11.720059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] PATH_INFO: `/v3/projects/6c4495b6d0284d208f4c4c3ad8682182` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:11.723229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4495b6d0284d208f4c4c3ad8682182)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:11.728418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:12.097282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4495b6d0284d208f4c4c3ad8682182', 'request_id': 'req-3118af73-a93b-430a-90ce-0ad3bad39abf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.243987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4495b6d0284d208f4c4c3ad8682182', 'request_id': 'req-3118af73-a93b-430a-90ce-0ad3bad39abf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.262024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4495b6d0284d208f4c4c3ad8682182', 'request_id': 'req-3118af73-a93b-430a-90ce-0ad3bad39abf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.290568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] The token cache is being invalidate because project 6c4495b6d0284d208f4c4c3ad8682182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:12.291129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.292359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.298960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2611/5204] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:11 2022] DELETE /identity/v3/projects/6c4495b6d0284d208f4c4c3ad8682182 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:12.301355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:12.303853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:12.330541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6445cb-43cd-4eff-9688-b15f27158734 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:12.472044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:12.473763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:12.476094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:12.477150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] PATH_INFO: `/v3/users/f6503ebffc4f4dbe892c4d1e03b209ac` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:12.481285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6503ebffc4f4dbe892c4d1e03b209ac)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:12.486043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:12.862776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6503ebffc4f4dbe892c4d1e03b209ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:12.886910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:12.889476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:12.927394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118af73-a93b-430a-90ce-0ad3bad39abf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:12.948276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:12.949576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:12.950700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:12.950700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] PATH_INFO: `/v3/projects/c34f7f165ff042b78803c807b99bd0da` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:12.959413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34f7f165ff042b78803c807b99bd0da)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:12.963397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:12.992784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6503ebffc4f4dbe892c4d1e03b209ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.025229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6503ebffc4f4dbe892c4d1e03b209ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.068856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6503ebffc4f4dbe892c4d1e03b209ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.071807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b52f6c7-448c-46a9-8988-6a6e4597536c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6503ebffc4f4dbe892c4d1e03b209ac'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.112383 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2594/5205] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:12 2022] DELETE /identity/v3/users/f6503ebffc4f4dbe892c4d1e03b209ac => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:13.264837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:13.275055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34f7f165ff042b78803c807b99bd0da', 'request_id': 'req-e9a59edc-0df2-40ac-9b30-7eaf1240899d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.392366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34f7f165ff042b78803c807b99bd0da', 'request_id': 'req-e9a59edc-0df2-40ac-9b30-7eaf1240899d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.430104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34f7f165ff042b78803c807b99bd0da', 'request_id': 'req-e9a59edc-0df2-40ac-9b30-7eaf1240899d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.474456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] The token cache is being invalidate because project c34f7f165ff042b78803c807b99bd0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:13.475171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.480681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9a59edc-0df2-40ac-9b30-7eaf1240899d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:13.490981 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2612/5206] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:12 2022] DELETE /identity/v3/projects/c34f7f165ff042b78803c807b99bd0da => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:13.494000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:13.494876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:13.495073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:13.552009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:13.554823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:13.588233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:13.694068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2595/5207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:13.708415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:13.709294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:13.710241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:13.751398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:13.754438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:13.772516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2613/5208] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:13.782400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:13.808856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b275c5-0eac-4aa1-bdab-cd2e68773f57 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:13.822855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:13.827065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:13.828014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:13.828963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:13.830444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:13.833086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:13.837108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:13.865036 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2596/5209] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:13.877617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:13.911258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8a1a5-6b34-4e17-83c1-d64f6387fa1a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:13.934480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:13.935649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:13.936109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:13.936608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:13.937803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:13.941606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:14.601685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2614/5210] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:13 2022] POST /identity/v3/projects => generated 367 bytes in 727 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:14.613024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:14.657213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dead4-885e-410f-8927-9c0e472551d6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:14.913591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:14.915039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:14.915700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:14.916313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:14.917816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:14.922910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:15.186535 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2597/5211] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:14 2022] POST /identity/v3/users => generated 284 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:15.188198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:15.225796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fd294-4aaa-4997-a397-63a1e8f68de2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:15.241939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:15.243040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:15.244139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:15.245468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:15.248008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:15.253640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:15.299098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:15.303672 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2615/5212] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:15.334444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05266-4e9a-4b12-880d-2573e593ae44 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:15.360840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:15.362025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:15.362524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:15.363009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:15.365038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:15.369333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041713bb-f83e-440d-9a60-e3343a3811b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:15.415239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2598/5213] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:15.415592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:15.446115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925e24-7413-4046-8887-56a8d9e749d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:15.458886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:15.462099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:15.464754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:15.475018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] PATH_INFO: `/v3/projects/b9bd8061142f4fc3b5abd58a5c53ad10/users/ee2e7d056c88436abafc30041c162b30/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:15.513311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bd8061142f4fc3b5abd58a5c53ad10, user_id=ee2e7d056c88436abafc30041c162b30, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:15.520382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:15.719457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2616/5214] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:15 2022] PUT /identity/v3/projects/b9bd8061142f4fc3b5abd58a5c53ad10/users/ee2e7d056c88436abafc30041c162b30/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:15.753948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:15.760039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:15.764080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:15.910262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] MFA Rules not processed for user `ee2e7d056c88436abafc30041c162b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:15.915101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:16.210486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:16.215352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:16.336035 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2599/5215] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 595 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:16.350347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:16.594148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c74a6-8cf6-493a-88bd-cc18fec56b3e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:16.612839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:16.613481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468b59-9188-422f-a563-87c8e8bdcfd0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:16.614679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:16.616000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:16.616675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] PATH_INFO: `/v3/projects/9de937e7299e453fb5202a0beb8377f9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:16.620475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de937e7299e453fb5202a0beb8377f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:16.624799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:16.639960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:16.641072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:16.641571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:16.642090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:16.643374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:16.648070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:16.768009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:16.873094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de937e7299e453fb5202a0beb8377f9', 'request_id': 'req-75e094f6-b33c-454b-a404-2aef9f939f1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:16.889587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2600/5216] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:16 2022] POST /identity/v3/projects => generated 367 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:16.897331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:16.974009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de937e7299e453fb5202a0beb8377f9', 'request_id': 'req-75e094f6-b33c-454b-a404-2aef9f939f1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:16.997692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de937e7299e453fb5202a0beb8377f9', 'request_id': 'req-75e094f6-b33c-454b-a404-2aef9f939f1f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:17.034838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:17.052905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] The token cache is being invalidate because project 9de937e7299e453fb5202a0beb8377f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:17.053437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:17.055203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75e094f6-b33c-454b-a404-2aef9f939f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:17.064193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2617/5217] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:16 2022] DELETE /identity/v3/projects/9de937e7299e453fb5202a0beb8377f9 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:17.075620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7feb4-97b1-469a-84b3-816db66746c4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.076098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7feb4-97b1-469a-84b3-816db66746c4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.076582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7feb4-97b1-469a-84b3-816db66746c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.097080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88595ec-8925-4821-824b-5952da662788 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:17.106443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:17.107702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.107702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.108137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.109368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:17.113528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:17.157122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f4c7feb4-97b1-469a-84b3-816db66746c4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:17.160196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4c7feb4-97b1-469a-84b3-816db66746c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:17.177903 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2618/5218] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:17.193400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.197201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.199945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.248340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:17.253166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:17.297208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2601/5219] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:16 2022] POST /identity/v3/users => generated 290 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:17.303590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.311330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:17.324258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2619/5220] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:17.331040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.375418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4ac8e-e94b-44bc-a23f-c5905071c373 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:17.392173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a00b5-c09d-40a5-abcf-0f5bcd665d34 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:17.421305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:17.424233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.425113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.428045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:17.428487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.430323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.431083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.431673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.433900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:17.435104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:17.438533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:17.440898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:17.443992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:17.497635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2620/5221] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:17.505197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.524265 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2602/5222] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:17.541029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.578736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d7aa-b463-4b4f-8590-7beea400e414 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:17.586681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1270bb-ade6-42df-b0c8-ca2085b803ad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:17.592141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:17.593739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.594535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.595344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.596993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:17.604196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:17.629503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:17.631740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:17.632064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:17.634084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] PATH_INFO: `/v3/projects/1291bf77f503402cb3b606e3ec355032/users/48dee46137e4499194c1409295965268/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:17.709716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1291bf77f503402cb3b606e3ec355032, user_id=48dee46137e4499194c1409295965268, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:17.718415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:17.850910 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2621/5223] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:17 2022] POST /identity/v3/projects => generated 389 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:17.852896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.865458 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2603/5224] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:17 2022] PUT /identity/v3/projects/1291bf77f503402cb3b606e3ec355032/users/48dee46137e4499194c1409295965268/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:17.882029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:17.902807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:18.309624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752612-a395-4e5a-9728-71af1191f831 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:18.354450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:18.355617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:18.356078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:18.356539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:18.357659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:18.376211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:18.431222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:18.610263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2604/5225] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:17 2022] POST /identity/v3/users => generated 301 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:18.612032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:18.675341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef4827-6758-4f39-ae9c-ad354be12418 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:18.700650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:18.701823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:18.702444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:18.703045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:18.707345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:18.711070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:18.772513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2605/5226] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:18.775275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:18.776646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db8ab-afce-4293-a9b7-f8bf1a123f17 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:18.800272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:18.802446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:18.804040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:18.805418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] PATH_INFO: `/v3/users/8ca55756d08d40fb8464b859f5945e64` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:18.819468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca55756d08d40fb8464b859f5945e64)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:18.827368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:18.860459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc0a6-ae1b-43a9-9cdf-d229b0ffee14 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:18.868632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:18.872329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:18.873049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:18.874523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:18.882778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:18.892111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:18.978971 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2606/5227] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:18.982185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:19.010642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b200-9610-497b-b2f6-a66c96940295 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:19.023380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:19.025026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:19.026227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:19.027876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] PATH_INFO: `/v3/projects/1291bf77f503402cb3b606e3ec355032/users/48dee46137e4499194c1409295965268/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:19.031962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1291bf77f503402cb3b606e3ec355032, user_id=48dee46137e4499194c1409295965268, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:19.040443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:19.075992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2607/5228] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:18 2022] PUT /identity/v3/projects/1291bf77f503402cb3b606e3ec355032/users/48dee46137e4499194c1409295965268/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:19.079038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:19.298050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9d6c-81ab-4ae5-8842-f241f4eac9ed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:19.320672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:19.322915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:19.331614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:19.332248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] PATH_INFO: `/v3/projects/16bc747c8f984e4a9a1506f65102ede1/users/3ee4c72e561a43578459dd6b8a6a2624/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:19.423856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bc747c8f984e4a9a1506f65102ede1, user_id=3ee4c72e561a43578459dd6b8a6a2624, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:19.444574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ee0a7-11f2-4d24-bf83-4a59cb8a0397 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:19.521301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca55756d08d40fb8464b859f5945e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:19.526714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca55756d08d40fb8464b859f5945e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:19.623705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2608/5229] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:19 2022] PUT /identity/v3/projects/16bc747c8f984e4a9a1506f65102ede1/users/3ee4c72e561a43578459dd6b8a6a2624/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:19.625788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be55-9fda-4881-81dc-92641407cb21 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:19.626233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be55-9fda-4881-81dc-92641407cb21 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:19.626692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8be55-9fda-4881-81dc-92641407cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:19.661149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca55756d08d40fb8464b859f5945e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:19.810232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca55756d08d40fb8464b859f5945e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:19.844813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca55756d08d40fb8464b859f5945e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:19.898921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2622/5230] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:17 2022] DELETE /identity/v3/users/8ca55756d08d40fb8464b859f5945e64 => generated 0 bytes in 2042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:19.911554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:19.922392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:19.935515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9ef8be55-9fda-4881-81dc-92641407cb21 None None] MFA Rules not processed for user `48dee46137e4499194c1409295965268`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:19.947775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ef8be55-9fda-4881-81dc-92641407cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:20.131957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:20.346640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2609/5231] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 722 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:20.349259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.353670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b873-0416-4349-99e7-099565b670db admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:20.364211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.364698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:20.380096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:20.382457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.384088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.390978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:20.390978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:20.394039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:20.428462 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2623/5232] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:20.431318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:20.433562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:20.435887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:20.471042 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2610/5233] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:20.472992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:20.500855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecc4cb-dbae-4f78-be28-121f4eef9b4f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:20.508787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff1428-2aa3-428d-a9b1-b95849578eec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:20.533805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:20.534343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:20.534965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.535438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.536000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] PATH_INFO: `/v3/projects/16bc747c8f984e4a9a1506f65102ede1/users/3ee4c72e561a43578459dd6b8a6a2624/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:20.538550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.540750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.541580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:20.549507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bc747c8f984e4a9a1506f65102ede1, user_id=3ee4c72e561a43578459dd6b8a6a2624, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:20.556140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:20.564324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:20.576054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8244c0-2813-4e86-a600-a51c84b8584b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:20.586046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:20.605587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2611/5234] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:20 2022] PUT /identity/v3/projects/16bc747c8f984e4a9a1506f65102ede1/users/3ee4c72e561a43578459dd6b8a6a2624/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:20.607045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:20.624597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:20.818192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2624/5235] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:20 2022] POST /identity/v3/projects => generated 360 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:20.824362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65027cee-0d40-43b7-b396-ea30f9b721ad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:20.826867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.828126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.829830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:20.953453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] MFA Rules not processed for user `3ee4c72e561a43578459dd6b8a6a2624`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:20.966106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:20.994940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:20.997264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:20.997264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:20.997264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:21.258405 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2625/5236] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:21.260245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:21.301668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:21.312840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:21.364320 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2612/5237] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:21.369274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:21.414035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a0b7-33df-4ce0-849a-3bf99b72e175 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:21.436470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:21.437436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:21.437919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:21.438407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:21.440426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:21.453909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:21.536381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be607b0-8f87-4790-9d65-014a0097b1a3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:21.546558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:21.547768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:21.548295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:21.548958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:21.550720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:21.555609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:21.668708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2613/5238] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:21 2022] POST /identity/v3/projects => generated 393 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:21.676500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:21.753611 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2626/5239] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:21 2022] POST /identity/v3/users => generated 373 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:21.756744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:21.798126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc511ee-bf16-4dad-91b2-a5d8bcf190a8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.001319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96b19-3365-4f61-88b9-dd70c3263e6c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.035845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.037239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.038153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.040110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.041335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.049801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:22.061369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.062776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.064656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.065713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/6d941510f5e24bd0aebc9c1e659aed4a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.107742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_user(user_id=6d941510f5e24bd0aebc9c1e659aed4a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.113131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:22.124035 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2627/5240] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:21 2022] GET /identity/v3/users/6d941510f5e24bd0aebc9c1e659aed4a => generated 373 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:22.126840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:22.148553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355da09-f8f4-4612-aba5-66c5cb5b3432 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.161919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.163754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.164630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.165354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/6d941510f5e24bd0aebc9c1e659aed4a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.172801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6d941510f5e24bd0aebc9c1e659aed4a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.174722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:22.346353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2614/5241] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:21 2022] POST /identity/v3/users => generated 297 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:22.352480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:22.418317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0509c-1ada-4a38-9edb-a895fcc7b143 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.458874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.460016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.460527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.461018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.468710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.476418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:22.544397 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2615/5242] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:22.550205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:22.569415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d941510f5e24bd0aebc9c1e659aed4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:22.572129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d941510f5e24bd0aebc9c1e659aed4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:22.593422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:22.616573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2f4f-52a0-469b-8d7a-4277f50dfe3c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.630341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.632507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.633292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.635379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.636345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.640290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:22.672307 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2616/5243] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:22.686179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:22.705611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d941510f5e24bd0aebc9c1e659aed4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:22.734513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e215-de74-4d9e-a880-df2124dd49c2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:22.763381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:22.765080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:22.765504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:22.766345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] PATH_INFO: `/v3/projects/a65d50e28ca14290ac9da09fe3450c59/users/9ba59afcd9a0453d8825aebe32f2c5a4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:22.768366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d941510f5e24bd0aebc9c1e659aed4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:22.819057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d941510f5e24bd0aebc9c1e659aed4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:22.842683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65d50e28ca14290ac9da09fe3450c59, user_id=9ba59afcd9a0453d8825aebe32f2c5a4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:22.849983 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2628/5244] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:22 2022] DELETE /identity/v3/users/6d941510f5e24bd0aebc9c1e659aed4a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:22.852062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:22.855962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:22.864289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087b92-c4c6-416f-aa74-aebc1465566d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:23.095749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e4575-69bf-41e3-af5c-3bd1eb6fe153 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:23.102463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:23.102873 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2617/5245] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:22 2022] PUT /identity/v3/projects/a65d50e28ca14290ac9da09fe3450c59/users/9ba59afcd9a0453d8825aebe32f2c5a4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:23.112481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8379af-193e-4f1d-8d73-302ff3f0c781 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:23.116291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8379af-193e-4f1d-8d73-302ff3f0c781 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:23.117174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8379af-193e-4f1d-8d73-302ff3f0c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:23.277160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-db8379af-193e-4f1d-8d73-302ff3f0c781 None None] MFA Rules not processed for user `9ba59afcd9a0453d8825aebe32f2c5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:23.284009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db8379af-193e-4f1d-8d73-302ff3f0c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:23.372091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:23.373560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:23.374069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:23.374570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/f0ba154ebee14e1ca0fab55a976431b4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:23.377830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f0ba154ebee14e1ca0fab55a976431b4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:23.391544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:23.529337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2618/5246] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:23.531941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:23.535690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:23.535996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:23.667288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] MFA Rules not processed for user `89ac095cfc354ca2beb4289baf11fb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:23.671085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:23.729026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ba154ebee14e1ca0fab55a976431b4', 'request_id': 'req-a4e31393-b31c-4505-b196-eaea59295d82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:23.871181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ba154ebee14e1ca0fab55a976431b4', 'request_id': 'req-a4e31393-b31c-4505-b196-eaea59295d82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:23.900313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ba154ebee14e1ca0fab55a976431b4', 'request_id': 'req-a4e31393-b31c-4505-b196-eaea59295d82'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:23.947760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] The token cache is being invalidate because project f0ba154ebee14e1ca0fab55a976431b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:23.950735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:23.952670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:23.959002 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2629/5247] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:22 2022] DELETE /identity/v3/projects/f0ba154ebee14e1ca0fab55a976431b4 => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:23.966716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:23.973439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:23.998246 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2619/5248] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:23.999802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:24.025949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:24.182000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:24.308645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b1ae7-89c5-42ec-8c81-51359d98efd1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:24.343566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:24.344922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:24.345434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:24.346050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:24.347788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:24.352282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:24.360622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e31393-b31c-4505-b196-eaea59295d82 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:24.376194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:24.387710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:24.387710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:24.387710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:24.396872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:24.612366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:24.615738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217566b-0db4-417e-ab5b-79739c69f809 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:24.636786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2630/5249] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:24.643952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:24.644472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:24.645051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:24.664511 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2620/5250] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:23 2022] POST /identity/v3/projects => generated 359 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:24.668629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:24.674156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:24.750313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] MFA Rules not processed for user `f2a38bfe37194b57aeca1a0e11becf17`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:24.755997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:24.853699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010106-4a41-4955-8f54-b43c9b6bf3e8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:24.866245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:24.867185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:24.867705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:24.868209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] PATH_INFO: `/v3/projects/28d648bc85694df58d795f914acd4843` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:24.873689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d648bc85694df58d795f914acd4843)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:24.884945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:24.946536 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2631/5251] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:24.948606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:24.951648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:25.257796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f442-36dd-4f93-a857-dece7872b216 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:25.291622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d648bc85694df58d795f914acd4843', 'request_id': 'req-60d65054-d73e-4f3c-a160-7d10ddd6a10d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:25.337221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d648bc85694df58d795f914acd4843', 'request_id': 'req-60d65054-d73e-4f3c-a160-7d10ddd6a10d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:25.380133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d648bc85694df58d795f914acd4843', 'request_id': 'req-60d65054-d73e-4f3c-a160-7d10ddd6a10d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:25.604880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:25.606286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:25.606813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:25.619012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:25.619012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:25.623350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788615a-c71a-4373-bb36-3116bce293fc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:25.624795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] The token cache is being invalidate because project 28d648bc85694df58d795f914acd4843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:25.625694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:25.628497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:25.641061 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2621/5252] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:24 2022] DELETE /identity/v3/projects/28d648bc85694df58d795f914acd4843 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:25.644090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:25.647484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:25.833073 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2632/5253] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:24 2022] POST /identity/v3/users => generated 417 bytes in 881 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:25.833073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:25.833073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:25.833909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:25.917616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:25.931363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:25.991669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d65054-d73e-4f3c-a160-7d10ddd6a10d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.021803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.025294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.031663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.037146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.043366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:26.124865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:26.271890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2633/5254] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:26.274004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.286344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:26.327511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690160d-53fc-4be1-ab57-1fdac2f81c9b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.360294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.361728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.362334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.364115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.365636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.382584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.388620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.398804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a7fe-9832-40a0-8a68-bddfeb736083 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.454060 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2622/5255] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:26.459357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.460016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.461051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.560015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:26.564185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:26.594610 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2634/5256] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:54:26 2022] POST /identity/v3/roles => generated 240 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:26.610147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.618651 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2623/5257] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:26.625669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.692444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783e5c5-c9bc-4287-a3d8-a5e28bcdd1db None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.699615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6803ce-f2a6-4f05-afed-4e0f4ec6e684 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.704725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.706045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.706682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.707313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.708790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:26.710254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.713538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.731560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.732812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.733597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.735026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/6a214e7587f7460686892c955d1a40a6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.746250 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2624/5258] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:54:26.753586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.778182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbb68-4118-494e-a963-9b9a07a6a0d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.788857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.790017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.790622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.790811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_user(user_id=6a214e7587f7460686892c955d1a40a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.791106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.792627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.795459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.801059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.817870 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2635/5259] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:26 2022] GET /identity/v3/users/6a214e7587f7460686892c955d1a40a6 => generated 417 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:26.825319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.876131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb7844-ab22-4e90-9342-d5f2f0d94e96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.889399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.891838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.892841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.894475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/roles/9cbe5423911c47d08e13f02d8c506f3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.899397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_role(role_id=9cbe5423911c47d08e13f02d8c506f3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.902926 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:26.902926 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:54:26.902926 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:54:26.905644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:26.910150 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2636/5260] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:26 2022] GET /identity/v3/roles/9cbe5423911c47d08e13f02d8c506f3a => generated 240 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:26.919455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:26.951243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590759-7d2b-4973-8580-b1d8b1f716ce tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:26.975493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:26.980536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:26.982714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:26.983947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:26.986218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:26.993597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:27.006593 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2625/5261] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:27.015234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:27.291296 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2637/5262] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:26 2022] POST /identity/v3/projects => generated 358 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:27.298760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:27.302591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32312-cc38-438a-b798-9e87607a082f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:27.491430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:27.509771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf97aa-8be4-4ac0-881b-32647d14d611 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:27.534177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:27.535302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:27.535839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:27.536345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:27.549312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_project(project_id=edbb07a0bddd4d0aa2966f25f63e28b3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:27.554291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:27.558151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2638/5263] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:54:27 2022] GET /identity/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3 => generated 358 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:54:27.564586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:27.584268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da334f2-b0be-41b7-a41f-aae199061a34 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:27.602836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:27.608625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:27.612032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:27.613995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3/users/6a214e7587f7460686892c955d1a40a6/roles/9cbe5423911c47d08e13f02d8c506f3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:27.617184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:27.622295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:27.624052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:27.626137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:27.628171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_grant(project_id=edbb07a0bddd4d0aa2966f25f63e28b3, user_id=6a214e7587f7460686892c955d1a40a6, role_id=9cbe5423911c47d08e13f02d8c506f3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:27.632523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:27.644113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:27.646405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d91609-58b9-467b-8de1-13ac395066a3 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:27.818417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2639/5264] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:27 2022] PUT /identity/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3/users/6a214e7587f7460686892c955d1a40a6/roles/9cbe5423911c47d08e13f02d8c506f3a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:27.821137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:27.821645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:27.822139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:27.823708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2626/5265] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:27 2022] POST /identity/v3/users => generated 287 bytes in 810 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:27.829365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:54:27.844315 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:54:27.846579 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:54:27.911496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7fbc6-9248-47d2-9785-c9be4bd82731 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:27.913548 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2640/5266] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:54:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 86 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:54:27.913548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:28.149580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:28.150687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:28.151756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:28.155483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:28.155483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:28.158422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:28.183428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83f16-d4aa-407e-a429-932637c484d4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:28.210855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2627/5267] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:27 2022] GET /identity/v3/roles => generated 1651 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:28.212105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:28.221077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:28.222210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:28.222943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:28.226362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:28.232926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:28.239813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:28.251885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c80b5-0b4d-4aca-8858-48ca49564bff admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:28.276986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:28.278051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:28.278551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:28.279064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:28.280403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:28.283792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:28.335754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2628/5268] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:28 2022] GET /identity/v3/roles => generated 1651 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:28.337474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:28.379254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a766-4d22-4b92-afd3-920f18854412 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:28.412800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:28.414035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:28.414551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:28.415036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] PATH_INFO: `/v3/projects/8600ebb44bd847e2b8114c3d8d2cbbf2/users/f06e5f7d140c4e689955b9856e651331/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:28.489588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8600ebb44bd847e2b8114c3d8d2cbbf2, user_id=f06e5f7d140c4e689955b9856e651331, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:28.503248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7c94f-1edf-4012-8208-1c35580a29bc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:28.527580 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2641/5269] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:27 2022] POST /identity/v3/projects => generated 359 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:28.537329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:28.650882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2629/5270] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:28 2022] PUT /identity/v3/projects/8600ebb44bd847e2b8114c3d8d2cbbf2/users/f06e5f7d140c4e689955b9856e651331/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:28.682844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed4b5-90b9-4279-98cf-0b35ac6e2853 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:28.682844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed4b5-90b9-4279-98cf-0b35ac6e2853 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:28.682844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed4b5-90b9-4279-98cf-0b35ac6e2853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:28.803638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2341fbb-2d6d-47d3-b632-00fa406ce241 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:28.860131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-271ed4b5-90b9-4279-98cf-0b35ac6e2853 None None] MFA Rules not processed for user `f06e5f7d140c4e689955b9856e651331`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:28.864259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-271ed4b5-90b9-4279-98cf-0b35ac6e2853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:29.023851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:29.025653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.026928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.028305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.037319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_project(project_id=1b62a35a88c0491b8d7be5e9db76a21d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:29.045919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:29.052430 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2642/5271] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:54:28 2022] GET /identity/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d => generated 359 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:29.059911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:29.080766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b8c85-6bba-48b3-bbd9-d927e5b90ff8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:29.090878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:29.098198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:29.099807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.100405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.101094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d/users/6a214e7587f7460686892c955d1a40a6/roles/9cbe5423911c47d08e13f02d8c506f3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.106312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1b62a35a88c0491b8d7be5e9db76a21d, user_id=6a214e7587f7460686892c955d1a40a6, role_id=9cbe5423911c47d08e13f02d8c506f3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:29.112176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:29.163252 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2630/5272] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:29.178277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.178704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.179073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.213850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2643/5273] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:29 2022] PUT /identity/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d/users/6a214e7587f7460686892c955d1a40a6/roles/9cbe5423911c47d08e13f02d8c506f3a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:29.222740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:29.242136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] MFA Rules not processed for user `f06e5f7d140c4e689955b9856e651331`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:29.244563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:29.411661 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2631/5274] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:29.433743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb35-2f47-4434-aeea-01114e42e1e0 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:29.453821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:29.456455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.456950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.457547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/6a214e7587f7460686892c955d1a40a6/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.461788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=6a214e7587f7460686892c955d1a40a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:29.464790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:29.467027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:29.469540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:29.656360 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2644/5275] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 4 20:54:29 2022] GET /identity/v3/users/6a214e7587f7460686892c955d1a40a6/projects => generated 841 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:29.665413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:29.708166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d103b-23fd-494e-b0e8-27051467d5df tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:29.722908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:29.724121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.724837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.725554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.731316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b62a35a88c0491b8d7be5e9db76a21d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:29.743359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:29.764742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34281af-97c2-4926-9da7-f2cc54c0a740 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:29.801007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:29.802311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:29.802822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:29.803356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:29.834730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:29.842334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:29.842559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:29.885493 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2632/5276] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:29.888496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:29.897563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:30.208139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b62a35a88c0491b8d7be5e9db76a21d', 'request_id': 'req-fb5020e7-9cee-4c52-9922-7ce44a9c266b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:30.225562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1f29-b2df-485c-a37e-bfd055558c44 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:30.344019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b62a35a88c0491b8d7be5e9db76a21d', 'request_id': 'req-fb5020e7-9cee-4c52-9922-7ce44a9c266b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:30.364323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b62a35a88c0491b8d7be5e9db76a21d', 'request_id': 'req-fb5020e7-9cee-4c52-9922-7ce44a9c266b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:30.397503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] The token cache is being invalidate because project 1b62a35a88c0491b8d7be5e9db76a21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:30.398599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:30.402480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:30.407392 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2645/5277] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:29 2022] DELETE /identity/v3/projects/1b62a35a88c0491b8d7be5e9db76a21d => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:30.419517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:30.424641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:30.511304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:30.512641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:30.513279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:30.513821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] PATH_INFO: `/v3/users/3ee4c72e561a43578459dd6b8a6a2624` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:30.518395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee4c72e561a43578459dd6b8a6a2624)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:30.523802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:30.711711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5020e7-9cee-4c52-9922-7ce44a9c266b tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:30.725324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:30.727262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:30.728167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:30.729943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:30.732768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=edbb07a0bddd4d0aa2966f25f63e28b3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:30.769650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:30.776304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:31.020019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee4c72e561a43578459dd6b8a6a2624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.191278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee4c72e561a43578459dd6b8a6a2624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.224354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee4c72e561a43578459dd6b8a6a2624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.279253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee4c72e561a43578459dd6b8a6a2624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.281930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee4c72e561a43578459dd6b8a6a2624'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.338593 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2633/5278] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:29 2022] DELETE /identity/v3/users/3ee4c72e561a43578459dd6b8a6a2624 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:31.338593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:31.348669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:31.434789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbb07a0bddd4d0aa2966f25f63e28b3', 'request_id': 'req-260d5fce-35bf-4f58-a21c-af70287d2197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.568230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbb07a0bddd4d0aa2966f25f63e28b3', 'request_id': 'req-260d5fce-35bf-4f58-a21c-af70287d2197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.586313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbb07a0bddd4d0aa2966f25f63e28b3', 'request_id': 'req-260d5fce-35bf-4f58-a21c-af70287d2197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.616121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] The token cache is being invalidate because project edbb07a0bddd4d0aa2966f25f63e28b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:31.617095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.619435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260d5fce-35bf-4f58-a21c-af70287d2197 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:31.629650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2646/5279] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:30 2022] DELETE /identity/v3/projects/edbb07a0bddd4d0aa2966f25f63e28b3 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:31.634372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:31.634751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:31.635075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:31.652952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81023626-e121-46be-aa37-674afb2ddb74 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:31.684703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:31.688346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:31.877425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2647/5280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:31.883953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:31.888771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:31.893472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:31.894550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:31.895074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:31.895600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] PATH_INFO: `/v3/users/1ed0e5e12c494b52bc9f0e93ff7dce74` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:31.897849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed0e5e12c494b52bc9f0e93ff7dce74)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:31.907947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:31.930045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:32.174136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c674-b49a-4342-aa72-f50d50a2c29e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:32.185439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:32.186851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:32.187723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:32.188329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/roles/9cbe5423911c47d08e13f02d8c506f3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:32.191653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9cbe5423911c47d08e13f02d8c506f3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:32.195525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:32.479847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:32.516574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed0e5e12c494b52bc9f0e93ff7dce74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.675806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed0e5e12c494b52bc9f0e93ff7dce74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.734696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invalidating the token cache because role 9cbe5423911c47d08e13f02d8c506f3a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:32.749812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.749812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.761543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed0e5e12c494b52bc9f0e93ff7dce74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.768967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2648/5281] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:31 2022] DELETE /identity/v3/roles/9cbe5423911c47d08e13f02d8c506f3a => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:32.768967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:32.779511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:32.888784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed0e5e12c494b52bc9f0e93ff7dce74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.893112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed0e5e12c494b52bc9f0e93ff7dce74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:32.921738 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2634/5282] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:31 2022] DELETE /identity/v3/users/1ed0e5e12c494b52bc9f0e93ff7dce74 => generated 0 bytes in 1581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:32.929496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:32.930349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:32.992885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:33.208486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ea71f-4502-4e62-b500-d67995598f96 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:33.298850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243939-a7df-495f-857c-9fa36b161f61 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:33.361170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:33.361458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:33.368252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:33.369247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:33.371575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/6a214e7587f7460686892c955d1a40a6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:33.381226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a214e7587f7460686892c955d1a40a6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:33.393274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:33.496028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:33.503908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:33.506505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:33.507065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:33.519729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:33.733286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:33.734302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975dcef-7c30-462c-accf-27390a2c056e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:33.762178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2649/5283] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 997 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:33.764576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:33.764576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:33.764576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:33.794139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:33.795642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:33.806433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2650/5284] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:33.848687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:33.851405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:33.886045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a2c3-2a56-45c1-8f1d-99ece4f11122 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:33.899331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:33.900206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:33.900599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:33.901044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:33.932723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:33.934637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:33.959405 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2651/5285] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:34.078432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a214e7587f7460686892c955d1a40a6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:34.277854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a214e7587f7460686892c955d1a40a6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:34.304233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a214e7587f7460686892c955d1a40a6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:34.405079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a214e7587f7460686892c955d1a40a6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:34.422594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a214e7587f7460686892c955d1a40a6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:34.487751 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2635/5286] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:32 2022] DELETE /identity/v3/users/6a214e7587f7460686892c955d1a40a6 => generated 0 bytes in 1565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:34.490869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:34.543051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f59f-c2b9-4efd-b7e4-f4aa2af9fb34 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:34.858222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:34.918147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:34.919429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:34.920060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:34.920666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/60de750cb01647dfb8025bbbf6970f91` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:34.923347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60de750cb01647dfb8025bbbf6970f91)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:34.929888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:35.032215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:35.256688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60de750cb01647dfb8025bbbf6970f91', 'request_id': 'req-caab4875-5a48-48ad-b00c-b30db82f45bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:35.558719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60de750cb01647dfb8025bbbf6970f91', 'request_id': 'req-caab4875-5a48-48ad-b00c-b30db82f45bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:35.576912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60de750cb01647dfb8025bbbf6970f91', 'request_id': 'req-caab4875-5a48-48ad-b00c-b30db82f45bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:35.646364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] The token cache is being invalidate because project 60de750cb01647dfb8025bbbf6970f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:35.653024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:35.654545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-caab4875-5a48-48ad-b00c-b30db82f45bc tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:35.663672 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2652/5287] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:34 2022] DELETE /identity/v3/projects/60de750cb01647dfb8025bbbf6970f91 => generated 0 bytes in 1174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:35.679511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:35.679511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:35.745270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c652fa-b6c0-430d-b148-093ce897ab09 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:36.036495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:36.039672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:36.040804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:36.042402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/ee2e7d056c88436abafc30041c162b30` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:36.053390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee2e7d056c88436abafc30041c162b30)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:36.060732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:36.290887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:36.315167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:36.514421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invalidating the token cache because user ee2e7d056c88436abafc30041c162b30 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:36.515431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:36.524261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:36.526666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2636/5288] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:54:35 2022] PATCH /identity/v3/users/ee2e7d056c88436abafc30041c162b30 => generated 297 bytes in 854 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:36.538751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:36.539744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:36.540519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:36.666301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] MFA Rules not processed for user `ee2e7d056c88436abafc30041c162b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:36.672102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:36.691627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2653/5289] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:36 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:36.699816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:36.702685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:36.733156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becc32c-3fa6-4cad-bf45-3ac1a434c931 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:36.749467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:36.751667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:36.752693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:36.753745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/ee2e7d056c88436abafc30041c162b30` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:36.766428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee2e7d056c88436abafc30041c162b30)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:36.774975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:36.827565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:36.830100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:37.076896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.155204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494e1cc-8fee-4c71-b534-b3c99db1e990 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:37.197530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:37.198693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:37.201057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:37.204599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] PATH_INFO: `/v3/projects/3809e6c0563e46a2bba84c0b5b2c7ed0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:37.211358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3809e6c0563e46a2bba84c0b5b2c7ed0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:37.220590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:37.259448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invalidating the token cache because user ee2e7d056c88436abafc30041c162b30 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:37.260020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.263422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.266298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2637/5290] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:54:36 2022] PATCH /identity/v3/users/ee2e7d056c88436abafc30041c162b30 => generated 297 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:37.268327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:37.274622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:37.334645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc21b-e428-4921-8cb5-08ee4e357c00 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:37.373328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:37.374400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:37.374895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:37.375421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] PATH_INFO: `/v3/projects/16bc747c8f984e4a9a1506f65102ede1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:37.383503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bc747c8f984e4a9a1506f65102ede1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:37.391513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:37.649461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3809e6c0563e46a2bba84c0b5b2c7ed0', 'request_id': 'req-806ab32e-47c1-4986-828e-dc41483af3d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.707411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bc747c8f984e4a9a1506f65102ede1', 'request_id': 'req-31145a47-bb24-470d-a64b-053a649ccd58'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.736488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bc747c8f984e4a9a1506f65102ede1', 'request_id': 'req-31145a47-bb24-470d-a64b-053a649ccd58'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.752715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bc747c8f984e4a9a1506f65102ede1', 'request_id': 'req-31145a47-bb24-470d-a64b-053a649ccd58'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:37.771290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:38.029980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3809e6c0563e46a2bba84c0b5b2c7ed0', 'request_id': 'req-806ab32e-47c1-4986-828e-dc41483af3d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.044664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3809e6c0563e46a2bba84c0b5b2c7ed0', 'request_id': 'req-806ab32e-47c1-4986-828e-dc41483af3d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.068487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] The token cache is being invalidate because project 3809e6c0563e46a2bba84c0b5b2c7ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:38.069000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.070706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.075386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2654/5291] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:36 2022] DELETE /identity/v3/projects/3809e6c0563e46a2bba84c0b5b2c7ed0 => generated 0 bytes in 1249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:38.077509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:38.081019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:38.216412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] The token cache is being invalidate because project 16bc747c8f984e4a9a1506f65102ede1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:38.216913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.218147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-31145a47-bb24-470d-a64b-053a649ccd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.220852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2638/5292] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:37 2022] DELETE /identity/v3/projects/16bc747c8f984e4a9a1506f65102ede1 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:38.224972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:38.227806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:38.228651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:38.246887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab32e-47c1-4986-828e-dc41483af3d5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:38.299038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:38.301926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:38.372237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:38.422035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:38.424122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:38.424122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:38.424589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/ee2e7d056c88436abafc30041c162b30` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:38.470984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee2e7d056c88436abafc30041c162b30)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:38.472403 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:54:38.472403 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:54:38.472403 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:54:38.476163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:38.570324 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2639/5293] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:38.575462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:38.581313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:38.652371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc0961-5148-4413-b187-e9209d2cfb6d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:38.666981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:38.695633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:38.696333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:38.696641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:38.698268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] PATH_INFO: `/v3/users/9ba59afcd9a0453d8825aebe32f2c5a4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:38.703413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba59afcd9a0453d8825aebe32f2c5a4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:38.711518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:38.757892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.870782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invalidating the token cache because user ee2e7d056c88436abafc30041c162b30 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:38.872069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.872975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-df87fce6-d54d-448e-b099-73cd55da2c8c tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:38.882810 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2655/5294] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:54:38 2022] PATCH /identity/v3/users/ee2e7d056c88436abafc30041c162b30 => generated 297 bytes in 800 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:38.882810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873298b-a558-49ea-b65b-f4baefff498d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:38.882810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873298b-a558-49ea-b65b-f4baefff498d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:38.882810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873298b-a558-49ea-b65b-f4baefff498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:38.966609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0873298b-a558-49ea-b65b-f4baefff498d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:38.968916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0873298b-a558-49ea-b65b-f4baefff498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:38.991495 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2656/5295] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:38.994065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:38.994596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:38.995342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:39.079682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] MFA Rules not processed for user `ee2e7d056c88436abafc30041c162b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:39.082323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:39.089448 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2657/5296] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:38 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:39.092237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:39.119409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba59afcd9a0453d8825aebe32f2c5a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.125181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05cdfa-3364-4d89-82d4-5927b63ade7e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:39.135841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:39.137424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:39.138319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:39.139088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:39.140735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:39.141260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:39.144442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:39.172750 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2658/5297] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:39.175054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:39.178967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:39.211970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c03685-82c3-4e44-b825-5cacdb953c46 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:39.223255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:39.225213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:39.225876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:39.227070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/ee2e7d056c88436abafc30041c162b30` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:39.229758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee2e7d056c88436abafc30041c162b30)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:39.235801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:39.276637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba59afcd9a0453d8825aebe32f2c5a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.293174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba59afcd9a0453d8825aebe32f2c5a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.320894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba59afcd9a0453d8825aebe32f2c5a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.322181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba59afcd9a0453d8825aebe32f2c5a4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.340553 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2640/5298] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:38 2022] DELETE /identity/v3/users/9ba59afcd9a0453d8825aebe32f2c5a4 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:39.342938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:39.346685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:39.440760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.588693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc432-49e3-4111-96fd-bc8793616949 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:39.598199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:39.599699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:39.600609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:39.601278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:39.602834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:39.608297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:39.784580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invalidating the token cache because user ee2e7d056c88436abafc30041c162b30 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:39.785280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.786595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:39.794834 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2659/5299] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:54:39 2022] PATCH /identity/v3/users/ee2e7d056c88436abafc30041c162b30 => generated 297 bytes in 616 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:39.804300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:39.809632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:39.840818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269b8a-233e-4565-ab05-ada261452260 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:39.888939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2641/5300] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:39 2022] POST /identity/v3/projects => generated 373 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:39.894720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:39.906432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:40.203262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434def4-80e2-4c05-854f-583445b3410a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:40.217103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:40.218132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:40.219308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:40.220507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:40.221647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:40.225529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:40.231821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:40.236929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:40.239707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:40.240587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:40.242037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:40.253094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:40.303728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:40.409918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:40.471631 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2660/5301] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:54:39 2022] POST /identity/v3/users => generated 264 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:40.474188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:40.487778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2642/5302] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:39 2022] POST /identity/v3/users => generated 287 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:40.493419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:40.531437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8342d64-f137-4c94-8c62-15c0e977c898 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:40.569040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb15b-e8f1-441a-8e0d-fc59e917d0a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:40.589726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:40.608157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:40.610540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:40.611296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:40.616025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:40.616413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:40.651876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2643/5303] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:40.654808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:40.659463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:40.759414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:40.762163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:40.763183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:40.763848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/1644a101ba4141719b090899c6057723/password` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:40.938621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131bf95-2976-4292-b26d-d7120176bed8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:40.946299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:40.947261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:40.948880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:40.949783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:40.953423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:40.989602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:40.991664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:41.020281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2644/5304] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:41.022798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:41.049272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf22b44-b5fc-46bd-abb3-d8c66e3607cc service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:41.057605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:41.058752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:41.059283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:41.059875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:41.061196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:41.064374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:41.085448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2645/5305] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:41.092752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:41.111553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb907-7c29-49ef-a61a-697c830558f0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:41.124587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:41.127595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:41.127595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:41.127595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] PATH_INFO: `/v3/projects/c7334c8cfafb46b9a97b90e9fc802910/users/4f27784d32ce4b8c84b06684eb98f5bc/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:41.162103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7334c8cfafb46b9a97b90e9fc802910, user_id=4f27784d32ce4b8c84b06684eb98f5bc, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:41.170218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac65f-3863-4291-93a3-6fedea02e42c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:41.176257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:41.305878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2661/5306] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 4 20:54:40 2022] POST /identity/v3/users/1644a101ba4141719b090899c6057723/password => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:41.310746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:41.313356 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2646/5307] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:41 2022] PUT /identity/v3/projects/c7334c8cfafb46b9a97b90e9fc802910/users/4f27784d32ce4b8c84b06684eb98f5bc/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:41.324629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:41.334143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:41.334143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:41.335539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:41.358921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d607d3e-5fd1-4ba5-b604-8e784589c915 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:41.414257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] MFA Rules not processed for user `4f27784d32ce4b8c84b06684eb98f5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:41.417454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:41.569458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:41.570592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:41.571374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:41.571942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] PATH_INFO: `/v3/projects/a65d50e28ca14290ac9da09fe3450c59` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:41.575840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65d50e28ca14290ac9da09fe3450c59)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:41.582922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:41.670394 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2647/5308] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:41.729167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:41.731849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:41.954240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74530e8-80e6-4089-942a-ce89c25292b1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:41.957500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65d50e28ca14290ac9da09fe3450c59', 'request_id': 'req-5df10204-c23f-45fe-9d71-9bb8810ac197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:42.071754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:42.072951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.073440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.073919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.132889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65d50e28ca14290ac9da09fe3450c59', 'request_id': 'req-5df10204-c23f-45fe-9d71-9bb8810ac197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:42.147721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65d50e28ca14290ac9da09fe3450c59', 'request_id': 'req-5df10204-c23f-45fe-9d71-9bb8810ac197'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:42.209535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] The token cache is being invalidate because project a65d50e28ca14290ac9da09fe3450c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:42.209535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:42.210796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5df10204-c23f-45fe-9d71-9bb8810ac197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:42.217843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2662/5309] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:41 2022] DELETE /identity/v3/projects/a65d50e28ca14290ac9da09fe3450c59 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:42.226268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:42.226563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce7f3-0f98-496a-9851-8f1ccc4ca012 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.226563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce7f3-0f98-496a-9851-8f1ccc4ca012 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.227008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce7f3-0f98-496a-9851-8f1ccc4ca012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.228269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5495-b05b-4155-a5c3-7f1cfecaa060 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:42.273649 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2648/5310] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:54:42.296105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6f0ce7f3-0f98-496a-9851-8f1ccc4ca012 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:42.298378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f0ce7f3-0f98-496a-9851-8f1ccc4ca012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:42.314104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.314594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.315442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.387499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] MFA Rules not processed for user `1644a101ba4141719b090899c6057723`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:42.399267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:42.414037 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2649/5311] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:42 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 20:54:42.421553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:42.426010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:42.570855 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2663/5312] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:42.584485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.592971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.592971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.692798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:42.704447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:42.767910 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2664/5313] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:42.776069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:42.792600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ab9b6-1fdb-4201-a7df-6222cded0d17 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:42.801724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:42.802993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.803646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.804378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.810639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adab20-a3d3-4bdd-917e-343554198ad9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:42.819372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:42.824314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:42.824684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:42.825661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.826156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.826665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.828045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:42.828595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:42.831903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:42.846696 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2650/5314] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 4 20:54:42 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:42.854970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:42.861087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2665/5315] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:42.869507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:42.880810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a651e9-4469-4f91-92d8-8defb430f35e tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:42.892579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:42.893759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.894266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.894761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/1644a101ba4141719b090899c6057723` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.895609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fda3f-ed8c-4299-9389-6483c442169e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:42.897493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1644a101ba4141719b090899c6057723)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:42.903047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:42.907321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:42.908759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:42.909793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:42.910339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:42.911743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:42.916406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:43.108849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2666/5316] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:42 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:54:43.116570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:43.273202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:43.362283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:43.375610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fd2-e26a-4b67-ad0b-f58756d80449 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:43.401092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:43.410869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:43.416242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:43.423605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:43.423605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:43.425016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:43.432286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:43.465741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:43.475445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1644a101ba4141719b090899c6057723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:43.500054 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2651/5317] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:42 2022] DELETE /identity/v3/users/1644a101ba4141719b090899c6057723 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:43.516287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:43.520353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:43.635045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2667/5318] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:43 2022] POST /identity/v3/users => generated 297 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:43.646319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:43.652503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:43.713590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4346b-9fc7-4c02-81c7-1413d14f3d0e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:43.784038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:43.865671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae8621-b588-4ca2-bba7-7c0c0172ed22 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:43.903763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:43.903763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:43.903763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:43.904908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:43.904908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:43.914835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:44.028429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:44.036293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:44.036293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:44.036293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:44.036293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:44.036293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:44.069229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2668/5319] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:44.075430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:44.114313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e611a3-6df5-435a-a18d-8a89a17ef4f7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:44.127777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:44.129888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:44.131395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:44.133859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] PATH_INFO: `/v3/projects/391d7c29d0b5467097de06e4be638bfd/users/2e51a8f0e1494c3c9e9329c5a6d21342/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:44.186400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=391d7c29d0b5467097de06e4be638bfd, user_id=2e51a8f0e1494c3c9e9329c5a6d21342, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:44.196103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:44.234994 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2652/5320] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:43 2022] POST /identity/v3/users => generated 367 bytes in 720 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:44.242623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:44.265340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c439c-ba39-4fab-bfa9-3de21eef9b50 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:44.275880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:44.277146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:44.278114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:44.278417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:44.280122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:44.285711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:44.371739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2669/5321] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:44 2022] PUT /identity/v3/projects/391d7c29d0b5467097de06e4be638bfd/users/2e51a8f0e1494c3c9e9329c5a6d21342/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:44.378054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:44.501983 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2653/5322] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:44 2022] POST /identity/v3/projects => generated 359 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:44.509365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:44.901052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d3fb-a9de-4602-8e5c-3450a85e888f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:44.930117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b1b2-ebe1-48a2-8107-646c1d7a73b8 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:44.951668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:44.953379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:44.954326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:44.955487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/109a9d613896474d81d72ac4440aac51` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.024620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:update_user(user_id=109a9d613896474d81d72ac4440aac51)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:45.030107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:45.081216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:45.212573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:45.214498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:45.215213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:45.215866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.217428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:45.221140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:45.268160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2670/5323] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 890 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:45.271291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:45.355292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b189c-3357-4292-a17b-be525373f6e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:45.356021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2654/5324] 10.222.0.78 () {60 vars in 1244 bytes} [Tue Oct 4 20:54:44 2022] PATCH /identity/v3/users/109a9d613896474d81d72ac4440aac51 => generated 521 bytes in 848 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:45.364523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:45.407640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51d921-0de4-40d9-85ba-b4ae917918fe tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:45.420306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:45.422076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:45.423226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:45.425901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/109a9d613896474d81d72ac4440aac51` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.439728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:45.445937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:45.450096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:45.454537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] PATH_INFO: `/v3/projects/391d7c29d0b5467097de06e4be638bfd/users/2e51a8f0e1494c3c9e9329c5a6d21342/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.474965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391d7c29d0b5467097de06e4be638bfd, user_id=2e51a8f0e1494c3c9e9329c5a6d21342, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:45.494130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c125e-020f-49e6-9f96-b44fe9bfafa3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:45.506770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:get_user(user_id=109a9d613896474d81d72ac4440aac51)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:45.512732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:45.517380 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2655/5325] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:45 2022] GET /identity/v3/users/109a9d613896474d81d72ac4440aac51 => generated 388 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:45.523897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:45.574807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c516-8c45-4378-b66d-951955539d0f tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:45.591193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2671/5326] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:45 2022] PUT /identity/v3/projects/391d7c29d0b5467097de06e4be638bfd/users/2e51a8f0e1494c3c9e9329c5a6d21342/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:45.605275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:45.605813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:45.606243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.756965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] MFA Rules not processed for user `2e51a8f0e1494c3c9e9329c5a6d21342`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:45.760507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:45.795197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:45.796524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:45.797783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:45.798672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/projects/d95dc9a65ea44d4c85972be634283cd0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:45.801829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d95dc9a65ea44d4c85972be634283cd0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:45.807119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:45.881680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:46.050407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95dc9a65ea44d4c85972be634283cd0', 'request_id': 'req-7ea5e70b-118b-4a5d-ad83-9289b3c98772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.059935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2672/5327] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:54:46.063893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:46.068103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:46.073718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95dc9a65ea44d4c85972be634283cd0', 'request_id': 'req-7ea5e70b-118b-4a5d-ad83-9289b3c98772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.093689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95dc9a65ea44d4c85972be634283cd0', 'request_id': 'req-7ea5e70b-118b-4a5d-ad83-9289b3c98772'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.258262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] The token cache is being invalidate because project d95dc9a65ea44d4c85972be634283cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:46.260789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.262881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.268587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2656/5328] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:45 2022] DELETE /identity/v3/projects/d95dc9a65ea44d4c85972be634283cd0 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:46.275094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:46.275094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:46.290966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde0800-2037-4263-ae06-f22f77e17d18 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:46.494463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e70b-118b-4a5d-ad83-9289b3c98772 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:46.507455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:46.508655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:46.508942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:46.509235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:46.510428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] PATH_INFO: `/v3/users/3fb1f6f1b6c24316bb09ff23ae0a9252` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:46.512683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:46.514619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:46.514858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb1f6f1b6c24316bb09ff23ae0a9252)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:46.515064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:46.516608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:46.522057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:46.523082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:46.541191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:46.834104 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2657/5329] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:46 2022] POST /identity/v3/projects => generated 381 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:46.836415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:46.839629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:46.907075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb1f6f1b6c24316bb09ff23ae0a9252'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.908777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb1f6f1b6c24316bb09ff23ae0a9252'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:46.989600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe023d21-59af-42d1-b237-e2603d3e2db0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:47.000945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb1f6f1b6c24316bb09ff23ae0a9252'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.002271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48dee46137e4499194c1409295965268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1291bf77f503402cb3b606e3ec355032', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:47.004505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:47.007080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:47.007830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] PATH_INFO: `/v3/users/109a9d613896474d81d72ac4440aac51` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:47.012240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=109a9d613896474d81d72ac4440aac51)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:47.018559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:47.031090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb1f6f1b6c24316bb09ff23ae0a9252'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.052190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb1f6f1b6c24316bb09ff23ae0a9252'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.069011 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2673/5330] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:46 2022] DELETE /identity/v3/users/3fb1f6f1b6c24316bb09ff23ae0a9252 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:47.071832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:47.075286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:47.229973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2a90-65b9-4e63-9802-57ca51e1724b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:47.239614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:47.240961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:47.241597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:47.242222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:47.243753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:47.248234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:47.270872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109a9d613896474d81d72ac4440aac51'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.413147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109a9d613896474d81d72ac4440aac51'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.429314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109a9d613896474d81d72ac4440aac51'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.432053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2674/5331] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:47 2022] POST /identity/v3/users => generated 291 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:47.434372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:47.437774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:47.472781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109a9d613896474d81d72ac4440aac51'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.472781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109a9d613896474d81d72ac4440aac51'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:47.499715 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2658/5332] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:46 2022] DELETE /identity/v3/users/109a9d613896474d81d72ac4440aac51 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:47.501671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:47.515479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:47.582480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed386-d045-4538-85c1-1929ef88e645 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:47.680390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ceaf6-22c2-4fc7-8714-fe939713b7c7 tempest-UsersV3TestJSON-1975424654 tempest-UsersV3TestJSON-1975424654-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:47.694443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:47.695606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:47.696096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:47.696559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:47.698578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:47.702154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:47.760861 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2659/5333] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:47.762873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:47.771530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:47.801992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d16e7-2bfd-4d95-8c3b-1c500beeb3bc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:47.817402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:47.819919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:47.825885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:47.826889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] PATH_INFO: `/v3/users/ee2e7d056c88436abafc30041c162b30` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:47.865601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2e7d056c88436abafc30041c162b30)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:47.874383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:47.892329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:47.895943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:47.896536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:47.897184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:47.910499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:47.967129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:47.970451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:48.000875 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2675/5334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:48.002828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:48.033807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab26d-a9be-4849-8f01-e38b3a87cfc6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:48.044554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:48.046311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.046725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.047191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.048964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:48.053937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:48.082816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2676/5335] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:48.090876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:48.113697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e774-da17-45fc-9a98-8056e4077531 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:48.126654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:48.128699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.130142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.130951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] PATH_INFO: `/v3/projects/fa34ec2ba12d4123b4634e568b25d291/users/e04865f9630d464193951ced66599ad3/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.170345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa34ec2ba12d4123b4634e568b25d291, user_id=e04865f9630d464193951ced66599ad3, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:48.191179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271fa2-c562-49f5-9909-b6a190796306 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:48.207308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:48.232150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:48.306622 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2677/5336] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:48 2022] PUT /identity/v3/projects/fa34ec2ba12d4123b4634e568b25d291/users/e04865f9630d464193951ced66599ad3/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:48.327392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00546-af05-4131-b499-dda8d3bf4836 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.327763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00546-af05-4131-b499-dda8d3bf4836 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.329110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00546-af05-4131-b499-dda8d3bf4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.385556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:48.398968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8fc00546-af05-4131-b499-dda8d3bf4836 None None] MFA Rules not processed for user `e04865f9630d464193951ced66599ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:48.405294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8fc00546-af05-4131-b499-dda8d3bf4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:48.410194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:48.450771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:48.477096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:48.481188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2e7d056c88436abafc30041c162b30'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:48.497214 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2660/5337] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:47 2022] DELETE /identity/v3/users/ee2e7d056c88436abafc30041c162b30 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:48.500170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:48.506664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:48.620775 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2678/5338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:48.624512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.625417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.626042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.670157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:48.674627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:48.695849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2679/5339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:48.697762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:48.698727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb890e-c8a2-4c8f-a807-71df2876aa1c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:48.705814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:48.712280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:48.715949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.716279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.717064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] PATH_INFO: `/v3/users/4ed2a563a2ab4a788e75ee1af5cd252d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.719082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed2a563a2ab4a788e75ee1af5cd252d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:48.722655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:48.845141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5314-ffaa-4819-bba2-eed3a4b152b1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:48.854990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:48.856619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:48.857122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:48.857903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:48.867960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:49.050819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:49.055009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:49.061176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed2a563a2ab4a788e75ee1af5cd252d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:49.087071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2680/5340] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:49.093513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:49.100438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:49.368901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ecfaf-d331-4bcc-9d29-1981564de3ae service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:49.377357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:49.378449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:49.379058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:49.379586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:49.395593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed2a563a2ab4a788e75ee1af5cd252d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:49.401789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:49.407350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8aea7-ba58-40a2-82b4-7f04ca23bf15 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:49.428602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed2a563a2ab4a788e75ee1af5cd252d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:49.433402 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2681/5341] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:49.481717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed2a563a2ab4a788e75ee1af5cd252d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:49.483000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed2a563a2ab4a788e75ee1af5cd252d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:49.503853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2661/5342] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:48 2022] DELETE /identity/v3/users/4ed2a563a2ab4a788e75ee1af5cd252d => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:49.516974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390b12-6723-4503-bd92-287830912a07 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:49.527587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390b12-6723-4503-bd92-287830912a07 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:49.529798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390b12-6723-4503-bd92-287830912a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:49.563505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:49.637031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b8390b12-6723-4503-bd92-287830912a07 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:49.641656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8390b12-6723-4503-bd92-287830912a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:49.801378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2682/5343] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:49.826726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:49.829414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:50.017427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f5ae7-3487-43d5-a4cc-4b2c85ba2cf8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:50.031410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:50.032241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:50.032540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:50.032890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:50.053680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:50.057167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:50.080865 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2662/5344] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:54:50.237504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:50.370893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8390b12-6723-4503-bd92-287830912a07 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:50.381608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8390b12-6723-4503-bd92-287830912a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:50.407638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:50.448199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8390b12-6723-4503-bd92-287830912a07 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:50.471667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:50.473540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:50.474264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:50.474864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] PATH_INFO: `/v3/projects/bd8adb1a7e034cbeb6d40757ae7cf31b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:50.479845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8adb1a7e034cbeb6d40757ae7cf31b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:50.484852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:50.842875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8adb1a7e034cbeb6d40757ae7cf31b', 'request_id': 'req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:50.946266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8adb1a7e034cbeb6d40757ae7cf31b', 'request_id': 'req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:50.978947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8adb1a7e034cbeb6d40757ae7cf31b', 'request_id': 'req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.015476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] The token cache is being invalidate because project bd8adb1a7e034cbeb6d40757ae7cf31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:51.016129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.029441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.037744 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2683/5345] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:50 2022] DELETE /identity/v3/projects/bd8adb1a7e034cbeb6d40757ae7cf31b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:51.040014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:51.062016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89892-a2b4-4143-bf49-3b7763f2e56d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:51.238970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:51.240507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:51.241191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:51.242653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] PATH_INFO: `/v3/users/b1ba82c63ee1445f919d1a736c1c9df2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:51.246207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ba82c63ee1445f919d1a736c1c9df2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:51.250804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:51.391490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:51.395665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:51.433884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc8446-2ed6-4a6e-94eb-20202ab4d36b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:51.448566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:51.449835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:51.451468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:51.452115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] PATH_INFO: `/v3/users/2e51a8f0e1494c3c9e9329c5a6d21342` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:51.454551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e51a8f0e1494c3c9e9329c5a6d21342)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:51.459067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:51.607448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ba82c63ee1445f919d1a736c1c9df2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.733520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ba82c63ee1445f919d1a736c1c9df2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.753733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ba82c63ee1445f919d1a736c1c9df2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.798324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ba82c63ee1445f919d1a736c1c9df2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.800305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ba82c63ee1445f919d1a736c1c9df2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.825269 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2663/5346] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:51 2022] DELETE /identity/v3/users/b1ba82c63ee1445f919d1a736c1c9df2 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:51.833816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e51a8f0e1494c3c9e9329c5a6d21342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.835286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e51a8f0e1494c3c9e9329c5a6d21342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:51.925556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:51.929178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:52.006513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e51a8f0e1494c3c9e9329c5a6d21342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.057354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e51a8f0e1494c3c9e9329c5a6d21342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.089934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-14f8ab70-4c00-4f74-b6a1-3daf81f0b7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e51a8f0e1494c3c9e9329c5a6d21342'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.106469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5812-8615-4ba0-858f-9c0b419f58f9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:52.111606 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2684/5347] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:51 2022] DELETE /identity/v3/users/2e51a8f0e1494c3c9e9329c5a6d21342 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:54:52.120397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:52.121160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:52.122063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:52.183314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:52.186725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:52.233784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:52.334526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:52.388318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:52.393614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:52.395489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:52.398225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] PATH_INFO: `/v3/projects/7293bb41bd38438db52b687bd0b0e941` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:52.406659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7293bb41bd38438db52b687bd0b0e941)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:52.408811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:52.483129 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2685/5348] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:52.486572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:52.491058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:52.528309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14b7d-3dc8-4687-aa3d-7abc8832266e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:52.542287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:52.543698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:52.544887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:52.547087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] PATH_INFO: `/v3/projects/b9bd8061142f4fc3b5abd58a5c53ad10` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:52.553160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bd8061142f4fc3b5abd58a5c53ad10)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:52.560791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:52.667125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7293bb41bd38438db52b687bd0b0e941', 'request_id': 'req-83f41785-8d43-48a5-b4c2-16de34adfb7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.702946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7293bb41bd38438db52b687bd0b0e941', 'request_id': 'req-83f41785-8d43-48a5-b4c2-16de34adfb7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.711257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7293bb41bd38438db52b687bd0b0e941', 'request_id': 'req-83f41785-8d43-48a5-b4c2-16de34adfb7b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.781582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bd8061142f4fc3b5abd58a5c53ad10', 'request_id': 'req-7d613856-7f39-4f1d-8803-f359da74c0ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.898288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] The token cache is being invalidate because project 7293bb41bd38438db52b687bd0b0e941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:52.899381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.902246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:52.906005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2664/5349] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:51 2022] DELETE /identity/v3/projects/7293bb41bd38438db52b687bd0b0e941 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:52.907970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:52.910679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.001353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bd8061142f4fc3b5abd58a5c53ad10', 'request_id': 'req-7d613856-7f39-4f1d-8803-f359da74c0ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.016522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bd8061142f4fc3b5abd58a5c53ad10', 'request_id': 'req-7d613856-7f39-4f1d-8803-f359da74c0ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.047525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] The token cache is being invalidate because project b9bd8061142f4fc3b5abd58a5c53ad10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:53.048404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.051626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7d613856-7f39-4f1d-8803-f359da74c0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.061899 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2686/5350] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:52 2022] DELETE /identity/v3/projects/b9bd8061142f4fc3b5abd58a5c53ad10 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:53.067223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:53.067761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:53.068342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:53.084184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41785-8d43-48a5-b4c2-16de34adfb7b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:53.124430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:53.126213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.279183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:53.280441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:53.280976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:53.281474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:53.287789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.298209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2687/5351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:53.310013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:53.310013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.321335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea10d4-2cbb-4bc1-a4b8-ec55ccc66253 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:53.330584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:53.331085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:53.332225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:53.332933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:53.333429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] PATH_INFO: `/v3/projects/0d0dc488153a43779aabb1dc0774eda1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:53.334076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:53.336238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0dc488153a43779aabb1dc0774eda1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:53.340352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:53.353761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2665/5352] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:53.355606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:53.358044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.381936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e10ca6-7daa-43fe-99a5-b7ab5586d3aa service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:53.393344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:53.393344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:53.393929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:53.394319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] PATH_INFO: `/v3/users/48dee46137e4499194c1409295965268` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:53.396882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48dee46137e4499194c1409295965268)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:53.401701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:53.454748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:53.642735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0dc488153a43779aabb1dc0774eda1', 'request_id': 'req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.809199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0dc488153a43779aabb1dc0774eda1', 'request_id': 'req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.827664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:53.831237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0dc488153a43779aabb1dc0774eda1', 'request_id': 'req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.858557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48dee46137e4499194c1409295965268'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.876993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] The token cache is being invalidate because project 0d0dc488153a43779aabb1dc0774eda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:53.879117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.881195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-98a98c5c-3015-42cc-aeee-8fd1d22ac77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:53.889575 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2688/5353] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:53 2022] DELETE /identity/v3/projects/0d0dc488153a43779aabb1dc0774eda1 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:53.892781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:53.893293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:53.893814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:53.947892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:53.950602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:53.967721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48dee46137e4499194c1409295965268'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:54.001463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48dee46137e4499194c1409295965268'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:54.033543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48dee46137e4499194c1409295965268'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:54.034861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-03ca4816-c8d9-49df-9431-473382017566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48dee46137e4499194c1409295965268'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:54.049956 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2666/5354] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:53 2022] DELETE /identity/v3/users/48dee46137e4499194c1409295965268 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:54.053767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdfb61-5634-4cd1-af85-50a8d604703f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.054247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdfb61-5634-4cd1-af85-50a8d604703f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.055197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdfb61-5634-4cd1-af85-50a8d604703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.079717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:54.093516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6ecdfb61-5634-4cd1-af85-50a8d604703f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:54.096058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ecdfb61-5634-4cd1-af85-50a8d604703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:54.185773 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2689/5355] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:54.192165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:54.260571 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2667/5356] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:54.263362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.264072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.264659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.265258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6bfa2-e06c-4bad-b4b9-d850ad127a31 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:54.278474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:54.280454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.280976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.281545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.283771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:54.284347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:54.288392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:54.341135 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2690/5357] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:54.349306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:54.359966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:54.362156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:54.375732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87d72f-412e-44b1-aaf0-22bf67084dac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:54.388941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:54.390888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.391810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.392782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.394676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:54.396089 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2668/5358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:54.406302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:54.410084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:54.445758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b8a11-99ed-4956-91de-ace8ff56ebfd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:54.469862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:54.475536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.476409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.476690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.477415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:54.482318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:54.485785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:54.548530 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2669/5359] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:54:54.556410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:54.575921 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2691/5360] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:54 2022] POST /identity/v3/projects => generated 357 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:54.578064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:54.629488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93951636-9d2c-4ea7-a77b-df9ba83066ce admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:54.789586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0685e33-c02f-44c8-9825-5f661e70eb28 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:54.800531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:54.802570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.803311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.803972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.805580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:54.810271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:54.819206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:54.820552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:54.821174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:54.822287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:54.823702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:54.828254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:55.083215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2692/5361] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:54 2022] POST /identity/v3/users => generated 279 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:55.096436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:55.146521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1b5ce-2692-493c-bf16-aa135b580af6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:55.150186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2670/5362] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:54 2022] POST /identity/v3/projects => generated 389 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:55.154898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:55.264578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:55.429051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:55.430155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:55.430637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:55.431806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:55.433194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:55.436496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:55.452164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:55.462244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04aeae-d757-4503-b5eb-05ac13c03a3a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:55.463745 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2693/5363] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:55.470421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:55.487795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:55.491356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:55.492338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:55.492542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dfd01-a7e2-4bf1-9850-e8eddbabe45c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:55.493057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:55.495276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:55.499602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:55.502594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:55.503730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:55.504214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:55.505718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:55.505973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:55.510918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:55.549658 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2694/5364] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:55.553233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:55.561589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:55.602363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009e1e-ec1d-4a65-b42c-ccaec322fc73 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:55.667377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:55.673242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:55.673242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:55.676332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] PATH_INFO: `/v3/projects/1291bf77f503402cb3b606e3ec355032` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:55.683004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1291bf77f503402cb3b606e3ec355032)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:55.695552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:55.725642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2671/5365] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:55 2022] POST /identity/v3/users => generated 295 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:55.727555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:55.802155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463617d3-eddf-4279-98e2-3beeb9c40c6a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:55.822444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:55.823828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:55.824293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:55.825148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] PATH_INFO: `/v3/projects/436cef25c16049babc37ca979ca1fd26/users/6c0b7846c79c4555beeb5a9f4e22d8f6/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:55.861926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=436cef25c16049babc37ca979ca1fd26, user_id=6c0b7846c79c4555beeb5a9f4e22d8f6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:55.868316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:56.004812 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2672/5366] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:55 2022] PUT /identity/v3/projects/436cef25c16049babc37ca979ca1fd26/users/6c0b7846c79c4555beeb5a9f4e22d8f6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:56.008575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:56.137931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1291bf77f503402cb3b606e3ec355032', 'request_id': 'req-1d1545d6-7d77-4205-aae7-3b69c9758e1d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:56.224194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6fc57-ea0d-49ad-9317-6fd113b45d6e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:56.281598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1291bf77f503402cb3b606e3ec355032', 'request_id': 'req-1d1545d6-7d77-4205-aae7-3b69c9758e1d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:56.300293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1291bf77f503402cb3b606e3ec355032', 'request_id': 'req-1d1545d6-7d77-4205-aae7-3b69c9758e1d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:56.335017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] The token cache is being invalidate because project 1291bf77f503402cb3b606e3ec355032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:56.336290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:56.344217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d1545d6-7d77-4205-aae7-3b69c9758e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:56.359625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2695/5367] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:55 2022] DELETE /identity/v3/projects/1291bf77f503402cb3b606e3ec355032 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:56.364503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:56.365376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:56.366097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:56.484450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:56.486899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:56.488767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:56.489676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:56.491466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:56.497062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:56.499342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] MFA Rules not processed for user `6c0b7846c79c4555beeb5a9f4e22d8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:56.502050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:56.521701 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2673/5368] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:56.524305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:56.528158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:56.729826 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2696/5369] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:56.729826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:56.731160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:56.773048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e431a-e326-4f08-837b-7fdebd60451b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:56.798080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:56.801373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:56.805636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:56.805636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] PATH_INFO: `/v3/projects/391d7c29d0b5467097de06e4be638bfd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:56.805636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391d7c29d0b5467097de06e4be638bfd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:56.810012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:56.822778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b972-af32-44e3-b5bb-67be9dd35e93 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:56.859126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:56.867613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:56.869467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:56.872239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:56.881566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:56.928366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:56.935424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a5c11-b00e-493e-9574-339afa2878a0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:56.982188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2674/5370] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:56.985179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:56.985701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:56.986199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:57.025256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391d7c29d0b5467097de06e4be638bfd', 'request_id': 'req-7cac448f-3120-44a7-b7e2-049c012e49d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:57.050418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:57.055551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:57.127839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391d7c29d0b5467097de06e4be638bfd', 'request_id': 'req-7cac448f-3120-44a7-b7e2-049c012e49d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:57.148271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391d7c29d0b5467097de06e4be638bfd', 'request_id': 'req-7cac448f-3120-44a7-b7e2-049c012e49d8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:57.192858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] The token cache is being invalidate because project 391d7c29d0b5467097de06e4be638bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:54:57.193777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:57.196996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:57.212575 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2697/5371] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:54:56 2022] DELETE /identity/v3/projects/391d7c29d0b5467097de06e4be638bfd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:57.212575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:57.218679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:57.315719 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2675/5372] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:57.322764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:57.329102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:57.468256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:57.512167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac448f-3120-44a7-b7e2-049c012e49d8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:57.521327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:57.538843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:57.539995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:57.541277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:57.541791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:57.543105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:57.546585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:57.594510 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2698/5373] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:57.596111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:57.602882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:57.629991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8222-ecaa-44f2-a3bf-8e3b15451537 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:57.632152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c19b6-a3d6-4ede-856e-c65625c90a7b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:57.643562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:57.645136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:57.645633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:57.646127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:57.652910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:57.666175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:57.667642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:57.670243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:57.670962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] PATH_INFO: `/v3/users/e04865f9630d464193951ced66599ad3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:57.680394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04865f9630d464193951ced66599ad3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:57.688020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:57.862302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:57.867077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f02c0-746c-441a-8c3a-30f9db11d1e1 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:57.907598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2676/5374] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:57.910470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:57.911350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:57.912606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:57.975737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:57.979951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:58.009788 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2677/5375] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:58.011911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:58.035890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04865f9630d464193951ced66599ad3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:58.038429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04865f9630d464193951ced66599ad3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:58.051656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b5765-4ac8-4e81-9204-910ec48c60c7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:58.061335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:58.062694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:58.063262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:58.063750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] PATH_INFO: `/v3/projects/a7aee6375ab0440d970befc057955940/users/790598df1c304f4e9984449ad8b26c95/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:58.100432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7aee6375ab0440d970befc057955940, user_id=790598df1c304f4e9984449ad8b26c95, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:58.108461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:58.196258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04865f9630d464193951ced66599ad3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:58.233158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04865f9630d464193951ced66599ad3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:58.251239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2678/5376] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:58 2022] PUT /identity/v3/projects/a7aee6375ab0440d970befc057955940/users/790598df1c304f4e9984449ad8b26c95/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:58.253615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:58.262360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0aa25e4b-8870-4f14-85a1-5a70bb3dfafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04865f9630d464193951ced66599ad3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:54:58.277527 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2699/5377] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:54:57 2022] DELETE /identity/v3/users/e04865f9630d464193951ced66599ad3 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:54:58.284398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:58.284900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:58.285460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:58.359544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:54:58.360025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:58.360736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:58.540224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:58.553277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926d0f-e51e-497d-b094-efea3f3bf81b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:58.592063 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2700/5378] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:54:58.642290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:58.645087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:58.761343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:58.763582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:58.764439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:58.766906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:58.770381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:54:58.775826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:58.782593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:58.851632 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2679/5379] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 599 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:54:58.862472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:58.886737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:54:58.934466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377966d-50e7-465d-a09d-9bd1a7d99192 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:58.941969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d62ed-5b94-4d34-b90c-88626e6d76cd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:58.957658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:58.959339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:58.961012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:58.962091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:58.962795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:58.963681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:58.971385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:58.971385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:58.971385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:58.975238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:58.985201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:58.989517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:59.013058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2701/5380] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:54:59.166935 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2680/5381] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:54:58 2022] POST /identity/v3/projects => generated 369 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:59.178286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:59.202253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ecb50-14af-4c6d-b401-a8c7915a322a service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:59.235940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:59.389901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:59.393087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:59.394276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:59.394974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:59.398596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:59.402649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:59.604556 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2702/5382] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:54:59 2022] POST /identity/v3/users => generated 285 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:54:59.611279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:59.616304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:59.642197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351aef00-e1d2-4aa2-a448-aa916ed1fc0f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:59.652908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:59.653893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:59.655200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:59.655450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:59.657117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:59.660265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:59.672761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:59.686641 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2681/5383] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:54:59.693894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:59.718732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be586c-6de1-4acc-9806-9f9cb9b322ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:59.730323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:59.731964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:59.732701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:59.733533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:59.734836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:59.738677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b62e4-30ac-4676-aac3-b0108214bc54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:54:59.762012 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2703/5384] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:54:59.769480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:54:59.793588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672351-91b4-439f-9f9f-191e737a50d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:54:59.805591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:54:59.806642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:54:59.807277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:54:59.807734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] PATH_INFO: `/v3/projects/47e9f09510664624beae60960fb50e2c/users/73d600fdca7e4460866841d444a8c9e5/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:54:59.841545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e9f09510664624beae60960fb50e2c, user_id=73d600fdca7e4460866841d444a8c9e5, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:54:59.847408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:00.003257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2682/5385] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:54:59 2022] PUT /identity/v3/projects/47e9f09510664624beae60960fb50e2c/users/73d600fdca7e4460866841d444a8c9e5/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:00.009683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:00.011080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:00.011699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:00.100742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] MFA Rules not processed for user `73d600fdca7e4460866841d444a8c9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:00.104477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:00.284337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:00.289801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:00.336520 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2704/5386] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:00.342873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:00.373266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f0335-8067-4177-a5d9-b8832c78d257 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:00.396651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:00.398180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:00.399773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:00.400933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:00.404128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:00.409159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:00.625957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934652c-70ee-4107-b599-755349440ecd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:00.644626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:00.645786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:00.646277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:00.646842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] PATH_INFO: `/v3/projects/fa34ec2ba12d4123b4634e568b25d291` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:00.651554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa34ec2ba12d4123b4634e568b25d291)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:00.656749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:00.721824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:00.783216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2705/5387] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:55:00 2022] POST /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials => generated 921 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:00.791130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:00.815099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b9291-fde2-41f9-a591-fabf5e3b4f3d tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:00.825265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:00.827079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:00.827656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:00.828176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/9631b7b59eef432091cd49fed430ffbd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:00.830818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:delete_access_rule(user_id=73d600fdca7e4460866841d444a8c9e5, access_rule_id=9631b7b59eef432091cd49fed430ffbd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:00.834270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application session.delete(ref) Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application yield resource Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:00.914177 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise self.value Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application session.commit() Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:55:00.916276 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._synchronize( Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise AssertionError( Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 04 20:55:00.918859 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:55:00.922447 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2706/5388] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 4 20:55:00 2022] DELETE /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/9631b7b59eef432091cd49fed430ffbd => generated 89 bytes in 133 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:55:00.927004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:00.955104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234ecf-9dcc-4781-b950-de417615adf9 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:00.979401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa34ec2ba12d4123b4634e568b25d291', 'request_id': 'req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:01.016024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa34ec2ba12d4123b4634e568b25d291', 'request_id': 'req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:01.079455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa34ec2ba12d4123b4634e568b25d291', 'request_id': 'req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:01.230890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:01.235043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.241062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.241062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials/a9d06e5f604140df872c919d56ef0785` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.256951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] The token cache is being invalidate because project fa34ec2ba12d4123b4634e568b25d291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:01.260270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:01.260691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ed56b5cd-8fa2-4bbf-aaa4-c9fbadc12931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:01.264068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2683/5389] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:00 2022] DELETE /identity/v3/projects/fa34ec2ba12d4123b4634e568b25d291 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:01.272426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:01.274062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e68d2-f585-49e8-a33f-069e615b97d7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.274637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e68d2-f585-49e8-a33f-069e615b97d7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.275188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e68d2-f585-49e8-a33f-069e615b97d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.299950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:delete_application_credential(user_id=73d600fdca7e4460866841d444a8c9e5, application_credential_id=a9d06e5f604140df872c919d56ef0785)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:01.304039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:01.365461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-813e68d2-f585-49e8-a33f-069e615b97d7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:01.371660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-813e68d2-f585-49e8-a33f-069e615b97d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:01.512095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2707/5390] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:55:00 2022] DELETE /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials/a9d06e5f604140df872c919d56ef0785 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:01.520241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:01.526609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:01.586143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6f02-89ce-4af7-996f-9286afc92a3f tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:01.617814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:01.619444 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2684/5391] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:01.629406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.631838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.636145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.636711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.638339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.640592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.641863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:01.650889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:01.685783 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2708/5392] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:55:01 2022] GET /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules => generated 369 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:01.694167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:01.728929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:01.734278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7f1d-e6c3-4703-98a9-62d7997a2615 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:01.735904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:01.800177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:01.809808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.809808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.809808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/9631b7b59eef432091cd49fed430ffbd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.812087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:delete_access_rule(user_id=73d600fdca7e4460866841d444a8c9e5, access_rule_id=9631b7b59eef432091cd49fed430ffbd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:01.815015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:01.856193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2685/5393] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:01.856193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:01.891734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0db0a-99aa-4985-981d-09b4dcbd6c2d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:01.904695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:01.906404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:01.907086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:01.907816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:01.909315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:01.910032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:01.921659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:01.963260 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2686/5394] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:01.965169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:02.020961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d6633-7fb7-4c41-9d98-157158ea5ce9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:02.087360 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2709/5395] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 4 20:55:01 2022] DELETE /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/9631b7b59eef432091cd49fed430ffbd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:02.089094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:02.089680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:02.092590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:02.093428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:02.096235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:02.096235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:02.106001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:02.218424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffdc5-e366-4dc1-ac2e-f9047cc604de tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:02.235344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:02.236610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:02.237114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:02.239582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:02.246241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:02.252754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:02.278913 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2710/5396] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:55:02 2022] GET /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules => generated 158 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:02.287074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:02.315906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063b864-f107-465d-82c3-59ce22de5765 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:02.332469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2687/5397] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:01 2022] POST /identity/v3/projects => generated 371 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:02.339401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:02.340337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:02.343550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:02.344915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:02.346929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:02.356069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:02.358469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:02.640845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:02.726028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a57c-300e-433d-8ca6-dfeb52b2057f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:02.769081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:02.772441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:02.775426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:02.776170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:02.777596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:02.783103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:02.914051 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2711/5398] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:55:02 2022] POST /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials => generated 920 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:02.927879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:02.964648 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2688/5399] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:02 2022] POST /identity/v3/users => generated 286 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:02.970631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.002145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91136b-c20f-4efc-a63d-027ce6246d7e tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.028671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb800b9b-5855-4318-bc7d-7ce57fdeb773 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.048480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:03.049568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.050124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.051090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.056988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:03.063421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:03.073782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:03.116652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2689/5400] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:03.122825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.146922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29eea-9202-499b-adba-ea502f8d98d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.157854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:03.158967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.159512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.165377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.165377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:03.165377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:03.187223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2690/5401] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:03.193076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.229937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:03.232256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.235461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.236274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.241031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54840df-8b8e-479e-bb8a-a21fd4377370 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.241802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:03.245888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:03.251998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:03.254686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.255750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.256508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] PATH_INFO: `/v3/projects/739bc9c01f9c42febc9ee45be220cfa2/users/25bfa357542b4c349054ce25bf3a91f4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.268723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2712/5402] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:55:02 2022] GET /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules => generated 369 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:03.277092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.304348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739bc9c01f9c42febc9ee45be220cfa2, user_id=25bfa357542b4c349054ce25bf3a91f4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:03.305293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24ae7-02e7-4316-884c-fc62b8875115 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.312946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e2f92-9590-43ed-8547-c34d82242ee3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:03.317542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:03.320015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.320638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.328218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.328218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:03.328218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:03.511883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2691/5403] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:03 2022] PUT /identity/v3/projects/739bc9c01f9c42febc9ee45be220cfa2/users/25bfa357542b4c349054ce25bf3a91f4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:03.532308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:03.532975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:03.533881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:03.635069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] MFA Rules not processed for user `25bfa357542b4c349054ce25bf3a91f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:03.638381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:03.730512 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2713/5404] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:55:03 2022] POST /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/application_credentials => generated 920 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:03.749121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.802040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969598-78db-4fb2-8abc-a6b7aee13927 tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:03.909258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2692/5405] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:03.956157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:03.962025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:04.003651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d600fdca7e4460866841d444a8c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e9f09510664624beae60960fb50e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:04.004992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:04.005510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:04.006010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/adc35e5f96c546ce9769d24e4aa654b2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:04.008516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorizing `identity:get_access_rule(user_id=73d600fdca7e4460866841d444a8c9e5, access_rule_id=adc35e5f96c546ce9769d24e4aa654b2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:04.011630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:04.030443 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2714/5406] 10.222.0.78 () {58 vars in 1359 bytes} [Tue Oct 4 20:55:03 2022] GET /identity/v3/users/73d600fdca7e4460866841d444a8c9e5/access_rules/adc35e5f96c546ce9769d24e4aa654b2 => generated 229 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:04.038088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:04.038088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:04.186471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b6c9-d263-4dc9-ab6e-3f4ca316efd9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:04.194096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:04.195116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:04.195673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:04.196858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:04.218357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:04.221664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d69be-2359-4f4f-8079-491ecef72ceb service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:04.259954 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2693/5407] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:55:04.260550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845613fd-330d-4bf7-aec7-d2ecf6ed9bbb tempest-AccessRulesV3Test-736917207 tempest-AccessRulesV3Test-736917207-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:04.270744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:04.271927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:04.272518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:04.273191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] PATH_INFO: `/v3/users/73d600fdca7e4460866841d444a8c9e5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:04.276197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d600fdca7e4460866841d444a8c9e5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:04.280301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:04.427946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:04.733829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d600fdca7e4460866841d444a8c9e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:04.735973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d600fdca7e4460866841d444a8c9e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:04.892620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d600fdca7e4460866841d444a8c9e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:05.349103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:05.350018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:05.350177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:05.377877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d600fdca7e4460866841d444a8c9e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:05.428326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5769abdb-5c62-4c86-8d65-f058fcd07535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d600fdca7e4460866841d444a8c9e5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:05.460798 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2715/5408] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:04 2022] DELETE /identity/v3/users/73d600fdca7e4460866841d444a8c9e5 => generated 0 bytes in 1425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:05.463878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:05.470065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:05.470065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:05.521863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:05.562946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:05.565579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:05.586899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:05.592036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:05.839016 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2694/5409] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:05.981168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2716/5410] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:06.048990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:06.053517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:06.134198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:06.137161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:06.417770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364152c-fe30-4711-8f5e-26e36b1cc4de None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:06.441910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:06.447416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:06.448215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:06.452504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:06.498202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:06.501380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:06.547755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2695/5411] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:06.593418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77404b-5738-4caf-835c-aae59174faa6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:06.638482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:06.639804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:06.640465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:06.641086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:06.670667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:06.678565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:06.712088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2717/5412] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:07.382179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:08.083438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:08.086421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:08.100254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:08.103202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:08.141492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4270b6-5cf5-46c8-9d7e-59ad2ac8c3cc service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:08.157781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc18a8-0459-4f5d-b441-6929be47d1a1 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:08.159403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:08.161338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:08.161940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:08.162517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] PATH_INFO: `/v3/users/f2a38bfe37194b57aeca1a0e11becf17` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:08.166461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a38bfe37194b57aeca1a0e11becf17)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:08.172241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:08.178868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:08.181060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:08.181681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:08.182582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] PATH_INFO: `/v3/projects/47e9f09510664624beae60960fb50e2c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:08.186773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e9f09510664624beae60960fb50e2c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:08.200587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:08.748858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e9f09510664624beae60960fb50e2c', 'request_id': 'req-924e63b2-694c-438c-9a5d-4bb2ea6e789a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:08.911451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e9f09510664624beae60960fb50e2c', 'request_id': 'req-924e63b2-694c-438c-9a5d-4bb2ea6e789a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:08.933293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a38bfe37194b57aeca1a0e11becf17'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:08.950498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e9f09510664624beae60960fb50e2c', 'request_id': 'req-924e63b2-694c-438c-9a5d-4bb2ea6e789a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:08.990768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] The token cache is being invalidate because project 47e9f09510664624beae60960fb50e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:08.992388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:08.998488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-924e63b2-694c-438c-9a5d-4bb2ea6e789a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:09.007849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2718/5413] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:08 2022] DELETE /identity/v3/projects/47e9f09510664624beae60960fb50e2c => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:09.017530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:09.019791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:09.022114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:09.075710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a38bfe37194b57aeca1a0e11becf17'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:09.098653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:09.103367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:09.104371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a38bfe37194b57aeca1a0e11becf17'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:09.139580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a38bfe37194b57aeca1a0e11becf17'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:09.141188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bf8fc0e6-df21-4ef9-b75e-f1f44d839976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a38bfe37194b57aeca1a0e11becf17'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:09.159436 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2696/5414] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:08 2022] DELETE /identity/v3/users/f2a38bfe37194b57aeca1a0e11becf17 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:09.163452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b424-7b58-4b61-9ca3-081b1046cf96 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:09.164313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b424-7b58-4b61-9ca3-081b1046cf96 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:09.166548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b424-7b58-4b61-9ca3-081b1046cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:09.207545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:09.271510 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2719/5415] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:09.306282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:09.312721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:09.384564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0cf3b424-7b58-4b61-9ca3-081b1046cf96 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:09.391129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0cf3b424-7b58-4b61-9ca3-081b1046cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:09.624405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:09.728659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2697/5416] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:09.748870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:09.748870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:09.749712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:09.817236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92f5a5-4d34-491b-a87e-876476786687 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:09.921140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:09.923910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:09.969904 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2698/5417] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:09.977844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:10.063933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedef953-f4d4-4a84-80ab-4bd5951c5655 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:10.099207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:10.099207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:10.099207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:10.099207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:10.099992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:10.099992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:10.099992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:10.159127 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2699/5418] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:10.161926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:10.166814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:10.168222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:10.168734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:10.169234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:10.205359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ec8c-ff42-4f3b-96e5-fd1522e33bd9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:10.225418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:10.226894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:10.227689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:10.228324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:10.229571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:10.233897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:10.393555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:10.397535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:10.439852 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2720/5419] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:10.670251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:10.673173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:10.700431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2700/5420] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:10 2022] POST /identity/v3/projects => generated 397 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:10.702365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:10.769962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253658-7919-4c98-adc6-4d1dd8ad9a60 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:10.978645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4dad5-f156-4225-94f7-8652633e4a4c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:10.989180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:10.990648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:10.991092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:10.991632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:10.993390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:10.998760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:11.045225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:11.047751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:11.048044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:11.049067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] PATH_INFO: `/v3/projects/46118121de724c439d844950f5542370` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:11.051997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46118121de724c439d844950f5542370)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:11.058172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:11.233873 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2701/5421] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:10 2022] POST /identity/v3/users => generated 305 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:55:11.241577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:11.285669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6bc66-dd65-4dde-afab-cffb04e28a8e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:11.328111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46118121de724c439d844950f5542370', 'request_id': 'req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:11.349348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:11.477522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46118121de724c439d844950f5542370', 'request_id': 'req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:11.512172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46118121de724c439d844950f5542370', 'request_id': 'req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:11.564139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] The token cache is being invalidate because project 46118121de724c439d844950f5542370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:11.565314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:11.571389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:11.576399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:11.577484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:11.578077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:11.578493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:11.579508 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2721/5422] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:10 2022] DELETE /identity/v3/projects/46118121de724c439d844950f5542370 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:11.584280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:11.586553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:11.590272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:11.599261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:11.640964 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2702/5423] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:55:11.642895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:11.652618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:11.673237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1bae-dd1f-4760-83d8-f7cadd2edb24 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:11.706474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:11.709054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:11.715733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:11.715733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] PATH_INFO: `/v3/users/89ac095cfc354ca2beb4289baf11fb2b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:11.717957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ac095cfc354ca2beb4289baf11fb2b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:11.726858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:11.741363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beb8c-3a3e-4e13-a2f9-fcafc080945a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:11.745541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:11.764402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:11.765151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:11.767093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:11.767093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] PATH_INFO: `/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf/users/b01c6f1532d244b59cf74869ad2d3db4/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:11.848703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c702cfdd1cbe4ccd92aeb9769381b1bf, user_id=b01c6f1532d244b59cf74869ad2d3db4, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:11.859736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:12.058918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2703/5424] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:11 2022] PUT /identity/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf/users/b01c6f1532d244b59cf74869ad2d3db4/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:12.062783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:12.200844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ac095cfc354ca2beb4289baf11fb2b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:12.203225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ac095cfc354ca2beb4289baf11fb2b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:12.355498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ac095cfc354ca2beb4289baf11fb2b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:12.392004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ac095cfc354ca2beb4289baf11fb2b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:12.396408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f400c-8305-4ccc-8ee5-0b7753a570b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:12.412374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ac095cfc354ca2beb4289baf11fb2b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:12.426615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:12.426615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:12.426615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:12.426615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:12.427633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:12.442525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2c777-79d6-445d-9b8f-5a6b5dd492f0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:12.486639 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2722/5425] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:11 2022] DELETE /identity/v3/users/89ac095cfc354ca2beb4289baf11fb2b => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:12.521886 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2704/5426] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:55:12.531421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:12.531421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:12.692593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:12.693772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:12.698594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:12.838546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:12.841796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:12.884585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc27780-d14d-450f-a649-6c6fbaef7629 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:12.912310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:12.926486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:12.927265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:12.927445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] PATH_INFO: `/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf/users/b01c6f1532d244b59cf74869ad2d3db4/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:12.936916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c702cfdd1cbe4ccd92aeb9769381b1bf, user_id=b01c6f1532d244b59cf74869ad2d3db4, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:12.945388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779728-7451-4c3f-ab24-f3fe27f0e229 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:13.007187 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2723/5427] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:12 2022] PUT /identity/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf/users/b01c6f1532d244b59cf74869ad2d3db4/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:13.019205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:13.019584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:13.020143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:13.077406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2705/5428] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:13.104079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:13.107897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:13.127352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] MFA Rules not processed for user `b01c6f1532d244b59cf74869ad2d3db4`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:13.129592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:13.289835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:13.293652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:13.393712 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2724/5429] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:13.401642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:13.497754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847499-8fd9-453d-b2f9-d8d8482c0697 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:13.729591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5649-aa6b-4519-97c4-06d5f8ccdf78 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:13.744976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:13.747904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:13.747904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:13.747904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:13.749835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:13.755086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:13.801500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:13.802501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:13.802972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:13.803463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:14.019972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:14.023309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:14.031727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:14.044648 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2725/5430] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:13 2022] POST /identity/v3/projects => generated 397 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:14.051705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:14.085233 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2706/5431] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 982 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:14.337489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0388e2-2f61-4e31-a476-d068c650b576 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:14.360894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:14.363723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:14.364725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:14.365887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:14.368046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:14.378908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:14.598976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2726/5432] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:14 2022] POST /identity/v3/users => generated 299 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:55:14.611500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:14.701621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995392e-15b9-4db6-b53a-e4daf42c11a8 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:14.738971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:14.741142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:14.742357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:14.744423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:14.747989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:14.758395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:14.820131 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2707/5433] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:14.822527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:14.872132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97c70-d6d0-42e2-b4de-850a7f4999f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:14.883301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:14.885355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:14.890261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:14.890261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:14.890261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:14.893371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab616d4-3f94-4fad-8200-5f9d3da278bb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:14.926139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2727/5434] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:14.929980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:14.959446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162fa77-b158-4493-b9a0-f67ac8fea474 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:14.974151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:14.976020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:14.976701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:14.977537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] PATH_INFO: `/v3/projects/e96346f3d20e42f89a023c96a9d28c4c/users/00f5a272a013419cb5304e3fba79c37d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:15.048713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96346f3d20e42f89a023c96a9d28c4c, user_id=00f5a272a013419cb5304e3fba79c37d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:15.059697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:15.200727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2708/5435] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:14 2022] PUT /identity/v3/projects/e96346f3d20e42f89a023c96a9d28c4c/users/00f5a272a013419cb5304e3fba79c37d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:15.209029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:15.209928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:15.210368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:15.283826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] MFA Rules not processed for user `00f5a272a013419cb5304e3fba79c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:15.286100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:15.402457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:15.406925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:15.471350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:15.554968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:15.604135 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2728/5436] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:15.622146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:15.625209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:15.667935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7acb-33b2-46b4-abcb-d8d1207342d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:15.689231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:15.690632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:15.691992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:15.691992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] PATH_INFO: `/v3/projects/bf7c559faf714f8395ef38d122e31e8d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:15.695395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7c559faf714f8395ef38d122e31e8d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:15.700491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:15.833023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b623cd1-ab8a-4e8a-8724-05af6e21ef94 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:15.842542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:15.844433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:15.845148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:15.845838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:15.988184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7c559faf714f8395ef38d122e31e8d', 'request_id': 'req-df1e555d-004f-43b8-9159-05ff3aca5d28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:16.006608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7c559faf714f8395ef38d122e31e8d', 'request_id': 'req-df1e555d-004f-43b8-9159-05ff3aca5d28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:16.010739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:16.014932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973d66b-ccf9-44f6-8f61-5ef341225148 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:16.019324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7c559faf714f8395ef38d122e31e8d', 'request_id': 'req-df1e555d-004f-43b8-9159-05ff3aca5d28'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:16.037213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2729/5437] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:55:16.041030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.042174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.043099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.077520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:16.079997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:16.173330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] The token cache is being invalidate because project bf7c559faf714f8395ef38d122e31e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:16.173848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:16.181126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df1e555d-004f-43b8-9159-05ff3aca5d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:16.188332 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2709/5438] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:15 2022] DELETE /identity/v3/projects/bf7c559faf714f8395ef38d122e31e8d => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:16.210213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449998e-0882-4d72-ade8-ec2c4845190e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.210782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449998e-0882-4d72-ade8-ec2c4845190e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.211069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449998e-0882-4d72-ade8-ec2c4845190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.234675 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2730/5439] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:16.261835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:16.281043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1449998e-0882-4d72-ade8-ec2c4845190e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:16.281760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:16.284531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1449998e-0882-4d72-ade8-ec2c4845190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:16.433624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:16.557293 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2710/5440] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:16.579617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345dd61-5a14-4af0-a797-beb3998e9d23 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:16.600081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:16.600081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.600081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.600081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.637714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:16.641705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:16.689355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.690336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.690336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.719211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2731/5441] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:16.748638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:16.750848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:16.761975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2711/5442] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 04 20:55:16.766739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:16.779179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e739b5-680b-4cbc-96b6-c6752668eb90 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:16.786639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:16.795048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:16.815178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2732/5443] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:16.828170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:16.844434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b57b4d-1028-46d6-809a-0a7edc287c29 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:16.854181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:16.855434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:16.855920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:16.856300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:16.857573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:16.862027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:17.022121 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2712/5444] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:16 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:55:17.027705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:17.044474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d728be-9b86-4dc1-a0a3-fdfc099e37cd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:17.180683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:17.182616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:17.183331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:17.183990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:17.185704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:17.194582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:17.422054 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2733/5445] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:17 2022] POST /identity/v3/users => generated 283 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:17.424106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:17.453961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0294de-c1f1-4a4e-9a2d-b4ddcf2ccdbc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:17.484530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:17.487016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:17.487016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:17.487016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:17.487743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:17.491447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:17.551315 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2713/5446] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:17.558719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:17.588706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f791-20bc-4e87-a0df-11c91e014806 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:17.635419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:17.637447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:17.643170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:17.644372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:17.645609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:17.650486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b9890-589f-4775-969d-b9c89e0c576a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:17.707922 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2734/5447] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:17.710538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:17.751793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf792ea7-62b7-4487-8e86-651959b3c84d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:17.774177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:17.775435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:17.775911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:17.777874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67/users/003a9f520055490f920716d1e71b9999/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:17.834702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67, user_id=003a9f520055490f920716d1e71b9999, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:17.845891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9d6da-b450-4df8-8722-ab39f62dbcc5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:17.871476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:18.087991 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2714/5448] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:17 2022] PUT /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67/users/003a9f520055490f920716d1e71b9999/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:18.106744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:18.116596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:18.117260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:18.227773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] MFA Rules not processed for user `003a9f520055490f920716d1e71b9999`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:18.232722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:18.338928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:18.339487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:18.339974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:18.405945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:18.409526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:18.543799 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2735/5449] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:18.543799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:18.545359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:18.615761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:18.639743 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2715/5450] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:18.641895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:18.649586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:18.789789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9671a-4757-4aaa-9c01-20440a9ca3c1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:18.803257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:18.805722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:18.806413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:18.807054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] PATH_INFO: `/v3/users/b01c6f1532d244b59cf74869ad2d3db4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:18.811502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01c6f1532d244b59cf74869ad2d3db4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:18.815834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:18.923232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7309519-554b-4d23-ab75-9cf233c787ea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:18.936935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:18.938571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:18.939426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:18.940200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:18.963390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:18.969428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:19.006365 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2716/5451] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:19.008370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:19.246200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01c6f1532d244b59cf74869ad2d3db4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:19.253438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01c6f1532d244b59cf74869ad2d3db4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:19.256517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00526-61ce-4d38-926b-890649be3c83 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:19.274181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:19.277185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:19.278002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:19.278674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:19.308230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:19.313543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd215-aed4-492b-ba52-678f0539c0e9 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:19.346404 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2717/5452] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:19.354776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:19.361631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:19.362873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:19.374674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2718/5453] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:55:19 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:55:19.385001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:55:19.453095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:19.496116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed49d-2957-4cd7-8a8d-e64b2b7dc206 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:19.504460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003a9f520055490f920716d1e71b9999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:19.505616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:19.506481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:19.507650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:19.510530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01c6f1532d244b59cf74869ad2d3db4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:19.520768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorizing `identity:get_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:19.525183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80009dd3-39ed-4218-8023-10ef23a65054 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:19.540245 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2719/5454] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:55:19 2022] GET /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 365 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:19.565933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01c6f1532d244b59cf74869ad2d3db4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:19.628768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01c6f1532d244b59cf74869ad2d3db4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:19.653431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd11da-e11a-45bf-b3cc-7b14b3e96656 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:19.653431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd11da-e11a-45bf-b3cc-7b14b3e96656 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:19.664958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd11da-e11a-45bf-b3cc-7b14b3e96656 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:19.664958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2720/5455] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:55:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:55:19.673989 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2736/5456] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:18 2022] DELETE /identity/v3/users/b01c6f1532d244b59cf74869ad2d3db4 => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:19.682163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:19.682660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:19.683182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:19.702255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:55:19.704747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:19.709962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:19.744280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:19.747972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:20.011872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:20.017685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:20.049653 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2721/5457] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:20.070221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:20.073244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:20.089633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:20.214168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50544c-868c-4649-81f9-c6c96fc94896 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:20.225537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003a9f520055490f920716d1e71b9999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:20.225537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.225537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.230917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.233213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorizing `identity:get_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:20.241890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cabcb-01b6-4ddf-9b29-db2cf2bc229c tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:20.264161 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2737/5458] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:55:19 2022] GET /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 365 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:20.347307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7231a2-0c2c-4012-9dc4-52ee53b1a8fe None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:20.373820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:20.374928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.375715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.376002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.395707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.397365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.398340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.402388 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2738/5459] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:55:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:55:20.425060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:55:20.431609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:20.434029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21165dd-3c59-453a-b6b5-bdacf8f7db03 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:20.472270 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2722/5460] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:20.491707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:20.518581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a134-e0e0-4f5c-ab5f-b8f8271f9643 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:20.545189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003a9f520055490f920716d1e71b9999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:20.546941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.549854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.550786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.554047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorizing `identity:get_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:20.559572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:20.565987 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2739/5461] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:55:20 2022] GET /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 365 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:20.657175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2df5-4c33-4081-9710-1188b1d4e9c6 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.658592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2df5-4c33-4081-9710-1188b1d4e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.659498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a2df5-4c33-4081-9710-1188b1d4e9c6 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.661582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2723/5462] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:55:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:55:20.679116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:55:20.723812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:20.772997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf54393-9763-42a5-9579-91e18cbd1878 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:20.784085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003a9f520055490f920716d1e71b9999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:20.785868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.788321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.789211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.792493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorizing `identity:get_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:20.798568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:20.825779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2740/5463] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:55:20 2022] GET /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 365 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:20.911625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:20.912488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:20.913286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:20.917434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2724/5464] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 20:55:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 20:55:20.923832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 20:55:20.926575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:20.981387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:21.016170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b4e9-8c37-4bf7-9654-88b31cfe4609 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:21.040758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003a9f520055490f920716d1e71b9999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:21.041949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:21.042778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:21.043560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:21.048466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorizing `identity:get_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:21.051594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841dc54-6385-42b2-ad09-9f6cd39e0543 tempest-QuotasTestJSON-1585801544 tempest-QuotasTestJSON-1585801544-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:21.056774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2741/5465] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 20:55:20 2022] GET /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 365 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:21.147733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:21.152666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:21.189716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6f6dd-760a-4a9b-9616-8e2c0e47775e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:21.202867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:21.204608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:21.206221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:21.206809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] PATH_INFO: `/v3/users/003a9f520055490f920716d1e71b9999` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:21.209277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003a9f520055490f920716d1e71b9999)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:21.213806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:21.282734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:21.283737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:21.284409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:21.328068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:21.332470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:21.607350 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2742/5466] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:21.620191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:21.628458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:21.694895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003a9f520055490f920716d1e71b9999'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:21.828848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003a9f520055490f920716d1e71b9999'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:21.861374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003a9f520055490f920716d1e71b9999'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:21.895965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f131d48-e8d2-4a8c-b77f-fa2440ee4e8c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:21.926526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:21.928110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003a9f520055490f920716d1e71b9999'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:21.929059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:21.929531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:21.929844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2ee9285-86e8-4eb5-aae7-5c5852bd01b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003a9f520055490f920716d1e71b9999'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:21.930036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:21.947681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:21.960411 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2725/5467] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:21 2022] DELETE /identity/v3/users/003a9f520055490f920716d1e71b9999 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:55:21.963798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:21.964421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:21.965016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:21.982686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:21.987449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:22.016761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2743/5468] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:22.079418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:22.081823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:22.167897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:22.406281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2726/5469] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:22.428904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:22.431191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:22.537931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e4a7-57d5-47de-9bca-f4f5f68ee2e7 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:22.672446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:22.685403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:22.764005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab182ae-d31d-4910-806e-7119273b3cd7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:22.792659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:22.794311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:22.795091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:22.795878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] PATH_INFO: `/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:22.805732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:22.806042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c702cfdd1cbe4ccd92aeb9769381b1bf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:22.812085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:22.894421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:22.895910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:22.900997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:22.901738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:22.991912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:22.999374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:23.027986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2744/5470] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:23.101579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c702cfdd1cbe4ccd92aeb9769381b1bf', 'request_id': 'req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:23.127278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c702cfdd1cbe4ccd92aeb9769381b1bf', 'request_id': 'req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:23.165658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c702cfdd1cbe4ccd92aeb9769381b1bf', 'request_id': 'req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:23.315866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] The token cache is being invalidate because project c702cfdd1cbe4ccd92aeb9769381b1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:23.316877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:23.318444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:23.322612 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2727/5471] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:22 2022] DELETE /identity/v3/projects/c702cfdd1cbe4ccd92aeb9769381b1bf => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:23.332384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:23.423350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342622f-29cf-4d09-a21c-7aab7e545850 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:23.817504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:23.820031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:23.821368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:23.823058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] PATH_INFO: `/v3/users/00f5a272a013419cb5304e3fba79c37d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:23.826600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f5a272a013419cb5304e3fba79c37d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:23.831238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:24.332647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f5a272a013419cb5304e3fba79c37d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:24.337774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f5a272a013419cb5304e3fba79c37d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:24.487177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f5a272a013419cb5304e3fba79c37d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:24.577771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f5a272a013419cb5304e3fba79c37d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:24.646905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-650bfebc-ed01-4f2b-b9eb-9ef9c282ed6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f5a272a013419cb5304e3fba79c37d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:24.704278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2745/5472] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:23 2022] DELETE /identity/v3/users/00f5a272a013419cb5304e3fba79c37d => generated 0 bytes in 1374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:25.248919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:25.248919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:25.300159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee048a-f55a-4a12-bbe2-0c90584dfd62 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:25.601936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:25.601936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:25.601936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:25.601936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] PATH_INFO: `/v3/users/f06e5f7d140c4e689955b9856e651331` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:25.604069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06e5f7d140c4e689955b9856e651331)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:25.611966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:25.698105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:25.700893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:25.701831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:25.746809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:25.750305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:25.877407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:25.924970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2746/5473] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:25.929171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:25.932846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:26.093711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:26.100755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06e5f7d140c4e689955b9856e651331'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:26.242845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06e5f7d140c4e689955b9856e651331'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:26.262620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08194f9-a648-4092-b85b-a525c06a48b1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:26.279130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06e5f7d140c4e689955b9856e651331'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:26.290418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:26.292329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:26.293184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:26.294746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:26.320012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:26.329727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321cc9-5013-431a-8a06-69e9ebafe3aa service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:26.377040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2747/5474] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:55:26.420203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06e5f7d140c4e689955b9856e651331'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:26.424082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06e5f7d140c4e689955b9856e651331'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:26.496632 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2728/5475] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:25 2022] DELETE /identity/v3/users/f06e5f7d140c4e689955b9856e651331 => generated 0 bytes in 1250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:26.499899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:26.500621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:26.501198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:26.559813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:26.581699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:26.750446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:26.755425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:26.873951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2748/5476] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:26.928137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:26.928137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:27.122657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cfc76-eb83-4808-8df1-684f56603ac0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:27.134888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:27.145128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:27.145128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:27.145128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] PATH_INFO: `/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:27.145128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b54dbb6a0bc4d3aa3aa943d646aed67)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:27.149664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:27.320466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8ec4-82da-4858-8f67-8cd6b8250131 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:27.362035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:27.364064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:27.368423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:27.370368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:27.434780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:27.441407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e95e51-7158-426d-867e-a2fde9142adb service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:27.466262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'request_id': 'req-e7add32a-f392-4893-9066-a1de2a8a6995'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:27.501768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'request_id': 'req-e7add32a-f392-4893-9066-a1de2a8a6995'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:27.508316 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2749/5477] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:55:27.510825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:27.512241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:27.514677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:27.533368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b54dbb6a0bc4d3aa3aa943d646aed67', 'request_id': 'req-e7add32a-f392-4893-9066-a1de2a8a6995'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:27.598404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:27.600984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:27.707922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] The token cache is being invalidate because project 9b54dbb6a0bc4d3aa3aa943d646aed67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:27.708396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:27.709619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7add32a-f392-4893-9066-a1de2a8a6995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:27.716084 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2729/5478] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:26 2022] DELETE /identity/v3/projects/9b54dbb6a0bc4d3aa3aa943d646aed67 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:27.728659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc212-4adc-490e-99a9-ca83d0163f32 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:27.729039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc212-4adc-490e-99a9-ca83d0163f32 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:27.733189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc212-4adc-490e-99a9-ca83d0163f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:27.836857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3e3cc212-4adc-490e-99a9-ca83d0163f32 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:27.839950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e3cc212-4adc-490e-99a9-ca83d0163f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:27.857774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2750/5479] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:27.909947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:27.916407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:28.077230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:28.086426 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2730/5480] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:28.099103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:28.100567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:28.101587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:28.180696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:28.184220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:28.212177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2731/5481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:55:28.219933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:28.222802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0ce4-62be-4090-9ec2-0aae93be59f5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:28.235930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:28.236971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:28.237461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:28.237969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:28.244403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82282-e835-44a5-8e72-1efbf5de38fa None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:28.255600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:28.258070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:28.259774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:28.260846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:28.265014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:28.266181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:28.272106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:28.309914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:28.309914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:28.322994 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2732/5482] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:28.326881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:28.331582 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2751/5483] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 20:55:28.393971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:28.393971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686b9f-05eb-4bf8-a3a2-d4ac766e48dc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:28.426434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:28.427290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:28.428191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:28.429029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:28.431206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:28.437828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:28.772654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2733/5484] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:28 2022] POST /identity/v3/projects => generated 401 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:28.785882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:28.786755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:28.791523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:28.835915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47f63-59bb-4631-bcdb-45bad10916eb service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:29.082253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575b55e-7ad0-4b12-8778-7e9bfb618ec1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:29.103495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:29.104909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:29.105794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:29.115576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] PATH_INFO: `/v3/projects/e96346f3d20e42f89a023c96a9d28c4c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:29.118283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96346f3d20e42f89a023c96a9d28c4c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:29.122514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:29.130284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:29.133766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:29.136578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:29.137804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:29.139464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:29.150227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475eb-9395-4fea-a9f1-d3fd0ceb6a43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:29.485178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2752/5485] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:28 2022] POST /identity/v3/users => generated 301 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:29.490705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a62b-531f-490b-bfed-ab41cc257a3c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:29.491808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a62b-531f-490b-bfed-ab41cc257a3c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:29.493162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a62b-531f-490b-bfed-ab41cc257a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:29.512376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96346f3d20e42f89a023c96a9d28c4c', 'request_id': 'req-45c57289-6061-40ec-ad3b-bc987d28787a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:29.528036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96346f3d20e42f89a023c96a9d28c4c', 'request_id': 'req-45c57289-6061-40ec-ad3b-bc987d28787a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:29.557729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96346f3d20e42f89a023c96a9d28c4c', 'request_id': 'req-45c57289-6061-40ec-ad3b-bc987d28787a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:29.561942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5219a62b-531f-490b-bfed-ab41cc257a3c None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:29.564830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5219a62b-531f-490b-bfed-ab41cc257a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:29.690834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] The token cache is being invalidate because project e96346f3d20e42f89a023c96a9d28c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:29.704005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:29.705856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:29.722466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2734/5486] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:28 2022] DELETE /identity/v3/projects/e96346f3d20e42f89a023c96a9d28c4c => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:29.724865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:29.729857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:29.816673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:29.850421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2753/5487] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:29.862610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:29.864541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:29.865504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:29.966812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:29.972537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:30.010411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2754/5488] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:30.012412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:30.014620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57289-6061-40ec-ad3b-bc987d28787a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:30.021981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:30.035933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:30.039307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.040456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.041473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.044820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:30.053461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce13d0-1478-4fd5-9cbf-ab7a3fed4a49 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:30.115653 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2735/5489] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:30.120341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.126027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.126027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.163616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:30.226282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:30.231710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:30.281628 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2736/5490] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:30.286058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:30.333479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be49ea3-840d-4312-9c82-baa42ada0135 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:30.358282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:30.362493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a501-d690-4c36-9271-84394d4cfa2d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:30.367349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.368483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.370260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.379606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:30.382064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.385032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.385575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.387077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:30.395879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:30.410136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:30.416482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bc743-eb8f-49f5-a1d5-57c87435ef21 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:30.454134 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2737/5491] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:30.457613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:30.482028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2755/5492] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:30.486302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28373f7-b580-4151-93b4-b7fbc2f1ff22 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:30.487827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.489465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.490067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.502095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:30.503748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.504345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.506000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.508936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:30.509556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:30.517237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:30.574718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2738/5493] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:30.580789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:30.635253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7f22-c9cd-453c-b295-e87297a61cc3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:30.707703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:30.711535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:30.712449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:30.714228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] PATH_INFO: `/v3/projects/fee0803dedef4618ac76d0aa5d113848/users/07e95fd59c8b492599787f697ab7ac50/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:30.746018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] MFA Rules not processed for user `790598df1c304f4e9984449ad8b26c95`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:30.755448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:30.819882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee0803dedef4618ac76d0aa5d113848, user_id=07e95fd59c8b492599787f697ab7ac50, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:30.830062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246763b-5c9a-47ad-9025-37db0bfc3290 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:31.070192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2756/5494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:31.074369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:31.121015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523f881-8499-47db-92e9-39fde6397fd7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:31.132127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:31.134709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:31.135649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:31.136407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:31.138832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:31.150424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2739/5495] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:30 2022] PUT /identity/v3/projects/fee0803dedef4618ac76d0aa5d113848/users/07e95fd59c8b492599787f697ab7ac50/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:31.152779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14d87-0d66-4c59-88ff-f3e43ac860a2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:31.154359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14d87-0d66-4c59-88ff-f3e43ac860a2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:31.154977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14d87-0d66-4c59-88ff-f3e43ac860a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:31.174390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:31.212428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-41e14d87-0d66-4c59-88ff-f3e43ac860a2 None None] MFA Rules not processed for user `790598df1c304f4e9984449ad8b26c95`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:31.214000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41e14d87-0d66-4c59-88ff-f3e43ac860a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:31.366536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2740/5496] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:31.370337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:31.371155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:31.371683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:31.402442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2757/5497] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:31 2022] POST /identity/v3/projects => generated 375 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:31.402442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:31.412344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:31.498237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] MFA Rules not processed for user `07e95fd59c8b492599787f697ab7ac50`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:31.501691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:31.731112 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2741/5498] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:31.731112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:31.731923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:31.735636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:31.793650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:31.838000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6561d9-e655-4276-8989-b04af6732c2c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:31.862548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:31.864546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:31.865705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:31.866740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:31.937795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ce4c9-6f82-4ff0-a56a-f6f317411dea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:31.947794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:31.949265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:31.949867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:31.950673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] PATH_INFO: `/v3/projects/8600ebb44bd847e2b8114c3d8d2cbbf2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:31.955896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8600ebb44bd847e2b8114c3d8d2cbbf2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:31.963848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:32.019832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:32.025518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:32.074380 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2758/5499] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:32.076919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:32.121213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843f088-70ef-4cbd-af4b-9d055f617bb8 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:32.146693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:32.147946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:32.148461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:32.148962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:32.150251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:32.154342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2255d7b-eea3-4e5b-a6fc-9ba927b024e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:32.306672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'request_id': 'req-ddc700c2-c05a-49a1-b7cb-98cb72c32931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:32.341493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'request_id': 'req-ddc700c2-c05a-49a1-b7cb-98cb72c32931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:32.379612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8600ebb44bd847e2b8114c3d8d2cbbf2', 'request_id': 'req-ddc700c2-c05a-49a1-b7cb-98cb72c32931'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:32.409989 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2759/5500] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:32 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:32.416706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:32.417385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:32.417917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:32.504322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:32.510625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:32.552938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] The token cache is being invalidate because project 8600ebb44bd847e2b8114c3d8d2cbbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:32.557310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:32.561870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:32.579798 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2742/5501] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:31 2022] DELETE /identity/v3/projects/8600ebb44bd847e2b8114c3d8d2cbbf2 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:32.579798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:32.594758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:32.784084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2760/5502] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:32.785805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:32.790203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:32.901661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc700c2-c05a-49a1-b7cb-98cb72c32931 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:32.911165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:32.912607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:32.913179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:32.914233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:32.916243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:32.920631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.053286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ca327-a365-4bb8-b735-25bd18b12865 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.063894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.065216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.065883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.066580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.068502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.072482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baddaa-bfb6-4538-9a0e-c0d74a6fd26f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.109374 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2761/5503] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:33.109374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.109374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.110312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.112098 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2743/5504] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:32 2022] POST /identity/v3/projects => generated 401 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:33.116877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.121864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:33.164763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:33.168832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:33.181216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:33.239000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:33.368466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59df4e-ab79-4d1c-8b9a-4a658dea6f16 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.390840 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2762/5505] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:33.390840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.405172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.407542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.409629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.410687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.437137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc319f1a-f50b-46ef-9775-a2218861987d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.453594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.454983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.455972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.456704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.458256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.466680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.512215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2763/5506] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:33.513088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.552166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c236af-98d6-433c-8d96-a75d76068321 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.561725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.562862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.563450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.563939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.565210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.569250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.654412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.660863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9b0b1-9a4a-45dd-a85c-d105aaeb2440 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.687391 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2744/5507] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:33.693485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ae62-af89-45ab-a691-5ff4b5c500b9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.694450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ae62-af89-45ab-a691-5ff4b5c500b9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.695920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ae62-af89-45ab-a691-5ff4b5c500b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.703584 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2764/5508] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:33 2022] POST /identity/v3/users => generated 307 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:33.705315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.743093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06881864-0acc-4392-b9f1-6d75bc0246a0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.756924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.758513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.758791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.764846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] PATH_INFO: `/v3/projects/1a7b7232575d487e948be03702bd49a7/users/a0400f00d59f4ca8be4de616e5aeeb83/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.803708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c917ae62-af89-45ab-a691-5ff4b5c500b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:33.813103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c917ae62-af89-45ab-a691-5ff4b5c500b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:33.841331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7b7232575d487e948be03702bd49a7, user_id=a0400f00d59f4ca8be4de616e5aeeb83, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.846610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.852487 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2745/5509] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:33.855987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.857044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.857443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:55:33.875968 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:55:33.879857 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:55:33.882066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2746/5510] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:33 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:55:33.882066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.946900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed3650-b96d-4178-9c4d-06e76d94348f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:33.962231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:33.963485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:33.965820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:33.966171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:33.967012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:33.971189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:33.983397 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2765/5511] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:33 2022] PUT /identity/v3/projects/1a7b7232575d487e948be03702bd49a7/users/a0400f00d59f4ca8be4de616e5aeeb83/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:33.993994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:33.996335 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2747/5512] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:34.009832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:34.046550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec72b-c3c1-417f-8686-acfa8574095d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:34.277958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8876-6352-4b1e-b4e6-4ab5a1db039c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:34.289962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:34.291762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:34.293135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:34.293798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:34.296672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:34.297888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:34.302540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf1936-c739-475f-9e76-ea758aa0ad2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:34.371925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:34.376743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:34.377350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:34.377946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] PATH_INFO: `/v3/projects/f11d03cefa494d6c967acc98b8077860/users/aef691b8ea5642be92a0124a7a021147/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:34.384941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2766/5513] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:34.398673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:34.400512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:34.401147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:34.434823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11d03cefa494d6c967acc98b8077860, user_id=aef691b8ea5642be92a0124a7a021147, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:34.446219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:34.571708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] MFA Rules not processed for user `a0400f00d59f4ca8be4de616e5aeeb83`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:34.578352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:34.580773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2748/5514] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:34 2022] PUT /identity/v3/projects/f11d03cefa494d6c967acc98b8077860/users/aef691b8ea5642be92a0124a7a021147/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:34.582438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:34.833644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:34.838978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:34.953453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2767/5515] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:34.956441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115f367-9875-425a-8798-8ea5990fefaa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:34.957723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:34.982459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:34.983448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:34.988038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:34.988815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:34.989889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:34.997375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:35.025075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f627-18b0-476d-8b2d-7195a45eec9f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:35.047808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:35.049107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:35.049755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:35.050364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:35.052614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:35.058484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94b67-d8c6-41db-89b0-a969c4ad78d0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:35.109899 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2768/5516] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:35.112549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:35.113059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:35.113811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:35.212966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:35.220388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:35.223278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2749/5517] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:34 2022] POST /identity/v3/projects => generated 381 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:35.226878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:35.528654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328f5b-5801-48a9-816e-a1b742a34ff5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:35.548654 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2769/5518] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:35.551880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:35.555036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:35.555429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:35.555579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:35.558026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:35.560474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:35.567403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:35.601834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19f669-7668-4d66-afcd-de4314b4822f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:35.620991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:35.622938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:35.624925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:35.626566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] PATH_INFO: `/v3/projects/f11d03cefa494d6c967acc98b8077860/users/aef691b8ea5642be92a0124a7a021147/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:35.639489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11d03cefa494d6c967acc98b8077860, user_id=aef691b8ea5642be92a0124a7a021147, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:35.650738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:35.715342 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2770/5519] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:35 2022] PUT /identity/v3/projects/f11d03cefa494d6c967acc98b8077860/users/aef691b8ea5642be92a0124a7a021147/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:35.715342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:35.844737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2750/5520] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:35 2022] POST /identity/v3/projects => generated 375 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:35.849543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:36.012757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64fd8b-4c81-48a1-8f80-92b1523d37e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:36.185289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604ab2-2e13-40fb-806a-74494a051357 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:36.209170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:36.211615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:36.214193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:36.215119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:36.287748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:36.291648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:36.294829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:36.295600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:36.297931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:36.308309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ce7fe-ffdf-4607-898e-7d57dad5b499 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:36.470244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:36.478817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:36.497192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2771/5521] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:35 2022] POST /identity/v3/users => generated 291 bytes in 786 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:36.500984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:36.501593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:36.502295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:36.535482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:36.541921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:36.610153 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2751/5522] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:36.615165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:36.688675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f6b0-2d04-4382-8cb5-7ccd80bc20fb service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:36.694214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] MFA Rules not processed for user `aef691b8ea5642be92a0124a7a021147`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:36.696859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:36.708059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:36.708910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:36.709294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:36.711530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:36.713292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:36.717128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:36.879406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2752/5523] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:36 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:36.881260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:36.926222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809480-206f-4cad-ae61-5139c2d2d8b3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:36.949890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:36.951605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:36.953969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:36.956275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:36.959325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:36.968286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:36.995774 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2753/5524] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:36.997320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.010474 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2772/5525] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:37.010474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.031262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8074fa-0781-4864-82b9-e4e450267c4c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.043764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.044543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.045040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.045415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.045617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4b75-1eb3-43ae-8ba1-cddfd42a70bd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.046268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.048266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.065153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.065798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.066145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.066411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.067733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.070866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.077317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2754/5526] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:37.080167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.104635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c9e5-1424-4b13-9977-c50510c2e583 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.105078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2773/5527] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:37.106557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.125496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0c15-ce9f-4d2a-a39e-4695372155ad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.128987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef691b8ea5642be92a0124a7a021147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11d03cefa494d6c967acc98b8077860', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.129994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.130485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.130981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.132855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.134228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.137435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.138141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.138346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.138346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.138346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.140594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.180044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2774/5528] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:37.181893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.203612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b386a-22b2-4ab7-b4d3-a1381ddad63c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.232135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.238673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.239856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.240697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] PATH_INFO: `/v3/projects/8bc331439dfe4bbbb6c764bc5c243b35/users/0da48b8d726f40ddadd9f51c65ba8fde/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.272551 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2755/5529] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:55:37 2022] POST /identity/v3/roles => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:37.274855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.307431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35b72-7ab2-4b66-86a5-46f63a80ed60 tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.308804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc331439dfe4bbbb6c764bc5c243b35, user_id=0da48b8d726f40ddadd9f51c65ba8fde, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.314662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.319277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.321554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.322384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.323489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] PATH_INFO: `/v3/projects/121fb8b31400423dad7c1422106a7470/users/1f8c8177528a44b084ff65082bc9d919/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.359378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] RBAC: Authorizing `identity:create_grant(project_id=121fb8b31400423dad7c1422106a7470, user_id=1f8c8177528a44b084ff65082bc9d919, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.367185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37122-8489-4150-a394-3640444f90be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.488162 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2775/5530] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:37 2022] PUT /identity/v3/projects/8bc331439dfe4bbbb6c764bc5c243b35/users/0da48b8d726f40ddadd9f51c65ba8fde/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:37.495567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:37.569653 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2756/5531] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:37 2022] PUT /identity/v3/projects/121fb8b31400423dad7c1422106a7470/users/1f8c8177528a44b084ff65082bc9d919/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:37.576629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4ea6-4bdb-4b14-a6c7-7146addbcc61 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.577595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4ea6-4bdb-4b14-a6c7-7146addbcc61 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.579846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4ea6-4bdb-4b14-a6c7-7146addbcc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.703385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-093d4ea6-4bdb-4b14-a6c7-7146addbcc61 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:37.706817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-093d4ea6-4bdb-4b14-a6c7-7146addbcc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:37.736569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f70b-6d41-4c8a-bdc0-7c4dabb35482 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:37.888309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:37.954531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef691b8ea5642be92a0124a7a021147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11d03cefa494d6c967acc98b8077860', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:37.955871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.956386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.956909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] PATH_INFO: `/v3/projects/fee0803dedef4618ac76d0aa5d113848/users/07e95fd59c8b492599787f697ab7ac50/roles/ace6ba66199144c8bb3b3da46005df84` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:37.967092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fee0803dedef4618ac76d0aa5d113848, user_id=07e95fd59c8b492599787f697ab7ac50, role_id=ace6ba66199144c8bb3b3da46005df84)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:37.981943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2757/5532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:37.984069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecaa98-4cb4-4534-af72-ba894fc73d5a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:37.992287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:37.992943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:37.993446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:38.078937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] MFA Rules not processed for user `1f8c8177528a44b084ff65082bc9d919`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:38.085221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:38.089837 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2776/5533] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:37 2022] PUT /identity/v3/projects/fee0803dedef4618ac76d0aa5d113848/users/07e95fd59c8b492599787f697ab7ac50/roles/ace6ba66199144c8bb3b3da46005df84 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:38.093417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:38.094268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:38.095260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:38.177574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:38.181079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:38.322794 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2758/5534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:38.324821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:38.329003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:38.345537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:38.356237 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2777/5535] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:38.358921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:38.368359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:38.547037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb2a7f-9336-42cc-bf21-2adff82ec20d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:38.557406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:38.558579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:38.559083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:38.559602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:38.595789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522a7b-0cb4-4f88-99c4-0e2d13b1fcff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:38.604377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e95fd59c8b492599787f697ab7ac50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fee0803dedef4618ac76d0aa5d113848', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1388233816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:38.604691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:38.605019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:38.605296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] PATH_INFO: `/v3/users/07e95fd59c8b492599787f697ab7ac50/application_credentials` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:38.606357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: Authorizing `identity:create_application_credential(user_id=07e95fd59c8b492599787f697ab7ac50)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:38.607478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:38.750180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:38.754987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:38.780773 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2778/5536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:38.782565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:38.785695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:38.877706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:38.937085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15adec1-ff73-4d48-8e36-d690aa96d2b6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:38.947301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:38.947674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:38.948451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:38.949091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:39.011796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2759/5537] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 4 20:55:38 2022] POST /identity/v3/users/07e95fd59c8b492599787f697ab7ac50/application_credentials => generated 659 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:39.013980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:39.143097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:39.146474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:39.174627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2779/5538] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:39.176744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:39.179611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:39.193071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b5906-82fb-41ed-a3f4-01820c07efd0 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:39.209647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:39.209647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:39.209647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:39.209647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:39.232498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:39.236138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283912bb-c10b-4b02-bd6d-1ecb19bc5096 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:39.238977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b8f7-d388-41f3-8fab-ce915d2cf3b4 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:39.258961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:39.260577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:39.264498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:39.265277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] PATH_INFO: `/v3/users/4f27784d32ce4b8c84b06684eb98f5bc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:39.269601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f27784d32ce4b8c84b06684eb98f5bc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:39.278783 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2760/5539] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:39.280721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:39.294568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:39.294938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:39.299872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:39.411461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] MFA Rules not processed for user `07e95fd59c8b492599787f697ab7ac50`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:39.416736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:39.459373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:39.763411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f27784d32ce4b8c84b06684eb98f5bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:39.768263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f27784d32ce4b8c84b06684eb98f5bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:39.863570 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2761/5540] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 04 20:55:39.871495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:39.891350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f27784d32ce4b8c84b06684eb98f5bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:39.899726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d2fe7-b513-4c06-8fd6-9eb4c1fc7f16 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:39.910630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e95fd59c8b492599787f697ab7ac50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fee0803dedef4618ac76d0aa5d113848', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1388233816'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:39.912144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:39.912737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:39.913380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] PATH_INFO: `/v3/users/07e95fd59c8b492599787f697ab7ac50/application_credentials/b38b6b616cf04664aee6c550aec88740` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:39.916286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: Authorizing `identity:delete_application_credential(user_id=07e95fd59c8b492599787f697ab7ac50, application_credential_id=b38b6b616cf04664aee6c550aec88740)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:39.919809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6493c-fded-404d-92a4-efa1da291ee8 tempest-ApplicationCredentialsV3AdminTest-777306837 tempest-ApplicationCredentialsV3AdminTest-777306837-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:39.933182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f27784d32ce4b8c84b06684eb98f5bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:39.953890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3e51e12-205f-4cce-a62a-22c5392f8f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f27784d32ce4b8c84b06684eb98f5bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:39.974416 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2780/5541] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:39 2022] DELETE /identity/v3/users/4f27784d32ce4b8c84b06684eb98f5bc => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:39.977802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:39.978756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:39.979608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:40.025222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:40.027765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:40.161268 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2762/5542] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 4 20:55:39 2022] DELETE /identity/v3/users/07e95fd59c8b492599787f697ab7ac50/application_credentials/b38b6b616cf04664aee6c550aec88740 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:40.164099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:40.169084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:40.171304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:40.198884 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2781/5543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:40.203510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:40.211284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:40.221982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:40.249833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:40.252780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:40.422689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eda1d-bd5a-46c5-a421-bfcb5b750bf3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:40.440057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2763/5544] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:40.442215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:40.446179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:40.449869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef691b8ea5642be92a0124a7a021147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f11d03cefa494d6c967acc98b8077860', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:40.453145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:40.453760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:40.454407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] PATH_INFO: `/v3/roles/ace6ba66199144c8bb3b3da46005df84` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:40.458155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ace6ba66199144c8bb3b3da46005df84)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:40.463944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:40.493852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e68e4-cefd-4d4f-ab56-aecdc85423bd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:40.509645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:40.510948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:40.511607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:40.512210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] PATH_INFO: `/v3/users/25bfa357542b4c349054ce25bf3a91f4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:40.514767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bfa357542b4c349054ce25bf3a91f4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:40.518503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:40.888869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Invalidating the token cache because role ace6ba66199144c8bb3b3da46005df84 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:40.889617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:40.891033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:40.902494 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2782/5545] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:40 2022] DELETE /identity/v3/roles/ace6ba66199144c8bb3b3da46005df84 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:40.904251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:40.906940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:40.924849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bfa357542b4c349054ce25bf3a91f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:40.933909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:41.028122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bfa357542b4c349054ce25bf3a91f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:41.051107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bfa357542b4c349054ce25bf3a91f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:41.079658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca939e-881d-49c3-81e6-a3d62ed9782a tempest-ApplicationCredentialsV3AdminTest-561802283 tempest-ApplicationCredentialsV3AdminTest-561802283-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:41.092793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:41.094376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:41.095293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:41.096722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:41.101113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:41.124570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bfa357542b4c349054ce25bf3a91f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:41.126608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bfa357542b4c349054ce25bf3a91f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:41.170202 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2764/5546] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:40 2022] DELETE /identity/v3/users/25bfa357542b4c349054ce25bf3a91f4 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:41.173685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:41.179450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:41.348435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:41.351687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:41.384986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2783/5547] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:41.386837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:41.397353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:41.398365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fc497-c50d-4f13-92d9-99fb3a51754a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:41.413938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:41.415183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:41.415602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:41.416279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] PATH_INFO: `/v3/users/49e15ecb7d8e4dad9d20620ac755ef7a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:41.428121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e15ecb7d8e4dad9d20620ac755ef7a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:41.433122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:41.613789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feea7-d09f-47e0-aaf3-cd4d215accf5 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:41.765807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:41.767240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:41.768063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:41.768640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:41.773340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:41.956683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:41.960625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:41.980423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2784/5548] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:41.989423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:41.989423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:42.030242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8da1-9909-4c00-8473-5aa9622fc79f service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:42.042150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:42.043390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:42.043973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:42.044431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] PATH_INFO: `/v3/users/07e95fd59c8b492599787f697ab7ac50` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:42.047167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e95fd59c8b492599787f697ab7ac50)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:42.052375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:42.164187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e15ecb7d8e4dad9d20620ac755ef7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.280046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e15ecb7d8e4dad9d20620ac755ef7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.287816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:42.305267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e15ecb7d8e4dad9d20620ac755ef7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.334157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e15ecb7d8e4dad9d20620ac755ef7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.336067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82d9d3de-bb37-4858-983a-3ac25298a28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e15ecb7d8e4dad9d20620ac755ef7a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.350317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2765/5549] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:41 2022] DELETE /identity/v3/users/49e15ecb7d8e4dad9d20620ac755ef7a => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:42.353683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133460-97a6-49fe-a78b-e92260caeb39 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:42.354617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133460-97a6-49fe-a78b-e92260caeb39 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:42.355417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133460-97a6-49fe-a78b-e92260caeb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:42.416917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-80133460-97a6-49fe-a78b-e92260caeb39 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:42.426058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-80133460-97a6-49fe-a78b-e92260caeb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:42.492326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e95fd59c8b492599787f697ab7ac50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.496001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e95fd59c8b492599787f697ab7ac50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.620120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:42.629877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e95fd59c8b492599787f697ab7ac50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.691367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e95fd59c8b492599787f697ab7ac50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.741187 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2766/5550] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:42.744343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:42.745503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:42.746258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:42.746478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e95fd59c8b492599787f697ab7ac50'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:42.777999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2785/5551] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:41 2022] DELETE /identity/v3/users/07e95fd59c8b492599787f697ab7ac50 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:42.784469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:42.792159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:42.794703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:42.798018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.013405 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2767/5552] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:43.015608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:43.018165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.063492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf38a-f58a-483e-a6ec-def93772592a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:43.078798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:43.080470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.081310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.082098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] PATH_INFO: `/v3/projects/c7334c8cfafb46b9a97b90e9fc802910` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.086635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7334c8cfafb46b9a97b90e9fc802910)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:43.092394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:43.229945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7011-0415-48c5-bd44-a26c36912d43 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:43.240900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:43.247216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.247216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.247216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.248016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.281221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:43.287327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c21e-9868-453a-8fb1-0fe3de1d00bf service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:43.332945 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2768/5553] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:43.340663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.341368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.343125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.348562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7334c8cfafb46b9a97b90e9fc802910', 'request_id': 'req-6cd144ad-1c5a-4380-988d-3cec26a4ceef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:43.442403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:43.445401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.475158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7334c8cfafb46b9a97b90e9fc802910', 'request_id': 'req-6cd144ad-1c5a-4380-988d-3cec26a4ceef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:43.503739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7334c8cfafb46b9a97b90e9fc802910', 'request_id': 'req-6cd144ad-1c5a-4380-988d-3cec26a4ceef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:43.522774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:43.558146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] The token cache is being invalidate because project c7334c8cfafb46b9a97b90e9fc802910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:43.560387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:43.564225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:43.572058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2786/5554] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:42 2022] DELETE /identity/v3/projects/c7334c8cfafb46b9a97b90e9fc802910 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:43.577367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:43.584859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.641883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2769/5555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:43.646526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:43.649308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.818950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd144ad-1c5a-4380-988d-3cec26a4ceef admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:43.828698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:43.830413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.831005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.831755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.835612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.837109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53571-269b-4f36-8083-ea21f4c5b064 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:43.845703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:43.847502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.848422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.849166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.854524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.866969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:43.870149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02c10b-417c-4e9e-848d-bd9692c085a7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:43.892423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2787/5556] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:43.896172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.896826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.897915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:43.941251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:43.944550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:43.964275 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2788/5557] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:43.964867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:43.986157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820713b-48c0-43b2-9113-2a0261c6747c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:43.995612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:43.996979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:43.997827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:43.998475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:44.019300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:44.023549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79a0dd-e459-4092-91f3-8f5490bfea81 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:44.037255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:44.043771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:44.087864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2789/5558] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:44.106311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2770/5559] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:44.141687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:44.142463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:44.143339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:44.172887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:44.221882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:44.227272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:44.253846 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2790/5560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:44.256619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:44.283577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f641c9-0392-4359-8823-5f471b26e948 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:44.312667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:44.315164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:44.316962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:44.317750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:44.319811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:44.327966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:44.333736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64f5c-9480-4a2a-a404-4a7f71ade225 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:44.366666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2771/5561] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:55:44.373686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:44.414066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86113c8-bf80-4566-8713-3be21b4001e9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:44.428154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:44.428891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:44.434595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:44.436617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:44.438080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:44.438588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:44.439072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:44.440372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:44.448873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:44.521514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:44.534985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:44.736259 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2791/5562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:44 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:55:44.746278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:44.935979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2772/5563] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:44.939325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:44.946222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:45.032043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:45.113952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813317-1e69-4397-a473-1664274cd08d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:45.140629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:45.141901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:45.142442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:45.143360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:45.144609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:45.156364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:45.220780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feba50-2124-433c-8d2f-97451f73d5ea None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:45.258426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:45.377084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2792/5564] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:44 2022] POST /identity/v3/users => generated 292 bytes in 628 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:45.380397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:45.385982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:45.398159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:45.398159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:45.398159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:45.398159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:45.452228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a502ff-e4d1-4f31-9c18-54377e9ac35d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:45.477476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:45.480819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:45.481297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:45.482070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] PATH_INFO: `/v3/projects/739bc9c01f9c42febc9ee45be220cfa2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:45.487945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=739bc9c01f9c42febc9ee45be220cfa2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:45.502617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:45.623956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:45.629002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:45.652842 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2773/5565] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 20:55:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:45.654461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:45.739699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fc48d-dbc5-4429-a611-435f15026228 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:45.770784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:45.771965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:45.772523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:45.772949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:45.774192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:45.778658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:45.853649 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2774/5566] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:45.853649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:45.881488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739bc9c01f9c42febc9ee45be220cfa2', 'request_id': 'req-52e4e312-fba6-4733-b975-4fad3f7ae5bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:45.889193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a6ce-8e0c-447e-8def-e8cc5ca1a82d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:46.071431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:46.072367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.072844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.073705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.075651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739bc9c01f9c42febc9ee45be220cfa2', 'request_id': 'req-52e4e312-fba6-4733-b975-4fad3f7ae5bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.077843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:46.079989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:46.096858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739bc9c01f9c42febc9ee45be220cfa2', 'request_id': 'req-52e4e312-fba6-4733-b975-4fad3f7ae5bb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.230574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2775/5567] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:46.232444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:46.241962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] The token cache is being invalidate because project 739bc9c01f9c42febc9ee45be220cfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:46.244489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.246874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:46.251114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.262544 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2793/5568] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:45 2022] DELETE /identity/v3/projects/739bc9c01f9c42febc9ee45be220cfa2 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:46.264408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:46.273759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:46.333262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73d3-be75-4601-8a3a-36e608b50246 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:46.349328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e312-fba6-4733-b975-4fad3f7ae5bb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:46.360134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:46.364666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.365174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.365661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] PATH_INFO: `/v3/projects/fee0803dedef4618ac76d0aa5d113848` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.371923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee0803dedef4618ac76d0aa5d113848)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:46.380705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:46.383393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.384061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.384543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] PATH_INFO: `/v3/projects/825a530099354fcb9edeb215922b4719/users/3330bd060e534e1bb602b3b3f2ba31f1/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.387323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:46.480764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825a530099354fcb9edeb215922b4719, user_id=3330bd060e534e1bb602b3b3f2ba31f1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:46.492726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb8b61-fd71-425e-b927-89ab50a16b03 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:46.671592 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2794/5569] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:46 2022] PUT /identity/v3/projects/825a530099354fcb9edeb215922b4719/users/3330bd060e534e1bb602b3b3f2ba31f1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:46.691532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e239-d41d-41d2-86ca-3cb772b269d0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.695322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e239-d41d-41d2-86ca-3cb772b269d0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.697307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e239-d41d-41d2-86ca-3cb772b269d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.706471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:46.727314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee0803dedef4618ac76d0aa5d113848', 'request_id': 'req-c2849bde-bccd-4ecf-8ec3-a679f779f737'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.738046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6cd9e239-d41d-41d2-86ca-3cb772b269d0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:46.741089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6cd9e239-d41d-41d2-86ca-3cb772b269d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:46.745250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee0803dedef4618ac76d0aa5d113848', 'request_id': 'req-c2849bde-bccd-4ecf-8ec3-a679f779f737'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.761696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee0803dedef4618ac76d0aa5d113848', 'request_id': 'req-c2849bde-bccd-4ecf-8ec3-a679f779f737'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.785972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:46.874935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2795/5570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:46.877334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] The token cache is being invalidate because project fee0803dedef4618ac76d0aa5d113848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:46.878175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541ee43-a81c-4fe2-a90d-97b35d1ccaf7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.878593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.879334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541ee43-a81c-4fe2-a90d-97b35d1ccaf7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.880147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541ee43-a81c-4fe2-a90d-97b35d1ccaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.880458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:46.889620 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2776/5571] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:46 2022] DELETE /identity/v3/projects/fee0803dedef4618ac76d0aa5d113848 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:46.889620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:46.891357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:46.931513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849bde-bccd-4ecf-8ec3-a679f779f737 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:46.950169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c541ee43-a81c-4fe2-a90d-97b35d1ccaf7 None None] MFA Rules not processed for user `3330bd060e534e1bb602b3b3f2ba31f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:46.954511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:46.955880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c541ee43-a81c-4fe2-a90d-97b35d1ccaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:46.956191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:46.957467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:46.958523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] PATH_INFO: `/v3/users/a0400f00d59f4ca8be4de616e5aeeb83` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:46.962023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0400f00d59f4ca8be4de616e5aeeb83)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:46.968636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:47.098669 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2796/5572] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:47.110360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:47.110874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:47.111468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:47.158952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:47.162001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:47.178048 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2797/5573] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:47.181556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:47.186660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:47.208034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac9b8-adb7-4667-920f-1483dc57cb7b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:47.215553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:47.216566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:47.217566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:47.218021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] PATH_INFO: `/v3/users/aef691b8ea5642be92a0124a7a021147` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:47.219604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef691b8ea5642be92a0124a7a021147)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:47.222847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:47.276058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0400f00d59f4ca8be4de616e5aeeb83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.401172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0400f00d59f4ca8be4de616e5aeeb83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.433560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0400f00d59f4ca8be4de616e5aeeb83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.456625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0400f00d59f4ca8be4de616e5aeeb83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.457606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0400f00d59f4ca8be4de616e5aeeb83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.466946 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2777/5574] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:46 2022] DELETE /identity/v3/users/a0400f00d59f4ca8be4de616e5aeeb83 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:47.468371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:47.470567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:47.578568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef691b8ea5642be92a0124a7a021147'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.580682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef691b8ea5642be92a0124a7a021147'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.592867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c516-c9d2-4dfa-a358-d5ce78fbf7c5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:47.611464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:47.614952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:47.614952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:47.614952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:47.618245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:47.756685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:47.762934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:47.765840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef691b8ea5642be92a0124a7a021147'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.766618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:47.783500 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2778/5575] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:47.784837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:47.788563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:47.800329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef691b8ea5642be92a0124a7a021147'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.827212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef691b8ea5642be92a0124a7a021147'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:47.846797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2798/5576] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:47 2022] DELETE /identity/v3/users/aef691b8ea5642be92a0124a7a021147 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:47.846797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:47.852810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:48.030182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10289-77c1-4ca1-9355-29ab04537cc7 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:48.178280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de842a6-0411-4aa7-978e-54d0e3de1ccb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:48.190813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:48.193302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:48.193934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:48.194646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] PATH_INFO: `/v3/projects/223d432ff6a643f39235b9d5774265c1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:48.197745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223d432ff6a643f39235b9d5774265c1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:48.205669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:48.311533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:48.312766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:48.313253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:48.313831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:48.315012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:48.321024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:48.324369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a921d-e55f-4a6d-8901-796573f32aed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:48.358070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:48.368279 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2779/5577] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:48.378287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:48.378745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:48.379508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:48.536270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:48.542590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:48.549801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223d432ff6a643f39235b9d5774265c1', 'request_id': 'req-6479e14e-48b5-4cce-b381-81a0f815a606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:48.773991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223d432ff6a643f39235b9d5774265c1', 'request_id': 'req-6479e14e-48b5-4cce-b381-81a0f815a606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:48.801079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223d432ff6a643f39235b9d5774265c1', 'request_id': 'req-6479e14e-48b5-4cce-b381-81a0f815a606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:48.803853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2780/5578] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:48.806263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:48.812663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:48.841242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] The token cache is being invalidate because project 223d432ff6a643f39235b9d5774265c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:48.841554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:48.843030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:48.846741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2799/5579] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:47 2022] DELETE /identity/v3/projects/223d432ff6a643f39235b9d5774265c1 => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:48.848255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:48.852216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:48.858050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ff83-c169-474e-a8de-db47c5c0f82a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:48.869738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:48.871103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:48.872567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:48.873155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] PATH_INFO: `/v3/users/6c0b7846c79c4555beeb5a9f4e22d8f6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:48.877990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0b7846c79c4555beeb5a9f4e22d8f6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:48.885615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:48.891281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479e14e-48b5-4cce-b381-81a0f815a606 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:48.906295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:48.910000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:48.911905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:48.914404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:48.916860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:48.927173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:49.166703 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2800/5580] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:48 2022] POST /identity/v3/projects => generated 383 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:49.168130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:49.173402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:49.315290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:49.374184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0b7846c79c4555beeb5a9f4e22d8f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.480558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0b7846c79c4555beeb5a9f4e22d8f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.487232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244b9f8-489c-40cd-9d6a-bfaa2f3a9f88 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:49.499985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:49.502753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:49.503410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:49.504206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] PATH_INFO: `/v3/users/3330bd060e534e1bb602b3b3f2ba31f1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:49.505445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0b7846c79c4555beeb5a9f4e22d8f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.508943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3330bd060e534e1bb602b3b3f2ba31f1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:49.513360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:49.557856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0b7846c79c4555beeb5a9f4e22d8f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.559309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0b7846c79c4555beeb5a9f4e22d8f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.590943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2781/5581] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:48 2022] DELETE /identity/v3/users/6c0b7846c79c4555beeb5a9f4e22d8f6 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:49.593605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:49.607834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:49.735704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:49.839279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708fc9-5d0c-48e2-be94-0610a51c0c09 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:49.847098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:49.848411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:49.848923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:49.849411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:49.853553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:49.889267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3330bd060e534e1bb602b3b3f2ba31f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:49.891408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3330bd060e534e1bb602b3b3f2ba31f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.014016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:50.017598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df3b39-31ee-48ae-9074-2ee741beb02a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:50.026813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3330bd060e534e1bb602b3b3f2ba31f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.057041 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2782/5582] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:50.057041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.057041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.057041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.092628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3330bd060e534e1bb602b3b3f2ba31f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.118090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bb34a265-60bf-478a-a7c0-fd4db5097866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3330bd060e534e1bb602b3b3f2ba31f1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.119489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:50.122501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.144188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2783/5583] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:50.146102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:50.154128 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2801/5584] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:49 2022] DELETE /identity/v3/users/3330bd060e534e1bb602b3b3f2ba31f1 => generated 0 bytes in 987 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:50.156457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.156983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.157592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.158138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.185909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d40ba2-a9fe-4f7e-a440-34d3b8255ebd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:50.224629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:50.231673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.337121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:50.375645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:50.376834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.378975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.380326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.381239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:50.386757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7629-3f58-4c1b-9644-ad414f55e119 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:50.457987 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2802/5585] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:50.457987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:50.458980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.487006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218ae1-b17d-46f2-af2a-5c9af48260c5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:50.500330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:50.503503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.508111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.508111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] PATH_INFO: `/v3/projects/f11d03cefa494d6c967acc98b8077860` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.508680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11d03cefa494d6c967acc98b8077860)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:50.514013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:50.514860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2784/5586] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:50 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:50.523469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29d26-8701-4239-9eee-00c33b7d1f6f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.524156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29d26-8701-4239-9eee-00c33b7d1f6f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.524670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29d26-8701-4239-9eee-00c33b7d1f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.636211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a6e29d26-8701-4239-9eee-00c33b7d1f6f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:50.638606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6e29d26-8701-4239-9eee-00c33b7d1f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.678808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2785/5587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:50.682511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:50.682511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:50.683524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:50.732483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:50.769520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:50.815483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11d03cefa494d6c967acc98b8077860', 'request_id': 'req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.988967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11d03cefa494d6c967acc98b8077860', 'request_id': 'req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:50.998563 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2786/5588] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:51.000787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.010879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.015517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11d03cefa494d6c967acc98b8077860', 'request_id': 'req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:51.073025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] The token cache is being invalidate because project f11d03cefa494d6c967acc98b8077860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:51.073624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:51.077586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:51.081101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2803/5589] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:50 2022] DELETE /identity/v3/projects/f11d03cefa494d6c967acc98b8077860 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:51.089363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.096310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.170754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f09d-b1cb-44a2-bd22-7ec24451759b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.212171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.221967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.224347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.228366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.244602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.257756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.284320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c49d1-9dd6-4dee-8c1f-e10123b9b365 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.308540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2804/5590] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:51.310101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.323771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.325642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.327837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.331692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.332234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.343385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.366511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:51.387552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.393067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.412478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144dac-44db-4d03-84a1-291d5d7cfb01 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.412478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.412478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.412478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.413300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.417983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.432612 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2787/5591] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:51.439673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.444810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.446272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.449546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa32f0-7e49-4ca5-9adf-2493d2a522d2 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.483527 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2805/5592] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:51.486225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.487737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055722fc-55b0-486a-aee0-33ec8c7b4c13 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.493825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.494938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.501329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.503269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.503765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.504255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.505621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:51.507331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.512657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.555096 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2788/5593] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:51.557633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.563120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.578702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:51.585818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:51.615243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2806/5594] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:51.617395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.618579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85389ab0-2b5c-4e03-8de9-b4102584d660 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.647817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.648997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.650094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.653873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] PATH_INFO: `/v3/projects/1a7b7232575d487e948be03702bd49a7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.655895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2c68b-0bd6-48a7-b745-ab849cf9f612 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.660224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7b7232575d487e948be03702bd49a7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.666412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.698347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.706887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.710859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.711614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.713343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.719735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.772706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2807/5595] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:51.774504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:51.816869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab953-1bb9-45b3-8214-ffeb6b6252e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:51.828515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:51.829959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:51.830632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:51.831448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:51.833596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:51.837980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087290e6-c2d7-4466-97b9-564a034ed44c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:51.964821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7b7232575d487e948be03702bd49a7', 'request_id': 'req-b8a1469e-1065-4fd7-85bb-338da5b24fc6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:51.991718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7b7232575d487e948be03702bd49a7', 'request_id': 'req-b8a1469e-1065-4fd7-85bb-338da5b24fc6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:52.002471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:52.008820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7b7232575d487e948be03702bd49a7', 'request_id': 'req-b8a1469e-1065-4fd7-85bb-338da5b24fc6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:52.028864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2808/5596] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:51 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:52.033263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.034118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.034635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.089019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:52.092955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:52.146414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] The token cache is being invalidate because project 1a7b7232575d487e948be03702bd49a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:52.151490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:52.151490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:52.155554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2789/5597] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:51 2022] DELETE /identity/v3/projects/1a7b7232575d487e948be03702bd49a7 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:52.165111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:52.172252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:52.301763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2809/5598] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:52.303579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:52.307682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:52.343001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534329e-60f9-4c1a-999c-916f1fc975c8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:52.358981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:52.360366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.362138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.362667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.375096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:52.375096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:52.461334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1469e-1065-4fd7-85bb-338da5b24fc6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:52.470923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:52.472255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.472768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.473268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] PATH_INFO: `/v3/projects/c9762bc564f54ad7b64c5cf50ec1801d/users/18731d28383849e2a96d2fb6df256119/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.510071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9762bc564f54ad7b64c5cf50ec1801d, user_id=18731d28383849e2a96d2fb6df256119, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:52.517219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:52.621458 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2810/5599] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:52 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:52.621458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:52.627021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:52.679227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118415-7f85-4b72-8b4b-4c8001c6418e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:52.717618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2790/5600] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:52 2022] PUT /identity/v3/projects/c9762bc564f54ad7b64c5cf50ec1801d/users/18731d28383849e2a96d2fb6df256119/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:52.717618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:52.872212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:52.873421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.873959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.874460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] PATH_INFO: `/v3/users/1f8c8177528a44b084ff65082bc9d919` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.877146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8c8177528a44b084ff65082bc9d919)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:52.882123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:52.899447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149ffb5-30a5-459b-985b-0cea73d6b30d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:52.909407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:52.911224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.912018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.912911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.914166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:52.914709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:52.918672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:52.947385 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2791/5601] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:52.949660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:52.955808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:52.981914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4bf7-f321-4f86-b35d-5fea2514e5f4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:52.993276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:52.994803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:52.995360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:52.995926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] PATH_INFO: `/v3/projects/436cef25c16049babc37ca979ca1fd26` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:52.998567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=436cef25c16049babc37ca979ca1fd26)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:53.002700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:53.314431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:53.340246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8c8177528a44b084ff65082bc9d919'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.342001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8c8177528a44b084ff65082bc9d919'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.358202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436cef25c16049babc37ca979ca1fd26', 'request_id': 'req-ca9b46d0-a0f1-491c-9392-4f602feff24b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.373951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436cef25c16049babc37ca979ca1fd26', 'request_id': 'req-ca9b46d0-a0f1-491c-9392-4f602feff24b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.386689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436cef25c16049babc37ca979ca1fd26', 'request_id': 'req-ca9b46d0-a0f1-491c-9392-4f602feff24b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.486462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8c8177528a44b084ff65082bc9d919'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.524683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8c8177528a44b084ff65082bc9d919'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.549749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8c8177528a44b084ff65082bc9d919'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.564864 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2811/5602] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:52 2022] DELETE /identity/v3/users/1f8c8177528a44b084ff65082bc9d919 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:53.566406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:53.584166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] The token cache is being invalidate because project 436cef25c16049babc37ca979ca1fd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:53.585866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.586185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:53.587605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca9b46d0-a0f1-491c-9392-4f602feff24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:53.612336 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2792/5603] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:52 2022] DELETE /identity/v3/projects/436cef25c16049babc37ca979ca1fd26 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:53.616698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:53.617420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:53.618458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:53.696352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] MFA Rules not processed for user `18731d28383849e2a96d2fb6df256119`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:53.699055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:53.860152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729679-310b-4668-affc-6cdc0cb8ec23 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:53.873762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:53.875274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:53.875799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:53.876302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:53.878834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:53.888943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:53.919939 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2812/5604] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:53.922088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:53.926896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:53.941640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2793/5605] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:53.943413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:53.946831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:53.977221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bc0d0-eaba-40b7-9969-a508c31f05ba None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:53.986523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:53.987734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:53.988491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:53.988968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] PATH_INFO: `/v3/users/790598df1c304f4e9984449ad8b26c95` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:53.991860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790598df1c304f4e9984449ad8b26c95)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:53.995910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:54.007468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c372-49ac-435b-8fdb-1cb73dc08f5f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:54.030764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:54.032051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:54.032550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:54.033132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:54.034314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:54.047392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:54.229824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2813/5606] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:53 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:54.231725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:54.235351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:54.333624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:54.352373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790598df1c304f4e9984449ad8b26c95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.403468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3958e-cb37-44e9-b3ba-b582e0bf5cbb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:54.415184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:54.419919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:54.419919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:54.419919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] PATH_INFO: `/v3/projects/825a530099354fcb9edeb215922b4719` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:54.420591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825a530099354fcb9edeb215922b4719)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:54.424199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:54.494807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790598df1c304f4e9984449ad8b26c95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.515625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790598df1c304f4e9984449ad8b26c95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.554573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790598df1c304f4e9984449ad8b26c95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.555954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2225418e-3827-423a-94b3-dc2f25e988a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790598df1c304f4e9984449ad8b26c95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.571013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2794/5607] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:55:53 2022] DELETE /identity/v3/users/790598df1c304f4e9984449ad8b26c95 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:54.576828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:54.576828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:54.576828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:54.612441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:54.621867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:54.708679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825a530099354fcb9edeb215922b4719', 'request_id': 'req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.842423 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2795/5608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:54.842423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:54.846833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:54.874825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0b4e-c6ea-4228-b4b9-fcc41d3c6b77 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:54.879770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825a530099354fcb9edeb215922b4719', 'request_id': 'req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.904726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825a530099354fcb9edeb215922b4719', 'request_id': 'req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.954029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] The token cache is being invalidate because project 825a530099354fcb9edeb215922b4719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:54.954708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.956629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:54.963198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2814/5609] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:54 2022] DELETE /identity/v3/projects/825a530099354fcb9edeb215922b4719 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:54.963198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:54.966929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.054610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:55.055976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.056428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.056907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.058294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:55.061537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:55.083517 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2796/5610] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:55.085290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:55.088367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.109574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba65-c356-43f2-a8b1-c37c8976c5ce admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:55.120044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:55.121188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.121710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.122259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.123672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:55.127629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:55.133598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3d0dc-6e76-415d-8ba1-223cb10fb611 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:55.143806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:55.145315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.149709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.149709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.149709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:55.152245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00b4ee-7d70-4e64-bf9c-a861bc40db9c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:55.310091 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2797/5611] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:55 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:55.313042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:55.317758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.365089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2815/5612] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:54 2022] POST /identity/v3/projects => generated 385 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:55.368737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9098d-edd1-414a-a7a1-f8cb480ac02e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.369564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9098d-edd1-414a-a7a1-f8cb480ac02e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.371381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9098d-edd1-414a-a7a1-f8cb480ac02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.385975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5bc8-1254-4e02-ba6d-8bcf300f24d6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:55.419714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7aa9098d-edd1-414a-a7a1-f8cb480ac02e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:55.421740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7aa9098d-edd1-414a-a7a1-f8cb480ac02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.609970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2816/5613] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:55.612514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.613026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.613840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.647577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:55.648680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.649912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.650392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] PATH_INFO: `/v3/projects/121fb8b31400423dad7c1422106a7470` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.650906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:55.652642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121fb8b31400423dad7c1422106a7470)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:55.653066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.657700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:55.670419 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2817/5614] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:55.672066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:55.674610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:55.701623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4c356-fe5b-4cb0-8abb-3ed5a9b03cc3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:55.711466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:55.712651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:55.713123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:55.713608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] PATH_INFO: `/v3/projects/b8778b8dbc3e4e43b57b33f6114daabe/users/309b57b5974a4688967a27539a423625/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:55.750611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8778b8dbc3e4e43b57b33f6114daabe, user_id=309b57b5974a4688967a27539a423625, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:55.757096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:56.004503 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2818/5615] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:55 2022] PUT /identity/v3/projects/b8778b8dbc3e4e43b57b33f6114daabe/users/309b57b5974a4688967a27539a423625/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:56.006666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:56.018123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:56.041223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121fb8b31400423dad7c1422106a7470', 'request_id': 'req-38fbba1d-c71e-4d55-885f-15c1aebf2758'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.063194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121fb8b31400423dad7c1422106a7470', 'request_id': 'req-38fbba1d-c71e-4d55-885f-15c1aebf2758'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.107175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121fb8b31400423dad7c1422106a7470', 'request_id': 'req-38fbba1d-c71e-4d55-885f-15c1aebf2758'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.167895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:56.235655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950514a-0af7-48e3-b80a-8c5d7fe3bf77 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:56.246615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] The token cache is being invalidate because project 121fb8b31400423dad7c1422106a7470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:56.247113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.248331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.251690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2798/5616] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:55 2022] DELETE /identity/v3/projects/121fb8b31400423dad7c1422106a7470 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:56.252607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:56.255034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:56.391685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:56.393644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:56.394143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:56.394723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] PATH_INFO: `/v3/projects/a7aee6375ab0440d970befc057955940` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:56.398298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7aee6375ab0440d970befc057955940)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:56.403954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:56.481712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbba1d-c71e-4d55-885f-15c1aebf2758 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:56.501201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:56.502163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:56.502597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:56.503023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:56.504355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:56.507227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:56.529904 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2799/5617] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:56.531238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:56.533601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:56.555211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cc0f-be72-497f-a62c-7dbec546563e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:56.563946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:56.568491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:56.568491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:56.568491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:56.568491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:56.570731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:56.666504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7aee6375ab0440d970befc057955940', 'request_id': 'req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.739216 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2800/5618] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:56 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:56.741281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:56.744279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:56.768650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744c24-1027-4ddf-ab70-94fc0550efcd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:56.846647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7aee6375ab0440d970befc057955940', 'request_id': 'req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.872140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7aee6375ab0440d970befc057955940', 'request_id': 'req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.901669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] The token cache is being invalidate because project a7aee6375ab0440d970befc057955940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:55:56.905242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.907059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a72eccda-c350-4bb2-bc08-6a261c8cbe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:55:56.911472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2819/5619] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:56 2022] DELETE /identity/v3/projects/a7aee6375ab0440d970befc057955940 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:56.914223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373d36-69b9-41ee-91cd-8376fa1b2eb2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:56.915055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373d36-69b9-41ee-91cd-8376fa1b2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:56.915838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373d36-69b9-41ee-91cd-8376fa1b2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:56.962110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ff373d36-69b9-41ee-91cd-8376fa1b2eb2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:56.966036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff373d36-69b9-41ee-91cd-8376fa1b2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:56.987596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:56.989188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:56.989718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:56.990227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:56.992253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:56.992880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:56.996338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a04c05-ea48-4fb9-8d71-b1fd9b753ec0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.046386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:57.047843 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2801/5620] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:57.056819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.057613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.058078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.127085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] MFA Rules not processed for user `309b57b5974a4688967a27539a423625`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:57.129435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.136849 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2820/5621] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:57.139274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.139780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.140281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.206684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:57.208470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.231458 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2821/5622] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:57.246148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.255694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.291384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae18ea-73f1-40ea-b85c-64a19aa7c7d6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.304148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.305287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.305732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.306231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.307562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:57.317316 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2802/5623] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:57.317660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0bb52-8855-4fa7-a19c-5f744fab0ea1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.317837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.329888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.343723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2822/5624] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:57.346186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.346698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.347220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.382568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0234c9-a40d-4572-9235-a9db81e842e6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.393830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:57.404438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.419848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.421534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.421798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.423003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2823/5625] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:57.424775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.427702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.437863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.439423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:57.442483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.474191 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2803/5626] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:57.475841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.480029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767532-02ce-4ffa-8bbe-90d2f9e874fc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.494572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.495920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.496519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.497102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.498307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e862-5ecb-4b42-9c0d-cb727a7e0609 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.499200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:57.503961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.510330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.511593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.512088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.512774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.514474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:57.515473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:57.521714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e46e1-3b3d-4368-a682-52905600ff1e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.559588 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2804/5627] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:57.569512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.570008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.570521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.576673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:57.639544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:57.642068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.672279 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2824/5628] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:57 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:57.673077 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2805/5629] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:57.674483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.684159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:57.686787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:57.860988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce692a6-cea6-4aea-a2e9-a7108988530f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.901223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb235a1-77ff-40e5-8929-c2b9258f64ff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:57.910825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.912225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.913379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.913987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] PATH_INFO: `/v3/projects/348cafd6176d42e783d7b9613ba30dd7/users/b775c62079bc4a19b8624a7ec623d636/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:57.936340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:57.947786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348cafd6176d42e783d7b9613ba30dd7, user_id=b775c62079bc4a19b8624a7ec623d636, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:57.950850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cd1ae-94fe-4fe6-ac72-0461c91bacc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:57.993856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:57.995091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:57.995618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:57.996115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.066223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2825/5630] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:57 2022] PUT /identity/v3/projects/348cafd6176d42e783d7b9613ba30dd7/users/b775c62079bc4a19b8624a7ec623d636/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:58.068137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.068646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.069149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.121590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:58.124090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:58.132547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.135739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.154725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2806/5631] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:58.156189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.176297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4586f-c812-4047-bf8f-a0291ea81b4d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.278063 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2826/5632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:58.278063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.280199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:58.283873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.284647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.284972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.285295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.286045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.288952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.301090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2753d-84f9-490e-b3ce-688947fb644d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.303778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2807/5633] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:58.305573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.316050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.317260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.317699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.318258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.319584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.322486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d43f0-7357-4596-ba66-c272f9789212 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.325348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1f1e-d320-4de9-9168-4ebb83fd5b35 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.335407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.336550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.337106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.337656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.338862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.343813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.515955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2808/5634] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:58 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:58.515955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.517818 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2827/5635] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:58 2022] POST /identity/v3/projects => generated 369 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:58.520858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.521819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.523097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.553439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6ba0-d2a2-451b-b805-d52b86e9a65a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.586158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] MFA Rules not processed for user `0da48b8d726f40ddadd9f51c65ba8fde`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:58.588915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:58.594970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:58.719601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.721021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.721944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.722765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.725691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:58.726816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.730845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6ed9-68ae-4b78-9699-6fd985d16602 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.780967 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2809/5636] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:58.781267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2828/5637] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:58.783294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.784992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.785705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.786399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.825565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586bfd-40ee-4bdd-8180-626e6703a00d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.836241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.837707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.838418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.839612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.841287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:55:58.845597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.845597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.877424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2829/5638] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:55:58.878103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] MFA Rules not processed for user `b775c62079bc4a19b8624a7ec623d636`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:58.879392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:58.883002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:58.906429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b296-5977-4be9-a801-dd77ebdabb7c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:58.920965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:58.922637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:58.924271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:58.930348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] PATH_INFO: `/v3/projects/07fe50e17c004c95b980473d22e4b2a2/users/3a8cd29b5d324ba2afba869ed5a1d237/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:58.966529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fe50e17c004c95b980473d22e4b2a2, user_id=3a8cd29b5d324ba2afba869ed5a1d237, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:58.972942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:58.995939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:59.097222 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2810/5639] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:55:59.099412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:59.126267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bdfbd-fb51-4a11-a3e4-f6e0a97dd769 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:59.136690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2830/5640] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:55:58 2022] PUT /identity/v3/projects/07fe50e17c004c95b980473d22e4b2a2/users/3a8cd29b5d324ba2afba869ed5a1d237/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:55:59.149437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:59.257888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:59.281700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:59.285772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:59.285772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:59.285772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:59.285772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:59.289499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:59.311817 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2811/5641] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:55:59.313566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:59.335252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f173f-f16b-4574-97e3-b8205e0929e2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:59.343080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976dd81-112a-44ba-92ac-4ca518cb3a31 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:59.344660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:59.345935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:59.353067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:59.353067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:59.353067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:59.354468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:59.364889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:59.367935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:59.369315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:59.370065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:59.372190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:59.388436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1fc7-18a8-4ea1-a49a-312cab37f0c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:59.687332 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2831/5642] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:55:59 2022] POST /identity/v3/users => generated 285 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:59.696855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:59.707664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:59.708263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:59.708687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:59.725517 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2812/5643] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:59 2022] POST /identity/v3/projects => generated 369 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:55:59.725517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:55:59.790779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] MFA Rules not processed for user `0da48b8d726f40ddadd9f51c65ba8fde`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:55:59.798363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:55:59.883012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed49784-5b30-4997-b719-89d63e5b1484 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:55:59.890391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:55:59.893254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:55:59.894392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:55:59.895369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:55:59.898496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:55:59.903918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01791e-ebca-4ed0-9d67-9b8fb6809c17 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:55:59.950287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:59.995606 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2832/5644] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:00.000342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.028574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3733c-a3a3-4699-959e-dd1ef97b800a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.038632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.039728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.040429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.040943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.042187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:00.046474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:00.088912 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2813/5645] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:00.091519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.092100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.092622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.152537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] MFA Rules not processed for user `3a8cd29b5d324ba2afba869ed5a1d237`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:00.154907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:00.247919 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2833/5646] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:55:59 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:00.251857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.336853 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2814/5647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:00.338507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.469235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a916-b4e1-4d0f-bb8e-41ef22a2d60c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.481445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.481872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:00.482791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.483879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.484659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.487388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:00.490649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:00.532728 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2834/5648] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:00.535294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.560514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577314-b3db-4969-b2ac-2f8e5ee821ec admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.571720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.572895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.574789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.574789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.575915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:00.580312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:00.648559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5939-a9c2-4688-8cc4-f4747abba387 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.656693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.658007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.658523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.658990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.660565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:00.665518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:00.688164 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2815/5649] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:00.689558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.693154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:00.766659 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2835/5650] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:00 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:00.768109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:00.819860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61357-67ab-4535-b83f-4bdc4eecb522 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.850090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.850090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.850090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.850090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:00.850822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:00.853383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:00.956240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597d416-4250-4df5-9e4a-ebb52787a487 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:00.971272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:00.972231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:00.972515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:00.972893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.012023 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2836/5651] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:00 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:01.013912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.038277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882ee56-8478-4749-bab7-a26b1535c405 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.048963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.051622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.052493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.054185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.055952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.061416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.121365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.124886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.145935 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2816/5652] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:01.148082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.153731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:01.237266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2837/5653] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:01 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:01.246874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.273572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd390c-ed2a-43b2-b230-413196e3def7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.310884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.316301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.317233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.317837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] PATH_INFO: `/v3/projects/cc2d4e9869bf4d408b39c45f651a033b/users/7468140a2f7d42c6bb00af7a5a3af37c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.322762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076b6c-31e3-44f5-a3ba-1a35f7009a08 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.328410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.329606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.330338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.330784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.334171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:01.369110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2d4e9869bf4d408b39c45f651a033b, user_id=7468140a2f7d42c6bb00af7a5a3af37c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.375436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.384138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:01.484501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.493510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.519179 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2817/5654] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:01.521211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.546227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739884-47c4-4fcb-9e19-f2e9bb0354cc service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.550201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2838/5655] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:01 2022] PUT /identity/v3/projects/cc2d4e9869bf4d408b39c45f651a033b/users/7468140a2f7d42c6bb00af7a5a3af37c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:01.555454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.700856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:01.733338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.741988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.742319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4453-0a9c-4d51-9c01-6eeb691c6f55 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.742531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.742531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.742531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.742531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.750766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.752715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.753458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.754232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.755755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.760903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.814536 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2839/5656] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:01.816479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.825211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2818/5657] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:01.833105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.843743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67beb-655e-4244-9765-68e0c6dd47c3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.855549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.862694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.862694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.862694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.864162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4bb6b-3a32-45eb-a454-dba4c69e6015 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:01.864352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.864931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437b171-9df6-47ff-b7ad-a849a34f9843 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.870251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:01.871306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.871963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.873457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.876088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:01.880954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:01.897552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2840/5658] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:01.900271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:01.902895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:01.902895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:01.950126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:01.950126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:01.951327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2819/5659] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:01.952978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.970290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2841/5660] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:01.972864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:01.997778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c4262-1324-4d5a-9a41-aabb93fafc92 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.011118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd7bc-ebbd-4b4b-b101-093588ecfd18 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.024320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.026030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.026775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.027516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] PATH_INFO: `/v3/projects/6c1d2c9709a94cf691cb05145eeb8e23/users/72c5bb1c1f1e40549f50045f0b001aad/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.035167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.040415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.042181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.046794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.064523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.064523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.069432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1d2c9709a94cf691cb05145eeb8e23, user_id=72c5bb1c1f1e40549f50045f0b001aad, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.080274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.094273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2820/5661] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:02.098847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:02.140298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725dbd-f948-4768-b8fa-70e2f37e473b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.156608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.161885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.161885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.161885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.161885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.165568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.200786 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2821/5662] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:02.202516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:02.215211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2842/5663] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:01 2022] PUT /identity/v3/projects/6c1d2c9709a94cf691cb05145eeb8e23/users/72c5bb1c1f1e40549f50045f0b001aad/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:02.215211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:02.215211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:02.231548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e81ce-7ec7-4b7c-a907-1e19673d2cf3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.412817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.416135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.416582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.417028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] PATH_INFO: `/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27/users/912d6e0b09c24b47b960e2182154ba91/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.418454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225944ae-69bb-44ac-8078-3087c280b7b0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.426195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.426882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.427397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.427924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.463022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ad5b0f3dad45b5965f437bb46afe27, user_id=912d6e0b09c24b47b960e2182154ba91, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.463940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.467034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.473775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2232d6-680e-4480-8454-c8cc334fae7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.489932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2843/5664] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:02.491892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:02.514741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba9d04-ede4-4c77-83c7-92929efba6b9 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.527169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:02.529207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.529719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.531218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] PATH_INFO: `/v3/projects/d59234191f7845f8aecc023df0f76015/users/b0346e9f75904499a5d56c15272fbd4b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.565141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59234191f7845f8aecc023df0f76015, user_id=b0346e9f75904499a5d56c15272fbd4b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:02.570343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67d9f-db5e-465e-b1f3-2b525f3588c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:02.649582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2822/5665] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:02 2022] PUT /identity/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27/users/912d6e0b09c24b47b960e2182154ba91/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:02.656264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.656503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.656949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:56:02.666016 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:56:02.668237 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:56:02.708892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2823/5666] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:56:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:56:02.708892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:02.708892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:02.831411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2844/5667] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:02 2022] PUT /identity/v3/projects/d59234191f7845f8aecc023df0f76015/users/b0346e9f75904499a5d56c15272fbd4b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:02.835504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:02.836058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:02.836632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:02.907052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c2ad6-7576-434d-98a9-cc7801209349 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:02.993136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] MFA Rules not processed for user `72c5bb1c1f1e40549f50045f0b001aad`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:02.998327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:03.137020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:03.139110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:03.139110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:03.139617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] PATH_INFO: `/v3/projects/423269a2642a45b29d4f92a0995e6c3c/users/0c675434f74c4f5098001c859f7963d6/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:03.181018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423269a2642a45b29d4f92a0995e6c3c, user_id=0c675434f74c4f5098001c859f7963d6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:03.184479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:03.230782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2845/5668] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:03.234221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:03.259457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:03.327992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2824/5669] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:02 2022] PUT /identity/v3/projects/423269a2642a45b29d4f92a0995e6c3c/users/0c675434f74c4f5098001c859f7963d6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:03.329606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:03.424854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef475c-202c-435f-a522-c57d61d8a241 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:03.548841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5e4d-783e-4d7b-ba56-b2a6afd64068 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:03.557015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:03.558114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:03.558685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:03.559303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:03.560984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:03.563671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef285-e1cc-4386-8507-19809f847762 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:03.593142 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2825/5670] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:03.594989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1169-b5d8-45b4-a877-1120c7590dd3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:03.595513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1169-b5d8-45b4-a877-1120c7590dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:03.595977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1169-b5d8-45b4-a877-1120c7590dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:03.625353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:03.633708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:03.633708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:03.633708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:03.681804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-470e1169-b5d8-45b4-a877-1120c7590dd3 None None] MFA Rules not processed for user `b0346e9f75904499a5d56c15272fbd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:03.684178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-470e1169-b5d8-45b4-a877-1120c7590dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:03.738724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:03.804253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:03.808978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:03.836090 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2846/5671] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:03.837694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:03.949897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2826/5672] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:03.957247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:03.960989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:03.962036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.078174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:04.080272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:04.121922 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2827/5673] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:04.124584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:04.134092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d04e-3706-4a23-b915-63e2420d527f service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:04.150408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:04.151472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:04.151860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:04.152444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.159188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540d78-3825-4270-972d-b4419ec2aba7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:04.188235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:04.189437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:04.189960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:04.190448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] PATH_INFO: `/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27/users/912d6e0b09c24b47b960e2182154ba91/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.197691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ad5b0f3dad45b5965f437bb46afe27, user_id=912d6e0b09c24b47b960e2182154ba91, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:04.214063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:04.246390 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2828/5674] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:04 2022] PUT /identity/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27/users/912d6e0b09c24b47b960e2182154ba91/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:04.248716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:04.337142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:04.431386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:04.435245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:04.555454 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2847/5675] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:04.556757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d1fb-0b8a-4106-b8a8-e08214560fc8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:04.562013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:04.582241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:04.585280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:04.585922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:04.586422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.587917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:04.606439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b423-ba30-4b59-bb79-70d7b4a4bcb6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:04.611859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad3d8-477d-4381-8010-d9682021f16a service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:04.827257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2829/5676] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:04 2022] POST /identity/v3/projects => generated 369 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:04.829877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:04.830421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:04.831086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.889301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:04.890994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:04.891833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:04.893034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:04.928985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:04.932120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] MFA Rules not processed for user `912d6e0b09c24b47b960e2182154ba91`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:04.936034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:04.937221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:05.034298 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2848/5677] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:05.039815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:05.128884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c7d-0e38-4fbd-95f1-06d9e02893c2 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:05.291598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2830/5678] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:05.300871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:05.368280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7a265-8f89-4442-8ac6-b283b5ff18b7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:05.399477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:05.400715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:05.401408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:05.401732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:05.403039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:05.406308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:05.470013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:05.471224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:05.471743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:05.472673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:05.473508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:05.481629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:05.602009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:05.631710 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2831/5679] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:56:05 2022] POST /identity/v3/domains => generated 245 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:05.638421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:05.729415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2849/5680] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:05 2022] POST /identity/v3/users => generated 285 bytes in 694 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:05.736727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:05.772718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8bf5-5fd3-41a3-afdc-c372d0411e37 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:05.907627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135931-b4e9-4a7b-b331-b11c917ddbf4 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:05.923583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:05.927194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:05.927915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:05.928976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:05.930321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:05.934666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.006870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:06.010438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.010970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.013612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:06.020639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:06.029806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.076865 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2850/5681] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:06.078539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:06.102224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:06.111726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f9f23-f725-4239-a173-9acb9292899f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:06.123250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:06.127290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.127591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.128138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:06.129275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:06.133662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.191500 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2851/5682] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:06.191500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:06.191500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803c894-a31c-404e-9924-651c944b4275 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:06.208116 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2832/5683] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:05 2022] POST /identity/v3/projects => generated 410 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:56:06.210722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:06.215049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:06.216253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.217340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.217340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] PATH_INFO: `/v3/projects/a86a5c68e53f4c1e9df7415b51472a25/users/38fb17ca3638484fb26a6efcb013f0c0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:06.264970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86a5c68e53f4c1e9df7415b51472a25, user_id=38fb17ca3638484fb26a6efcb013f0c0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:06.275991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.384351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4425e-aa17-4c51-ba42-601b790bad8f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:06.396213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:06.397685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.398308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.398966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] PATH_INFO: `/v3/users/18731d28383849e2a96d2fb6df256119` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:06.401545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18731d28383849e2a96d2fb6df256119)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:06.408486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.448995 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2852/5684] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:06 2022] PUT /identity/v3/projects/a86a5c68e53f4c1e9df7415b51472a25/users/38fb17ca3638484fb26a6efcb013f0c0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:06.460140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:06.664344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096a90b-a23a-444a-9d0c-ed6df5b8c667 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:06.697015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:06.698660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.699628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.700424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:06.701984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:06.708196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63effdc-3730-4f7e-82c1-ae75990c7b09 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:06.850499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18731d28383849e2a96d2fb6df256119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:06.862986 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2853/5685] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:06 2022] POST /identity/v3/users => generated 347 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:06.872485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e07a4-aabb-4cee-9453-c49acb8d4294 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:06.873778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e07a4-aabb-4cee-9453-c49acb8d4294 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:06.875622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e07a4-aabb-4cee-9453-c49acb8d4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.011531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e34e07a4-aabb-4cee-9453-c49acb8d4294 None None] MFA Rules not processed for user `38fb17ca3638484fb26a6efcb013f0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:07.014546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e34e07a4-aabb-4cee-9453-c49acb8d4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.024391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18731d28383849e2a96d2fb6df256119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:07.049250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18731d28383849e2a96d2fb6df256119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:07.097385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:07.112733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18731d28383849e2a96d2fb6df256119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:07.114660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18731d28383849e2a96d2fb6df256119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:07.135051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2833/5686] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:06 2022] DELETE /identity/v3/users/18731d28383849e2a96d2fb6df256119 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:07.136514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:07.142655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.265516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2854/5687] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:07.269101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:07.269881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:07.270847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.325686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:07.328582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.361867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2323c2-7049-4cec-85b8-c173344e1049 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:07.377903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:07.379829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:07.381810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:07.382646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.384503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:07.392193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:07.434804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2834/5688] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:07.438021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:07.442132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.555418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2855/5689] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:07.555418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:07.581572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd3f9-8237-40a7-ac1f-0d24c5fc8cab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:07.611632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:07.612982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:07.613922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:07.614467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/projects/8b986fd4478c421cad0e7d7bcfe41ede/users/6c3200e0cc424251919a15b45b7b2bdd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.641947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ad0ad-4f7c-4e24-9e4b-45abf040cec5 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:07.650940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:07.652210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:07.652823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:07.653570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.657404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.677365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8b986fd4478c421cad0e7d7bcfe41ede, user_id=6c3200e0cc424251919a15b45b7b2bdd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:07.695352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:07.872299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:07.875520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f650e3-ab13-48a1-97b0-872fd8820849 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:07.902690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2835/5690] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:07.907556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f652e1b-5a29-4518-9b20-4a4ec40ad90f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:07.908301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f652e1b-5a29-4518-9b20-4a4ec40ad90f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:07.912859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f652e1b-5a29-4518-9b20-4a4ec40ad90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:07.914510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:07.924315 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2856/5691] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:07 2022] PUT /identity/v3/projects/8b986fd4478c421cad0e7d7bcfe41ede/users/6c3200e0cc424251919a15b45b7b2bdd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:07.930987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:07.950511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:07.990312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8f652e1b-5a29-4518-9b20-4a4ec40ad90f None None] MFA Rules not processed for user `7468140a2f7d42c6bb00af7a5a3af37c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:07.994348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f652e1b-5a29-4518-9b20-4a4ec40ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:08.174425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2836/5692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:08.174425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:08.174425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:08.174425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:08.246075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cdb35-92d1-415d-bb69-98c38f1ac4c9 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:08.258469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:08.259792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:08.260275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:08.261688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:08.489194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:08.508736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:08.566257 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2857/5693] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:08.572817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:08.577458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:08.600816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] MFA Rules not processed for user `6c3200e0cc424251919a15b45b7b2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:08.605598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:08.649144 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2837/5694] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:08.652770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:08.689111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5405-0ebe-43f1-aa75-ebb60f623a80 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:08.701366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:08.702672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:08.703392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:08.704035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:08.706015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:08.711186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece749c-63e6-427b-8e71-c19aad71f8f9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:08.819790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41282f6-13b7-46ed-92fe-5bbd9f8b4343 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:08.829445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:08.830860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:08.831723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:08.832125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:08.930396 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2858/5695] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:08 2022] POST /identity/v3/projects => generated 405 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:08.932917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:08.933424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:08.933954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:08.996324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.002576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.041910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:09.064283 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2838/5696] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:09.067265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:09.103639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a96a4-e200-41a1-96ab-a86498657732 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:09.118736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:09.147186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] MFA Rules not processed for user `6c3200e0cc424251919a15b45b7b2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:09.152431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:09.170455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2859/5697] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:09.176158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:09.199985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad3fb4-ec86-4b6b-8819-d5ddaf0d3f6d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:09.208257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3200e0cc424251919a15b45b7b2bdd', 'user_domain_id': 'a301682f24824ad18883430e3cb45663', 'system_scope': None, 'project_id': '8b986fd4478c421cad0e7d7bcfe41ede', 'project_domain_id': 'a301682f24824ad18883430e3cb45663', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:09.210782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:09.211200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:09.212121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:09.226016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.229127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.246282 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2860/5698] 10.222.0.78 () {56 vars in 1284 bytes} [Tue Oct 4 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:09.251693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:09.251693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:09.252364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:09.252860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:09.253946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:09.254307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.259279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.390306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375893f-9749-4bad-acb0-a83710acdb71 tempest-test_project-1233640573 tempest-user-464559800] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:09.425604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:09.431393 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2839/5699] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:09 2022] POST /identity/v3/users => generated 309 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:09.431635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:09.431635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:09.431635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/users/6c3200e0cc424251919a15b45b7b2bdd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:09.435970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:09.445504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c3200e0cc424251919a15b45b7b2bdd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.457532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.485270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e37ac-a566-4772-957f-893be6aad880 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:09.500888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:09.502881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:09.503609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:09.504408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:09.506916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.510522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.572618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2840/5700] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:56:09.575217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:09.595183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698952-aace-4d24-94d4-cba78d9616da admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:09.605073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:09.606743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:09.607278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:09.607765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] PATH_INFO: `/v3/projects/6edae73f17bc4105b7320901bea14a6a/users/9d632176918f4b65a976710edacda959/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:09.640584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edae73f17bc4105b7320901bea14a6a, user_id=9d632176918f4b65a976710edacda959, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:09.646024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:09.853664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2841/5701] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:09 2022] PUT /identity/v3/projects/6edae73f17bc4105b7320901bea14a6a/users/9d632176918f4b65a976710edacda959/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:09.855637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:10.036178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3200e0cc424251919a15b45b7b2bdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:10.038270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3200e0cc424251919a15b45b7b2bdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:10.089481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7edb-2167-40ac-bad5-811e94a7c280 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:10.109583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:10.111352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:10.112384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:10.114252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:10.116676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:10.120503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:10.150449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2842/5702] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:10.157746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:10.189608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c8b3-b14d-4dc2-a789-ecd5456009a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:10.201370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:10.202870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:10.203624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:10.204522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] PATH_INFO: `/v3/projects/6edae73f17bc4105b7320901bea14a6a/users/9d632176918f4b65a976710edacda959/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:10.210212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edae73f17bc4105b7320901bea14a6a, user_id=9d632176918f4b65a976710edacda959, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:10.216947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3200e0cc424251919a15b45b7b2bdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:10.218780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:10.250317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2843/5703] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:10 2022] PUT /identity/v3/projects/6edae73f17bc4105b7320901bea14a6a/users/9d632176918f4b65a976710edacda959/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:10.263839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3200e0cc424251919a15b45b7b2bdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:10.284146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3200e0cc424251919a15b45b7b2bdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:10.339028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:10.341735 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2861/5704] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:09 2022] DELETE /identity/v3/users/6c3200e0cc424251919a15b45b7b2bdd => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:10.354081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:10.358721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:10.644886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c1dc-51d0-46c1-b48a-d3a261a10f28 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:10.831979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:10.833448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:10.835097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:10.835509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/projects/8b986fd4478c421cad0e7d7bcfe41ede` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:10.838440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b986fd4478c421cad0e7d7bcfe41ede)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:10.843433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:11.107610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:11.110295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:11.122392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b986fd4478c421cad0e7d7bcfe41ede', 'request_id': 'req-555c3a55-853b-46bc-bb1d-6136a3f917e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.144016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b986fd4478c421cad0e7d7bcfe41ede', 'request_id': 'req-555c3a55-853b-46bc-bb1d-6136a3f917e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.162479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:11.168889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b986fd4478c421cad0e7d7bcfe41ede', 'request_id': 'req-555c3a55-853b-46bc-bb1d-6136a3f917e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.293305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] The token cache is being invalidate because project 8b986fd4478c421cad0e7d7bcfe41ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:11.294145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.302467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.323411 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2844/5705] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:10 2022] DELETE /identity/v3/projects/8b986fd4478c421cad0e7d7bcfe41ede => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:11.325820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:11.330683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:11.339879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973444-b95e-4652-8886-e31443fdfa2f tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:11.350614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:11.607644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3a55-853b-46bc-bb1d-6136a3f917e3 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:11.628198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:11.633015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:11.635081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:11.636833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:11.637518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/domains/a301682f24824ad18883430e3cb45663` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:11.640866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a301682f24824ad18883430e3cb45663)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:11.643967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:11.644278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:11.644771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] PATH_INFO: `/v3/projects/c9762bc564f54ad7b64c5cf50ec1801d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:11.648911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9762bc564f54ad7b64c5cf50ec1801d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:11.657595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:11.658434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:11.751569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.754911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:11.970746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9762bc564f54ad7b64c5cf50ec1801d', 'request_id': 'req-ee83af1c-f056-4635-a674-fb15b6909aac'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.028872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.029998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.041570 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2845/5706] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:56:11 2022] PATCH /identity/v3/domains/a301682f24824ad18883430e3cb45663 => generated 246 bytes in 718 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:56:12.043717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:12.046361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:12.118671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9762bc564f54ad7b64c5cf50ec1801d', 'request_id': 'req-ee83af1c-f056-4635-a674-fb15b6909aac'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.132063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9762bc564f54ad7b64c5cf50ec1801d', 'request_id': 'req-ee83af1c-f056-4635-a674-fb15b6909aac'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.154048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] The token cache is being invalidate because project c9762bc564f54ad7b64c5cf50ec1801d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:12.160004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.160004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.160004 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2862/5707] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:11 2022] DELETE /identity/v3/projects/c9762bc564f54ad7b64c5cf50ec1801d => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:12.168099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:12.176687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:12.377136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792c798-009c-4159-9d1a-5615e7f2b439 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:12.550478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83af1c-f056-4635-a674-fb15b6909aac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:12.565207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:12.569588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:12.570267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:12.570884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] PATH_INFO: `/v3/users/3a8cd29b5d324ba2afba869ed5a1d237` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:12.580321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8cd29b5d324ba2afba869ed5a1d237)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:12.585566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:12.654625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '912d6e0b09c24b47b960e2182154ba91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2ad5b0f3dad45b5965f437bb46afe27', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:12.656015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:12.656405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:12.656988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] PATH_INFO: `/v3/domains/a301682f24824ad18883430e3cb45663` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:12.707623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a301682f24824ad18883430e3cb45663)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:12.714910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:12.781914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:12.790976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a301682f24824ad18883430e3cb45663'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.051911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8cd29b5d324ba2afba869ed5a1d237'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.051911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8cd29b5d324ba2afba869ed5a1d237'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.067190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.160250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.174699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:13.192152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.233941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8cd29b5d324ba2afba869ed5a1d237'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.282107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8cd29b5d324ba2afba869ed5a1d237'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.303952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8cd29b5d324ba2afba869ed5a1d237'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.327330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2863/5708] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:12 2022] DELETE /identity/v3/users/3a8cd29b5d324ba2afba869ed5a1d237 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:13.378674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] The token cache is being invalidate because project a301682f24824ad18883430e3cb45663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:13.380812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.387344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.520425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.535219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.537221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1 tempest-TestDefaultProjectId-1439582382 tempest-TestDefaultProjectId-1439582382-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a301682f24824ad18883430e3cb45663', 'request_id': 'req-ec3b7099-1c4d-4b56-8f4c-c9350b32e3b1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:13.579471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2846/5709] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:12 2022] DELETE /identity/v3/domains/a301682f24824ad18883430e3cb45663 => generated 0 bytes in 1537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:13.589695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:13.593697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:13.916527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc04b69-5df4-4a51-b089-3c580ee682c0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:13.936635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:13.937886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:13.938280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:13.938715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] PATH_INFO: `/v3/users/b775c62079bc4a19b8624a7ec623d636` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:13.942695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b775c62079bc4a19b8624a7ec623d636)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:13.948818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:14.358859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:14.368361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b775c62079bc4a19b8624a7ec623d636'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:14.370730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b775c62079bc4a19b8624a7ec623d636'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:14.550365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b775c62079bc4a19b8624a7ec623d636'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:14.618158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b775c62079bc4a19b8624a7ec623d636'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:14.649512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b775c62079bc4a19b8624a7ec623d636'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:14.672113 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2864/5710] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:13 2022] DELETE /identity/v3/users/b775c62079bc4a19b8624a7ec623d636 => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:14.686901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:14.694009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:14.694853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:14.751194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:14.754027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:15.160888 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2847/5711] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:15.196470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:15.198923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:15.360217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f4d0-745e-4003-af5f-735819db9c6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:15.512907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:15.512907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:15.512907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:15.512907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:15.513872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:15.513872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:15.513872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2865/5712] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:16.056010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:16.058566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:16.145651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05654c7b-eeb7-413a-a223-e3a4658aa4c9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:16.145651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:16.145651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:16.145651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:16.147340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] PATH_INFO: `/v3/projects/07fe50e17c004c95b980473d22e4b2a2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:16.147340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fe50e17c004c95b980473d22e4b2a2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:16.147340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:16.192938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:16.195886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:16.277560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d46f-b986-42fd-8195-cb6cdc8e6491 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:16.290445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:16.296275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:16.297292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:16.298360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] PATH_INFO: `/v3/users/b0346e9f75904499a5d56c15272fbd4b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:16.307776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0346e9f75904499a5d56c15272fbd4b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:16.312585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:16.328876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:16.552649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fe50e17c004c95b980473d22e4b2a2', 'request_id': 'req-79088e3a-dd93-40ad-9afd-f9ab74daf35e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.577664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fe50e17c004c95b980473d22e4b2a2', 'request_id': 'req-79088e3a-dd93-40ad-9afd-f9ab74daf35e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.612868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fe50e17c004c95b980473d22e4b2a2', 'request_id': 'req-79088e3a-dd93-40ad-9afd-f9ab74daf35e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.821970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] The token cache is being invalidate because project 07fe50e17c004c95b980473d22e4b2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:16.822310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.825433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79088e3a-dd93-40ad-9afd-f9ab74daf35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.828636 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2848/5713] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:16 2022] DELETE /identity/v3/projects/07fe50e17c004c95b980473d22e4b2a2 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:16.832495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:16.833005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:16.834334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:16.900988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0346e9f75904499a5d56c15272fbd4b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.902327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0346e9f75904499a5d56c15272fbd4b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:16.932296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] MFA Rules not processed for user `9d632176918f4b65a976710edacda959`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:16.935331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.059962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0346e9f75904499a5d56c15272fbd4b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.125433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0346e9f75904499a5d56c15272fbd4b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.159760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b76dcc6b-049c-4703-b529-0cb8734a4626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0346e9f75904499a5d56c15272fbd4b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.182143 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2866/5714] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:16 2022] DELETE /identity/v3/users/b0346e9f75904499a5d56c15272fbd4b => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:17.185596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0840-1044-41bb-b0f2-8a51288af68d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:17.186985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0840-1044-41bb-b0f2-8a51288af68d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:17.188022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0840-1044-41bb-b0f2-8a51288af68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:17.197024 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2849/5715] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:17.198996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:17.208749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.269072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a0bb0840-1044-41bb-b0f2-8a51288af68d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:17.271974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a0bb0840-1044-41bb-b0f2-8a51288af68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.438681 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2867/5716] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:17.441902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb84b4-6644-4c7a-b427-15ad98024af6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:17.442966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb84b4-6644-4c7a-b427-15ad98024af6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:17.444024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb84b4-6644-4c7a-b427-15ad98024af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:17.493088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73fb84b4-6644-4c7a-b427-15ad98024af6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:17.495934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568656b8-f0a7-419d-9edb-1889b444cd0c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:17.496887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73fb84b4-6644-4c7a-b427-15ad98024af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.513597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2868/5717] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:17.517730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:17.519695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:17.520608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:17.521055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:17.524131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:17.525705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:17.526219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] PATH_INFO: `/v3/projects/348cafd6176d42e783d7b9613ba30dd7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:17.530758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348cafd6176d42e783d7b9613ba30dd7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:17.539787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:17.581374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:17.582807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.627925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2869/5718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:17.630162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:17.634220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:17.774797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0cad7-d584-4d04-8097-f4b1cb66c3c3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:17.788051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:17.789985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:17.791042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:17.792487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:17.872280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:17.882305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:17.897998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348cafd6176d42e783d7b9613ba30dd7', 'request_id': 'req-9d35c0d0-53b5-4219-8968-2ec13bd31f55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.916734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348cafd6176d42e783d7b9613ba30dd7', 'request_id': 'req-9d35c0d0-53b5-4219-8968-2ec13bd31f55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.934692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2870/5719] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:17.935504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348cafd6176d42e783d7b9613ba30dd7', 'request_id': 'req-9d35c0d0-53b5-4219-8968-2ec13bd31f55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:17.935698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:17.970604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e55ee-ffa1-48da-ba62-e3ab4590b714 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:18.098235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:18.099379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:18.099862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:18.100460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:18.101815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:18.102579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:18.105482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:18.145060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] The token cache is being invalidate because project 348cafd6176d42e783d7b9613ba30dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:18.152583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:18.154129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:18.164823 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2871/5720] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:18.166715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:18.171815 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2850/5721] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:17 2022] DELETE /identity/v3/projects/348cafd6176d42e783d7b9613ba30dd7 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:18.174433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:18.178379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:18.180106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:18.238187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c0d0-53b5-4219-8968-2ec13bd31f55 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:18.244017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfa9b-11d2-4bb2-9c36-a991ba8bac54 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:18.269907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:18.272765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:18.272765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:18.273211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:18.273415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] PATH_INFO: `/v3/users/912d6e0b09c24b47b960e2182154ba91` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:18.275105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:18.276116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:18.276877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:18.278593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:18.279385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=912d6e0b09c24b47b960e2182154ba91)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:18.283184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:18.285070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:18.518301 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2872/5722] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:18 2022] POST /identity/v3/projects => generated 367 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:18.521914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:18.576840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:18.722886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912d6e0b09c24b47b960e2182154ba91'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:18.757200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5d0c-4673-4dad-888a-78b205421584 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:18.766964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:18.768581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:18.769150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:18.769655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:18.771067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:18.776302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:18.938444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912d6e0b09c24b47b960e2182154ba91'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:18.958866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912d6e0b09c24b47b960e2182154ba91'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:19.005802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2873/5723] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:18 2022] POST /identity/v3/users => generated 284 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:19.012522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:19.014279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912d6e0b09c24b47b960e2182154ba91'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:19.016808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912d6e0b09c24b47b960e2182154ba91'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:19.039622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0041f53-3d12-461e-ac51-ecf14417240e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:19.053915 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2851/5724] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:18 2022] DELETE /identity/v3/users/912d6e0b09c24b47b960e2182154ba91 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:19.190766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:19.192090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:19.192795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:19.194470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:19.194930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:19.198710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:19.227637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2874/5725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:19.230733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:19.234184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:19.263964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cec74f-307c-4418-a045-f73ab7625ad4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:19.274957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:19.276750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:19.277332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:19.277900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:19.279277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:19.284447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f2a54-897c-4c8e-9193-d20ffff23f7a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:19.308072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2852/5726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:19.313703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:19.338434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041396-a375-41f8-abd6-098c729d4955 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:19.354323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:19.357035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:19.358103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:19.358358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] PATH_INFO: `/v3/projects/53e74ec889da4c90a905a6ecd57243cf/users/c9d5a01f00e345aaa6c53fe5ee71bd3b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:19.408106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e74ec889da4c90a905a6ecd57243cf, user_id=c9d5a01f00e345aaa6c53fe5ee71bd3b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:19.415462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:19.577039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2875/5727] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:19 2022] PUT /identity/v3/projects/53e74ec889da4c90a905a6ecd57243cf/users/c9d5a01f00e345aaa6c53fe5ee71bd3b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:56:19.604035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:19.604533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:19.609391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:19.671307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] MFA Rules not processed for user `c9d5a01f00e345aaa6c53fe5ee71bd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:19.685620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:19.886630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:19.895583 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2853/5728] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:19.904834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:19.908135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:20.181573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d50-f5e6-49b4-989a-685018da0566 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:20.192612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166520b0-354c-4775-892a-734b35479143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:20.199539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166520b0-354c-4775-892a-734b35479143 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:20.199539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166520b0-354c-4775-892a-734b35479143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:20.199539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166520b0-354c-4775-892a-734b35479143 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:20.199539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166520b0-354c-4775-892a-734b35479143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:20.202714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166520b0-354c-4775-892a-734b35479143 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:20.236585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e39be-f09d-44e2-a822-73ca6daad41b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:20.253984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:20.255411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:20.256395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:20.256877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] PATH_INFO: `/v3/projects/d59234191f7845f8aecc023df0f76015` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:20.259343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59234191f7845f8aecc023df0f76015)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:20.263519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:20.379224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2876/5729] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:19 2022] POST /identity/v3/projects => generated 369 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:20.387065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166520b0-354c-4775-892a-734b35479143 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:20.536909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59234191f7845f8aecc023df0f76015', 'request_id': 'req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:20.561248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59234191f7845f8aecc023df0f76015', 'request_id': 'req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:20.590906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59234191f7845f8aecc023df0f76015', 'request_id': 'req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:20.648665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:20.652882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166520b0-354c-4775-892a-734b35479143 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:20.771319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] The token cache is being invalidate because project d59234191f7845f8aecc023df0f76015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:20.776545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:20.778774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:20.790960 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2854/5730] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:19 2022] DELETE /identity/v3/projects/d59234191f7845f8aecc023df0f76015 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:20.793078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:20.795806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:20.818781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:20.820648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:20.822020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:20.823619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:20.825341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:20.830585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:20.992689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2877/5731] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:20 2022] POST /identity/v3/users => generated 291 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:20.994986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:21.002728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:21.004878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3193-52b1-4e3a-ad22-6e96ba0d1dc5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:21.034027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:21.035292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:21.035856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:21.036852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] PATH_INFO: `/v3/users/38fb17ca3638484fb26a6efcb013f0c0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:21.039884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fb17ca3638484fb26a6efcb013f0c0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:21.044002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:21.059049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eab618-c703-468d-9c81-bc51fb6a9bb7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:21.091500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:21.097356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:21.097356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:21.097356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:21.097356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:21.098321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:21.147564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2878/5732] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:21.155570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:21.184391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f77c-0889-4d5b-87dc-7bf0dd862f1e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:21.194487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:21.196325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:21.196852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:21.197348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] PATH_INFO: `/v3/projects/df47136960274b22997db6ade5066ecf/users/39f91239ad1a4d498c01177d6fc4f3ab/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:21.239430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df47136960274b22997db6ade5066ecf, user_id=39f91239ad1a4d498c01177d6fc4f3ab, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:21.249633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:21.467207 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2879/5733] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:21 2022] PUT /identity/v3/projects/df47136960274b22997db6ade5066ecf/users/39f91239ad1a4d498c01177d6fc4f3ab/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:21.470994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:21.574143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fb17ca3638484fb26a6efcb013f0c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:21.758675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef588da-1a8c-470a-b3ae-16355a3678f4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:21.792587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:21.795689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:21.799243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fb17ca3638484fb26a6efcb013f0c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:21.809122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:21.809122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:21.812614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:21.824459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:21.825903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fb17ca3638484fb26a6efcb013f0c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:21.877382 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2880/5734] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:21.883796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:21.902180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fb17ca3638484fb26a6efcb013f0c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:21.913844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9e9fc0e5-17cc-45f5-9a83-8ecfcfd97fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fb17ca3638484fb26a6efcb013f0c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:21.947224 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2855/5735] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:20 2022] DELETE /identity/v3/users/38fb17ca3638484fb26a6efcb013f0c0 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:21.947546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2eb84-99ea-4d7e-8889-39e9c017c37e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:21.990135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:22.221610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:22.223222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:22.223924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:22.224761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] PATH_INFO: `/v3/projects/df47136960274b22997db6ade5066ecf/users/39f91239ad1a4d498c01177d6fc4f3ab/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:22.241735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df47136960274b22997db6ade5066ecf, user_id=39f91239ad1a4d498c01177d6fc4f3ab, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:22.249796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:22.285759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2881/5736] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:21 2022] PUT /identity/v3/projects/df47136960274b22997db6ade5066ecf/users/39f91239ad1a4d498c01177d6fc4f3ab/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:22.303622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:22.304649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:22.305254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:22.461014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] MFA Rules not processed for user `39f91239ad1a4d498c01177d6fc4f3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:22.464191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:22.611381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:22.612320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:22.778883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:22.849992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2856/5737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:56:22.964854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b6ee-04ff-44d4-a1a0-7ae3bc524ebd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:22.981721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:22.983515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:22.989647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:22.989647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] PATH_INFO: `/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:22.989647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ad5b0f3dad45b5965f437bb46afe27)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:22.993810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:23.057670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:23.064519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:23.310544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ad5b0f3dad45b5965f437bb46afe27', 'request_id': 'req-5aa8addc-5518-4f15-9c29-aad61fe317e2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:23.357734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793f9aa-d286-4caf-a25c-cdc7b919863b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:23.516270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:23.519755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ad5b0f3dad45b5965f437bb46afe27', 'request_id': 'req-5aa8addc-5518-4f15-9c29-aad61fe317e2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:23.548827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ad5b0f3dad45b5965f437bb46afe27', 'request_id': 'req-5aa8addc-5518-4f15-9c29-aad61fe317e2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:23.563600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:23.567987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:23.568873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:23.572192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:23.614354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] The token cache is being invalidate because project e2ad5b0f3dad45b5965f437bb46afe27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:23.617946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:23.620186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5aa8addc-5518-4f15-9c29-aad61fe317e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:23.638058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2882/5738] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:22 2022] DELETE /identity/v3/projects/e2ad5b0f3dad45b5965f437bb46afe27 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:23.643444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:23.646249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:23.646805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:23.756528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:23.763525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:24.008263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:24.021443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1bfeb-0de0-4705-b2ea-e46ec06c5e21 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:24.057247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2857/5739] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:24.137706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2883/5740] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:24.154843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8838-dbda-49af-a541-0057e296d552 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:24.159445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8838-dbda-49af-a541-0057e296d552 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:24.165408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df8838-dbda-49af-a541-0057e296d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:24.188587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:24.274957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22df8838-dbda-49af-a541-0057e296d552 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:24.279769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22df8838-dbda-49af-a541-0057e296d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:24.335669 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2858/5741] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:56:24.342178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:24.384742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f4bc-32e9-40c1-9f29-98172b9d83fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:24.399391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:24.402920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:24.408609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:24.409037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:24.409359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:24.410251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:24.410815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:24.414531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:24.497607 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2884/5742] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:24.506658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8838-dbda-49af-a541-0057e296d552 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:24.565763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df8838-dbda-49af-a541-0057e296d552 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:24.608452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:24.610156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:24.611054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:24.611892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:24.615087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:24.620915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:24.664166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:24.674228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:24.731661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897a80-a804-4c55-b74a-22e23823fa4c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:24.746065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:24.747520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:24.747881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:24.748673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] PATH_INFO: `/v3/users/7468140a2f7d42c6bb00af7a5a3af37c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:24.751850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7468140a2f7d42c6bb00af7a5a3af37c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:24.758291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:24.849946 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2859/5743] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:24 2022] POST /identity/v3/projects => generated 369 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:24.858723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:25.154839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a0f5e-0cfe-4def-bd87-2ece0636d438 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:25.186845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:25.186845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:25.186845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:25.186845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:25.187833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:25.197961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:25.247614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7468140a2f7d42c6bb00af7a5a3af37c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:25.251700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7468140a2f7d42c6bb00af7a5a3af37c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:25.373525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7468140a2f7d42c6bb00af7a5a3af37c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:25.408584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2860/5744] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:24 2022] POST /identity/v3/users => generated 285 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:25.411015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:25.451562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14679-5444-42ac-a2d8-3ed2d6b8d986 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:25.456297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7468140a2f7d42c6bb00af7a5a3af37c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:25.484461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:25.486726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:25.487865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:25.488935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:25.492405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7468140a2f7d42c6bb00af7a5a3af37c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:25.494041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:25.502744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:25.526896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2885/5745] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:24 2022] DELETE /identity/v3/users/7468140a2f7d42c6bb00af7a5a3af37c => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:25.543552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2861/5746] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:25.560693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:25.565136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:25.737827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:25.865516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f315ea5-d0cd-4fbd-8ef2-57f566f1bfac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:25.866708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:25.871801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:25.884681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:25.903376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:25.905829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:25.908035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:25.910167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:25.915801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:25.920666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ab7-c400-4736-8cb2-ac74694eaffd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:25.924167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:25.943248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:25.944353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:25.944820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:25.945274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] PATH_INFO: `/v3/users/0da48b8d726f40ddadd9f51c65ba8fde` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:25.955719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da48b8d726f40ddadd9f51c65ba8fde)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:25.959946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:26.013752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2886/5747] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:26.025438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:26.075452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434b643-3e73-4bc8-817b-e13dbdb5ef53 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:26.103387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:26.108817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:26.109327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:26.109844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] PATH_INFO: `/v3/projects/17122924c6f94ac493028e47a320efb2/users/923b522611304699b90c28f76fbf4f6c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:26.207412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17122924c6f94ac493028e47a320efb2, user_id=923b522611304699b90c28f76fbf4f6c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:26.224165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67c3a-f1e6-4407-8ec5-c66601106b56 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:26.367471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da48b8d726f40ddadd9f51c65ba8fde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:26.370452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2887/5748] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:26 2022] PUT /identity/v3/projects/17122924c6f94ac493028e47a320efb2/users/923b522611304699b90c28f76fbf4f6c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:26.402041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:26.403255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:26.403255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:26.514605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] MFA Rules not processed for user `923b522611304699b90c28f76fbf4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:26.521301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:26.570946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da48b8d726f40ddadd9f51c65ba8fde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:26.595443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da48b8d726f40ddadd9f51c65ba8fde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:26.659080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da48b8d726f40ddadd9f51c65ba8fde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:26.660764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da48b8d726f40ddadd9f51c65ba8fde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:26.699770 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2862/5749] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:25 2022] DELETE /identity/v3/users/0da48b8d726f40ddadd9f51c65ba8fde => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:26.701952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:26.713103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:26.794526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2888/5750] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:56:26.796782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:26.806124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:27.152800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c03bc-cbe8-4ee2-abbe-d8ceba9ca195 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:27.188717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:27.190667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:27.191531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:27.192868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] PATH_INFO: `/v3/projects/a86a5c68e53f4c1e9df7415b51472a25` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:27.195614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86a5c68e53f4c1e9df7415b51472a25)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:27.207615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:27.273646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe10bb8-3b86-4346-b2dc-ec438ae79ebe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:27.308394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:27.320190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:27.320817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:27.321331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:27.326074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:27.331893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:27.552041 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2889/5751] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:26 2022] POST /identity/v3/projects => generated 369 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:27.553849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:27.571776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86a5c68e53f4c1e9df7415b51472a25', 'request_id': 'req-8a613d7c-c231-4049-9a40-8a599720274b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:27.609239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86a5c68e53f4c1e9df7415b51472a25', 'request_id': 'req-8a613d7c-c231-4049-9a40-8a599720274b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:27.642627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86a5c68e53f4c1e9df7415b51472a25', 'request_id': 'req-8a613d7c-c231-4049-9a40-8a599720274b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:27.697418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:27.773823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f4c8-31c6-4a89-b5e6-dd85f6fe45a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:27.784944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:27.785806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:27.786814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:27.787425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:27.788699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:27.809929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9813-f5cb-4e56-bad6-2cda7ad0c44c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:27.813950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] The token cache is being invalidate because project a86a5c68e53f4c1e9df7415b51472a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:27.823354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:27.833391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:27.843625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2863/5752] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:26 2022] DELETE /identity/v3/projects/a86a5c68e53f4c1e9df7415b51472a25 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:27.849185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:27.857032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:28.011898 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2890/5753] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:27 2022] POST /identity/v3/users => generated 291 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:28.014494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.015023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.015609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.034677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:28.111197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:28.118089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:28.159349 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2891/5754] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:28.159349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:28.159349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:28.184693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613d7c-c231-4049-9a40-8a599720274b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:28.207609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:28.209548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.210239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.210874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] PATH_INFO: `/v3/projects/cc2d4e9869bf4d408b39c45f651a033b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.216052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2d4e9869bf4d408b39c45f651a033b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:28.224612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:28.265352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de54f3a-a128-40b1-9a89-d2d6e3f00230 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:28.282605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:28.285639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.287463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.293205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.307238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:28.316878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232afc6-8931-40c6-afdf-2ffa027da2b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:28.391939 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2892/5755] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:28.397677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.409943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.411828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.473323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:28.478775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:28.545141 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2893/5756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:28.554045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:28.604957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798253a-9ba0-4757-b8f0-63499f8967b4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:28.667062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2d4e9869bf4d408b39c45f651a033b', 'request_id': 'req-d65362b4-7afb-476b-a333-3a08f72cee78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:28.694095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2d4e9869bf4d408b39c45f651a033b', 'request_id': 'req-d65362b4-7afb-476b-a333-3a08f72cee78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:28.707353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2d4e9869bf4d408b39c45f651a033b', 'request_id': 'req-d65362b4-7afb-476b-a333-3a08f72cee78'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:28.821074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:28.822464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.823128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.823736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] PATH_INFO: `/v3/projects/2c728b817e0e48fbbe9bb48887270faf/users/c6df1b2d3c6c4371a9e2694fabc5e105/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.841320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] The token cache is being invalidate because project cc2d4e9869bf4d408b39c45f651a033b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:28.842610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:28.851841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:28.861688 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2864/5757] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:27 2022] DELETE /identity/v3/projects/cc2d4e9869bf4d408b39c45f651a033b => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:28.870044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:28.882287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:28.920006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c728b817e0e48fbbe9bb48887270faf, user_id=c6df1b2d3c6c4371a9e2694fabc5e105, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:28.936250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:28.954039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65362b4-7afb-476b-a333-3a08f72cee78 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:28.965514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:28.966642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:28.969916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:28.970665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:28.972053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:28.972673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:28.979763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:29.025277 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2865/5758] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:29.027366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:29.033021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:29.064877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3e00-10f0-4e7f-aae2-b06661824789 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:29.080019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:29.082122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:29.083306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:29.084255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] PATH_INFO: `/v3/users/9d632176918f4b65a976710edacda959` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:29.091978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d632176918f4b65a976710edacda959)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:29.096784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:29.127417 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2894/5759] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:28 2022] PUT /identity/v3/projects/2c728b817e0e48fbbe9bb48887270faf/users/c6df1b2d3c6c4371a9e2694fabc5e105/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:29.129802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:29.378598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d02f3-2b50-4278-99e4-31d1754c782d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:29.403894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:29.405254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:29.405790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:29.406313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:29.407857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:29.413276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:29.513980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d632176918f4b65a976710edacda959'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:29.578076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:29.620648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d632176918f4b65a976710edacda959'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:29.658336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2895/5760] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:29 2022] POST /identity/v3/projects => generated 407 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:29.671729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d632176918f4b65a976710edacda959'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:29.672638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:29.679609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:29.735565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d632176918f4b65a976710edacda959'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:29.736935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d632176918f4b65a976710edacda959'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:29.762955 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2866/5761] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:29 2022] DELETE /identity/v3/users/9d632176918f4b65a976710edacda959 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:29.762955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:29.769306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:29.815948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:30.001861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaf43f-ef01-4377-8fc4-225f492a3282 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:30.073663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35913eb3-f5a7-4e4f-a147-381c8b19c429 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:30.088226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:30.093302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:30.094232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:30.094723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] PATH_INFO: `/v3/projects/8bc331439dfe4bbbb6c764bc5c243b35` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:30.101045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc331439dfe4bbbb6c764bc5c243b35)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:30.109459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:30.261222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:30.263206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:30.264700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:30.266220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:30.269025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:30.274501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:30.324780 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2896/5762] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 666 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:30.326836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:30.342123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:30.378372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51562d1b-ddba-4a0e-b304-0508cc3255dd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:30.398951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:30.400232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:30.401014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:30.402852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:30.404620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:30.411109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:30.618947 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2897/5763] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:30 2022] POST /identity/v3/users => generated 304 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:30.622550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:30.629306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:30.639251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc331439dfe4bbbb6c764bc5c243b35', 'request_id': 'req-21382633-3ff3-462c-bb7d-170bc8f23c69'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:30.656217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc331439dfe4bbbb6c764bc5c243b35', 'request_id': 'req-21382633-3ff3-462c-bb7d-170bc8f23c69'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:30.668669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc331439dfe4bbbb6c764bc5c243b35', 'request_id': 'req-21382633-3ff3-462c-bb7d-170bc8f23c69'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:30.673660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c521af-c544-4144-a3f7-a4e51bbcf6cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:30.841770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:30.842977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:30.843825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:30.844320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] PATH_INFO: `/v3/projects/2c728b817e0e48fbbe9bb48887270faf/users/c6df1b2d3c6c4371a9e2694fabc5e105/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:30.854136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c728b817e0e48fbbe9bb48887270faf, user_id=c6df1b2d3c6c4371a9e2694fabc5e105, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:30.860875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e004c-8c5e-4d7e-a1a3-e56bea4b508d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:30.872904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] The token cache is being invalidate because project 8bc331439dfe4bbbb6c764bc5c243b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:30.874892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:30.879179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:30.886663 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2867/5764] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:29 2022] DELETE /identity/v3/projects/8bc331439dfe4bbbb6c764bc5c243b35 => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:30.889188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:30.906626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:30.906948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2898/5765] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:30 2022] PUT /identity/v3/projects/2c728b817e0e48fbbe9bb48887270faf/users/c6df1b2d3c6c4371a9e2694fabc5e105/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:30.917292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64a4a-9478-4f2e-9efa-4aaeff2c92b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:30.917668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64a4a-9478-4f2e-9efa-4aaeff2c92b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:30.919027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64a4a-9478-4f2e-9efa-4aaeff2c92b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:30.962667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-30b64a4a-9478-4f2e-9efa-4aaeff2c92b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:30.965948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-30b64a4a-9478-4f2e-9efa-4aaeff2c92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:30.971818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21382633-3ff3-462c-bb7d-170bc8f23c69 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.146877 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2899/5766] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:31.146877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.146877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.146877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.149095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:31.150463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.150955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.151470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.153000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:31.156888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44ce7-2f65-4452-8356-091b4accc3cd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:31.196007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2868/5767] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:31.199422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.200290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.201254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.208319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] MFA Rules not processed for user `c6df1b2d3c6c4371a9e2694fabc5e105`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:31.211684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:31.250038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:31.252926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:31.278692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2869/5768] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:31.281184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.305838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fcbeb-09b7-4b79-9af5-39c189e06479 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.316029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:31.318170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.318813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.319469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.321075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:31.324553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:31.348368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2870/5769] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:31.348368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.350614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:31.375291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ef863-b10e-4400-893f-6afa3978fddf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.386778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:31.387863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.388411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.389232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] PATH_INFO: `/v3/projects/6edae73f17bc4105b7320901bea14a6a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.391686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edae73f17bc4105b7320901bea14a6a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:31.394408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:31.401159 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2900/5770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:31.403293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.425045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adab0c8-eeac-4c27-ad12-3c03cb6faa89 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.439295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:31.439987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.440864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.441758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.444009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:31.444673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:31.462875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:31.500684 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2901/5771] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:31.503261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.530330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bfe1-2885-4473-9317-fe9bc1e69dc5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.539543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:31.541757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:31.542368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:31.544345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] PATH_INFO: `/v3/projects/57c85c13cfbf49bca8d9da7a6dd46000/users/826d1d7a5a034dca9e6e44322964a9f7/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:31.575235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c85c13cfbf49bca8d9da7a6dd46000, user_id=826d1d7a5a034dca9e6e44322964a9f7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:31.580686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:31.710340 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2902/5772] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:31 2022] PUT /identity/v3/projects/57c85c13cfbf49bca8d9da7a6dd46000/users/826d1d7a5a034dca9e6e44322964a9f7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:31.710340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.768724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edae73f17bc4105b7320901bea14a6a', 'request_id': 'req-d0d0337e-061c-4e13-a130-3b188e27f76f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:31.800776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edae73f17bc4105b7320901bea14a6a', 'request_id': 'req-d0d0337e-061c-4e13-a130-3b188e27f76f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:31.817505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edae73f17bc4105b7320901bea14a6a', 'request_id': 'req-d0d0337e-061c-4e13-a130-3b188e27f76f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:31.936452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81b5a-fdf9-434d-a9cc-b73068d43f65 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:31.969765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] The token cache is being invalidate because project 6edae73f17bc4105b7320901bea14a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:31.971014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:31.975481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:31.991525 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2871/5773] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:31 2022] DELETE /identity/v3/projects/6edae73f17bc4105b7320901bea14a6a => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:31.994090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:31.996844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:32.121882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:32.124723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:32.124723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:32.125493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:32.127241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:32.133643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a0d5-bba4-4e50-9005-23cc2da727ae tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:32.268627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0337e-061c-4e13-a130-3b188e27f76f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:32.287851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:32.299772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:32.299772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:32.299772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:32.299772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:32.299772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2a720-662e-4b77-b7a9-3f92f1e48537 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:32.418524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:32.536122 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2903/5774] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:31 2022] POST /identity/v3/projects => generated 359 bytes in 828 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:32.540310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:32.540591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:32.541124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:32.573615 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2872/5775] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:31 2022] POST /identity/v3/projects => generated 365 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:32.573615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:32.574318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:32.574714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:32.619911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] MFA Rules not processed for user `826d1d7a5a034dca9e6e44322964a9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:32.622935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:32.661034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:32.663336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:32.870389 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2904/5776] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:32.872119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:32.874784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:32.932924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:32.965453 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2873/5777] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:32.965453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.005482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d9c5a-4889-4b49-9492-15a095457798 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.022724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.024003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.024471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.024895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.028054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.031338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.105829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba948f-9d8b-4b7a-80e4-c0981f82f449 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.117212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.118595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.119351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.119919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.121473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.126217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d079461-4ef0-402a-82cd-cf0f2bf21055 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.187918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2874/5778] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:32 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:33.194354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.207381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:33.239195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439f9bf-da46-4120-a2b2-010affe6d428 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.249273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.251253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.252023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.253395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.255745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.260057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.312604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2905/5779] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:32 2022] POST /identity/v3/users => generated 416 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:33.320398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.321145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.322322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.377127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:33.381048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:33.406243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2906/5780] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:33.406243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.428575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b9f5c-c574-4b5b-860f-acc3b8a5e06d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.439058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.440076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.440611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.442913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.444327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.452956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.453922 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2875/5781] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:33 2022] POST /identity/v3/projects => generated 403 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:33.456000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.497920 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2907/5782] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:33.505838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.542411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0494-2da8-4a9c-a0dc-a8fad092d5e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.664235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467122-ea17-49f3-b2df-6b1a48ab1d58 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.702467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.705394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.706960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.709294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/users/6c1ff88486124ec2935e11633e600220` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.756393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_user(user_id=6c1ff88486124ec2935e11633e600220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.763068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.770395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2876/5783] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:56:33 2022] GET /identity/v3/users/6c1ff88486124ec2935e11633e600220 => generated 416 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:33.775349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.799445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.802813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.804679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.805027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.810826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:33.811398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.814612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30326b-7c0f-47ba-b5b9-2541e38c6a81 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.819414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.834142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.839663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.840657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.844555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.851337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.868483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:33.882768 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2908/5784] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:33.890922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:33.926152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d78315-842e-4756-8ee8-17c1488dbc87 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:33.948433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:33.952641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:33.953651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:33.954226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:33.959758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:33.966223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5dd0-0bde-430a-b62a-4c2f02c5586f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:34.021623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2909/5785] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:34.029316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:34.036457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:34.037316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:34.128514 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2877/5786] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:33 2022] POST /identity/v3/users => generated 308 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:34.130663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:34.183900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] MFA Rules not processed for user `0c675434f74c4f5098001c859f7963d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:34.185685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cee440-4b71-4b6e-9b4d-6a469d6bc50d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:34.186151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:34.201240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:34.202827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:34.203744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:34.204479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/users/6c1ff88486124ec2935e11633e600220` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:34.208132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c1ff88486124ec2935e11633e600220)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:34.214696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:34.427955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2910/5787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:34.429702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:34.456213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3d0da-9ab7-49df-90c4-2cc7b218ab21 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:34.487496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:34.491295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:34.491786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:34.493160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:34.494790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:34.498749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:34.522863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:34.529405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1ff88486124ec2935e11633e600220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:34.810151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1ff88486124ec2935e11633e600220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:34.836431 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2911/5788] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:34 2022] POST /identity/v3/projects => generated 379 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:34.838145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:34.843455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1ff88486124ec2935e11633e600220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:34.918399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1ff88486124ec2935e11633e600220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:34.920297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1ff88486124ec2935e11633e600220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:34.941443 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2878/5789] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:34 2022] DELETE /identity/v3/users/6c1ff88486124ec2935e11633e600220 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:34.945571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:34.947637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:35.062104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a12c1a-0aea-4040-b382-6f47fcbe7f81 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:35.183444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e426-8a4e-45a9-abcb-8692426d815a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:35.212686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:35.213869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:35.214381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:35.214968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:35.216462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:35.222219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:35.255696 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2879/5790] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:35.258530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:35.262142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:35.267218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:35.305933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:35.307446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:35.308121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:35.308774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] PATH_INFO: `/v3/projects/9bcdc54c4bbc4cc9b71372434a42ed3a/users/cb1dddc330684fceb1568606e64af6f8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:35.395407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bcdc54c4bbc4cc9b71372434a42ed3a, user_id=cb1dddc330684fceb1568606e64af6f8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:35.401627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:35.559519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68610e-2779-4b11-a466-25c98f0c0ca2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:35.570580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:35.571763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:35.572444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:35.573470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:35.578160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:35.625339 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2912/5791] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:34 2022] PUT /identity/v3/projects/9bcdc54c4bbc4cc9b71372434a42ed3a/users/cb1dddc330684fceb1568606e64af6f8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:35.625339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:35.646449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:35.838277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3271-9d3d-4f4e-a199-5b7e8c837719 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:35.852227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:35.854444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:35.860133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:35.860133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:35.860133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:35.870677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:35.896829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:35.904161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:35.936826 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2880/5792] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:35.938690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:35.942479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:36.059035 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2913/5793] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:35 2022] POST /identity/v3/users => generated 290 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:36.061359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:36.106466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6c3e2-05fc-4492-b688-33d783768168 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:36.124825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:36.126059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:36.126577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:36.127073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] PATH_INFO: `/v3/projects/b9078b95f97843d0b764e1dfd41e9904/users/c0e5094b22f040259d5304ad9bfdaa61/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:36.186426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda360d-0848-4582-a024-13a9048d3b0c service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:36.202231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9078b95f97843d0b764e1dfd41e9904, user_id=c0e5094b22f040259d5304ad9bfdaa61, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:36.215891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c875f-951f-4fc8-8e33-c64120e83b5f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:36.351255 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2914/5794] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:36 2022] PUT /identity/v3/projects/b9078b95f97843d0b764e1dfd41e9904/users/c0e5094b22f040259d5304ad9bfdaa61/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:36.354054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:36.354589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:36.355109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:36.443901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:36.443901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:36.444419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:36.448980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/14fb40b5a65a4077a0cc24be4f37346a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:36.469218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] MFA Rules not processed for user `cb1dddc330684fceb1568606e64af6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:36.469680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14fb40b5a65a4077a0cc24be4f37346a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:36.474554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:36.475004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:36.750205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2915/5795] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:36.773038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:36.851043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fb40b5a65a4077a0cc24be4f37346a', 'request_id': 'req-1ead931a-8c76-4448-8efe-d0d07e17fe36'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:36.869055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fb40b5a65a4077a0cc24be4f37346a', 'request_id': 'req-1ead931a-8c76-4448-8efe-d0d07e17fe36'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:36.885332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fb40b5a65a4077a0cc24be4f37346a', 'request_id': 'req-1ead931a-8c76-4448-8efe-d0d07e17fe36'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:37.035872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 14fb40b5a65a4077a0cc24be4f37346a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:37.040780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:37.049118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:37.060041 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2881/5796] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:35 2022] DELETE /identity/v3/projects/14fb40b5a65a4077a0cc24be4f37346a => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:37.064099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:37.068256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:37.091038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c3b05-95f8-43c5-8e6d-c978873a447b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:37.291043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:37.292170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:37.292981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:37.299626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:37.302049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:37.310044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:37.310405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:37.352084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2916/5797] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:37.358556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:37.358556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:37.395618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead931a-8c76-4448-8efe-d0d07e17fe36 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:37.423210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:37.424364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:37.424873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:37.425462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:37.427115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:37.430431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:37.454868 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2882/5798] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:37.456571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:37.459886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:37.639735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42354462-0a98-48a3-8b7a-021390d4805e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:37.651219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:37.651912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:37.652434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:37.653013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:37.658318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:37.696533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df1da-2b61-4607-8810-111123880c29 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:37.711549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:37.713428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:37.714113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:37.714782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:37.716799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:37.723697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:37.895381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:37.902370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:37.907029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2883/5799] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:37 2022] POST /identity/v3/projects => generated 348 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:37.909003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:37.923741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:37.929636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2917/5800] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:37.931758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:38.016242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33110-af02-47d2-beca-0237d32049fe service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:38.233262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6831-7b80-4d6d-9fd0-0f16e0effff8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:38.246111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:38.248772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:38.249895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:38.250593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:38.253216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:38.260715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:38.326499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:38.344019 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2884/5801] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:38.346180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:38.360805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:38.362233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:38.362664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:38.364224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] PATH_INFO: `/v3/projects/b9078b95f97843d0b764e1dfd41e9904/users/c0e5094b22f040259d5304ad9bfdaa61/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:38.378073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9078b95f97843d0b764e1dfd41e9904, user_id=c0e5094b22f040259d5304ad9bfdaa61, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:38.383050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:38.450692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:38.485239 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2918/5802] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:37 2022] PUT /identity/v3/projects/b9078b95f97843d0b764e1dfd41e9904/users/c0e5094b22f040259d5304ad9bfdaa61/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:38.489380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:38.493458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:38.683034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c114b-9284-43aa-8c7f-591dd3db3531 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:38.844809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d57ea-58be-4ce0-a316-594d618c58ad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:38.856647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:38.857729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:38.858214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:38.858675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] PATH_INFO: `/v3/users/cb1dddc330684fceb1568606e64af6f8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:38.861179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1dddc330684fceb1568606e64af6f8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:38.866874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:38.921656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:38.921656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:38.921656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:38.922257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:38.922257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:38.922257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:38.930722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:38.993217 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2885/5803] 10.222.0.78 () {58 vars in 1160 bytes} [Tue Oct 4 20:56:38 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 648 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:38.995094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:39.037273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9923cf0-f7e5-4c6c-b16c-45b8a2b3c243 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:39.047971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:39.049724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:39.051648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:39.052810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] PATH_INFO: `/v3/projects/24e08e2656f84d8abbe5401f88972b62/users/597e48c929454295ae83765b69e1b696/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:39.109831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e08e2656f84d8abbe5401f88972b62, user_id=597e48c929454295ae83765b69e1b696, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:39.118532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dbbde-fa68-4ab2-9d76-7e69c87de9ec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:39.273464 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2886/5804] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:38 2022] PUT /identity/v3/projects/24e08e2656f84d8abbe5401f88972b62/users/597e48c929454295ae83765b69e1b696/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:39.279602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8ea90-a4f9-41e0-832b-e1db662cff6b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:39.280367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8ea90-a4f9-41e0-832b-e1db662cff6b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:39.280557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8ea90-a4f9-41e0-832b-e1db662cff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:39.281468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1dddc330684fceb1568606e64af6f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:39.290273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1dddc330684fceb1568606e64af6f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:39.387958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c2c8ea90-a4f9-41e0-832b-e1db662cff6b None None] MFA Rules not processed for user `c0e5094b22f040259d5304ad9bfdaa61`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:39.393492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1dddc330684fceb1568606e64af6f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:39.407777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c2c8ea90-a4f9-41e0-832b-e1db662cff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:39.442491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1dddc330684fceb1568606e64af6f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:39.486335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1dddc330684fceb1568606e64af6f8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:39.513581 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2919/5805] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:38 2022] DELETE /identity/v3/users/cb1dddc330684fceb1568606e64af6f8 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:39.515179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:39.523747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:39.733313 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2887/5806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:39.737459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:39.739786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:39.740819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:39.848696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] MFA Rules not processed for user `597e48c929454295ae83765b69e1b696`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:39.869345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:39.880725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc396c-4d77-4cc6-a9f1-b840833aa548 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:39.924445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:39.927901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:39.928493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:39.929423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:39.931482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:39.935032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6cf2e-9db7-4f0a-b486-2e79431f7c95 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:40.047031 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2920/5807] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:56:39 2022] GET /identity/v3/domains => generated 829 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:40.055958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:40.056599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:40.057111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:40.129795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:40.138649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:40.145836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:40.202281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2888/5808] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:40.208533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:40.225855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:40.245374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:40.387321 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2921/5809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:40.388939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:40.423924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884afa14-949f-4ee0-856b-9f9bde70ccbb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:40.443566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:40.443566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:40.443566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:40.444358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/52a5cfcfd5f043fe87cfa66ff3cf04bc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:40.446410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_project(project_id=52a5cfcfd5f043fe87cfa66ff3cf04bc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:40.448749 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:56:40.448749 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:56:40.448749 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:56:40.450837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:40.463640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f1e1b-8362-407f-8f84-8f396ed7f86e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:40.471597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:40.473486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:40.474491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:40.475533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:40.477153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:40.478578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:40.480062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:40.747675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:40.749513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:40.760014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2922/5810] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:56:40 2022] PATCH /identity/v3/projects/52a5cfcfd5f043fe87cfa66ff3cf04bc => generated 362 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:40.765407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:40.768410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:40.770524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:40.774773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:40.806004 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2889/5811] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:40.807821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:40.812411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:40.880232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851498e8-03a1-4e23-8f81-2de73ee3d14b service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:41.105691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:41.107045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:41.107554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb656c3-c491-4845-aa2f-018ed3ac625c tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:41.107760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:41.108144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:41.112288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:41.120113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:41.121408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:41.121953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:41.122429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:41.124178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:41.130150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:41.139797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:41.143384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:41.169363 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2890/5812] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:41.171109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:41.173827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:41.357879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2923/5813] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:40 2022] POST /identity/v3/projects => generated 379 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:41.366384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6656f-eee8-452c-a037-451f880b6243 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:41.374673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:41.393384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:41.555975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:41.640770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:41.645494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:41.646231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:41.646747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:41.656511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:41.752947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:41.794154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:41.870120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7b2a-1413-4761-8156-ed8d0785d75f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:41.920265 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2891/5814] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:41.932083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:41.944106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:41.951273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:41.958800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:41.967880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/52a5cfcfd5f043fe87cfa66ff3cf04bc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:42.062932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52a5cfcfd5f043fe87cfa66ff3cf04bc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:42.067981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:42.161559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:42.196209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.249553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.314547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55857654-abc4-4f99-843e-082fe3c0889f service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:42.327031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:42.329271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:42.329876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:42.330379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:42.331901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:42.336097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:42.560086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.665748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2892/5815] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:41 2022] POST /identity/v3/users => generated 296 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:42.677584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:42.695658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.710304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4da7f-44cd-455f-a572-b8b367c289f6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:42.787376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.849669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 52a5cfcfd5f043fe87cfa66ff3cf04bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:42.849669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.855175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.903745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.910902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.912228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '52a5cfcfd5f043fe87cfa66ff3cf04bc', 'request_id': 'req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:42.968743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2924/5816] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:41 2022] DELETE /identity/v3/projects/52a5cfcfd5f043fe87cfa66ff3cf04bc => generated 0 bytes in 1596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:42.988130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:42.994769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:43.040256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:43.041399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:43.041873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:43.042359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:43.043692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:43.045543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:43.071756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:43.084813 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2893/5817] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:43.086059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:43.089245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:43.115659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48734d67-b782-4dc3-818d-2b41645941c0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:43.135690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:43.136415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:43.136695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:43.147414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] PATH_INFO: `/v3/projects/7633d705fd394188a6a8f46ffe10e475/users/54820d84f8fe47ccadb7369383b85079/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:43.235721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7633d705fd394188a6a8f46ffe10e475, user_id=54820d84f8fe47ccadb7369383b85079, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:43.248567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:43.339556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cc4dc-d13b-44b1-8a6a-4f4169244fee tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:43.353759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:43.355223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:43.356244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:43.357252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:43.360472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:43.376005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:43.672463 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2894/5818] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:43 2022] PUT /identity/v3/projects/7633d705fd394188a6a8f46ffe10e475/users/54820d84f8fe47ccadb7369383b85079/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:43.697144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:43.872107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454e88f-3d4b-4174-b7bf-ae125b577741 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:43.896283 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2925/5819] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:42 2022] POST /identity/v3/projects => generated 360 bytes in 910 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:43.918142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:44.040028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:44.041141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:44.042065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:44.043314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:44.045970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:44.052766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:44.110778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2895/5820] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:44.123205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:44.132198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:44.168954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd3ccd-6bf3-4973-833c-c75390f28aed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:44.196073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:44.197915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:44.198697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:44.201951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] PATH_INFO: `/v3/projects/9bcdc54c4bbc4cc9b71372434a42ed3a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:44.211518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bcdc54c4bbc4cc9b71372434a42ed3a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:44.223414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:44.232188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268160-2f0c-46b4-a335-85733e5dabe9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:44.244613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:44.254857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:44.255705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:44.260312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/106c254dfe4d418cb7df3f1dc29f11d7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:44.263309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=106c254dfe4d418cb7df3f1dc29f11d7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:44.269042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:44.274763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2926/5821] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:43 2022] GET /identity/v3/projects/106c254dfe4d418cb7df3f1dc29f11d7 => generated 360 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:44.276768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:44.327597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:44.335187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977f3a-a250-49fa-84de-1dd998484c2b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:44.351244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:44.352100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:44.352409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:44.352699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] PATH_INFO: `/v3/projects/7633d705fd394188a6a8f46ffe10e475/users/54820d84f8fe47ccadb7369383b85079/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:44.361670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:44.363600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7633d705fd394188a6a8f46ffe10e475, user_id=54820d84f8fe47ccadb7369383b85079, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:44.370414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:44.458583 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2927/5822] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:44 2022] PUT /identity/v3/projects/7633d705fd394188a6a8f46ffe10e475/users/54820d84f8fe47ccadb7369383b85079/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:44.460244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:44.547017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bcdc54c4bbc4cc9b71372434a42ed3a', 'request_id': 'req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:44.576455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bcdc54c4bbc4cc9b71372434a42ed3a', 'request_id': 'req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:44.616406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bcdc54c4bbc4cc9b71372434a42ed3a', 'request_id': 'req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:44.819200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44a288-c052-4244-8281-dc747c1f093c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:44.829550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] The token cache is being invalidate because project 9bcdc54c4bbc4cc9b71372434a42ed3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:44.836723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:44.837396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5b35efc0-29a1-4a99-9b93-b0aa105eaf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:44.845880 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2896/5823] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:44 2022] DELETE /identity/v3/projects/9bcdc54c4bbc4cc9b71372434a42ed3a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:44.861179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3169-33d7-47a2-8881-628f2a954572 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:44.861732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3169-33d7-47a2-8881-628f2a954572 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:44.865431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3169-33d7-47a2-8881-628f2a954572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:45.010408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fe9d3169-33d7-47a2-8881-628f2a954572 None None] MFA Rules not processed for user `54820d84f8fe47ccadb7369383b85079`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:45.012834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe9d3169-33d7-47a2-8881-628f2a954572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:45.105346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:45.135883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:45.142555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:45.142555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:45.142555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/106c254dfe4d418cb7df3f1dc29f11d7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:45.142555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=106c254dfe4d418cb7df3f1dc29f11d7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:45.146716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:45.360528 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2897/5824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:45.364000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:45.365596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:45.366670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:45.456188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:45.467227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:45.538000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106c254dfe4d418cb7df3f1dc29f11d7', 'request_id': 'req-b053eb7b-160d-4d7d-9c83-69e36ce33148'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:45.690672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106c254dfe4d418cb7df3f1dc29f11d7', 'request_id': 'req-b053eb7b-160d-4d7d-9c83-69e36ce33148'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:45.711266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106c254dfe4d418cb7df3f1dc29f11d7', 'request_id': 'req-b053eb7b-160d-4d7d-9c83-69e36ce33148'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:45.771972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 106c254dfe4d418cb7df3f1dc29f11d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:45.772942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:45.776224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:45.786478 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2928/5825] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:44 2022] DELETE /identity/v3/projects/106c254dfe4d418cb7df3f1dc29f11d7 => generated 0 bytes in 1327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:45.791573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:45.799349 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2898/5826] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:45.802600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:45.805906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:45.811096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:46.026716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:46.065499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc21f-1315-49d1-8acb-b9d985e8a4f8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:46.090563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:46.096592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:46.097150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:46.098560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:46.100901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:46.112537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc5621-eecf-4604-a2ab-9cca7d1fe9c8 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:46.221384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053eb7b-160d-4d7d-9c83-69e36ce33148 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:46.240533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:46.243528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:46.244012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:46.244521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:46.256479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:46.371215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2899/5827] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:45 2022] POST /identity/v3/projects => generated 360 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:46.381492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:46.383515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:46.384115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:46.492127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:46.495626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:46.515073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:46.520173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:46.586662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2929/5828] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:46.593143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:46.603236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:46.626693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:46.923637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:46.946059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31aad6-1cf2-4e27-a88e-285af7d9ec26 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:47.072180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2900/5829] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:47.072180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:47.306972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:47.325974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:47.327635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:47.328857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:47.337436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:47.435690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cbf8f-6296-4139-b8b3-4666030a6c86 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:47.448665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:47.450468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:47.450772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:47.451198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/e1e1704fa676483ba5124cb57ca6ef96` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:47.454583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=e1e1704fa676483ba5124cb57ca6ef96)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:47.463458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:47.470208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2901/5830] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:47 2022] GET /identity/v3/projects/e1e1704fa676483ba5124cb57ca6ef96 => generated 360 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:47.471918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:47.516346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a04ef-77e4-4842-8c07-941aaf2c2cd7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:47.538690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:47.539917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:47.540491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:47.540777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:47.549733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:47.550258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:47.556528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:47.612388 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2902/5831] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:47.617093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:47.630166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:47.633797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:47.662233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1215074-3f3b-4251-8263-47cb5eb2428d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:47.680833 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2930/5832] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 1093 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:47.685043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:47.690080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:47.695718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:47.697033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:47.697498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:47.697966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/e1e1704fa676483ba5124cb57ca6ef96` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:47.704875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e1e1704fa676483ba5124cb57ca6ef96)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:47.709361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:47.736851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dec4c6-91ce-4578-ae68-37576c228d6d service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:47.760191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:47.761342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:47.761849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:47.762360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:47.763545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:47.767307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:48.054435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e1704fa676483ba5124cb57ca6ef96', 'request_id': 'req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:48.054752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2931/5833] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:47 2022] POST /identity/v3/projects => generated 371 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:48.056410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:48.089061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e1704fa676483ba5124cb57ca6ef96', 'request_id': 'req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:48.125359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e1704fa676483ba5124cb57ca6ef96', 'request_id': 'req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:48.128564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:48.292057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87830e-310a-453e-82ee-6ebd6bb1d26b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:48.319665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:48.323499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:48.324298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:48.327855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:48.335606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:48.339652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:48.345898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project e1e1704fa676483ba5124cb57ca6ef96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:48.346685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:48.351618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:48.358431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2903/5834] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:47 2022] DELETE /identity/v3/projects/e1e1704fa676483ba5124cb57ca6ef96 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:48.374928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:48.385542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:48.625027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161968-e9dc-4cd1-bc2a-a5203f0b257e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:48.636762 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2932/5835] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:48 2022] POST /identity/v3/users => generated 286 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:48.638646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:48.641690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:48.696976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273fc9-9359-4c38-bc98-ceb3aa2433af admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:48.709210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:48.710853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:48.711888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:48.712348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:48.719920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:48.719920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:48.767602 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2933/5836] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:48.772047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:48.807893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18947f2-3fd4-424d-9c87-453469bbfa0f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:48.818676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:48.830036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:48.831639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:48.833756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:48.833756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:48.835556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:48.840562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:48.851572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:48.852955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:48.853579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:48.854185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:48.855564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:48.859188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:48.883247 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2934/5837] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:48.889692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:48.964238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7a63-682d-4883-8a04-17ed86397c2b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:48.986770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:48.989717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:48.990289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:48.991250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] PATH_INFO: `/v3/projects/1aaf8bf9335440398df3eee975345ab2/users/44502712a74b45b0a80365b8cdbad289/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:49.030710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaf8bf9335440398df3eee975345ab2, user_id=44502712a74b45b0a80365b8cdbad289, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:49.037545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:49.086456 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2904/5838] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:56:48 2022] POST /identity/v3/projects => generated 347 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:49.089323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:49.094361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:49.164117 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2935/5839] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:48 2022] PUT /identity/v3/projects/1aaf8bf9335440398df3eee975345ab2/users/44502712a74b45b0a80365b8cdbad289/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:49.170884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:49.469482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9c60-3e88-4b5e-b105-2c3e4e792729 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:49.482530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d89d9-07f0-43cb-9901-9932e528560e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:49.492711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:49.495015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:49.496424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:49.498304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/22fca08fb4a54735bac9409ee563350d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:49.504344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=22fca08fb4a54735bac9409ee563350d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:49.515942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c88bd-d28d-42b3-ae18-bdbf486615e7 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:49.524691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2936/5840] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:49 2022] GET /identity/v3/projects/22fca08fb4a54735bac9409ee563350d => generated 347 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:49.528128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3b73-952d-41bc-82a6-0c042f087121 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:49.529169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3b73-952d-41bc-82a6-0c042f087121 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:49.529971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3b73-952d-41bc-82a6-0c042f087121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:49.680747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f54a3b73-952d-41bc-82a6-0c042f087121 None None] MFA Rules not processed for user `44502712a74b45b0a80365b8cdbad289`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:49.688616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f54a3b73-952d-41bc-82a6-0c042f087121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:49.779115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:49.780294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:49.780751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:49.781218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] PATH_INFO: `/v3/users/309b57b5974a4688967a27539a423625` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:49.787532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309b57b5974a4688967a27539a423625)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:49.791900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:49.950346 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2937/5841] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:49.950346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:49.950346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:49.950346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:50.026521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] MFA Rules not processed for user `0c675434f74c4f5098001c859f7963d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:50.031463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:50.199062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309b57b5974a4688967a27539a423625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.207868 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2938/5842] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:50.207868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:50.234788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8607814-b0bb-41ab-9917-8524da751051 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:50.249376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:50.251909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:50.251909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:50.252836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/22fca08fb4a54735bac9409ee563350d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:50.255985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22fca08fb4a54735bac9409ee563350d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:50.259173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:50.347312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309b57b5974a4688967a27539a423625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.362490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:50.382669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309b57b5974a4688967a27539a423625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.449714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309b57b5974a4688967a27539a423625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.454021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309b57b5974a4688967a27539a423625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.489441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2905/5843] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:56:49 2022] DELETE /identity/v3/users/309b57b5974a4688967a27539a423625 => generated 0 bytes in 1401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:50.493834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:50.501790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:50.505476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fca08fb4a54735bac9409ee563350d', 'request_id': 'req-d02bba3d-cf91-419a-82d9-372be14c3217'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.646361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fca08fb4a54735bac9409ee563350d', 'request_id': 'req-d02bba3d-cf91-419a-82d9-372be14c3217'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.677970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fca08fb4a54735bac9409ee563350d', 'request_id': 'req-d02bba3d-cf91-419a-82d9-372be14c3217'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.732863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 22fca08fb4a54735bac9409ee563350d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:50.735123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.740191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:50.749832 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2939/5844] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:50 2022] DELETE /identity/v3/projects/22fca08fb4a54735bac9409ee563350d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:50.752184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:50.771570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:50.893802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92714d2d-1adf-4688-b4a4-1b7ecec40d85 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:50.912275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:50.913629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:50.914240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:50.914993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:50.917608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:50.922657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4665a-2bc0-4e9e-ba68-7ac12d86ce61 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:50.998303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bba3d-cf91-419a-82d9-372be14c3217 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:51.131740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2906/5845] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:51.135053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:51.135464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:51.136720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:51.137246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:51.137808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:51.139950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:51.141211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:51.141809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:51.159634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:51.207791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:51.207791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:51.534330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:51.537139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:51.572982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2907/5846] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:51.575001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:51.578019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:51.616093 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2940/5847] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 865 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:51.620266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:51.634944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:51.701564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9e470-9a75-42d1-a511-5c9c4e231f76 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:51.724490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:51.725682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:51.726212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:51.726730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:51.728028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:51.736509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:51.918771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4902c-c30c-4480-950b-e085b5b33150 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:51.930064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:51.931750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:51.932396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:51.933475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:51.935015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:51.939974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:51.975948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2941/5848] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:51 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:51.981198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:51.993609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:52.076616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2908/5849] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:56:51 2022] POST /identity/v3/domains => generated 273 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:52.078498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:52.175466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67baae6-06e8-4853-833a-da52a4c7dcb1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.259807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f67b-1433-4c8f-ae7f-16eccda70746 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.270051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.271280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.271924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.272581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.273943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.277365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:52.308418 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2909/5850] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:52.310615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:52.317902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.319706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.320534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.321316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.348464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.352063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:52.376833 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2942/5851] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:52.379579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:52.402983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf784-c0d5-45a7-aded-03896575a738 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.414246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.415836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.416421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.417130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] PATH_INFO: `/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156/users/0fbc235cacee4b2cac2b41ac9f132f0a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.455460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d986aa5cee4a7cb25ba5cb50127156, user_id=0fbc235cacee4b2cac2b41ac9f132f0a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.461373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:52.521302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bee781-9241-48c8-82a4-214eca7843ca admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.528173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.529186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.530941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.531304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.532095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.537303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:52.599732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:52.613660 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2943/5852] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:52 2022] PUT /identity/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156/users/0fbc235cacee4b2cac2b41ac9f132f0a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:52.618979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:52.746986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2910/5853] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:52 2022] POST /identity/v3/projects => generated 404 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:52.749838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:52.758763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33259-90f4-43fe-b11b-e03a8e9d1a2a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.906760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3f03-358d-401e-8c4e-d835c63d6340 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:52.918452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.921177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.934173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.937048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/a62556f24c9d4456a38f282e422bf345` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.942549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=a62556f24c9d4456a38f282e422bf345)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.952833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cab69-7973-4afe-84b8-a64d89569d35 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:52.963186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2911/5854] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:52 2022] GET /identity/v3/projects/a62556f24c9d4456a38f282e422bf345 => generated 404 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:52.963186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.964263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:52.965685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:52.966300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.967015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.968467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:52.973012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:52.974049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:52.977494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:53.012421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:56:53.023286 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 20:56:53.025534 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:56:53.028882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2912/5855] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 20:56:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:56:53.030428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:53.054721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2944/5856] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:56:53.054721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:53.086435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e00b9-dedd-4c19-8da1-5ab666945a05 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:53.099845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f9071-e730-4966-a29e-21dbcd331a15 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:53.103410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:53.106321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:53.106926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:53.107433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] PATH_INFO: `/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156/users/0fbc235cacee4b2cac2b41ac9f132f0a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:53.110676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:53.121216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:53.121216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:53.121216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/a62556f24c9d4456a38f282e422bf345` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:53.124462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d986aa5cee4a7cb25ba5cb50127156, user_id=0fbc235cacee4b2cac2b41ac9f132f0a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:53.127721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a62556f24c9d4456a38f282e422bf345)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:53.135060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:53.137544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b7ae2-fb8b-4efa-b935-daa7ecadc360 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:53.190057 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2945/5857] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:56:53 2022] PUT /identity/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156/users/0fbc235cacee4b2cac2b41ac9f132f0a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:53.213142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:53.213685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:53.214178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:53.310261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] MFA Rules not processed for user `0fbc235cacee4b2cac2b41ac9f132f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:53.317477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:53.483234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62556f24c9d4456a38f282e422bf345', 'request_id': 'req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:53.509083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62556f24c9d4456a38f282e422bf345', 'request_id': 'req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:53.538580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62556f24c9d4456a38f282e422bf345', 'request_id': 'req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:53.593611 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2946/5858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:56:53.593611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:53.608454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:53.760358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dbf79-8912-42a0-9b22-52c3e34335b5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:53.787034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:53.794276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project a62556f24c9d4456a38f282e422bf345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:53.794808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:53.802454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:53.805323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2913/5859] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:53 2022] DELETE /identity/v3/projects/a62556f24c9d4456a38f282e422bf345 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:53.812098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:53.821103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:53.969764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:53.972574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:53.973651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:53.974483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:53.980501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:54.043837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e4b-a0bd-47d0-bba0-d72c1bd6fe83 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:54.055439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:54.056677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:54.057176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:54.057669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] PATH_INFO: `/v3/projects/b8778b8dbc3e4e43b57b33f6114daabe` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:54.063359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8778b8dbc3e4e43b57b33f6114daabe)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:54.067911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:54.172829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:54.176764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:54.199768 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2947/5860] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:56:54.201545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:54.205037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:54.405422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8778b8dbc3e4e43b57b33f6114daabe', 'request_id': 'req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:54.417533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:54.446262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8778b8dbc3e4e43b57b33f6114daabe', 'request_id': 'req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:54.484569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651bd2-f736-43d6-bcd6-6d251b6ccf4a service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:54.494691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8778b8dbc3e4e43b57b33f6114daabe', 'request_id': 'req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:54.660797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] The token cache is being invalidate because project b8778b8dbc3e4e43b57b33f6114daabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:54.661781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:54.663575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:54.676450 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2914/5861] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:56:53 2022] DELETE /identity/v3/projects/b8778b8dbc3e4e43b57b33f6114daabe => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:54.678674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:54.682443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:54.794246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:54.795415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:54.809272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:54.809873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:54.817818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:54.817818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:55.001162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d49e-3515-4af1-9e40-6ac0fd366a4b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:55.021814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:55.023104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:55.023804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:55.024783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:55.029268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=40dfc24fe6b5424dbc7cb9b454f66781)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:55.033409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:55.037839 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2948/5862] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:54 2022] POST /identity/v3/services => generated 289 bytes in 837 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:55.041807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:55.051733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:55.182296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:55.185988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:55.402347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776616-a6d1-4657-b3e6-aaeed7c5e1c5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:55.415024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:55.419362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-22541c5e-7664-44d5-9c19-b5a18c314c74 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:55.429602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2915/5863] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:56:54 2022] PATCH /identity/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781 => generated 274 bytes in 752 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:55.432421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:55.432696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:55.433381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:55.485621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:55.488187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:55.574813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f91239ad1a4d498c01177d6fc4f3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df47136960274b22997db6ade5066ecf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:55.575996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:55.579471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:55.581776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:55.585530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:55.608709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:55.608709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:55.646890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2949/5864] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:55.648661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:55.654230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:55.767911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:55.771842 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2916/5865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:55.773545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:55.782800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:56.001106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688ad98-2ba2-4c1b-86b1-8536a9c6db60 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:56.045812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:56.046874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:56.047416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:56.047895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:56.049128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:56.051028 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:56:56.051028 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:56:56.051028 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:56:56.070468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:56.216268 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2950/5866] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 4 20:56:55 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 330 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:56.216268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:56.219534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:56.260594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89fa3-8b69-4252-b608-3ef083c82a20 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:56.308289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:56.314487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:56.315053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:56.322417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:56.328243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50803f-2d39-40af-9246-31b65713709a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:56.379157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f91239ad1a4d498c01177d6fc4f3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df47136960274b22997db6ade5066ecf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:56.380315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:56.380825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:56.381325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:56.382631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:56.397590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab29ff-e409-4834-9cb0-944ba5cba6f4 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:56.417548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=40dfc24fe6b5424dbc7cb9b454f66781)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:56.420915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:56.572376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:56.579843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:56.962784 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2951/5867] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:56 2022] POST /identity/v3/projects => generated 349 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:56.964743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:56.965103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:56.965454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:56.997493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:56:56.999966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:57.011589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:57.184730 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2952/5868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:56:57.190181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:57.199220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.240762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.268958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.469783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:57.473202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 40dfc24fe6b5424dbc7cb9b454f66781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:56:57.474113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.480178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.511663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02344-16d2-43bd-9c2e-991456973dcc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:57.516516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.536645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.541022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '40dfc24fe6b5424dbc7cb9b454f66781', 'request_id': 'req-f4150870-1b8f-4efd-a8e3-5e8d9270a867'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:56:57.587309 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2917/5869] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:56:55 2022] DELETE /identity/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781 => generated 0 bytes in 1806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:56:57.590764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:57.598826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:57.812154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:57.813898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:57.817552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:57.818436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:57.819944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:57.828730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:57.872304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150870-1b8f-4efd-a8e3-5e8d9270a867 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:57.912701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f91239ad1a4d498c01177d6fc4f3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df47136960274b22997db6ade5066ecf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:57.913828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:57.914356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:57.915980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:57.917754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:57.918614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:57.921891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:57.977573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2918/5870] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:57.982424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:57.992273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:58.020363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2953/5871] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:57 2022] POST /identity/v3/services => generated 288 bytes in 835 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:58.040548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:58.047166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:58.366058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee8dde-2496-48e2-bf8e-90b367272033 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:58.436501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:58.437726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:58.440673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:58.442964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:58.444914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:56:58.445457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:58.455642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:58.488764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:58.521993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2919/5872] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:58.523713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:58.537039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:56:58.539550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafd7e-03bc-46bc-9da8-5c6629aa9a6f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:58.565225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:58.566684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:58.567456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:58.572715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:58.574623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:58.578262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:58.697480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123788-134c-4caa-808f-29c7d93c5d93 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:58.749339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:58.752036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:58.754633 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2954/5873] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:56:58 2022] POST /identity/v3/domains => generated 277 bytes in 731 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:58.757914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:58.762746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:58.763352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:58.767444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:58.771097 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:56:58.771097 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:56:58.771097 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:56:58.783758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:58.977874 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2920/5874] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 4 20:56:58 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:58.979366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:59.051038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269996f3-7983-4c78-9558-6df575fec5dc tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:59.103752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:59.163475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c719-dd37-4e0e-9917-543c3090acd0 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:59.186058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:59.189231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:59.190112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:59.191466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:59.193011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:59.197419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:59.471663 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2955/5875] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:58 2022] POST /identity/v3/projects => generated 367 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:59.478767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:59.479945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:59.480546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:59.481211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:59.482834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:59.484960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:59.489012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:59.748891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009ca36-7c2a-46b3-a6a3-086bb1de9e52 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:56:59.770256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:56:59.773360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:56:59.774402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:56:59.775980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:56:59.777515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:56:59.779928 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:56:59.779928 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:56:59.779928 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:56:59.783251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:56:59.795376 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2921/5876] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:58 2022] POST /identity/v3/projects => generated 409 bytes in 817 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:56:59.797772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:56:59.822075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2956/5877] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:56:59 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 760 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:56:59.822075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:00.027727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:00.165769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:00.217427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d10547-10eb-470e-9f95-82527dbd3a89 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:00.260561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:00.261556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:00.262038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:00.262536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:00.263860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:00.281993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:00.284393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df769d-8334-4a27-83e0-fa923c0abee2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:00.532118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2922/5878] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:56:59 2022] POST /identity/v3/users => generated 284 bytes in 736 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:00.534855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:00.615743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:00.615743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:00.616320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:00.616320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:00.617579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:00.631009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:00.829573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:00.890798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493dab-ee13-4c46-bda4-e0563d9208bf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:00.923168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:00.923434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:00.924070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:00.924586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:00.930539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=f90cf6f178f144fbbb9ab4787c453917)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:00.934513 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:00.934513 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:00.934513 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:00.936333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:00.970508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2923/5879] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 4 20:57:00 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917 => generated 332 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:00.972119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:00.990570 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2957/5880] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:56:59 2022] POST /identity/v3/projects => generated 404 bytes in 1172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:00.996616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:01.022581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5671-d840-42f0-8582-392e6f5b1274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.123933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:01.185585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:01.186717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:01.187276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:01.187773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:01.189264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:01.193895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:01.240102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2924/5881] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:01.241878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:01.301029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c5eb-29c1-4060-b7b9-25aab614722a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.327415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:01.328964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:01.329582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:01.332982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:01.332982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=f90cf6f178f144fbbb9ab4787c453917)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:01.338619 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:01.338619 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:01.338619 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:01.344828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:01.374320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2958/5882] 10.222.0.78 () {58 vars in 1291 bytes} [Tue Oct 4 20:57:00 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917 => generated 0 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 04 20:57:01.377567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:01.405228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779fc47-345c-4c48-9846-f7b7a6cbdc18 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.415771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:01.417145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:01.417786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:01.418535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:01.420082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:01.423581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:01.442353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4352e-5116-4874-bbc2-30aada006273 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.449562 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2959/5883] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:01.452075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:01.452837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:01.454150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:01.454652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:01.455570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/578af7793b6e4eee9ab3795c299bad36` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:01.458291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=578af7793b6e4eee9ab3795c299bad36)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:01.464640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:01.485904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5604-2ff5-4b18-b216-03665ea8be83 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.500845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:01.502918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:01.504244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:01.505117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:01.506627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f90cf6f178f144fbbb9ab4787c453917)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:01.509175 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:01.509175 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:01.509175 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:01.512548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:01.767752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2960/5884] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:57:01 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:01.770716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:01.800694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8326f-b868-427a-a1d5-db4791f12d42 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:01.842089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578af7793b6e4eee9ab3795c299bad36', 'request_id': 'req-7ec6b7e7-91fa-4ef1-872f-31890b20147d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:01.860203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578af7793b6e4eee9ab3795c299bad36', 'request_id': 'req-7ec6b7e7-91fa-4ef1-872f-31890b20147d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:01.880982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578af7793b6e4eee9ab3795c299bad36', 'request_id': 'req-7ec6b7e7-91fa-4ef1-872f-31890b20147d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:02.012906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:02.015175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:02.016049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:02.016557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] PATH_INFO: `/v3/projects/b0c85d506fb94c18954be47609cba122/users/56e65852d5724eb2a27b7d436b22742c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:02.043503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 578af7793b6e4eee9ab3795c299bad36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:02.044539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:02.046112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:02.050567 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2925/5885] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:01 2022] DELETE /identity/v3/projects/578af7793b6e4eee9ab3795c299bad36 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:02.053231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:02.056886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c85d506fb94c18954be47609cba122, user_id=56e65852d5724eb2a27b7d436b22742c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:02.059053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:02.061130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:02.221928 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2961/5886] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:01 2022] PUT /identity/v3/projects/b0c85d506fb94c18954be47609cba122/users/56e65852d5724eb2a27b7d436b22742c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:02.225337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:02.241996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:02.341616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6b7e7-91fa-4ef1-872f-31890b20147d tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:02.557195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f075f-c54c-4e57-aa0b-753d66150abd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:02.593378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:02.611040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:02.615181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:02.627704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:02.642863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/8da3d1abcc144489b52173445fe599fa` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:02.652858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8da3d1abcc144489b52173445fe599fa)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:02.672237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:02.678905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:02.848246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:02.856351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:02.856849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:02.857549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:02.859089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:02.869466 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:02.869466 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:02.869466 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:02.874712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:02.892059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2926/5887] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 4 20:57:02 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 447 bytes in 840 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:02.894767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:02.899673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:03.043309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da3d1abcc144489b52173445fe599fa', 'request_id': 'req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.182785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5fe9d-db82-414a-ae89-d195937d5b2d tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:03.252598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da3d1abcc144489b52173445fe599fa', 'request_id': 'req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.283586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da3d1abcc144489b52173445fe599fa', 'request_id': 'req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.323954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 8da3d1abcc144489b52173445fe599fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:03.325081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.327035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bcd79ee4-b870-4d75-93db-dd3c4c4fa627 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.330122 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2962/5888] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:02 2022] DELETE /identity/v3/projects/8da3d1abcc144489b52173445fe599fa => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:03.332973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:03.333434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:03.334743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:03.389072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f91239ad1a4d498c01177d6fc4f3ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df47136960274b22997db6ade5066ecf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:03.393819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:03.394979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:03.394979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] PATH_INFO: `/v3/projects/8b744028bdc84c5cb5d54d5c44d0dbb7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:03.400296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b744028bdc84c5cb5d54d5c44d0dbb7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:03.404388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:03.426856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] MFA Rules not processed for user `56e65852d5724eb2a27b7d436b22742c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:03.429709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:03.626160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2963/5889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3511 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:03.628487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:03.634141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:03.728153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b744028bdc84c5cb5d54d5c44d0dbb7', 'request_id': 'req-0b800535-a5a9-4dbe-b45c-3745871f7ac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.752810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:03.776345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b744028bdc84c5cb5d54d5c44d0dbb7', 'request_id': 'req-0b800535-a5a9-4dbe-b45c-3745871f7ac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.807083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b744028bdc84c5cb5d54d5c44d0dbb7', 'request_id': 'req-0b800535-a5a9-4dbe-b45c-3745871f7ac9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:03.864808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a39f-fdb0-4ba5-b164-c635b4e354b5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:04.071491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] The token cache is being invalidate because project 8b744028bdc84c5cb5d54d5c44d0dbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:04.074089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.076207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.081850 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2927/5890] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:02 2022] DELETE /identity/v3/projects/8b744028bdc84c5cb5d54d5c44d0dbb7 => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:04.085033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:04.089116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:04.128576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:04.130245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:04.131052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:04.132001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:04.134979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f90cf6f178f144fbbb9ab4787c453917)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:04.140269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Could not find Endpoint Group: f90cf6f178f144fbbb9ab4787c453917.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: f90cf6f178f144fbbb9ab4787c453917. Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 04 20:57:04.170627 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: f90cf6f178f144fbbb9ab4787c453917. Oct 04 20:57:04.172766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:04.175552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2964/5891] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:57:03 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f90cf6f178f144fbbb9ab4787c453917 => generated 120 bytes in 548 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:04.184444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:04.194234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:04.282315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b800535-a5a9-4dbe-b45c-3745871f7ac9 tempest-RoutersAdminTest-1629167242 tempest-RoutersAdminTest-1629167242-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:04.292686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:04.295269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:04.296158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:04.296929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/052b55da19c546cb9d8e059484c4f391` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:04.300854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=052b55da19c546cb9d8e059484c4f391)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:04.304284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:04.370793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.372734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.522570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f2510-dcc9-48b3-91c9-423aebf99274 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:04.631461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.633231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:04.650153 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2928/5892] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:57:04 2022] PATCH /identity/v3/domains/052b55da19c546cb9d8e059484c4f391 => generated 278 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:04.656843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:04.658961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:04.747569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:04.748506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:04.753775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:04.754474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:04.762327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:04.974903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ff744-a428-4d72-a326-f8942eaab18a tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:04.979207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:05.004742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:05.005963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:05.006677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:05.007336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services/caec134271604fdea3620ac642307400` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:05.008411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_service(service_id=caec134271604fdea3620ac642307400)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:05.014885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:05.052644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:05.055601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:05.097764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2965/5893] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3511 bytes in 921 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:05.101123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:05.109995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:05.116883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:05.157002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1ee8-9a0d-41c3-a020-c529abceaefe service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:05.174111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:05.176775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:05.177401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:05.177897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:05.183879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:05.246176 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2929/5894] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:04 2022] DELETE /identity/v3/services/caec134271604fdea3620ac642307400 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:05.246176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:05.248374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:05.478921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:05.483797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:05.572537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7a5e-b79c-4ace-ae94-4a350be5759f tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:05.586794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2966/5895] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:05 2022] GET /identity/v3/auth/tokens => generated 3378 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:05.588416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:05.629539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:05.631067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:05.631067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:05.631705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/052b55da19c546cb9d8e059484c4f391` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:05.649215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b2ed2-77f5-493f-ba2f-4dc442f17ec3 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:05.678177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=052b55da19c546cb9d8e059484c4f391)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:05.685481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:05.712444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:05.713590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:05.714093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:05.714843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:05.716072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:05.719307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:05.791228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:05.805328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '052b55da19c546cb9d8e059484c4f391'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:05.876573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2967/5896] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:05 2022] POST /identity/v3/services => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:05.887380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:06.000739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297eac5-abb8-41c1-af64-b9a40be01039 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:06.021334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:06.022912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:06.028122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:06.029103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:06.033283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:06.039887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:06.152165 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2968/5897] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 4 20:57:05 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:06.158251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:06.183229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.212864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879f0a-329f-49f5-bbf1-986338da62a6 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:06.216269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.243100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.412507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 052b55da19c546cb9d8e059484c4f391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:06.412847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.418491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.453146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.466738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.470594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '052b55da19c546cb9d8e059484c4f391', 'request_id': 'req-6b029d56-bd83-4eff-92d9-7a4861f51d60'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:06.534703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2930/5898] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:05 2022] DELETE /identity/v3/domains/052b55da19c546cb9d8e059484c4f391 => generated 0 bytes in 1273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:06.534880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:06.534880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:06.534880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:06.535389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:06.535389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:06.549277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:06.554167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:06.570091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:06.727110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:06.735107 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2969/5899] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:06 2022] POST /identity/v3/services => generated 287 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:57:06.735607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:06.740077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:06.880906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083369-db45-4ce3-8d66-2f49a2b261b5 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:06.898240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:06.900245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:06.904350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:06.908341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7972a2e6d99c426a8c603476bead5eef` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:06.912874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=7972a2e6d99c426a8c603476bead5eef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:06.914685 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:06.914685 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:06.914685 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:06.916303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:06.921474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b029d56-bd83-4eff-92d9-7a4861f51d60 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:06.964025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:06.965020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:06.965445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:06.965947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:06.966799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:06.969325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.121637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2970/5900] 10.222.0.78 () {60 vars in 1313 bytes} [Tue Oct 4 20:57:06 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/7972a2e6d99c426a8c603476bead5eef => generated 335 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:07.126756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.172576 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2931/5901] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:06 2022] POST /identity/v3/projects => generated 377 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:07.174244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b1ed-b054-4519-af2a-29aceb0392d9 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.181128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.447288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838d5c-76a9-41e3-8709-57378ac9ce3b tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.457093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:07.458694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:07.458884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:07.459275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services/6f5a6d516126441181a7f66a99002f4e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:07.460472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6f5a6d516126441181a7f66a99002f4e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:07.463690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.471973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:07.473660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:07.473660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:07.474108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/17d232001b454f62bace03edf44ca0f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:07.484283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=17d232001b454f62bace03edf44ca0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:07.495407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.506305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2932/5902] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:07 2022] GET /identity/v3/projects/17d232001b454f62bace03edf44ca0f9 => generated 377 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:57:07.508272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.543398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f4219-9ce0-4b92-a8a7-98ae6f6044a1 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.553720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:07.555289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:07.555837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:07.556345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:07.557632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:07.561977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.627528 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2933/5903] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:57:07 2022] GET /identity/v3/projects => generated 7663 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:07.630083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.653353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207032e-20df-4603-bdc9-7f4aa726c348 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.669355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:07.670988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:07.671523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:07.672491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/17d232001b454f62bace03edf44ca0f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:07.678472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17d232001b454f62bace03edf44ca0f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:07.678769 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2971/5904] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:07 2022] DELETE /identity/v3/services/6f5a6d516126441181a7f66a99002f4e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:07.680620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.684347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.760386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec67cfe-7d7a-436d-beac-c086509cac2a tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.769468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:07.770697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:07.772266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:07.772780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7972a2e6d99c426a8c603476bead5eef` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:07.774037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=7972a2e6d99c426a8c603476bead5eef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:07.777096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:07.935884 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2972/5905] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:57:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/7972a2e6d99c426a8c603476bead5eef => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:07.944158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:07.945274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:07.969609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d232001b454f62bace03edf44ca0f9', 'request_id': 'req-3f010498-e73a-483a-99e9-a4cd18e33fcb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:07.988953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e832-a214-4202-a281-54d27be885a2 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:07.992805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d232001b454f62bace03edf44ca0f9', 'request_id': 'req-3f010498-e73a-483a-99e9-a4cd18e33fcb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:08.016436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d232001b454f62bace03edf44ca0f9', 'request_id': 'req-3f010498-e73a-483a-99e9-a4cd18e33fcb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:08.171789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 17d232001b454f62bace03edf44ca0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:08.172393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:08.174049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:08.177635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2934/5906] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:07 2022] DELETE /identity/v3/projects/17d232001b454f62bace03edf44ca0f9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:08.190128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:08.193770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:08.208583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:08.209892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:08.210476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:08.211034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services/e695d8f232c44683be5f9ed785458668` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:08.212478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e695d8f232c44683be5f9ed785458668)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:08.217581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:08.400146 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2973/5907] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:07 2022] DELETE /identity/v3/services/e695d8f232c44683be5f9ed785458668 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:08.412430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:08.421772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:08.477380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f010498-e73a-483a-99e9-a4cd18e33fcb tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:08.569968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463d52-9270-443e-8924-fb089e212d53 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:08.576270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:08.577924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:08.579314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:08.580082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:08.588378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:08.597528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:08.664504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:08.669247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:08.673354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:08.687713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/50094d3f925c4af482f16d56a499ef3e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:08.704288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=50094d3f925c4af482f16d56a499ef3e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:08.704288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:08.750225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:08.938173 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2974/5908] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 4 20:57:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/50094d3f925c4af482f16d56a499ef3e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:08.940208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:08.999939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2935/5909] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:57:08 2022] POST /identity/v3/projects => generated 347 bytes in 807 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:09.005223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:09.006990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777350a5-4bc4-4f6f-86f0-cbea8f9b5400 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:09.234976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fbc235cacee4b2cac2b41ac9f132f0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d986aa5cee4a7cb25ba5cb50127156', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:09.237294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:09.238373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:09.239258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] PATH_INFO: `/v3/services/df5ae65a101b484db995cf24fcf36972` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:09.242383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorizing `identity:delete_service(service_id=df5ae65a101b484db995cf24fcf36972)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:09.244040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:09.245579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cff68-9f47-428b-9869-7b92c10286cd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:09.257315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:09.259241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:09.260288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:09.260288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/20968d5ffae547e2a061b4f7ec34e72c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:09.263013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_project(project_id=20968d5ffae547e2a061b4f7ec34e72c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:09.265521 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:09.265521 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:09.265521 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:09.268184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:09.405067 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2975/5910] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:08 2022] DELETE /identity/v3/services/df5ae65a101b484db995cf24fcf36972 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:09.411614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:09.415732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:09.467425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2936/5911] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:57:09 2022] PATCH /identity/v3/projects/20968d5ffae547e2a061b4f7ec34e72c => generated 362 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:09.474864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:09.511450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd094e-ab83-425a-9429-c8497e41f036 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:09.546726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:09.568430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:09.570371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:09.571079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:09.571822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/20968d5ffae547e2a061b4f7ec34e72c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:09.613064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=20968d5ffae547e2a061b4f7ec34e72c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:09.619163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:09.627938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2937/5912] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:09 2022] GET /identity/v3/projects/20968d5ffae547e2a061b4f7ec34e72c => generated 349 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:09.632624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:09.686370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd723fa-e164-4a9a-a3e4-2976cb1523d5 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:09.723064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62bc84-81c2-4c3a-9f65-2165df734167 tempest-EndPointGroupsTest-1134908690 tempest-EndPointGroupsTest-1134908690-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:09.727121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:09.730080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:09.730947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:09.731854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/20968d5ffae547e2a061b4f7ec34e72c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:09.736223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20968d5ffae547e2a061b4f7ec34e72c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:09.740849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:09.741917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:09.743341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:09.746739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:09.747298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] PATH_INFO: `/v3/users/44502712a74b45b0a80365b8cdbad289` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:09.751362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44502712a74b45b0a80365b8cdbad289)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:09.755804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:10.241191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20968d5ffae547e2a061b4f7ec34e72c', 'request_id': 'req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.258728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44502712a74b45b0a80365b8cdbad289'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.261743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44502712a74b45b0a80365b8cdbad289'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.279012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20968d5ffae547e2a061b4f7ec34e72c', 'request_id': 'req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.315181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20968d5ffae547e2a061b4f7ec34e72c', 'request_id': 'req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.404513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44502712a74b45b0a80365b8cdbad289'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.437285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44502712a74b45b0a80365b8cdbad289'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.458830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a331bddb-508c-41dd-a9be-fa652235682e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44502712a74b45b0a80365b8cdbad289'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.488399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2976/5913] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:09 2022] DELETE /identity/v3/users/44502712a74b45b0a80365b8cdbad289 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:10.505326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:10.506640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:10.507812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:10.536647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 20968d5ffae547e2a061b4f7ec34e72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:10.540312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.551986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:10.566701 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2938/5914] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:09 2022] DELETE /identity/v3/projects/20968d5ffae547e2a061b4f7ec34e72c => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:10.568667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:10.580570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:10.615967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:10.618276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:10.890411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a20ca3-d5b4-41ac-b0ce-e85b92b92554 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:10.970795 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2977/5915] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:57:10.974424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:11.079837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:11.081272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:11.085562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:11.086246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:11.087604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:11.100108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:11.236217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:11.239192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:11.286109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:11.310891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2939/5916] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:10 2022] POST /identity/v3/projects => generated 357 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:11.317915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:11.522729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960569-f55a-4702-9acc-7ce4343d4810 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:11.621022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab0306-cd6a-40d2-a9bc-298eef0bb4d9 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:11.637083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:11.638536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:11.639235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:11.639902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/0da095cfe8bf4734b395cc52a9981d52` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:11.643437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_project(project_id=0da095cfe8bf4734b395cc52a9981d52)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:11.648454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:11.723336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:11.725977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:11.726460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:11.727441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:11.939097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:11.942732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:11.970721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:11.972901 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2978/5917] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:57:12.000446 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2940/5918] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:57:11 2022] PATCH /identity/v3/projects/0da095cfe8bf4734b395cc52a9981d52 => generated 369 bytes in 684 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:57:12.003995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:12.024945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6d06-c7ab-4b19-9ed7-8d1b50098cef service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:12.033787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:12.035519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:12.036018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:12.036507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/0da095cfe8bf4734b395cc52a9981d52` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:12.061463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=0da095cfe8bf4734b395cc52a9981d52)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:12.067022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:12.075992 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2979/5919] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:12 2022] GET /identity/v3/projects/0da095cfe8bf4734b395cc52a9981d52 => generated 356 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:12.078117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:12.102902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b9d0-83f4-4604-a84c-e9a009f21763 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:12.114814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:12.115898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:12.116415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:12.117148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/0da095cfe8bf4734b395cc52a9981d52` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:12.120078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0da095cfe8bf4734b395cc52a9981d52)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:12.125111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:12.270393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:12.275965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:12.351263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604f3-e1d3-474e-ac1d-8ce7bb78bb3e tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:12.387620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da095cfe8bf4734b395cc52a9981d52', 'request_id': 'req-6c0918eb-fc85-4779-86ab-c2e0f86be766'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.423281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da095cfe8bf4734b395cc52a9981d52', 'request_id': 'req-6c0918eb-fc85-4779-86ab-c2e0f86be766'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.453374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da095cfe8bf4734b395cc52a9981d52', 'request_id': 'req-6c0918eb-fc85-4779-86ab-c2e0f86be766'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.536895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:12.536895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:12.536895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:12.536895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] PATH_INFO: `/v3/users/0c675434f74c4f5098001c859f7963d6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:12.541161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c675434f74c4f5098001c859f7963d6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:12.548647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:12.609011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project 0da095cfe8bf4734b395cc52a9981d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:12.609491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.611053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.615882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2941/5920] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:12 2022] DELETE /identity/v3/projects/0da095cfe8bf4734b395cc52a9981d52 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:12.624060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:12.629728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:12.854815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0918eb-fc85-4779-86ab-c2e0f86be766 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:12.865610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:12.867030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:12.868429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:12.868429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:12.870347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:12.875851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:12.958619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c675434f74c4f5098001c859f7963d6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.961849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c675434f74c4f5098001c859f7963d6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:12.967108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:13.066705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2942/5921] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:12 2022] POST /identity/v3/projects => generated 353 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:13.074682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:13.176242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c675434f74c4f5098001c859f7963d6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:13.224749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c675434f74c4f5098001c859f7963d6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:13.269882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c675434f74c4f5098001c859f7963d6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:13.278430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc5779-7940-4ece-8615-c3628634f9c4 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:13.289519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:13.290930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:13.291458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:13.291949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:13.294439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2980/5922] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:12 2022] DELETE /identity/v3/users/0c675434f74c4f5098001c859f7963d6 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:13.295230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:update_project(project_id=fd490d1ae4604c25acb4d6b38d6d1a5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:13.305345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:13.508042 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2943/5923] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 4 20:57:13 2022] PATCH /identity/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c => generated 368 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:57:13.510088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:13.512441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:13.713702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ab454-051e-4ff5-bda1-7d20b2c60c59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:13.724818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:13.726230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:13.727622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:13.727991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:13.755726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:get_project(project_id=fd490d1ae4604c25acb4d6b38d6d1a5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:13.760775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:13.770319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2981/5924] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:13 2022] GET /identity/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c => generated 355 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:13.771671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:13.794752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f1594-fd99-4fea-919a-199e5ccfb19f tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:13.805006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:13.805521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:13.806443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:13.807192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:13.807782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:13.810798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd490d1ae4604c25acb4d6b38d6d1a5c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:13.815545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:14.053093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd490d1ae4604c25acb4d6b38d6d1a5c', 'request_id': 'req-7c60e7aa-94ef-4398-80f0-a6e4221575e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:14.074503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd490d1ae4604c25acb4d6b38d6d1a5c', 'request_id': 'req-7c60e7aa-94ef-4398-80f0-a6e4221575e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:14.093852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:14.097975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd490d1ae4604c25acb4d6b38d6d1a5c', 'request_id': 'req-7c60e7aa-94ef-4398-80f0-a6e4221575e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:14.264443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] The token cache is being invalidate because project fd490d1ae4604c25acb4d6b38d6d1a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:14.264443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:14.264443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:14.269536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2944/5925] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:13 2022] DELETE /identity/v3/projects/fd490d1ae4604c25acb4d6b38d6d1a5c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:14.276471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:14.279423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:14.315282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c633f-4304-43de-b30a-1a19c4610cfa tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:14.517719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:14.519547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:14.520408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:14.521188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/052b55da19c546cb9d8e059484c4f391` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:14.539495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Could not find domain: 052b55da19c546cb9d8e059484c4f391.: keystone.exception.DomainNotFound: Could not find domain: 052b55da19c546cb9d8e059484c4f391. Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 052b55da19c546cb9d8e059484c4f391. Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:14.553565 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:57:14.556401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 052b55da19c546cb9d8e059484c4f391. Oct 04 20:57:14.559956 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:14.570751 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2982/5926] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:57:14 2022] PATCH /identity/v3/domains/052b55da19c546cb9d8e059484c4f391 => generated 112 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:14.570951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:14.590806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e7aa-94ef-4398-80f0-a6e4221575e3 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:14.612517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6df1b2d3c6c4371a9e2694fabc5e105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c728b817e0e48fbbe9bb48887270faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:14.614504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:14.615094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:14.615969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] PATH_INFO: `/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:14.633388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Could not find domain: 40dfc24fe6b5424dbc7cb9b454f66781.: keystone.exception.DomainNotFound: Could not find domain: 40dfc24fe6b5424dbc7cb9b454f66781. Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 40dfc24fe6b5424dbc7cb9b454f66781. Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:14.645061 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:57:14.657922 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 40dfc24fe6b5424dbc7cb9b454f66781. Oct 04 20:57:14.660614 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:14.664153 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2945/5927] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:57:14 2022] PATCH /identity/v3/domains/40dfc24fe6b5424dbc7cb9b454f66781 => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:14.665448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:14.670257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:14.673421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:14.699696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:14.704181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:14.925508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33535-88c8-4ce1-b357-faeae0272630 tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:14.957492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:14.958713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:14.959373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:14.960343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] PATH_INFO: `/v3/projects/423269a2642a45b29d4f92a0995e6c3c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:14.963037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423269a2642a45b29d4f92a0995e6c3c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:14.969190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:14.986545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a58c5-339a-423d-aef5-ae07638bb9dd tempest-ProjectsTestJSON-1747401756 tempest-ProjectsTestJSON-1747401756-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:14.998554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:15.000918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:15.002028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:15.002854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] PATH_INFO: `/v3/users/923b522611304699b90c28f76fbf4f6c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:15.006104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923b522611304699b90c28f76fbf4f6c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:15.011661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:15.374734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423269a2642a45b29d4f92a0995e6c3c', 'request_id': 'req-f7120669-c3ae-413a-abd0-b410d64be963'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.375270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923b522611304699b90c28f76fbf4f6c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.376871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923b522611304699b90c28f76fbf4f6c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.429029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423269a2642a45b29d4f92a0995e6c3c', 'request_id': 'req-f7120669-c3ae-413a-abd0-b410d64be963'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.484886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423269a2642a45b29d4f92a0995e6c3c', 'request_id': 'req-f7120669-c3ae-413a-abd0-b410d64be963'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.547592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923b522611304699b90c28f76fbf4f6c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.615338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923b522611304699b90c28f76fbf4f6c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.645973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923b522611304699b90c28f76fbf4f6c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.688275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] The token cache is being invalidate because project 423269a2642a45b29d4f92a0995e6c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:15.693367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.694729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f7120669-c3ae-413a-abd0-b410d64be963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:15.695630 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2983/5928] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:14 2022] DELETE /identity/v3/users/923b522611304699b90c28f76fbf4f6c => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:15.707216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:15.710154 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2946/5929] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:14 2022] DELETE /identity/v3/projects/423269a2642a45b29d4f92a0995e6c3c => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:15.713782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bcc4-eb4e-4000-9e78-2082f64838b9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:15.715260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bcc4-eb4e-4000-9e78-2082f64838b9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:15.715260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bcc4-eb4e-4000-9e78-2082f64838b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:15.718138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:15.785280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3957bcc4-eb4e-4000-9e78-2082f64838b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:15.788191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3957bcc4-eb4e-4000-9e78-2082f64838b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.023860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972328b2-c078-4856-a844-d1dec6762f62 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:16.025244 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2947/5930] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:16.027754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:16.028208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:16.028761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:16.040946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:16.042901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:16.044027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:16.044955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] PATH_INFO: `/v3/projects/1aaf8bf9335440398df3eee975345ab2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:16.051798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aaf8bf9335440398df3eee975345ab2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:16.057424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:16.070568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:16.073540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.090993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2948/5931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:16.093507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:16.104887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.287688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e8540-5351-4fff-9282-84ebe12f9e55 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:16.310951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aaf8bf9335440398df3eee975345ab2', 'request_id': 'req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:16.465135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aaf8bf9335440398df3eee975345ab2', 'request_id': 'req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:16.475736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:16.485487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:16.486540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:16.489906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:16.500653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aaf8bf9335440398df3eee975345ab2', 'request_id': 'req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:16.545414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:16.584784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] The token cache is being invalidate because project 1aaf8bf9335440398df3eee975345ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:16.590062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:16.592733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f94f5b02-de78-4709-8d2e-f89e3d6fdbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:16.597924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2984/5932] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:15 2022] DELETE /identity/v3/projects/1aaf8bf9335440398df3eee975345ab2 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:16.601248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:16.602387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:16.603092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:16.670064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:16.673334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.812946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:16.889491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:16.900861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:16.935543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2985/5933] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:16.936298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2949/5934] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:16.938245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:16.943618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.948414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:16.954857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:16.976508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5edcfd-6c7b-4f43-9267-41573fae9007 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:16.991501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:16.993338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:16.994683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:16.995988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] PATH_INFO: `/v3/users/597e48c929454295ae83765b69e1b696` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:16.998988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=597e48c929454295ae83765b69e1b696)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:17.005353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:17.006072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714cd7-060e-429f-8c7c-9583de0cba97 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:17.021668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:17.028547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:17.028547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:17.028547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] PATH_INFO: `/v3/users/0fbc235cacee4b2cac2b41ac9f132f0a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:17.029490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbc235cacee4b2cac2b41ac9f132f0a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:17.033359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:17.415720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbc235cacee4b2cac2b41ac9f132f0a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.417624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbc235cacee4b2cac2b41ac9f132f0a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.483416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597e48c929454295ae83765b69e1b696'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.543879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:17.551647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbc235cacee4b2cac2b41ac9f132f0a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.578632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbc235cacee4b2cac2b41ac9f132f0a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.594479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbc235cacee4b2cac2b41ac9f132f0a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.630152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2986/5935] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:16 2022] DELETE /identity/v3/users/0fbc235cacee4b2cac2b41ac9f132f0a => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:17.637803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:17.642040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:17.754469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597e48c929454295ae83765b69e1b696'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.780602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597e48c929454295ae83765b69e1b696'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.872828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597e48c929454295ae83765b69e1b696'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.875757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-242bf5b7-773e-419c-949a-a9050fd6a4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597e48c929454295ae83765b69e1b696'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:17.911273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2950/5936] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:16 2022] DELETE /identity/v3/users/597e48c929454295ae83765b69e1b696 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:17.918809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:17.920666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:17.921203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:17.971926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e3c38-99d8-45e7-82f6-0f2107ceede5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:18.016166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:18.021079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:18.181671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:18.183108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:18.185065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:18.186403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:18.187250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:18.189111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:18.193757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:18.269049 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2987/5937] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 636 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:18.272698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:18.287074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:18.326883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2951/5938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:18.337191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b203c-5680-46e4-b8d7-a52c44446a32 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:18.352630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:18.354092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:18.354841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:18.355604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:18.357135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:18.364763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:18.480163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:18.484919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:18.690603 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2988/5939] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:18 2022] POST /identity/v3/projects => generated 403 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:18.696454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:18.706523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:18.762175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:18.772767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f8577-8b96-4b4a-bca1-2c2bd56905f1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.046123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:19.047336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.047858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.048348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:19.194425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b462f-cdfe-4dbd-9c7e-9a980dced653 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.217592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:19.219300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.219759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.220271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] PATH_INFO: `/v3/users/826d1d7a5a034dca9e6e44322964a9f7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:19.223768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826d1d7a5a034dca9e6e44322964a9f7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:19.229735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:19.343509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:19.358756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:19.399655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2952/5940] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 921 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:19.401320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:19.430011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d1dc1-0fa0-4aa1-8146-a247c9818a39 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.468875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:19.472110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.476441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.478674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:19.488568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:19.511050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:19.652413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:19.678402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826d1d7a5a034dca9e6e44322964a9f7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:19.690876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826d1d7a5a034dca9e6e44322964a9f7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:19.705855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2953/5941] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:19 2022] POST /identity/v3/users => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:19.716938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:19.745790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ba88-417f-447d-89d3-814e6a144b82 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.758257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:19.759901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.760867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.761914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:19.763839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:19.771292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:19.807910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2954/5942] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:19.810208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826d1d7a5a034dca9e6e44322964a9f7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:19.810753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:19.848503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241cc2b-e5f9-4b94-943e-47f8b07291db admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.861557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:19.863452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.864570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.865346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:19.867701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:19.872954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:19.873319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826d1d7a5a034dca9e6e44322964a9f7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:19.909675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2955/5943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:19.917112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:19.929603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-18eb3bff-4282-4485-9575-d3150dfdca72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826d1d7a5a034dca9e6e44322964a9f7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:19.965016 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2989/5944] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:18 2022] DELETE /identity/v3/users/826d1d7a5a034dca9e6e44322964a9f7 => generated 0 bytes in 1270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:19.969969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531677-fa85-4c77-8d5a-e73b40802079 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:19.972748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:19.980289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:19.980289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:20.070479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:20.076766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:20.140857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:20.146598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:20.147608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:20.148610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] PATH_INFO: `/v3/projects/1166594569c141c3b487333045126f23/users/2de56f4a214c43488be940287d51670b/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:20.234365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1166594569c141c3b487333045126f23, user_id=2de56f4a214c43488be940287d51670b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:20.239993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca708-fa4c-444e-a518-0cc0000256a5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:20.323104 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2990/5945] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:57:20.395631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:20.403012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:20.521039 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2956/5946] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:19 2022] PUT /identity/v3/projects/1166594569c141c3b487333045126f23/users/2de56f4a214c43488be940287d51670b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:20.535568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:20.536090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:20.536579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:20.673936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] MFA Rules not processed for user `2de56f4a214c43488be940287d51670b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:20.677789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:20.760849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b0c9-9a3c-456e-846a-10d119f5bbdb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:20.938193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:20.989157 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2957/5947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:21.038353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:21.044675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:21.076562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:21.090603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:21.102103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:21.102103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:21.312462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:21.320939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5348dd-605e-415d-a6c1-2b83eee67926 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:21.360044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7152dd-610f-45ba-b7d5-c0a0dacb276f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:21.377743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2991/5948] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 981 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:57:21.386231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:21.388116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:21.389551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:21.390539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] PATH_INFO: `/v3/users/2de56f4a214c43488be940287d51670b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:21.393303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de56f4a214c43488be940287d51670b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:21.398471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:21.765709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:21.803350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de56f4a214c43488be940287d51670b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:21.931631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de56f4a214c43488be940287d51670b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:21.977917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de56f4a214c43488be940287d51670b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:22.040697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de56f4a214c43488be940287d51670b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:22.043592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de56f4a214c43488be940287d51670b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:22.069283 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2958/5949] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:21 2022] DELETE /identity/v3/users/2de56f4a214c43488be940287d51670b => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:22.069910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:22.070432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:22.070949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:22.142122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:22.146154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:22.377574 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2992/5950] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:57:22.525344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:22.528336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:22.663532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:22.668661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:22.745489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8df10-2246-4733-86c9-ddb25d573cd2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:22.749505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702a4c-5e50-4dc2-aa81-f160824bbce3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:22.759865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:22.761644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:22.762432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:22.763983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] PATH_INFO: `/v3/projects/57c85c13cfbf49bca8d9da7a6dd46000` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:22.767366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c85c13cfbf49bca8d9da7a6dd46000)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:22.778766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:22.779042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:22.779042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:22.779042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:22.779042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:22.832955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:22.842777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:22.925902 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2959/5951] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:22.931833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:22.937410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:22.986005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff712d1-8cf7-43e5-8fbf-f007c3325928 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:23.030227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c85c13cfbf49bca8d9da7a6dd46000', 'request_id': 'req-a4a48f85-18d9-4c71-8ac0-72775995f953'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.187337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c85c13cfbf49bca8d9da7a6dd46000', 'request_id': 'req-a4a48f85-18d9-4c71-8ac0-72775995f953'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.204300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c85c13cfbf49bca8d9da7a6dd46000', 'request_id': 'req-a4a48f85-18d9-4c71-8ac0-72775995f953'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.221604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:23.222607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:23.227622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:23.228836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] PATH_INFO: `/v3/projects/17122924c6f94ac493028e47a320efb2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:23.231579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=17122924c6f94ac493028e47a320efb2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:23.240139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:23.250161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] The token cache is being invalidate because project 57c85c13cfbf49bca8d9da7a6dd46000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:23.250700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.256670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.267716 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2993/5952] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:22 2022] DELETE /identity/v3/projects/57c85c13cfbf49bca8d9da7a6dd46000 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:23.268024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:23.273712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:23.329265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48f85-18d9-4c71-8ac0-72775995f953 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:23.350272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:23.351795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:23.353484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:23.356485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] PATH_INFO: `/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:23.363863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d986aa5cee4a7cb25ba5cb50127156)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:23.368286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:23.531474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17122924c6f94ac493028e47a320efb2', 'request_id': 'req-84cd8117-de42-439e-be36-ad55ed1c0fba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.556677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17122924c6f94ac493028e47a320efb2', 'request_id': 'req-84cd8117-de42-439e-be36-ad55ed1c0fba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.574347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17122924c6f94ac493028e47a320efb2', 'request_id': 'req-84cd8117-de42-439e-be36-ad55ed1c0fba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.683111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d986aa5cee4a7cb25ba5cb50127156', 'request_id': 'req-69f311b0-455f-4198-860e-bb70c7ff7ee7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.760073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:23.795861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] The token cache is being invalidate because project 17122924c6f94ac493028e47a320efb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:23.797746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.800016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.808531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2960/5953] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:22 2022] DELETE /identity/v3/projects/17122924c6f94ac493028e47a320efb2 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:23.808531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:23.809585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:23.861462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d986aa5cee4a7cb25ba5cb50127156', 'request_id': 'req-69f311b0-455f-4198-860e-bb70c7ff7ee7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.884372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d986aa5cee4a7cb25ba5cb50127156', 'request_id': 'req-69f311b0-455f-4198-860e-bb70c7ff7ee7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.917799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] The token cache is being invalidate because project c4d986aa5cee4a7cb25ba5cb50127156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:23.918282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.920811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:23.932872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2994/5954] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:23 2022] DELETE /identity/v3/projects/c4d986aa5cee4a7cb25ba5cb50127156 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:23.932872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:23.935552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:24.045398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8117-de42-439e-be36-ad55ed1c0fba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:24.159654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:24.214400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f311b0-455f-4198-860e-bb70c7ff7ee7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:24.236909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:24.238455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:24.239873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:24.240517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] PATH_INFO: `/v3/projects/24e08e2656f84d8abbe5401f88972b62` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:24.243843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e08e2656f84d8abbe5401f88972b62)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:24.248888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:24.336763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:24.338001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:24.338511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:24.339035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] PATH_INFO: `/v3/users/c0e5094b22f040259d5304ad9bfdaa61` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:24.349264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e5094b22f040259d5304ad9bfdaa61)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:24.353353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:24.543975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e08e2656f84d8abbe5401f88972b62', 'request_id': 'req-37ef1a12-b669-4a97-823c-ef9c49395cff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.706915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e08e2656f84d8abbe5401f88972b62', 'request_id': 'req-37ef1a12-b669-4a97-823c-ef9c49395cff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.722654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e08e2656f84d8abbe5401f88972b62', 'request_id': 'req-37ef1a12-b669-4a97-823c-ef9c49395cff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.776356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] The token cache is being invalidate because project 24e08e2656f84d8abbe5401f88972b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:24.783531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.786516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.797184 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2995/5955] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:23 2022] DELETE /identity/v3/projects/24e08e2656f84d8abbe5401f88972b62 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:24.799986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:24.809951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:24.824533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e5094b22f040259d5304ad9bfdaa61'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.943250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e5094b22f040259d5304ad9bfdaa61'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:24.972988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e5094b22f040259d5304ad9bfdaa61'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.017748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e5094b22f040259d5304ad9bfdaa61'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.019530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-765f3160-3491-4005-8e64-121d95205297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e5094b22f040259d5304ad9bfdaa61'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.044129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2961/5956] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:23 2022] DELETE /identity/v3/users/c0e5094b22f040259d5304ad9bfdaa61 => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:25.045830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:25.046709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:25.046893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:25.110656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef1a12-b669-4a97-823c-ef9c49395cff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:25.115804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:25.119636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:25.249160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:25.250432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:25.250994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:25.251601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] PATH_INFO: `/v3/users/c6df1b2d3c6c4371a9e2694fabc5e105` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:25.254268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6df1b2d3c6c4371a9e2694fabc5e105)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:25.258124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:25.357769 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2962/5957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:25.359512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:25.362150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:25.395081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff3582-cf7b-4789-b343-437534e2efc2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:25.468709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:25.472638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:25.478074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:25.478863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] PATH_INFO: `/v3/users/54820d84f8fe47ccadb7369383b85079` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:25.482516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54820d84f8fe47ccadb7369383b85079)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:25.501650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:25.624168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6df1b2d3c6c4371a9e2694fabc5e105'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.634635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6df1b2d3c6c4371a9e2694fabc5e105'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.760876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6df1b2d3c6c4371a9e2694fabc5e105'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.811445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6df1b2d3c6c4371a9e2694fabc5e105'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.836220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6df1b2d3c6c4371a9e2694fabc5e105'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.846520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54820d84f8fe47ccadb7369383b85079'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.862490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2996/5958] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:24 2022] DELETE /identity/v3/users/c6df1b2d3c6c4371a9e2694fabc5e105 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:25.865264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:25.868314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:25.953602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54820d84f8fe47ccadb7369383b85079'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:25.977718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54820d84f8fe47ccadb7369383b85079'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.028622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54820d84f8fe47ccadb7369383b85079'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.031812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-807b2fd4-df09-4ec8-a4f9-ad5f8bb3d903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54820d84f8fe47ccadb7369383b85079'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.049066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2963/5959] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:25 2022] DELETE /identity/v3/users/54820d84f8fe47ccadb7369383b85079 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:26.057351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:26.060951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:26.063056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:26.115241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cdcc2-58cf-4a17-9395-3119dad0cc00 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:26.142465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:26.148747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:26.229208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:26.288902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:26.290032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:26.290650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:26.291278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] PATH_INFO: `/v3/projects/1166594569c141c3b487333045126f23` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:26.294311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1166594569c141c3b487333045126f23)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:26.299268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:26.338648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:26.339582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2964/5960] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:26.344663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:26.377144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284f55-348f-48b8-a0d5-c7e1664bdd2a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:26.387604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:26.389310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:26.389944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:26.390498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:26.391721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:26.392296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:26.396496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:26.426843 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2965/5961] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:26.428807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:26.432509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:26.463097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442585-2adf-46a8-a1b6-e501498f039f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:26.471018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:26.471831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:26.472103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:26.473189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] PATH_INFO: `/v3/projects/b9078b95f97843d0b764e1dfd41e9904` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:26.474710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9078b95f97843d0b764e1dfd41e9904)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:26.476979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:26.572505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1166594569c141c3b487333045126f23', 'request_id': 'req-dce55523-ef9d-4de4-9ad5-821ef41cde58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.657807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1166594569c141c3b487333045126f23', 'request_id': 'req-dce55523-ef9d-4de4-9ad5-821ef41cde58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.690759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1166594569c141c3b487333045126f23', 'request_id': 'req-dce55523-ef9d-4de4-9ad5-821ef41cde58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.710990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9078b95f97843d0b764e1dfd41e9904', 'request_id': 'req-ad2777cb-025d-4d49-b8fa-3e5568c3211d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.726147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] The token cache is being invalidate because project 1166594569c141c3b487333045126f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:26.726923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.728609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.730065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9078b95f97843d0b764e1dfd41e9904', 'request_id': 'req-ad2777cb-025d-4d49-b8fa-3e5568c3211d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.732572 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2997/5962] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:25 2022] DELETE /identity/v3/projects/1166594569c141c3b487333045126f23 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:26.743703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:26.743703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:26.755440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9078b95f97843d0b764e1dfd41e9904', 'request_id': 'req-ad2777cb-025d-4d49-b8fa-3e5568c3211d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.909164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] The token cache is being invalidate because project b9078b95f97843d0b764e1dfd41e9904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:26.909802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.911060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ad2777cb-025d-4d49-b8fa-3e5568c3211d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:26.915598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2966/5963] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:26 2022] DELETE /identity/v3/projects/b9078b95f97843d0b764e1dfd41e9904 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:26.925692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42790-bd24-4313-8dc1-5989e9fb5816 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:26.930709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42790-bd24-4313-8dc1-5989e9fb5816 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:26.933158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42790-bd24-4313-8dc1-5989e9fb5816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:26.954703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55523-ef9d-4de4-9ad5-821ef41cde58 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:27.032838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7aa42790-bd24-4313-8dc1-5989e9fb5816 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:27.035399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7aa42790-bd24-4313-8dc1-5989e9fb5816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:27.182018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:27.183054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.183621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.186876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.189603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:27.201415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a31fa-b084-4e97-a9f0-b50a264584e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:27.337020 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2967/5964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:27.340609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.341114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.341606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.386655 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2998/5965] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:26 2022] POST /identity/v3/projects => generated 367 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:27.392527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.396475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.396475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.411337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:27.414354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:27.448468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:27.450632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:27.617363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 2999/5966] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:27.620277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:27.623679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:27.654536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f865634-da18-49c0-97b1-8d9f2941975f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:27.668172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2968/5967] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:27.670728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:27.687318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:27.689913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.690698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.693353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.693746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:27.698841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:27.701076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a936-6039-48e2-96dc-3f4aad2abdd4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:27.721543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:27.723361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.723856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.724846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.725622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:27.726222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:27.729508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55611b9-794b-471b-92da-1e95702a321a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:27.758708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2969/5968] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:27.761166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.761672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.762165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.805229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:27.808145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:27.821192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2970/5969] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:27.822354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:27.850925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ec1f-ee40-4670-a14f-9eb8403b1030 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:27.856542 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3000/5970] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:27 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:27.856542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:27.865657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:27.869814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.873306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.875094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.876912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:27.885786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:27.887318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe692-2cee-422a-bad0-7b8f1fee7808 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:27.906417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:27.907989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:27.908499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:27.909002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:27.912886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:27.913679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:27.917178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:27.954376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3001/5971] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:27.957752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:27.976907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:27.988335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5686e54-7aba-48b6-a740-d80283e77265 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.007085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.008361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.008984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.010766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.010766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.014143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.043258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3002/5972] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:28.045051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.083712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047a836-10b4-47c7-84fc-83456e2e11e5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.096910 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2971/5973] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:27 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:28.105036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.120311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.125945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.127233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.128315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.132950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.141262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.294788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3003/5974] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:28 2022] POST /identity/v3/projects => generated 399 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:28.297260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.301746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c11bd-fe15-423a-8d5c-db5277eff301 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.510402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3801a8-ffd9-4b32-bb89-1c95f717ae1d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.515912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.519790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.519790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.519790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.519790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.523780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.524151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.524913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.525592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.526220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.528003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.533805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.556526 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2972/5975] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:28.556526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.560760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:28.586959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e016b-8435-42ac-a180-d89e9046a10d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.599507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.601384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.602249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.603541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] PATH_INFO: `/v3/projects/2c728b817e0e48fbbe9bb48887270faf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.606413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c728b817e0e48fbbe9bb48887270faf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.610753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.733012 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3004/5976] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:28 2022] POST /identity/v3/users => generated 292 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:28.735381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.760372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40470-f8b5-438e-9860-4147a0b08dd2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.771591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:28.772760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:28.773448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:28.774059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:28.775546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:28.779849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:28.815230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c728b817e0e48fbbe9bb48887270faf', 'request_id': 'req-cfb4e449-00b2-44f8-839e-d9db8b101d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:28.833300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c728b817e0e48fbbe9bb48887270faf', 'request_id': 'req-cfb4e449-00b2-44f8-839e-d9db8b101d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:28.845767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c728b817e0e48fbbe9bb48887270faf', 'request_id': 'req-cfb4e449-00b2-44f8-839e-d9db8b101d74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:28.944000 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3005/5977] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:28 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:28.944000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.972853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a0b70-3557-4e93-a9d2-c1522e2543af admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:28.973098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:28.984364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] The token cache is being invalidate because project 2c728b817e0e48fbbe9bb48887270faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:28.985325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:28.986395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:28.995916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2973/5978] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:28 2022] DELETE /identity/v3/projects/2c728b817e0e48fbbe9bb48887270faf => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:28.995916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:28.997808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:29.136760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.136760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.136760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.136760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] PATH_INFO: `/v3/projects/d1469bcd4b77414ba7514e71214d588f/users/25e76463495a4425bca9b54e8ec11f8b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.166253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4e449-00b2-44f8-839e-d9db8b101d74 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:29.171743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1469bcd4b77414ba7514e71214d588f, user_id=25e76463495a4425bca9b54e8ec11f8b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.177409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.178035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.178676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.179235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.179730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.181659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.186132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.234136 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2974/5979] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:29.234136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:29.235120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:29.267366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c937230-6353-4871-a5d8-81b36ca4d134 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:29.277736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.278777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.279532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.280321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.282556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.285207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71dc00-391b-4a7e-b732-11bda3b9a7fd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.313115 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2975/5980] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:29.313428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3006/5981] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:28 2022] PUT /identity/v3/projects/d1469bcd4b77414ba7514e71214d588f/users/25e76463495a4425bca9b54e8ec11f8b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:29.313428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:29.315850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:29.318510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.319196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.319696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.351793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:29.353829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:29.521933 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2976/5982] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:29.521933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:29.525953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9522b0-bbe9-42b0-b648-bd0115506b41 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:29.542256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.544352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.544614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.545283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] PATH_INFO: `/v3/projects/7633d705fd394188a6a8f46ffe10e475` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.552870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7633d705fd394188a6a8f46ffe10e475)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.554249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea61780-3334-46f2-bf91-85a597e48fbf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:29.556050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.571692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.573070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.575845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.577140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.578725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.585026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.619095 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2977/5983] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:29.621348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:29.645405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7cd7-8e67-42d6-9330-bb20461200d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:29.659086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:29.666851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.666851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.666851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.669800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:29.672944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3cc35-d33a-46ff-a3fb-a147c1bb1c75 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:29.705288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2978/5984] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:29.708337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e894c-659d-4304-a964-23179de155cc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:29.708923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e894c-659d-4304-a964-23179de155cc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:29.709740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e894c-659d-4304-a964-23179de155cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:29.786700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-081e894c-659d-4304-a964-23179de155cc None None] MFA Rules not processed for user `25e76463495a4425bca9b54e8ec11f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:29.788539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-081e894c-659d-4304-a964-23179de155cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:29.852896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:29.898944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7633d705fd394188a6a8f46ffe10e475', 'request_id': 'req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:29.976721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7633d705fd394188a6a8f46ffe10e475', 'request_id': 'req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:29.999175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7633d705fd394188a6a8f46ffe10e475', 'request_id': 'req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:30.036308 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2979/5985] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:30.040923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:30.042050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:30.044836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:30.046400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] The token cache is being invalidate because project 7633d705fd394188a6a8f46ffe10e475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:30.046933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:30.050960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:30.065062 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3007/5986] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:29 2022] DELETE /identity/v3/projects/7633d705fd394188a6a8f46ffe10e475 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:30.067354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:30.070870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:30.120509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:30.125097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:30.289381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c16d1-a6f7-408a-864b-a4b10ddc2c4a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:30.302184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2980/5987] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:30.303889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:30.306698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:30.307277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:30.309271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:30.310584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:30.312238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] PATH_INFO: `/v3/projects/f386d694b9154960a741f31caafb0e02/users/21f75ea1b9a94d7ebefe98bf691cf406/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:30.352118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591eabd-7adf-4e4e-adb5-4141fa578fda None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:30.352118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:30.352118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:30.352118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:30.352783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] PATH_INFO: `/v3/projects/3b95a2aecfd5445e8e78ba2bae3358ca/users/666a5b75998443b5ae9a778a1e789c89/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:30.356439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386d694b9154960a741f31caafb0e02, user_id=21f75ea1b9a94d7ebefe98bf691cf406, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:30.365719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:30.382597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b95a2aecfd5445e8e78ba2bae3358ca, user_id=666a5b75998443b5ae9a778a1e789c89, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:30.388235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f437-181a-4641-a59e-c37b0d19d127 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:30.588874 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3008/5988] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:30 2022] PUT /identity/v3/projects/f386d694b9154960a741f31caafb0e02/users/21f75ea1b9a94d7ebefe98bf691cf406/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:30.592936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:30.599265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:30.651778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2981/5989] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:30 2022] PUT /identity/v3/projects/3b95a2aecfd5445e8e78ba2bae3358ca/users/666a5b75998443b5ae9a778a1e789c89/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:30.655598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:30.660835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:30.660835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:30.718899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:30.724897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:30.802968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:30.916030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dca3bd-c64b-4321-a03b-93ce8b4bffed admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:31.028930 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2982/5990] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:31.031045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:31.073388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73d0af-1ce0-4e86-82ae-46ae233a3bca None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:31.104096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:31.111689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.117935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.117935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.117935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:31.117935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:31.117935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee72716-c2ad-4dab-9650-3c02ad20f74c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:31.141510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:31.146702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.148856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.150120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2983/5991] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:31.152718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db27ea-f371-4819-9152-0342a2d78e72 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.153259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db27ea-f371-4819-9152-0342a2d78e72 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.153747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db27ea-f371-4819-9152-0342a2d78e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.165122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.173200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:31.177264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16115269-5c87-441a-a301-34813168cef2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:31.224171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-83db27ea-f371-4819-9152-0342a2d78e72 None None] MFA Rules not processed for user `21f75ea1b9a94d7ebefe98bf691cf406`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:31.226775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-83db27ea-f371-4819-9152-0342a2d78e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:31.366365 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3009/5992] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:30 2022] POST /identity/v3/projects => generated 367 bytes in 776 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:31.369191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.370396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.371306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.435886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] MFA Rules not processed for user `666a5b75998443b5ae9a778a1e789c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:31.438999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:31.464642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2984/5993] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:31.469427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.485122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.487414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.564947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:31.568729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:31.593994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3010/5994] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:31.595542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:31.614783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:31.734564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2985/5995] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:31.736674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:31.765064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c3ead-cefc-4888-9c59-9e0ff68b5352 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:31.774943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:31.777509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.778007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.778668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.779714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:31.784998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:31.850662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1b8d2-d5d3-42a7-aafd-5b9b54090130 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:31.866172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:31.867095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:31.867604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:31.868283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:31.869634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:31.875839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:31.956990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2986/5996] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:31 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:31.958539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:31.961566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:32.077047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:32.101173 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3011/5997] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:31 2022] POST /identity/v3/projects => generated 395 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:32.101173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:32.268226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955174dd-0c54-4435-b753-b4e0dd497d08 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:32.384919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc30590-9ad2-4557-b5e5-79932db263f9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:32.410831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:32.410831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:32.410831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:32.410831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:32.411727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:32.411727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:32.503852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:32.507059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:32.508768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:32.508768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:32.959758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3012/5998] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:32 2022] POST /identity/v3/projects => generated 399 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:32.959758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:32.963771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:32.963771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:32.963771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2987/5999] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 914 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:32.963771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:32.963771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948004-74d4-4c04-af45-46c588ff41a3 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:32.971036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855617c-b4e5-47c0-83c0-6c6612c3ed89 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:32.989954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:32.989954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:32.990949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:32.991665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:32.994118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:32.994904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:32.998614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:33.015724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:33.019096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:33.020711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:33.024401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:33.026876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:33.031645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:33.055588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3013/6000] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:33.062186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:33.086811 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2988/6001] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:33.091182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:33.093503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71181-8da7-47cc-99f9-36a46450d7c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:33.106527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:33.107874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:33.108496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:33.109113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:33.110453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:33.123435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:33.148730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691cb7-7dc9-4b24-b85e-6cc65ac604ab admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:33.167369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:33.174129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:33.177355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:33.178154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:33.178845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:33.181936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:33.186535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:33.331290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:33.434968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3014/6002] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:33 2022] POST /identity/v3/users => generated 298 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:33.437048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:33.443810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2989/6003] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:33 2022] POST /identity/v3/users => generated 306 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:33.443810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:33.446816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:33.489674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28635-f4de-48e2-8ca6-a5fc7dd0bc78 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:33.518555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:33.520623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:33.521217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:33.521705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:33.525762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:33.536981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:33.748303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af712c-7767-4117-808f-5ca961a46d85 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:33.750947 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2990/6004] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:33 2022] POST /identity/v3/projects => generated 387 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:33.752997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:33.967376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:33.969732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:33.970665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:33.971229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:33.982014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:34.007945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236e6e0-ab49-448d-a5b5-6db037a87633 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.029955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.032760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.033613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.034140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] PATH_INFO: `/v3/projects/c643b3375dcd4b9cbf2c2181acd08187/users/9a85f39b471a4cbfa9c97a6271460e0f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.071978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643b3375dcd4b9cbf2c2181acd08187, user_id=9a85f39b471a4cbfa9c97a6271460e0f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.079390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.157717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.162519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.201129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:34.205768 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3015/6005] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:34.208034 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2991/6006] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:33 2022] PUT /identity/v3/projects/c643b3375dcd4b9cbf2c2181acd08187/users/9a85f39b471a4cbfa9c97a6271460e0f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:34.211738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.217165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.265229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c854e4-c2d5-4337-bb07-3a9c8c1dbc62 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.502082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.509226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.510116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.510904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.512580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.516590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.541797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2f513-3839-449e-aaf7-12d4583328b7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.551168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3016/6007] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:34.553235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.581223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46387f68-9dd1-4a7c-9f09-00fd674aa4f5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.581883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.583436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.587672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.588704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.600768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.601056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.601056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.601056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.601405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.606631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.611582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.611926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.669711 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2992/6008] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:34.669711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.686778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:34.687631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1a75d-cf8d-44b9-a80b-da18746424fb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.721774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.724378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.724894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.726423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.727700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.733137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.793331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2993/6009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:34.801335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.825261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597272-563e-46fd-bea0-107dd9106d2a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.850829 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3017/6010] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:34 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:34.860289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.866002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.867603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.872004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.872932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.874473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:34.884811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:34.911828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c6c8-1f4b-41cb-989c-d8348c0d0d87 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:34.938421 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2994/6011] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:34.940679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:34.943782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:34.945895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:34.949332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:34.950346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] PATH_INFO: `/v3/projects/25b7551b300a463789e2eebf5a7b189b/users/a51d34187bc84782bca3bf2a6d4d4e9e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:34.993501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067ec1-421d-40d0-81ae-6cca24d77c09 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:35.014330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:35.017459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b7551b300a463789e2eebf5a7b189b, user_id=a51d34187bc84782bca3bf2a6d4d4e9e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:35.019278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:35.021473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:35.022926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] PATH_INFO: `/v3/projects/c643b3375dcd4b9cbf2c2181acd08187/users/9a85f39b471a4cbfa9c97a6271460e0f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:35.028410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643b3375dcd4b9cbf2c2181acd08187, user_id=9a85f39b471a4cbfa9c97a6271460e0f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:35.029595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:35.036172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:35.079284 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2995/6012] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:34 2022] PUT /identity/v3/projects/c643b3375dcd4b9cbf2c2181acd08187/users/9a85f39b471a4cbfa9c97a6271460e0f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:35.081506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:35.158089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3018/6013] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:34 2022] PUT /identity/v3/projects/25b7551b300a463789e2eebf5a7b189b/users/a51d34187bc84782bca3bf2a6d4d4e9e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:35.160731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:35.328393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb9c2-7157-4121-acda-878c2b7e25e0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:35.419473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f0c78-a416-4b94-8719-e79492a2d114 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:35.435022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:35.437680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:35.439476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:35.440173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] PATH_INFO: `/v3/projects/322e7c94d0524c7ebe0663cedcf32ae4/users/f1d089cb6f77439f9696ed442ecd6ab4/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:35.503631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322e7c94d0524c7ebe0663cedcf32ae4, user_id=f1d089cb6f77439f9696ed442ecd6ab4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:35.521008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:35.521662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:35.522750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:35.523624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:35.529391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:35.529391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:35.529902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b8087-79ac-4bad-8b25-9a9ae95ead70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:35.558150 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2996/6014] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:35.560792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:35.561281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:35.561899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:35.633177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] MFA Rules not processed for user `9a85f39b471a4cbfa9c97a6271460e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:35.635352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:35.670938 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3019/6015] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:35 2022] PUT /identity/v3/projects/322e7c94d0524c7ebe0663cedcf32ae4/users/f1d089cb6f77439f9696ed442ecd6ab4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:35.672260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:35.905292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2997/6016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:35.907094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:35.947579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d533990-d8bf-42be-ae0c-5fb4702d1494 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:35.949934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:36.025446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ca4cb-6966-4c05-8545-b215d94bfcb4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:36.035901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:36.055346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:36.056961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:36.057847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:36.060224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:36.061827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:36.081427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ac26-11c8-46ef-bc07-da6590f6938a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:36.143391 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3020/6017] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:36.143391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:36.143391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:36.143391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:36.222659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:36.223842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:36.224361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:36.225255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:36.227058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:36.231645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:36.255314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] MFA Rules not processed for user `f1d089cb6f77439f9696ed442ecd6ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:36.257694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:36.266295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2998/6018] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:36.266295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:36.492729 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3021/6019] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:36.494366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:36.541231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe47aa-3b92-485b-951e-8066adca7563 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:36.558579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:36.561258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:36.561784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:36.562500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] PATH_INFO: `/v3/projects/25b7551b300a463789e2eebf5a7b189b/users/a51d34187bc84782bca3bf2a6d4d4e9e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:36.570367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b7551b300a463789e2eebf5a7b189b, user_id=a51d34187bc84782bca3bf2a6d4d4e9e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:36.575246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445474-4752-4567-aa8c-175f4f478353 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:36.576111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:36.586777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:36.588979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:36.589653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:36.590539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:36.593100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:36.597849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:36.633195 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3022/6020] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:36 2022] PUT /identity/v3/projects/25b7551b300a463789e2eebf5a7b189b/users/a51d34187bc84782bca3bf2a6d4d4e9e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:36.635162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:36.761418 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 2999/6021] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:57:36 2022] POST /identity/v3/domains => generated 276 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:36.761418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:36.906103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d88fd-227b-44ac-883c-955bdc31eecd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:37.107748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b9e1d-815b-4e67-9472-aebf298fc9c0 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:37.131228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:37.132299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:37.132763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:37.133293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:37.134436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:37.134744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:37.138103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf546-7c89-4c27-a60d-8624c0296cbb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:37.176543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:37.185707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:37.186989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:37.187517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:37.188015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] PATH_INFO: `/v3/projects/a9517b45f1ab4b7ca1b6b984c5ec2c37/users/3fbac1f4466849ebbc958b2a78b79e22/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:37.256854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9517b45f1ab4b7ca1b6b984c5ec2c37, user_id=3fbac1f4466849ebbc958b2a78b79e22, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:37.262372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:37.382076 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3000/6022] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:36 2022] POST /identity/v3/projects => generated 397 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:37.394151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3023/6023] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:36 2022] PUT /identity/v3/projects/a9517b45f1ab4b7ca1b6b984c5ec2c37/users/3fbac1f4466849ebbc958b2a78b79e22/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:37.394151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:37.399924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:37.402189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:37.403171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:37.478973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] MFA Rules not processed for user `a51d34187bc84782bca3bf2a6d4d4e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:37.483305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:37.685282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233cfcd-b06a-4577-82b6-2cad8595358b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:37.692728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:37.771782 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3001/6024] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:37.773725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:37.907266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:37.908313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:37.908811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:37.909295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:37.913301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:37.921020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11fc44-6bf9-4676-a08e-063186878cc4 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:37.994724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6989b-a360-4c8f-a83d-d9d61808a6da None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:38.004805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:38.005996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.006560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.007045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.008555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:38.012492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:38.093383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3024/6025] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:37 2022] POST /identity/v3/groups => generated 280 bytes in 708 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:38.095981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.100209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.100668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.159664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3002/6026] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:37 2022] POST /identity/v3/users => generated 305 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:38.161759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:38.172097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:38.177645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:38.238940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] MFA Rules not processed for user `3fbac1f4466849ebbc958b2a78b79e22`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:38.248483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:38.385303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:38.444990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aedf5c-56ab-402f-8fd1-39835fc6a643 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:38.485165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:38.494153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.495099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.495999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.571889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3025/6027] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:38.575955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:38.626317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350187-7ce3-449e-ad2c-0c2cd3fede39 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:38.640734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:38.658821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.659484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.660585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/c665b2cee9394d608c340cd35361d784` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.720269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:update_group(group_id=c665b2cee9394d608c340cd35361d784)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:38.723373 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:38.723373 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:38.723373 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:38.726430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:38.742023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:38.852430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:38.855210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:38.879235 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3003/6028] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:38.881604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:38.914902 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3026/6029] 10.222.0.78 () {60 vars in 1247 bytes} [Tue Oct 4 20:57:38 2022] PATCH /identity/v3/groups/c665b2cee9394d608c340cd35361d784 => generated 292 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:38.916773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:38.934174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca438-b351-4ebe-95fa-6acaab23742a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:38.950499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6c0c-be47-463c-b85d-f7b893eaee92 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:38.954400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:38.956122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.956122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.956562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.957893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:38.961229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:38.975114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:38.976676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:38.976828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:38.977324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:38.978645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:38.982868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:38.999602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3004/6030] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:39.001643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.017979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:39.052073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed793f1d-683f-4c3e-a35d-f24740bf480c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:39.061744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:39.062998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:39.063560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:39.064073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/c665b2cee9394d608c340cd35361d784` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:39.075033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:get_group(group_id=c665b2cee9394d608c340cd35361d784)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:39.077475 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:39.077475 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:39.077475 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:39.080103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:39.085092 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3005/6031] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:38 2022] GET /identity/v3/groups/c665b2cee9394d608c340cd35361d784 => generated 292 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:39.086759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.117618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f137e-738e-4bf0-82c8-511e68767b0f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:39.129363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:39.130680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:39.131239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:39.131759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] PATH_INFO: `/v3/projects/ec5b7a33bc12475caae480f784ac9701/users/783daf22faa64d96926429cc79b9ebc3/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:39.171440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b7a33bc12475caae480f784ac9701, user_id=783daf22faa64d96926429cc79b9ebc3, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:39.180268 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3027/6032] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:39.180573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:39.181216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.337161 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3006/6033] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:39 2022] PUT /identity/v3/projects/ec5b7a33bc12475caae480f784ac9701/users/783daf22faa64d96926429cc79b9ebc3/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:39.340086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.502755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42466-0a05-4338-830a-25c052bf84de admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:39.562013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e00e-8bd6-4b9f-8621-a632080f8c3a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:39.579085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:39.579861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:39.580330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:39.580790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:39.586515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:39.592737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:39.773926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3007/6034] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:39 2022] POST /identity/v3/users => generated 293 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:39.773926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.825820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:39.826560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:39.826686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:39.826968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/c665b2cee9394d608c340cd35361d784` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:39.831805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:update_group(group_id=c665b2cee9394d608c340cd35361d784)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:39.834399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:39.838373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04576-b0e3-4372-a103-b792cf4c6bd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:39.861755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:39.863558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:39.864455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:39.866319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:39.868356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:39.885978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:39.940301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3008/6035] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:39.941437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:39.980074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:40.008917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d555-e64c-4fc3-b066-a270013676b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:40.010888 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3028/6036] 10.222.0.78 () {60 vars in 1246 bytes} [Tue Oct 4 20:57:39 2022] PATCH /identity/v3/groups/c665b2cee9394d608c340cd35361d784 => generated 308 bytes in 834 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:40.017574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:40.039379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:40.040250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:40.040742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:40.041240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:40.042786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:40.056861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:40.088467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dae419-e4f4-4ab1-aa9d-f4ba386b7439 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:40.102795 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3009/6037] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:40.102795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:40.130109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:40.131714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:40.132787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:40.140005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] PATH_INFO: `/v3/projects/ec5b7a33bc12475caae480f784ac9701/users/783daf22faa64d96926429cc79b9ebc3/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:40.146370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5b7a33bc12475caae480f784ac9701, user_id=783daf22faa64d96926429cc79b9ebc3, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:40.157786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cbe7-8403-45c9-8122-571ace30b016 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:40.163798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:40.170401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:40.171646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:40.172522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:40.172651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/c665b2cee9394d608c340cd35361d784` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:40.198224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c665b2cee9394d608c340cd35361d784)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:40.200293 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:40.200293 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:40.200293 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:40.209482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748fa1-2ab0-4315-b0b9-2beb4fec5725 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:40.237807 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3029/6038] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:40 2022] PUT /identity/v3/projects/ec5b7a33bc12475caae480f784ac9701/users/783daf22faa64d96926429cc79b9ebc3/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:40.267874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:40.530036 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3010/6039] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:57:40 2022] DELETE /identity/v3/groups/c665b2cee9394d608c340cd35361d784 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:40.530036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:40.530036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:40.530036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:40.560545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:40.668986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5db6a-1f38-48ae-813c-592851dbdd85 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:40.673880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] MFA Rules not processed for user `783daf22faa64d96926429cc79b9ebc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:40.691024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:40.989477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:41.012297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:41.013257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:41.013772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:41.014290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:41.015622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:41.018926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:41.067705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3011/6040] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:41.069321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:41.079304 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3030/6041] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 836 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:41.079304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:41.339019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf418b1-8c82-4be6-9114-da6fd9501ee8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:41.349192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d089cb6f77439f9696ed442ecd6ab4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '322e7c94d0524c7ebe0663cedcf32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:41.350138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:41.350596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:41.351083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:41.352180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 04 20:57:41.358706 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 04 20:57:41.360551 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:41.367653 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3031/6042] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:57:41 2022] POST /identity/v3/projects => generated 136 bytes in 292 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:41.368868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:41.393444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae064-fb28-4c06-8dd5-df1f62e12f03 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:41.396716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:41.397500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:41.398002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:41.398302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] PATH_INFO: `/v3/projects/092044b74e2543bc948c906d37608244/users/bd43be1fd9f94690afe4a5bfb418caef/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:41.400216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27e3e9-91dc-422c-9c58-dc581ad77dec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:41.413409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:41.415054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:41.415992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:41.416793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:41.418433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:41.420980 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:41.420980 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:41.420980 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:41.422073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092044b74e2543bc948c906d37608244, user_id=bd43be1fd9f94690afe4a5bfb418caef, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:41.424660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:41.426893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:41.678497 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3032/6043] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:41 2022] PUT /identity/v3/projects/092044b74e2543bc948c906d37608244/users/bd43be1fd9f94690afe4a5bfb418caef/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:41.680803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:41.707548 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3012/6044] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:41 2022] POST /identity/v3/groups => generated 327 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:41.712197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:41.782041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cfaa-4816-43ee-a9f1-e2d7dca45dde tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:41.961633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2892f34-c898-45e7-8c0d-b8b385f3b613 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:42.006097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:42.006690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:42.007606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:42.009866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:42.010256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:42.010759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:42.011119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:42.012002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:42.012175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:42.024252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invalid input for field 'name': '' is too short Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: '' Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application '' Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.062115 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:57:42.064487 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application '' Oct 04 20:57:42.066170 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.080076 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3013/6045] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:57:41 2022] POST /identity/v3/projects => generated 283 bytes in 372 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:57:42.088469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:42.349850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:42.355978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494eeee-d659-4145-b1f8-d4a4a7ef226e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:42.409300 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3033/6046] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:42.443634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:42.444298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:42.444763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:42.474732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:UPDATE=2,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:42.499525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa025dbb-9507-4ef0-b200-e43907d5093b tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:42.511576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:42.526192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:42.529343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:42.530164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:42.532019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:42.533623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:42.539389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:42.610709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] MFA Rules not processed for user `bd43be1fd9f94690afe4a5bfb418caef`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:42.614330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:42.785987 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3014/6047] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:42 2022] POST /identity/v3/users => generated 323 bytes in 705 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:42.795261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:42.861174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f48a-226d-470d-9463-7b5c995e7a1f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:42.887084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:42.889593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:42.890421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:42.890974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:42.892356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:42.913147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: On instance['name']: Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise error Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:57:42.974546 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:42.976649 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application On instance['name']: Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:57:42.978323 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:42.981519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3015/6048] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:57:42 2022] POST /identity/v3/projects => generated 412 bytes in 193 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 20:57:42.982494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:43.008967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3034/6049] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:43.017038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:43.045920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.053477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7f789-5d41-4b5b-8e6d-d20d19d69a07 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:43.067985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cee47-d10a-4e2e-b330-f9edb0e770d4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:43.071511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:43.074019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:43.076251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:43.077947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:43.091094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:43.092579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:43.094541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:43.095644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects/0c78185e78c74c1da3b80d54f3fec34d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:43.128363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0c78185e78c74c1da3b80d54f3fec34d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:43.135528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:43.150749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.163376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=fc5e9b9b460b413e808d34d547d1d502)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:43.167914 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:43.167914 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:43.167914 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:43.176722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Could not find project: 0c78185e78c74c1da3b80d54f3fec34d.: keystone.exception.ProjectNotFound: Could not find project: 0c78185e78c74c1da3b80d54f3fec34d. Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 04 20:57:43.187642 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0c78185e78c74c1da3b80d54f3fec34d. Oct 04 20:57:43.195062 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:57:43.208168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3035/6050] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:43 2022] DELETE /identity/v3/projects/0c78185e78c74c1da3b80d54f3fec34d => generated 113 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:43.209952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:43.403970 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3016/6051] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:57:42 2022] PUT /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:43.403970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:43.419116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.484874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e08f9-d7dc-4c76-881e-7ed6fb461899 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:43.548742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.679625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee505-ba24-4cdd-a013-406c11e5587c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:43.692182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1d089cb6f77439f9696ed442ecd6ab4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '322e7c94d0524c7ebe0663cedcf32ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:43.693302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:43.693822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:43.694277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:43.695613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:43.697353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:43.698905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:43.702204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:43.703544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:43.705231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:43.710013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:43.721367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 04 20:57:43.725821 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._list_projects() Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 04 20:57:43.727681 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:43.728877 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3017/6052] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:57:43 2022] GET /identity/v3/projects => generated 135 bytes in 328 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:57:43.729861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:43.919905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:43.929364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3036/6053] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:43 2022] POST /identity/v3/projects => generated 387 bytes in 715 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:43.929364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:44.008848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924259d-666c-43cc-a691-b111b33f6918 tempest-ProjectsNegativeStaticTestJSON-729001156 tempest-ProjectsNegativeStaticTestJSON-729001156-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:44.199566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:44.207476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3ec7-33f7-4eb4-85d9-a7e9bcb3b3d5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:44.217312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:44.218787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:44.219587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:44.225718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:44.225718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:44.226143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:44.236439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:44.239222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:44.239913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:44.240582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:44.242932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:44.247650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:44.439908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3037/6054] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:43 2022] POST /identity/v3/projects => generated 359 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:44.442008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:44.479892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3018/6055] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:43 2022] POST /identity/v3/users => generated 323 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:44.484906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:44.544055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911078-c4ba-47b7-add1-63e9baa48a11 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:44.636059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:44.725762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629cda-0954-410f-95f1-1880a9886256 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:44.748915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:44.750139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:44.750490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:44.751221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:44.752454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:44.776497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:44.813214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:44.814751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:44.815367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:44.816110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:44.819256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:44.827407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:44.936996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.sql.core [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1125377716' for key 'project.ixu_project_name_domain_id'") Oct 04 20:57:44.936996 n-d-852085-12 devstack@keystone.service[82439]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:57:44.936996 n-d-852085-12 devstack@keystone.service[82439]: [parameters: {'id': '08a7c412c4ee4cc5a7f69241a678688c', 'name': 'tempest-project-dup-1125377716', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 20:57:44.936996 n-d-852085-12 devstack@keystone.service[82439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1125377716, project id 08a7c412c4ee4cc5a7f69241a678688c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1125377716, project id 08a7c412c4ee4cc5a7f69241a678688c. Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:57:45.009586 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1125377716' for key 'project.ixu_project_name_domain_id'") Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 20:57:45.011185 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application yield resource Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application next(self.gen) Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise self.value Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 20:57:45.013518 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application session.commit() Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.session.flush() Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application compat.raise_( Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 20:57:45.015973 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 20:57:45.017853 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application conn.query(q) Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result.read() Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:57:45.020163 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1125377716' for key 'project.ixu_project_name_domain_id'") Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [parameters: {'id': '08a7c412c4ee4cc5a7f69241a678688c', 'name': 'tempest-project-dup-1125377716', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:45.023552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1125377716 at domain ID default. Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:57:45.030172 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1125377716, project id 08a7c412c4ee4cc5a7f69241a678688c. Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3019/6056] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:57:44 2022] POST /identity/v3/projects => generated 285 bytes in 488 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 20:57:45.032848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:45.034100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3038/6057] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:44 2022] POST /identity/v3/users => generated 300 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:45.034100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:45.059029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad479e-21d7-4588-acf3-5f245aabe286 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:45.089435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783daf22faa64d96926429cc79b9ebc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec5b7a33bc12475caae480f784ac9701', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:45.090784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:45.091292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:45.091812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] PATH_INFO: `/v3/projects/3c2310b33840447a84244227380d7318` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:45.096407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c2310b33840447a84244227380d7318)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:45.106249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:45.150414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:45.190625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:45.273646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee50f-5dc9-4ee8-9b79-9684bbded4d2 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:45.301828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:45.302641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:45.303326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:45.303971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:45.372653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=d3666739b9ab4cb48f6c968db81d018d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:45.378381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:45.544075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2310b33840447a84244227380d7318', 'request_id': 'req-4bf4b179-1ab5-429d-84ea-4b1990017d72'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:45.670182 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3020/6058] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:57:44 2022] PUT /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:45.672404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:45.790468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2310b33840447a84244227380d7318', 'request_id': 'req-4bf4b179-1ab5-429d-84ea-4b1990017d72'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:45.812815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2310b33840447a84244227380d7318', 'request_id': 'req-4bf4b179-1ab5-429d-84ea-4b1990017d72'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:45.855322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] The token cache is being invalidate because project 3c2310b33840447a84244227380d7318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:45.856113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:45.858061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:45.873104 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3039/6059] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:45 2022] DELETE /identity/v3/projects/3c2310b33840447a84244227380d7318 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:45.874949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:45.877974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:45.903339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901af2-0da0-4564-9795-089ea47ab282 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:45.924620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:45.926218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:45.929483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:45.929483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:45.929483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:45.936052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:45.995043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3021/6060] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:46.000878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:46.005793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:46.043973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:46.061329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c7b0-12e5-42f0-93ca-c761901fed54 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:46.074504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:46.076072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:46.076718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:46.077326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] PATH_INFO: `/v3/users/f1d089cb6f77439f9696ed442ecd6ab4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:46.080158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d089cb6f77439f9696ed442ecd6ab4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:46.088470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:46.263243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b179-1ab5-429d-84ea-4b1990017d72 tempest-ProjectsNegativeStaticTestJSON-1590883829 tempest-ProjectsNegativeStaticTestJSON-1590883829-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:46.384599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:46.472616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d089cb6f77439f9696ed442ecd6ab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:46.530473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:46.531519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:46.532148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:46.532671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:46.533960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:46.538936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:46.640875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d089cb6f77439f9696ed442ecd6ab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:46.710695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d089cb6f77439f9696ed442ecd6ab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:46.714980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3040/6061] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:45 2022] POST /identity/v3/users => generated 321 bytes in 841 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:46.717148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:46.726189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:46.787183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d089cb6f77439f9696ed442ecd6ab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:46.789058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d089cb6f77439f9696ed442ecd6ab4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:46.811842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a124e-1299-4035-83c9-b5dd4788cbbe tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:46.825684 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3022/6062] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:45 2022] DELETE /identity/v3/users/f1d089cb6f77439f9696ed442ecd6ab4 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:46.844553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:46.846434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:46.846858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:46.847497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:46.850301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:46.851264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] PATH_INFO: `/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8/users/68f0e690d07b4aa2bb5481795aba65ea/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:46.925263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:46.929056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9a0f02c1234ac593eb8214e8e536f8, user_id=68f0e690d07b4aa2bb5481795aba65ea, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:46.946107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786083-4639-4823-8577-e4f567da60f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:47.116086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3acf1-f2b7-482e-941a-7a6dbec17afc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:47.129904 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3041/6063] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:46 2022] PUT /identity/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8/users/68f0e690d07b4aa2bb5481795aba65ea/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:47.133495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:47.134133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:47.134985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:47.188796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:47.192604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:47.219772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:47.425435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:47.427580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:47.428164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:47.428964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:47.499316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=54650a025f56449ca55735bd299ebd34)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:47.507117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:47.515801 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3042/6064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:47.536223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:47.541031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:47.591200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9921-0455-44f4-8b4c-a4218ac56973 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:47.606763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:47.608280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:47.609042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:47.609517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:47.610853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:47.614843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:47.643502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3043/6065] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:47.655364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:47.655364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:47.766818 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3023/6066] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:57:46 2022] PUT /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:47.768924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:47.821634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810ea6-e2a3-4d9f-a53c-20b1db509849 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.022435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6041-e184-4bbb-88b0-e65224254f39 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.032596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.033674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.034177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.035309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.048428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.053563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.055777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.056266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] PATH_INFO: `/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8/users/68f0e690d07b4aa2bb5481795aba65ea/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.066194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9a0f02c1234ac593eb8214e8e536f8, user_id=68f0e690d07b4aa2bb5481795aba65ea, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.069289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.072260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355107-6f98-4cc6-8ce9-0604a29f7a54 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:48.080048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:48.095407 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3044/6067] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:48.097657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:48.100928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3024/6068] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:57:47 2022] PUT /identity/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8/users/68f0e690d07b4aa2bb5481795aba65ea/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:48.118130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.118510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.120499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.202617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] MFA Rules not processed for user `68f0e690d07b4aa2bb5481795aba65ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:48.206312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:48.248633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:48.347007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef141-9e82-4730-93fb-cac5ee73b783 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.373384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:48.469138 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3025/6069] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:48.502787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:48.520540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:48.615017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.616177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.616909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.617376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.620293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dbc3ef63b9ec4366b32435a478e205c5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.622773 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:48.622773 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:48.622773 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:48.627154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:48.700527 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3045/6070] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:57:48 2022] GET /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users => generated 1083 bytes in 604 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:57:48.704318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:48.744555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f068c9-6d75-4962-bf8a-2cbe8eec9525 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.764797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.766012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.766686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.767252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.784625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=fc5e9b9b460b413e808d34d547d1d502)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.787384 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:48.787384 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:48.787384 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:48.791747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:48.796622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee0af0-df02-4a0f-96fa-ef5b7ba2a310 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.820422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.821590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.822037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.823014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.835193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3046/6071] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 4 20:57:48 2022] HEAD /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:48.841131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:48.864528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.868029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:48.876016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ab5e7-f644-47e5-b8be-08f707445a65 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:48.889803 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3026/6072] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 20:57:48.898829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:48.900551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:48.901434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:48.902070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:48.905911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=fc5e9b9b460b413e808d34d547d1d502)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:48.908556 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:48.908556 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:48.908556 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:48.911881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:49.006044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:49.220697 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3047/6073] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:57:48 2022] DELETE /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/fc5e9b9b460b413e808d34d547d1d502 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:49.227994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:49.266209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ad6b3-af12-48d9-bd7d-6833a1892c14 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:49.552989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:49.553996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:49.554402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:49.554813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:49.561660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=d3666739b9ab4cb48f6c968db81d018d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:49.563362 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:49.563362 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:57:49.563362 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:57:49.569262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:49.656493 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3027/6074] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 4 20:57:49 2022] HEAD /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:49.663993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:49.693147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f45aa-ac7b-434e-b413-3aa040ee955c tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:49.715609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:49.716727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:49.717216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:49.717679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:49.725066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=d3666739b9ab4cb48f6c968db81d018d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:49.728804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:49.850529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:50.010648 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3048/6075] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:57:49 2022] DELETE /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/d3666739b9ab4cb48f6c968db81d018d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:50.017370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:50.089111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486beedf-c213-4e90-9dab-ab76339d2e73 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:50.415972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:50.497296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:50.498685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:50.505851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:50.506601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:50.528797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=54650a025f56449ca55735bd299ebd34)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:50.536856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:50.609172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3028/6076] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 4 20:57:50 2022] HEAD /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:50.617425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:50.663543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fd7db-52bb-476e-b7d3-ddf723beef8d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:50.691961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:50.696093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:50.696962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:50.701736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:50.712362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dbc3ef63b9ec4366b32435a478e205c5, user_id=54650a025f56449ca55735bd299ebd34)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:50.717195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:50.845587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:50.975078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:50.978540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:51.014722 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3049/6077] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:57:50 2022] DELETE /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users/54650a025f56449ca55735bd299ebd34 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:51.024685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:51.328879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51db8-afc9-42fe-98ca-7e2241e39a2f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:51.354053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:51.355283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:51.355764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:51.356261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:51.358759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dbc3ef63b9ec4366b32435a478e205c5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:51.360172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6bea4-f69d-48e7-8426-5202f836c722 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:51.362641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:51.409694 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3050/6078] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:57:51 2022] GET /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5/users => generated 145 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:51.416381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:51.452208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60a6a-1131-4326-a9d1-6618d32b1a55 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:51.475200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:51.476274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:51.477253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:51.477427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users/54650a025f56449ca55735bd299ebd34` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:51.483814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=54650a025f56449ca55735bd299ebd34)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:51.489394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:51.526864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:51.702660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:51.704938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:51.705976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:51.706708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] PATH_INFO: `/v3/projects/322e7c94d0524c7ebe0663cedcf32ae4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:51.709437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322e7c94d0524c7ebe0663cedcf32ae4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:51.715369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:51.734041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:51.740565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:51.858363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:51.905519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:51.922718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54650a025f56449ca55735bd299ebd34'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:51.954287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3051/6079] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:51 2022] DELETE /identity/v3/users/54650a025f56449ca55735bd299ebd34 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:51.955896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:51.962257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:51.962509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322e7c94d0524c7ebe0663cedcf32ae4', 'request_id': 'req-a21ea608-1899-410e-a4ba-aa5ee4c4a829'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:52.005664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322e7c94d0524c7ebe0663cedcf32ae4', 'request_id': 'req-a21ea608-1899-410e-a4ba-aa5ee4c4a829'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:52.037437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322e7c94d0524c7ebe0663cedcf32ae4', 'request_id': 'req-a21ea608-1899-410e-a4ba-aa5ee4c4a829'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:52.162303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] The token cache is being invalidate because project 322e7c94d0524c7ebe0663cedcf32ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:52.162862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:52.165037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:52.173875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3029/6080] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:50 2022] DELETE /identity/v3/projects/322e7c94d0524c7ebe0663cedcf32ae4 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:52.177195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:52.182180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:52.186192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f39a-0c3d-48bb-bbf7-b1835b2f947a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:52.201197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:52.202286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:52.202749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:52.203261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:52.210338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:52.259736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:52.435589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ea608-1899-410e-a4ba-aa5ee4c4a829 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:52.553534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:52.562237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:52.627428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3052/6081] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:52.629329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:52.645521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:52.760525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:52.764336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:52.764336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:52.764336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users/d3666739b9ab4cb48f6c968db81d018d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:52.772319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d3666739b9ab4cb48f6c968db81d018d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:52.784849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:52.899893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:52.985571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f4ee5-fd12-4a05-a53c-df62e5b15931 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:53.006611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:53.007755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:53.008248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:53.008792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] PATH_INFO: `/v3/users/783daf22faa64d96926429cc79b9ebc3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:53.011684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=783daf22faa64d96926429cc79b9ebc3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:53.018084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:53.192611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.309122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.334941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.417569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.420243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3666739b9ab4cb48f6c968db81d018d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.437192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783daf22faa64d96926429cc79b9ebc3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.443915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783daf22faa64d96926429cc79b9ebc3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.449879 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3030/6082] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:52 2022] DELETE /identity/v3/users/d3666739b9ab4cb48f6c968db81d018d => generated 0 bytes in 1278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:53.457789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:53.465265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:53.705813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783daf22faa64d96926429cc79b9ebc3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.728077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:53.803424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a7c-9e5f-45ae-bb11-115f213a2acd tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:53.813780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:53.815033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:53.815602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:53.817491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users/fc5e9b9b460b413e808d34d547d1d502` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:53.820104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fc5e9b9b460b413e808d34d547d1d502)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:53.824121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:53.878260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783daf22faa64d96926429cc79b9ebc3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.925041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783daf22faa64d96926429cc79b9ebc3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:53.948418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3053/6083] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:52 2022] DELETE /identity/v3/users/783daf22faa64d96926429cc79b9ebc3 => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:54.069550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:54.270324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:54.323017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:54.362483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:54.365585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5e9b9b460b413e808d34d547d1d502'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:54.388103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3031/6084] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:57:53 2022] DELETE /identity/v3/users/fc5e9b9b460b413e808d34d547d1d502 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:54.394259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:54.396315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:54.832688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eac947-c526-4a62-b30e-757d68042beb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:55.146695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:55.148067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:55.148696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:55.155371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/dbc3ef63b9ec4366b32435a478e205c5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:55.164902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dbc3ef63b9ec4366b32435a478e205c5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:55.174178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:55.254851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:55.514418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3054/6085] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:57:54 2022] DELETE /identity/v3/groups/dbc3ef63b9ec4366b32435a478e205c5 => generated 0 bytes in 1121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:57:55.524427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:55.527654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:55.598662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6116d-62f3-4466-a222-af4c3cde9083 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:56.017948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:56.018898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:56.019598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:56.020320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:56.021726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:56.026693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:56.164298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3032/6086] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:55 2022] POST /identity/v3/groups => generated 325 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:56.174768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:56.210595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21002c-08e4-4408-a978-a49ce4cdad64 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:56.277709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:56.290902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:56.290902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:56.290902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:56.290902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:56.305355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:56.486214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:56.497330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3055/6087] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:56 2022] POST /identity/v3/groups => generated 325 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:57:56.531935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f20504-c6e5-449e-a268-9df330a053cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:56.561391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:56.567062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:56.571410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:56.576104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:56.578435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:56.583209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:56.717227 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3033/6088] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:56 2022] POST /identity/v3/groups => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:57:56.725877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:56.759535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250a840-75e1-4e42-9bf5-729e951f6def tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:56.783844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:56.790322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:56.805222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:56.806222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:56.806726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:56.815317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:56.817590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:56.830603 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:57:56.830603 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:57:56.830603 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:57:56.833672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:56.878487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3056/6089] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 4 20:57:56 2022] GET /identity/v3/groups => generated 1485 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 20:57:56.880741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:56.950012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a561913-6276-40c8-a8fe-a130f422874a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:56.980068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:56.988825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:56.989608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:56.990526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/02e770c3921949fd83b9b90dfb1d69d6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:57.024092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=02e770c3921949fd83b9b90dfb1d69d6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:57.040500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:57.087546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:57.219941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aa602-3ba5-4105-b147-44642a2b35b3 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:57.258678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:57.264364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:57.265054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:57.265519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] PATH_INFO: `/v3/projects/ec5b7a33bc12475caae480f784ac9701` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:57.273554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5b7a33bc12475caae480f784ac9701)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:57.282426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:57.383440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3057/6090] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:57:56 2022] DELETE /identity/v3/groups/02e770c3921949fd83b9b90dfb1d69d6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:57.398974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:57.570396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5b7a33bc12475caae480f784ac9701', 'request_id': 'req-80cb94f3-a0dc-4a28-94f7-3af845438fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:57.587863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5b7a33bc12475caae480f784ac9701', 'request_id': 'req-80cb94f3-a0dc-4a28-94f7-3af845438fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:57.624750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5b7a33bc12475caae480f784ac9701', 'request_id': 'req-80cb94f3-a0dc-4a28-94f7-3af845438fec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:57.650451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa5d10-edd3-4de3-b7ce-dd5ca356e8ba tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:57.789225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] The token cache is being invalidate because project ec5b7a33bc12475caae480f784ac9701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:57:57.789725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:57.798606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-80cb94f3-a0dc-4a28-94f7-3af845438fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:57:57.815479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3034/6091] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:57:56 2022] DELETE /identity/v3/projects/ec5b7a33bc12475caae480f784ac9701 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:57.827208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2572-894c-4d60-95bf-57e5f57a0164 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:57.827208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2572-894c-4d60-95bf-57e5f57a0164 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:57.827208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2572-894c-4d60-95bf-57e5f57a0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:57.886295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-966f2572-894c-4d60-95bf-57e5f57a0164 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:57.888665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-966f2572-894c-4d60-95bf-57e5f57a0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:57.967336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:57.968466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:57.969040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:57.969553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/df720f7705054fd29ecc967375d76920` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:58.002088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df720f7705054fd29ecc967375d76920)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:58.006003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:58.009751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:58.288947 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3058/6092] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:57:57 2022] DELETE /identity/v3/groups/df720f7705054fd29ecc967375d76920 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:58.298561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:58.304160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:58.350277 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3035/6093] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:58.368477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:58.368477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:58.371558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:58.526878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:57:58.534176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:57:58.628531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f80b7-368b-4201-a28f-1d7c0af033ce tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:58.658965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:58.659998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:58.660876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:58.661555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/afc9b212cb3040d69e8c5ecc55d8dedf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:58.687455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=afc9b212cb3040d69e8c5ecc55d8dedf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:58.693891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:58.906861 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3036/6094] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:57:58.908622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:58.951623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f88cea-6700-4a98-86ab-f18888d27210 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:58.974947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:58.976177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:58.978012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:58.978602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:58.979992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:57:58.983780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:58.986775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:59.025627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:59.064142 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3037/6095] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:57:59.067192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:59.095825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3d23d-6fb5-4de5-b1b7-f42d75ad95fd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:59.097872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3059/6096] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:57:58 2022] DELETE /identity/v3/groups/afc9b212cb3040d69e8c5ecc55d8dedf => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:57:59.106550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:59.362238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:59.364502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:59.364785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:59.365034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:59.365738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:59.375497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:59.376297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885fa77-b79d-4119-b3f0-a0052c66c654 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:59.417325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:59.418306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:59.419274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:59.420755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:59.427125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:59.446496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:57:59.564753 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3038/6097] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:57:59 2022] POST /identity/v3/projects => generated 385 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:59.566253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:59.681117 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3060/6098] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:59 2022] POST /identity/v3/users => generated 321 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:57:59.681117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:57:59.688734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:59.708094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1462cb-4068-4d28-acef-0e76a0bbcbe5 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:59.928530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf486-b5a9-4b50-bbcc-4a5545816a56 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:57:59.950892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:57:59.952262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:57:59.952493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:57:59.956980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:57:59.958427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:57:59.973758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:00.029279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:00.030463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:00.030974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:00.031510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:00.033750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:00.038992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:00.192720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3039/6099] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:57:59 2022] POST /identity/v3/users => generated 293 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:00.195705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:00.262504 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3061/6100] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:59 2022] POST /identity/v3/groups => generated 326 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:00.265379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:00.287720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a99813-f919-4b0a-bf74-f617d2fd015f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:00.314663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:00.315786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6ba9-50ea-4218-a42a-ce3b8e2f1a1b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:00.317816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:00.318343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:00.318858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:00.320247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:00.328238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:00.337660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:00.338911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:00.339518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:00.340057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/4acc60d7ce5543c38a1fcbb42b37e983/users/76eb25709cc3409192698a20424c3987` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:00.400230 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3040/6101] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:00.401979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:00.424886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4fe9a-bd62-47c2-b653-9f140fda89a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:00.438631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:00.440586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:00.441197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:00.442263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:00.443577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4acc60d7ce5543c38a1fcbb42b37e983, user_id=76eb25709cc3409192698a20424c3987)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:00.443763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:00.448979 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:00.448979 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:58:00.448979 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:58:00.449493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:00.453376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:00.728804 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3062/6102] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:58:00 2022] PUT /identity/v3/groups/4acc60d7ce5543c38a1fcbb42b37e983/users/76eb25709cc3409192698a20424c3987 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:00.730993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:01.010799 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3041/6103] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 610 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:01.017644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:01.086572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8013df-f539-4960-affe-b354e105f503 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:01.133798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8220-3d75-4577-9177-805944d60a7f tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:01.168968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:01.172161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:01.174577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:01.175652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:01.178318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:01.189783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:01.322700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:01.366022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:01.367371 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3063/6104] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:00 2022] POST /identity/v3/groups => generated 325 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:01.370413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:01.370998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:01.371531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] PATH_INFO: `/v3/projects/6aa6c89adf5f4fe79c8eb829190c7700/users/519d2a11d7ee44378a51d99279ae3453/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:01.376897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:01.441080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58074f-0705-4948-8030-d7f2263d38cf tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:01.457984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa6c89adf5f4fe79c8eb829190c7700, user_id=519d2a11d7ee44378a51d99279ae3453, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:01.471510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:01.472727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:01.473804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c936905-2fc6-4471-ad9d-3c1fc78c2bdf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:01.474075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:01.474256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/9f9f14f3ef994083b8f075df9d1e3d48/users/76eb25709cc3409192698a20424c3987` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:01.504566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9f9f14f3ef994083b8f075df9d1e3d48, user_id=76eb25709cc3409192698a20424c3987)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:01.520275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:01.638257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3042/6105] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:01 2022] PUT /identity/v3/projects/6aa6c89adf5f4fe79c8eb829190c7700/users/519d2a11d7ee44378a51d99279ae3453/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:58:01.672895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:01.675208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:01.675208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:01.712765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3064/6106] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:58:01 2022] PUT /identity/v3/groups/9f9f14f3ef994083b8f075df9d1e3d48/users/76eb25709cc3409192698a20424c3987 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:01.720020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:01.865457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] MFA Rules not processed for user `519d2a11d7ee44378a51d99279ae3453`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:01.869405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:01.889507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:02.029004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b6149-88b5-41de-ac1b-9b13cf1285f7 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:02.054227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:02.058757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:02.059399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:02.059898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users/76eb25709cc3409192698a20424c3987/groups` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:02.069327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=76eb25709cc3409192698a20424c3987)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:02.085795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:02.121654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3043/6107] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:02.133298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:02.167759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3065/6108] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 4 20:58:01 2022] GET /identity/v3/users/76eb25709cc3409192698a20424c3987/groups => generated 837 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 20:58:02.176372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:02.229449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc83c7-f24e-4a1e-afa0-53da6a50366b tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:02.262644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:02.263601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:02.264075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:02.265893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/9f9f14f3ef994083b8f075df9d1e3d48` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:02.302968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9f9f14f3ef994083b8f075df9d1e3d48)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:02.320889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:02.376215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353471e-38b9-4ec0-a5ed-2375d72f03bb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:02.405090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:02.406369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:02.407891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:02.407891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:02.411832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:02.419075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:02.721161 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3066/6109] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:58:02 2022] DELETE /identity/v3/groups/9f9f14f3ef994083b8f075df9d1e3d48 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:02.732475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:02.841692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3044/6110] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:02 2022] POST /identity/v3/projects => generated 385 bytes in 713 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:02.846592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:02.851815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:03.026300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531092cf-64a8-471a-83b8-a52b5173fcb6 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:03.093013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:03.257928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:03.259886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:03.260905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:03.261821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/groups/4acc60d7ce5543c38a1fcbb42b37e983` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:03.265248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4acc60d7ce5543c38a1fcbb42b37e983)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:03.277096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:03.283386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32c755-6e09-4513-b0e6-d5b048c48b1d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:03.326888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:03.327685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:03.328166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:03.328649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:03.339856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:03.346902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:03.409696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:03.413806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:03.459677 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3045/6111] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:03.461219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:03.607511 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3067/6112] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:58:02 2022] DELETE /identity/v3/groups/4acc60d7ce5543c38a1fcbb42b37e983 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:03.615056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:03.882560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9bb47-5113-4327-8e64-6e7e39ee7a2d service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:04.022270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e413-868a-4faa-8a17-d93c40f78a21 tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:04.045041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:04.048617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:04.049396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:04.049977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/users/76eb25709cc3409192698a20424c3987` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:04.055796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_user(user_id=76eb25709cc3409192698a20424c3987)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:04.067348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:04.177809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:04.178886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:04.183602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:04.190310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:04.193781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:04.217283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:04.391199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3046/6113] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:03 2022] POST /identity/v3/users => generated 299 bytes in 931 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:04.394092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:04.404645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:04.430723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76eb25709cc3409192698a20424c3987'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.432905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76eb25709cc3409192698a20424c3987'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.463540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041063-7797-44a5-8f8a-5d2e94b09eea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:04.476273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:04.477970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:04.478712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:04.482834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] PATH_INFO: `/v3/users/21f75ea1b9a94d7ebefe98bf691cf406` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:04.487268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f75ea1b9a94d7ebefe98bf691cf406)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:04.493285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:04.578375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76eb25709cc3409192698a20424c3987'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.636323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76eb25709cc3409192698a20424c3987'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.671262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76eb25709cc3409192698a20424c3987'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.711691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3068/6114] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:03 2022] DELETE /identity/v3/users/76eb25709cc3409192698a20424c3987 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:58:04.718020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:04.722976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:04.862907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f75ea1b9a94d7ebefe98bf691cf406'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:04.986254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:05.007007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f75ea1b9a94d7ebefe98bf691cf406'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.039766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f75ea1b9a94d7ebefe98bf691cf406'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.042163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:05.062591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cec43-62fc-4b11-b221-3907520ec04a tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:05.083058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:05.084450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:05.084972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:05.085492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:05.086816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:05.095006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f75ea1b9a94d7ebefe98bf691cf406'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.096663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f75ea1b9a94d7ebefe98bf691cf406'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.097570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7f25d-2063-43e3-b008-8d7d118ccf25 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:05.121876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3047/6115] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:04 2022] DELETE /identity/v3/users/21f75ea1b9a94d7ebefe98bf691cf406 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:05.123467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:05.130887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:05.149588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3069/6116] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:05.150371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:05.150840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:05.164487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:05.237139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:05.240194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:05.393453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255c18-9553-4a13-b6fe-efeeac6caca4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:05.420225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:05.421378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:05.422016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:05.422526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/domains/e1e0daf5e8dd43a5a261c4490989abb0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:05.426935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e1e0daf5e8dd43a5a261c4490989abb0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:05.430272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:05.531183 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3070/6117] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:05.536316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:05.541305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.543562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:05.544549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.653014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6c21-3dfe-42e5-89c1-41282e5b4ab8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:05.832485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.836283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:05.852992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3048/6118] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:05 2022] PATCH /identity/v3/domains/e1e0daf5e8dd43a5a261c4490989abb0 => generated 277 bytes in 730 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:05.861262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:05.875875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:05.928063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:05.930317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:05.930908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:05.931693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] PATH_INFO: `/v3/projects/c39f5a94354a4c468bbee28f09688277/users/78ce4b0370e04fc8ac5e70179cdafef0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.000907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39f5a94354a4c468bbee28f09688277, user_id=78ce4b0370e04fc8ac5e70179cdafef0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:06.019693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:06.125076 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3071/6119] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:05 2022] PUT /identity/v3/projects/c39f5a94354a4c468bbee28f09688277/users/78ce4b0370e04fc8ac5e70179cdafef0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:06.126238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:06.130766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:06.176722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674b9d-e2ee-4c36-b2db-9456295bf2ad tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:06.416341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:06.418979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:06.419961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:06.420710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.424984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:06.453913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6210eb-0b9c-4ece-84ca-77bbffdb63cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:06.469826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:06.478362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a85f39b471a4cbfa9c97a6271460e0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c643b3375dcd4b9cbf2c2181acd08187', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:06.479647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:06.480152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:06.480661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] PATH_INFO: `/v3/domains/e1e0daf5e8dd43a5a261c4490989abb0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.541684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e1e0daf5e8dd43a5a261c4490989abb0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:06.542437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:06.550782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:06.608728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:06.612492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:06.621016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:06.640465 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3049/6120] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:06.642204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:06.650051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:06.683893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:06.688762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7a6e-863e-4ad3-b9b1-bee4ce59ca1f service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:06.718154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:06.719575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:06.720163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:06.720657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.725658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:06.736831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:06.789804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3050/6121] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:06.793711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:06.849522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf0e7-ccdd-444a-8d52-ab3de3a16f83 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:06.875448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:06.876838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:06.877291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:06.877761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] PATH_INFO: `/v3/projects/c39f5a94354a4c468bbee28f09688277/users/78ce4b0370e04fc8ac5e70179cdafef0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.889681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39f5a94354a4c468bbee28f09688277, user_id=78ce4b0370e04fc8ac5e70179cdafef0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:06.905548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b4a9-a68c-4b71-bc95-cbe877065c70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:06.963349 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3051/6122] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:06 2022] PUT /identity/v3/projects/c39f5a94354a4c468bbee28f09688277/users/78ce4b0370e04fc8ac5e70179cdafef0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:06.976851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:06.979347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:06.979877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:06.987752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.079319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] MFA Rules not processed for user `78ce4b0370e04fc8ac5e70179cdafef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:07.085296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:07.172692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.194320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.223892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] The token cache is being invalidate because project e1e0daf5e8dd43a5a261c4490989abb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:07.224387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.225678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.247462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.251202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.251483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3052/6123] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:07.251798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e1e0daf5e8dd43a5a261c4490989abb0', 'request_id': 'req-462a396e-7ce4-4337-91b6-b3ae97f4396d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:07.258810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:07.274100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3072/6124] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:06 2022] DELETE /identity/v3/domains/e1e0daf5e8dd43a5a261c4490989abb0 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:07.280419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:07.292160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e19d4-2e6b-4afb-97a7-80634764de15 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:07.309521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:07.310070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ce4b0370e04fc8ac5e70179cdafef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39f5a94354a4c468bbee28f09688277', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:07.315237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:07.316106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:07.316377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:07.317865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:07.324147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:07.575323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3053/6125] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:07 2022] POST /identity/v3/projects => generated 360 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:07.577345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:07.588291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:07.588932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a396e-7ce4-4337-91b6-b3ae97f4396d tempest-GroupsV3TestJSON-305492077 tempest-GroupsV3TestJSON-305492077-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:07.801789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:07.810628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:07.821953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0521c-937f-497d-b994-b38805f5bdd7 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:07.823568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:07.825133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:07.826181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:07.827537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] PATH_INFO: `/v3/users/25e76463495a4425bca9b54e8ec11f8b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:07.829360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '519d2a11d7ee44378a51d99279ae3453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6aa6c89adf5f4fe79c8eb829190c7700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:07.830457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:07.830925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:07.831434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] PATH_INFO: `/v3/projects/521bf9f931fc493099c797627690242d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:07.833639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e76463495a4425bca9b54e8ec11f8b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:07.834183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] RBAC: Authorizing `identity:delete_project(project_id=521bf9f931fc493099c797627690242d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:07.838038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 04 20:58:07.846983 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:07.856128 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3054/6126] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:07 2022] DELETE /identity/v3/projects/521bf9f931fc493099c797627690242d => generated 136 bytes in 274 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:07.856836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:07.863759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:08.074450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed181-3d38-4cc3-923f-d3b3ec485b64 tempest-ProjectsNegativeTestJSON-1908581719 tempest-ProjectsNegativeTestJSON-1908581719-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:08.102306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78ce4b0370e04fc8ac5e70179cdafef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39f5a94354a4c468bbee28f09688277', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:08.104954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:08.108550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:08.114265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] PATH_INFO: `/v3/projects/521bf9f931fc493099c797627690242d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:08.129051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: Authorizing `identity:delete_project(project_id=521bf9f931fc493099c797627690242d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:08.150018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:08.245206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e76463495a4425bca9b54e8ec11f8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.247734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e76463495a4425bca9b54e8ec11f8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.384791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e76463495a4425bca9b54e8ec11f8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.418293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e76463495a4425bca9b54e8ec11f8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.445107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-effcd071-38d7-46db-b00a-b536751b093a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e76463495a4425bca9b54e8ec11f8b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.483764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3073/6127] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:07 2022] DELETE /identity/v3/users/25e76463495a4425bca9b54e8ec11f8b => generated 0 bytes in 1205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:08.493475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:08.503477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:08.505112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:08.560162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521bf9f931fc493099c797627690242d', 'request_id': 'req-2c6f4695-5218-4f76-a678-34c1feccd4f3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.607752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521bf9f931fc493099c797627690242d', 'request_id': 'req-2c6f4695-5218-4f76-a678-34c1feccd4f3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.616817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:08.623636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:08.643661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521bf9f931fc493099c797627690242d', 'request_id': 'req-2c6f4695-5218-4f76-a678-34c1feccd4f3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.770805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] The token cache is being invalidate because project 521bf9f931fc493099c797627690242d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:08.771867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.776854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:08.779866 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3055/6128] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:07 2022] DELETE /identity/v3/projects/521bf9f931fc493099c797627690242d => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 20:58:08.792184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:08.801935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:08.902296 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3074/6129] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:08.956961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:08.959817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:09.010319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4695-5218-4f76-a678-34c1feccd4f3 tempest-ProjectsNegativeTestJSON-2083568734 tempest-ProjectsNegativeTestJSON-2083568734-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:09.020979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:09.022217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:09.022930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:09.023427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] PATH_INFO: `/v3/users/519d2a11d7ee44378a51d99279ae3453` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:09.025932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519d2a11d7ee44378a51d99279ae3453)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:09.031180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:09.117920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36eda7-c5ae-45ed-b818-6a1b6ae2bd49 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:09.127511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:09.129110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:09.130368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:09.131197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:09.151625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:09.154466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:09.244152 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3075/6130] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:09.391311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:09.458629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519d2a11d7ee44378a51d99279ae3453'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:09.555117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519d2a11d7ee44378a51d99279ae3453'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:09.612892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:09.615891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:09.617461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519d2a11d7ee44378a51d99279ae3453'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:09.688821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519d2a11d7ee44378a51d99279ae3453'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:09.690323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f1c0-1112-4eea-a620-a751af3a2374 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:09.690862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e101af20-a509-4a1f-88bd-6bb22d384713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519d2a11d7ee44378a51d99279ae3453'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:09.711078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3056/6131] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:08 2022] DELETE /identity/v3/users/519d2a11d7ee44378a51d99279ae3453 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:09.718423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:09.718898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:09.719258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:09.720084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:09.721261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:09.721771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:09.722275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] PATH_INFO: `/v3/projects/f386d694b9154960a741f31caafb0e02` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:09.728467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f386d694b9154960a741f31caafb0e02)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:09.751912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:09.808145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:09.819060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:09.835764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:10.149261 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3057/6132] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:10.165334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f386d694b9154960a741f31caafb0e02', 'request_id': 'req-663a1141-fe25-4141-9a01-83cd2ea2b229'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:10.208649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:10.213552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:10.302169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f386d694b9154960a741f31caafb0e02', 'request_id': 'req-663a1141-fe25-4141-9a01-83cd2ea2b229'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:10.331381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f386d694b9154960a741f31caafb0e02', 'request_id': 'req-663a1141-fe25-4141-9a01-83cd2ea2b229'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:10.404864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] The token cache is being invalidate because project f386d694b9154960a741f31caafb0e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:10.405466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:10.411402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-663a1141-fe25-4141-9a01-83cd2ea2b229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:10.427215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3076/6133] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:09 2022] DELETE /identity/v3/projects/f386d694b9154960a741f31caafb0e02 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:10.433771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c53b-c49a-41b5-982a-be9bd8c95e00 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:10.434596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c53b-c49a-41b5-982a-be9bd8c95e00 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:10.440592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c53b-c49a-41b5-982a-be9bd8c95e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:10.497871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae015a6-87af-4ea7-ade1-d4ce5e6bdf05 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:10.513829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4d89c53b-c49a-41b5-982a-be9bd8c95e00 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:10.518166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4d89c53b-c49a-41b5-982a-be9bd8c95e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:10.753741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:10.767721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:10.769528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:10.772296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:10.779454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:10.867206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3077/6134] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:10.892171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:10.898742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:10.899339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:10.991314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:10.994828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:11.023321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:11.023321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:11.023720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3058/6135] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 816 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:11.074728 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3078/6136] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:11.076984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:11.109512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298b170-400b-4ca1-b9b0-b4fc253bf761 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:11.124859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:11.125961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:11.126429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:11.126942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:11.128874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:11.130543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:11.136854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:11.148002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:11.195192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3059/6137] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:11.201057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:11.224788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9874c99-c54f-4d84-9ad3-9cc224db3971 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:11.235318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:11.238062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:11.238062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:11.238062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:11.238775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:11.245757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:11.446113 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3079/6138] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:11 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:11.447494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:11.495795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b16194-d725-4d7f-a82b-fe1f0245afd9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:11.572100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:11.575554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:11.942236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:11.943666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:11.944233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:11.944743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:11.946213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:11.951571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:11.977096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d689cd-fd08-40da-82c1-a6ae9a3114ce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:11.986560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:11.987814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:11.988302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:11.989470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] PATH_INFO: `/v3/users/666a5b75998443b5ae9a778a1e789c89` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:11.992382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666a5b75998443b5ae9a778a1e789c89)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:12.006304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:12.038306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:12.234607 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3060/6139] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:11 2022] POST /identity/v3/users => generated 283 bytes in 789 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:12.236409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:12.260195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd355c-f570-40fa-9d90-360becd82f4b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:12.281400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:12.286263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:12.289933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:12.290968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:12.292446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:12.302062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:12.374920 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3061/6140] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:12.382515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:12.454372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aef957-e238-4521-88d1-be2319ead13e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:12.465729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666a5b75998443b5ae9a778a1e789c89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.467500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666a5b75998443b5ae9a778a1e789c89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.479336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:12.479336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:12.479336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:12.479336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:12.479932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:12.481835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:12.546691 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3062/6141] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:12.548300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:12.551545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:12.593056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666a5b75998443b5ae9a778a1e789c89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.610933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbc288-7f1e-40d2-b14d-0ebfe552c20e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:12.633984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:12.637624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:12.643177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:12.644799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] PATH_INFO: `/v3/projects/d1469bcd4b77414ba7514e71214d588f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:12.651781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1469bcd4b77414ba7514e71214d588f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:12.652565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666a5b75998443b5ae9a778a1e789c89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.662055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:12.690208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666a5b75998443b5ae9a778a1e789c89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.718232 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3080/6142] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:11 2022] DELETE /identity/v3/users/666a5b75998443b5ae9a778a1e789c89 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:12.720334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:12.730737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:12.961836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1469bcd4b77414ba7514e71214d588f', 'request_id': 'req-f07de281-8f08-4e99-bdfa-51125a165575'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.985633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1469bcd4b77414ba7514e71214d588f', 'request_id': 'req-f07de281-8f08-4e99-bdfa-51125a165575'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:12.993729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afd01-c97d-42fd-a7a2-e8df690ae618 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:13.000603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1469bcd4b77414ba7514e71214d588f', 'request_id': 'req-f07de281-8f08-4e99-bdfa-51125a165575'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.210641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:13.211870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:13.212390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:13.213138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] PATH_INFO: `/v3/projects/7322f650ca514b71a687715bcf398d52/users/4beadad11f48498f8aa945abbc4e5cfd/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:13.240505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] The token cache is being invalidate because project d1469bcd4b77414ba7514e71214d588f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:13.241044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.244270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f07de281-8f08-4e99-bdfa-51125a165575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.249147 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3063/6143] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:12 2022] DELETE /identity/v3/projects/d1469bcd4b77414ba7514e71214d588f => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:13.258721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:13.259247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:13.259771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:13.303381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7322f650ca514b71a687715bcf398d52, user_id=4beadad11f48498f8aa945abbc4e5cfd, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:13.318304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:13.324786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:13.329777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:13.357357 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3064/6144] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:13.360119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:13.363576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:13.406586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfe6f2-f20b-4e8e-8b20-eb01589f77f9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:13.427288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:13.427288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:13.427288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:13.427826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] PATH_INFO: `/v3/projects/6aa6c89adf5f4fe79c8eb829190c7700` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:13.431058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa6c89adf5f4fe79c8eb829190c7700)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:13.436513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:13.494573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3081/6145] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:12 2022] PUT /identity/v3/projects/7322f650ca514b71a687715bcf398d52/users/4beadad11f48498f8aa945abbc4e5cfd/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:13.528685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:13.541608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:13.573632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:13.717419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa6c89adf5f4fe79c8eb829190c7700', 'request_id': 'req-cc33524d-336f-40a2-92c1-7da32daa7f86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.758816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa6c89adf5f4fe79c8eb829190c7700', 'request_id': 'req-cc33524d-336f-40a2-92c1-7da32daa7f86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.774671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa6c89adf5f4fe79c8eb829190c7700', 'request_id': 'req-cc33524d-336f-40a2-92c1-7da32daa7f86'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.821569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135025-6c74-480c-9839-e6bbb3486af4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:13.949684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] The token cache is being invalidate because project 6aa6c89adf5f4fe79c8eb829190c7700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:13.950708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.952057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:13.955220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3065/6146] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:13 2022] DELETE /identity/v3/projects/6aa6c89adf5f4fe79c8eb829190c7700 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:13.956771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:13.961215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:13.978841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:13.980105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:13.980739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:13.981324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:13.985460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:14.187248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33524d-336f-40a2-92c1-7da32daa7f86 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:14.189699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:14.193912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:14.197572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:14.198752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:14.199319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:14.199721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] PATH_INFO: `/v3/users/9a85f39b471a4cbfa9c97a6271460e0f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:14.208106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a85f39b471a4cbfa9c97a6271460e0f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:14.228399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:14.245060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:14.251695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3082/6147] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:14.255085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:14.262652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:14.630194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a85f39b471a4cbfa9c97a6271460e0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:14.634393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80e-9f66-41d3-ac73-220f13aab7a1 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:14.647515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:14.648654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:14.650173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:14.650173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:14.661712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:14.709690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:14.713429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83657-4d06-47c8-8a2c-4432ac16ec0e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:14.759264 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3083/6148] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:14.767205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:14.768143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:14.768854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:14.775068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a85f39b471a4cbfa9c97a6271460e0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:14.814612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a85f39b471a4cbfa9c97a6271460e0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:14.868966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a85f39b471a4cbfa9c97a6271460e0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:14.871089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a85f39b471a4cbfa9c97a6271460e0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:14.913699 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3066/6149] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:13 2022] DELETE /identity/v3/users/9a85f39b471a4cbfa9c97a6271460e0f => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:14.926543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:14.930512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:14.931927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] MFA Rules not processed for user `4beadad11f48498f8aa945abbc4e5cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:14.938438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:15.011563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:15.283023 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3084/6150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:15.290884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:15.293548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:15.434505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948a28e-8d74-4472-ba88-62d7aa34c061 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:15.472493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:15.472493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:15.473909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:15.484276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] PATH_INFO: `/v3/users/78ce4b0370e04fc8ac5e70179cdafef0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:15.492535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ce4b0370e04fc8ac5e70179cdafef0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:15.496439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:15.698406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92f6d5-7b57-4438-8664-d210fdbc8ca3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:15.745670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:15.747387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:15.751626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:15.751626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:15.751626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:15.755891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:15.969968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3085/6151] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:15 2022] POST /identity/v3/projects => generated 365 bytes in 680 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:58:15.975380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:16.172483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:16.240167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ce4b0370e04fc8ac5e70179cdafef0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:16.256596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bff4e6-088b-4b3b-bbb9-04df37ec9652 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:16.287983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:16.289304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:16.289733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:16.290173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:16.295640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:16.306024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:16.389818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ce4b0370e04fc8ac5e70179cdafef0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:16.420717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ce4b0370e04fc8ac5e70179cdafef0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:16.491190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3086/6152] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:15 2022] POST /identity/v3/users => generated 289 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:16.493982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:16.532986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ce4b0370e04fc8ac5e70179cdafef0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:16.549193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d96d-bad6-47df-a115-cbbabdb4ec10 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:16.567190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:16.569761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:16.570424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ce4b0370e04fc8ac5e70179cdafef0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:16.570821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:16.571937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:16.573557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:16.577602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:16.609547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3067/6153] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:14 2022] DELETE /identity/v3/users/78ce4b0370e04fc8ac5e70179cdafef0 => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:16.628661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:16.629249 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3087/6154] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:16.635258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:16.970513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9095879-baa2-4d6d-99af-2175d115f7f7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:16.982804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:16.993598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:17.002635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:17.004920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:17.005703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:17.006438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] PATH_INFO: `/v3/projects/7f0233c160324d87b137e7a878a96452/users/0d14bd70accf48f3a17afb63dcdfca12/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:17.050296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199a93f-9bb3-4d40-af09-45f1089f9002 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:17.085284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:17.088873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0233c160324d87b137e7a878a96452, user_id=0d14bd70accf48f3a17afb63dcdfca12, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:17.094081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:17.094081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:17.094081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] PATH_INFO: `/v3/projects/3b95a2aecfd5445e8e78ba2bae3358ca` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:17.100794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:17.120389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b95a2aecfd5445e8e78ba2bae3358ca)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:17.137648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:17.256579 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3068/6155] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:16 2022] PUT /identity/v3/projects/7f0233c160324d87b137e7a878a96452/users/0d14bd70accf48f3a17afb63dcdfca12/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:17.263200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:17.341115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:17.477757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:17.576705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b95a2aecfd5445e8e78ba2bae3358ca', 'request_id': 'req-e83fba67-6ea0-4706-9c87-17f314eb46bd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:17.581495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b75d-fbbf-4ec9-8ed8-44d63f3af252 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:17.761032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b95a2aecfd5445e8e78ba2bae3358ca', 'request_id': 'req-e83fba67-6ea0-4706-9c87-17f314eb46bd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:17.791289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b95a2aecfd5445e8e78ba2bae3358ca', 'request_id': 'req-e83fba67-6ea0-4706-9c87-17f314eb46bd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:17.819881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] The token cache is being invalidate because project 3b95a2aecfd5445e8e78ba2bae3358ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:17.821645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:17.823388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:17.831101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3088/6156] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:16 2022] DELETE /identity/v3/projects/3b95a2aecfd5445e8e78ba2bae3358ca => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:17.833335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:17.844788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:17.896915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:17.898051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:17.898554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:17.899036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:17.900320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:17.903607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:17.955319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3069/6157] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 693 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:17.956955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:17.972082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:18.011194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2dc84-2f21-4f31-a348-573aefe22dd1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:18.041425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:18.051426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:18.051426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:18.051426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] PATH_INFO: `/v3/projects/7f0233c160324d87b137e7a878a96452/users/0d14bd70accf48f3a17afb63dcdfca12/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:18.053439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0233c160324d87b137e7a878a96452, user_id=0d14bd70accf48f3a17afb63dcdfca12, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:18.086059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7dd04-0e84-48f0-bdc7-82a144ae9011 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:18.108149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fba67-6ea0-4706-9c87-17f314eb46bd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:18.140616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3070/6158] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:17 2022] PUT /identity/v3/projects/7f0233c160324d87b137e7a878a96452/users/0d14bd70accf48f3a17afb63dcdfca12/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:18.146816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:18.147658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:18.148094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:18.148589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:18.148829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:18.149087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] PATH_INFO: `/v3/users/a51d34187bc84782bca3bf2a6d4d4e9e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:18.149874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:18.154037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51d34187bc84782bca3bf2a6d4d4e9e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:18.157885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:18.216551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] MFA Rules not processed for user `0d14bd70accf48f3a17afb63dcdfca12`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:18.218905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:18.470727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3071/6159] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:58:18.473879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:18.502489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a201e-64a3-4d27-9994-056386bf093b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:18.525920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:18.525920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:18.525920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:18.527495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:18.527495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:18.531209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:18.560013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51d34187bc84782bca3bf2a6d4d4e9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:18.561467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51d34187bc84782bca3bf2a6d4d4e9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:18.661659 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3072/6160] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:58:18 2022] POST /identity/v3/domains => generated 277 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:18.667982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:18.729753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51d34187bc84782bca3bf2a6d4d4e9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:18.786962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51d34187bc84782bca3bf2a6d4d4e9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:18.825452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51d34187bc84782bca3bf2a6d4d4e9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:18.840482 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3089/6161] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:17 2022] DELETE /identity/v3/users/a51d34187bc84782bca3bf2a6d4d4e9e => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:18.956549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1b56-0926-48da-8212-093541f104cc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:19.253383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:19.256818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:19.257405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:19.257877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:19.261889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:19.268960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:19.288829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:19.291592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:19.453307 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3073/6162] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:58:18 2022] POST /identity/v3/domains => generated 275 bytes in 787 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:58:19.465356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:19.467960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:19.551914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f1c8-884d-4831-85f1-6b3ca9a7f8b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:19.754599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297c7e1-576c-42b2-bccc-b47c4b933281 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:19.772824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:19.774203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:19.774871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:19.775529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:19.776991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:19.787232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:19.820165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:19.846118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:19.850995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:19.851516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:19.852041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] PATH_INFO: `/v3/projects/c643b3375dcd4b9cbf2c2181acd08187` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:19.857512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c643b3375dcd4b9cbf2c2181acd08187)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:19.869019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:19.934274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:19.949595 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3074/6163] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:58:19 2022] POST /identity/v3/domains => generated 277 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:58:19.956752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:20.185102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c643b3375dcd4b9cbf2c2181acd08187', 'request_id': 'req-c824720c-4b82-437f-8eeb-50240c29c7c3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:20.292982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c643b3375dcd4b9cbf2c2181acd08187', 'request_id': 'req-c824720c-4b82-437f-8eeb-50240c29c7c3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:20.322758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c643b3375dcd4b9cbf2c2181acd08187', 'request_id': 'req-c824720c-4b82-437f-8eeb-50240c29c7c3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:20.330254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd7b-28f3-4846-b237-597733f1ea22 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:20.377956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] The token cache is being invalidate because project c643b3375dcd4b9cbf2c2181acd08187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:20.378902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:20.382628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:20.391119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3090/6164] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:19 2022] DELETE /identity/v3/projects/c643b3375dcd4b9cbf2c2181acd08187 => generated 0 bytes in 1104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:20.393281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:20.401436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:20.575991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:20.577122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:20.577572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:20.578066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:20.579557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:20.586682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302c18e-2f5d-426e-aa07-22597ed3c6f9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:20.694866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824720c-4b82-437f-8eeb-50240c29c7c3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:20.718358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:20.719605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:20.723726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:20.727889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] PATH_INFO: `/v3/projects/c39f5a94354a4c468bbee28f09688277` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:20.734758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39f5a94354a4c468bbee28f09688277)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:20.752728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:20.845030 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3075/6165] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 4 20:58:19 2022] POST /identity/v3/domains => generated 279 bytes in 889 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 20:58:20.848627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:20.854468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:20.855189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:20.941061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:20.948327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:21.106238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39f5a94354a4c468bbee28f09688277', 'request_id': 'req-d623c63d-13f9-43fb-8208-18bad026d2ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:21.247688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39f5a94354a4c468bbee28f09688277', 'request_id': 'req-d623c63d-13f9-43fb-8208-18bad026d2ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:21.289088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39f5a94354a4c468bbee28f09688277', 'request_id': 'req-d623c63d-13f9-43fb-8208-18bad026d2ae'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:21.350423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] The token cache is being invalidate because project c39f5a94354a4c468bbee28f09688277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:21.350965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:21.360754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:21.378730 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3091/6166] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:20 2022] DELETE /identity/v3/projects/c39f5a94354a4c468bbee28f09688277 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:21.382667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:21.390618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:21.411346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:21.422689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3076/6167] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:21.428540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:21.433759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:21.509127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf80e9-18c1-4260-9e23-dff5ced60e83 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:21.824574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c63d-13f9-43fb-8208-18bad026d2ae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:21.840180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:21.851491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:21.852708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:21.854324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:21.854978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/4c6c0da104184ecebd54cbba809b70f3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:21.858787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:21.860074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:21.860588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:21.861094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] PATH_INFO: `/v3/projects/25b7551b300a463789e2eebf5a7b189b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:21.871582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b7551b300a463789e2eebf5a7b189b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:21.883490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:21.915516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4c6c0da104184ecebd54cbba809b70f3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:21.922875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:22.054735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.093198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.241921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b7551b300a463789e2eebf5a7b189b', 'request_id': 'req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.270343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b7551b300a463789e2eebf5a7b189b', 'request_id': 'req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.293068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b7551b300a463789e2eebf5a7b189b', 'request_id': 'req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.409560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] The token cache is being invalidate because project 25b7551b300a463789e2eebf5a7b189b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:22.410168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.416135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8e8a2c80-d2f5-46b6-a2b8-e796e1fae13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.420168 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3077/6168] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:21 2022] DELETE /identity/v3/projects/25b7551b300a463789e2eebf5a7b189b => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:22.423277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7166-4996-4c9a-bc9f-ea1a73cbca4a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:22.428606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7166-4996-4c9a-bc9f-ea1a73cbca4a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:22.429014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7166-4996-4c9a-bc9f-ea1a73cbca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:22.435351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.461118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:22.486953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d43e7166-4996-4c9a-bc9f-ea1a73cbca4a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:22.490767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d43e7166-4996-4c9a-bc9f-ea1a73cbca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:22.557234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.578377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.626843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project 4c6c0da104184ecebd54cbba809b70f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:22.628297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.634391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.677282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.687171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.691394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-735fdd60-a228-4e1e-b077-0397c1b76461 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4c6c0da104184ecebd54cbba809b70f3', 'request_id': 'req-735fdd60-a228-4e1e-b077-0397c1b76461'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:22.736154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3092/6169] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:21 2022] DELETE /identity/v3/domains/4c6c0da104184ecebd54cbba809b70f3 => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:22.740056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ed2d-bf49-4c7f-b50c-a4524605c9d9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:22.741022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ed2d-bf49-4c7f-b50c-a4524605c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:22.749957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ed2d-bf49-4c7f-b50c-a4524605c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:22.774047 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3078/6170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:22.774047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:22.775892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:22.776467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:22.852445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3a80ed2d-bf49-4c7f-b50c-a4524605c9d9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:22.857700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:22.859206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3a80ed2d-bf49-4c7f-b50c-a4524605c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:22.859817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:22.897632 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3079/6171] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:22.899345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:22.913648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:22.919538 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3093/6172] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:22.926819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5785-a666-46ee-a876-66676f01e0e8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:22.928362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5785-a666-46ee-a876-66676f01e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:22.931758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada5785-a666-46ee-a876-66676f01e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:22.999939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4ada5785-a666-46ee-a876-66676f01e0e8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:23.003282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4ada5785-a666-46ee-a876-66676f01e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:23.025545 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3094/6173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:23.028256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.029550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.030308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.043903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:23.079648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:23.081940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:23.096628 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3095/6174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:23.099064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.117501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfeddb-77aa-46ba-850a-f5f156932a97 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.131439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.132593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.133170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.133645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.135283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:23.136118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.140328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.177613 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3096/6175] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:23.179759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.237439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4ee7-8366-4161-9ca0-f1ebba14a501 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.246591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886610d-6df9-4ffb-a6e0-a51ab78cd010 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.251436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.252647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.253120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.253607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.256788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.257690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.257883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.258375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.258854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.262315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:23.262873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.265073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.266078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.316539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3097/6176] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:23.318651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.362219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f59c-8e21-4448-86f4-738d20f1259f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.372331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3080/6177] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:58:22 2022] POST /identity/v3/domains => generated 248 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:23.372331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.375083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.376371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.376692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.377579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.378720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:23.379346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.384260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.414661 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3098/6178] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:23.416550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.460658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb199-f64f-4e9e-bfbd-109c9b742d66 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.502632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:23.625150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990e46-cc78-4876-8876-d5418784492f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:23.635848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.637168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.638075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.638843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.639247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.647192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.712740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:23.714243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:23.714858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:23.715714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:23.717387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:23.721971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:23.866612 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3081/6179] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] POST /identity/v3/projects => generated 375 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:23.869497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:23.913567 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3099/6180] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] POST /identity/v3/projects => generated 365 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:23.915520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:24.114378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4639a-a7eb-4c07-89e1-02acb0a2e9e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:24.123010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5177ab-4125-4a6a-b864-7e43ee7390b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:24.136048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:24.137475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:24.137992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:24.138492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:24.139846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:24.144723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:24.158459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:24.303318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:24.304553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:24.305073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:24.305568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/536bed370f7445fab4cdb742eb7bceea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:24.347811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=536bed370f7445fab4cdb742eb7bceea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:24.352783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:24.388276 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3100/6181] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:23 2022] POST /identity/v3/projects => generated 363 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:24.390177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:24.417244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:24.420571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:24.582914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf4e8e-8aea-4df2-a345-031df07c0e91 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:24.591452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:24.593390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:24.604084 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3082/6182] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:23 2022] PATCH /identity/v3/domains/536bed370f7445fab4cdb742eb7bceea => generated 249 bytes in 737 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:24.606169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:24.616391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:24.711623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:24.852541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:24.853716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:24.854345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:24.854938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:24.856405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:24.860481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:24.896235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ac67-fdf4-4a5f-8a28-5dcb9883ff70 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:24.906718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:24.919427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:24.920015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:24.920526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:24.926142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:24.937704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.025792 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3101/6183] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:24 2022] POST /identity/v3/users => generated 288 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:25.027624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.030747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:25.063426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9e22-3ea2-45e3-b2cc-4df3f0bc113a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.073061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.074252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.074748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.075266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.076539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.081589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.196213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3083/6184] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:24 2022] POST /identity/v3/users => generated 283 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:25.196213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.198218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:25.252660 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3102/6185] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:25 2022] POST /identity/v3/users => generated 282 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:25.257197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.265068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:25.342766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf93a-6966-4a71-ac57-5801c0837c8a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.385041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.386531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.386968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.387489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.388712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.401392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.441459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7c27-5f12-4ee6-ad10-c06ebf2a5541 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.448654 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3103/6186] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:25.450667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.468853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.471627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.472688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.473516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/536bed370f7445fab4cdb742eb7bceea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.503818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98b32-68f4-4981-bcb8-e7e8a094b489 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.524932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=536bed370f7445fab4cdb742eb7bceea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.528531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.529830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.530035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.530659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.532918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.534438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.538354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.597564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:25.606975 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3104/6187] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:25.609438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '536bed370f7445fab4cdb742eb7bceea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:25.611841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.663915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920976-e411-4f67-8cc3-11a60466008b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.699888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.702638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.705747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.706419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.710505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.716983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.746070 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3105/6188] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:25.747858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.776662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100b47c-1a90-4abd-9e5a-290a38dd719c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.789920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:25.791416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:25.792050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:25.792767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:25.794794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:25.799314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:25.825040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3106/6189] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:25.827409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:25.840163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:25.850395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c153ffc-b421-47ae-bce1-b2d46b7cd688 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:25.867710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:25.887356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:25.906471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:26.052225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project 536bed370f7445fab4cdb742eb7bceea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:26.053034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:26.056207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:26.059402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:26.060540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:26.061041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:26.061861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:26.063113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:26.064528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:26.068058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:26.080135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:26.090049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:26.093120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '536bed370f7445fab4cdb742eb7bceea', 'request_id': 'req-b490ade2-2eef-4eed-b234-702636351b8a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:26.098963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3107/6190] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:26.098963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:26.102414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:26.106850 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3084/6191] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:25 2022] DELETE /identity/v3/domains/536bed370f7445fab4cdb742eb7bceea => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:26.108651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:26.112601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:26.143498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb2a9-ebaa-4a20-9208-f248d9bae2d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:26.151391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ade2-2eef-4eed-b234-702636351b8a tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:26.161888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:26.163195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:26.163673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:26.163876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:26.164206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] PATH_INFO: `/v3/projects/3900b8e7bbd1407cb2fabf04ff39acae/users/a41b2bdae45f42d0a473c4777e9abe68/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:26.166460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:26.167953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:26.168867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:26.173366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:26.180838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:26.214925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3108/6192] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:26.219759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:26.224777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:26.238629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3900b8e7bbd1407cb2fabf04ff39acae, user_id=a41b2bdae45f42d0a473c4777e9abe68, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:26.245787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:26.270597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc2703-eca1-40e6-80d2-74d1689d5e68 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:26.300966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:26.302350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:26.302773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:26.303341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] PATH_INFO: `/v3/projects/bd170b1b29e349dda205dcbd8e5c1854/users/6a3bc25254ae4b9c8901f75b0dc6ec74/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:26.352709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd170b1b29e349dda205dcbd8e5c1854, user_id=6a3bc25254ae4b9c8901f75b0dc6ec74, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:26.358946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:26.485986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3085/6193] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:26 2022] PUT /identity/v3/projects/3900b8e7bbd1407cb2fabf04ff39acae/users/a41b2bdae45f42d0a473c4777e9abe68/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:26.490499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:26.494035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:26.533347 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3109/6194] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:26 2022] PUT /identity/v3/projects/bd170b1b29e349dda205dcbd8e5c1854/users/6a3bc25254ae4b9c8901f75b0dc6ec74/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:26.546103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:26.799947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000905e-93c3-41ad-b536-b67c2ecb8d58 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:26.847947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be23c-c110-466f-b11a-f685d4a03163 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:26.868080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:26.871321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:26.871947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:26.874298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] PATH_INFO: `/v3/projects/4108981a7f8b42c9a29067d2f5f7c14a/users/68fe1ce265704ce4a3de83358e5ae1ee/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:26.908296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4108981a7f8b42c9a29067d2f5f7c14a, user_id=68fe1ce265704ce4a3de83358e5ae1ee, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:26.913188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbb503-3bef-4ebe-9301-2d734aa6ece5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:27.011752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3110/6195] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:26 2022] PUT /identity/v3/projects/4108981a7f8b42c9a29067d2f5f7c14a/users/68fe1ce265704ce4a3de83358e5ae1ee/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:27.015347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c388-9b0f-4a6b-9135-6f9da4b036e1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:27.015871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c388-9b0f-4a6b-9135-6f9da4b036e1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:27.018514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c388-9b0f-4a6b-9135-6f9da4b036e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:27.039859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:27.051642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:27.051642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:27.051642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:27.063561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:27.072546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5ded7-6924-49d9-84f7-271f99d6a2e9 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:27.139508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-68f0c388-9b0f-4a6b-9135-6f9da4b036e1 None None] MFA Rules not processed for user `a41b2bdae45f42d0a473c4777e9abe68`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:27.144429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-68f0c388-9b0f-4a6b-9135-6f9da4b036e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:27.244120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3086/6196] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:58:26 2022] POST /identity/v3/domains => generated 278 bytes in 756 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:27.258796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:27.263397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:27.263397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:27.390946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:27.436505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] MFA Rules not processed for user `6a3bc25254ae4b9c8901f75b0dc6ec74`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:27.441010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:27.451908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3111/6197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:27.456464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:27.458033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:27.458537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:27.626752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] MFA Rules not processed for user `68fe1ce265704ce4a3de83358e5ae1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:27.650049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:27.745704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:27.857129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3087/6198] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 612 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:27.859800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:27.998596 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3112/6199] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:28.005611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:28.111897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53374-233b-46ba-8950-af832dfaa394 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:28.125125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:28.127257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:28.127880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:28.128559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/22f2651cfb6a47da90861297060a4300` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:28.160374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=22f2651cfb6a47da90861297060a4300)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:28.164995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:28.237114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.239110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.249041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6db2-a91a-4c06-a2f2-e9f1e44f01c8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:28.401080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:28.402741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:28.403543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:28.404211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:28.405959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:28.411371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:28.437601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.440352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.449347 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3088/6200] 10.222.0.78 () {60 vars in 1250 bytes} [Tue Oct 4 20:58:27 2022] PATCH /identity/v3/domains/22f2651cfb6a47da90861297060a4300 => generated 277 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:28.451253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:28.462094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:28.485745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8df0-a168-4464-b4ca-d89273e14d08 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:28.495552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:28.496757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:28.497392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:28.497788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] PATH_INFO: `/v3/users/3fbac1f4466849ebbc958b2a78b79e22` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:28.500282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbac1f4466849ebbc958b2a78b79e22)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:28.504101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:28.626035 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3113/6201] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:28 2022] POST /identity/v3/projects => generated 375 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:28.628128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:28.632654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:28.696956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:28.826051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fcdd6-6faa-43fa-90e3-b5d350cc5287 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:28.830791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbac1f4466849ebbc958b2a78b79e22'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.842867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:28.847226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:28.847226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:28.847226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:28.847226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:28.851529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:28.967205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbac1f4466849ebbc958b2a78b79e22'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:28.984594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbac1f4466849ebbc958b2a78b79e22'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:29.014096 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3114/6202] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:28 2022] POST /identity/v3/projects => generated 361 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:29.016830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.022498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbac1f4466849ebbc958b2a78b79e22'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:29.023761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbac1f4466849ebbc958b2a78b79e22'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:29.023992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.037475 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3089/6203] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:28 2022] DELETE /identity/v3/users/3fbac1f4466849ebbc958b2a78b79e22 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:29.038841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.040933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.083638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.190466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3465f1-22f2-4358-8757-1062869fa3ea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.200078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.201296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.201956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.202585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/22f2651cfb6a47da90861297060a4300` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.210513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70783-7af6-4769-b692-3558ed0eadb0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.228084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=22f2651cfb6a47da90861297060a4300)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.232205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.240921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3090/6204] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:58:29 2022] GET /identity/v3/domains/22f2651cfb6a47da90861297060a4300 => generated 277 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:29.242726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.246246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.358452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.359621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.360610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.360610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.361879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.366777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.415909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086657d-aa46-49f5-86f9-a318a51ed0ec tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.424649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.425790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.426336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.426858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.428322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.432619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aab77-700a-495e-8154-1c1b928dbb93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.554223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3115/6205] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:29 2022] POST /identity/v3/projects => generated 365 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:29.556039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.559262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.579043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3091/6206] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:29 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:29.579043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.579716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.580268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.627324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:29.630285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.657119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.702304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76ff24-d6ca-4863-a34e-5fe8af286851 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.710456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.711387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.712022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.713324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.714193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.720828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.760757 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3092/6207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:29.760757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.832262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.857873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e067e-08c5-408e-8385-1c75357121e2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.864384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.865772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.866267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.866678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/22f2651cfb6a47da90861297060a4300` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.868714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=22f2651cfb6a47da90861297060a4300)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.879025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.883192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3116/6208] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:29 2022] POST /identity/v3/users => generated 287 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:29.884295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:29.886544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:29.905054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ddd3-8ad2-4b60-8a17-83d0b1ed407b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:29.916173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:29.916889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:29.917205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:29.917577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:29.918411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:29.921361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:29.941827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:29.948554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '22f2651cfb6a47da90861297060a4300'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.098101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3117/6209] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:29 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:30.098101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.145405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91436-4707-4f5b-a069-03f6fc46aa81 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.163955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.165479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.170668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.172718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.174636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.179931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:30.202984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.219637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.221816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3118/6210] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:30.227193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.236078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.236845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.320936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a28bb-9371-4c2f-93ca-f8630cf06dd9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.367950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project 22f2651cfb6a47da90861297060a4300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:30.368465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.371081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.392252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.400098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.401624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '22f2651cfb6a47da90861297060a4300', 'request_id': 'req-3e5a20f3-77fe-455a-99e0-af5835a7bc32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:30.420496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3093/6211] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:29 2022] DELETE /identity/v3/domains/22f2651cfb6a47da90861297060a4300 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:30.422173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.422398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.424501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.425744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.427089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.428694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.441219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.639877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a20f3-77fe-455a-99e0-af5835a7bc32 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.652681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.653802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.654307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.654894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.657386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.666026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:30.673962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.686143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:30.704346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3094/6212] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:30.706833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.710099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.731085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3119/6213] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:30.732698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.735026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072e13-b30a-463f-acfd-26df3bf6e2e1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.743612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.747541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.747777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.747934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.747934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.747934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.750631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:30.763669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:30.777105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3095/6214] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:30.780300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:30.784460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:30.785316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965265d-953d-4549-9c4a-b4611e7dcfc7 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.803820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.806349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.806657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.807348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] PATH_INFO: `/v3/projects/379adfc187154c999a7426e782951e94/users/0be4e15a72d84e39b900f021c36e161d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.836981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:30.868536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379adfc187154c999a7426e782951e94, user_id=0be4e15a72d84e39b900f021c36e161d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.882243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:30.979373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45149e1-f031-4cf4-85b9-0a5e5484b711 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:30.989950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:30.991383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:30.992548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:30.993090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:30.994391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:30.996580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.024346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3096/6215] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:58:30 2022] GET /identity/v3/domains => generated 1347 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:31.025801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.057807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666cc20-2709-4e5d-8c72-d79fe3a636ea tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.075894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.077917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.079594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.080621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] PATH_INFO: `/v3/projects/5afeead2f2774e36a4fcb67e8b55c630/users/77c8347d33f2416eb915fac17da5a403/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.091401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3120/6216] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:30 2022] PUT /identity/v3/projects/379adfc187154c999a7426e782951e94/users/0be4e15a72d84e39b900f021c36e161d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:31.091401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.128955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afeead2f2774e36a4fcb67e8b55c630, user_id=77c8347d33f2416eb915fac17da5a403, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.137988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.263597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c6a59-2134-4b19-a58d-6d6c4dfb18a2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.280154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.284760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.285410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.285948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] PATH_INFO: `/v3/projects/22b8f44c8127471b9d35a93492f2d1c8/users/66a66469515a41d1bb9323751e23860d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.294303 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3097/6217] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:31 2022] PUT /identity/v3/projects/5afeead2f2774e36a4fcb67e8b55c630/users/77c8347d33f2416eb915fac17da5a403/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:31.299000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.369796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b8f44c8127471b9d35a93492f2d1c8, user_id=66a66469515a41d1bb9323751e23860d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.383206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.450676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1219162-4cd7-4145-802b-ec6b4c7df3fb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.463631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.467698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.468206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.468812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/22f2651cfb6a47da90861297060a4300` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.486096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find domain: 22f2651cfb6a47da90861297060a4300.: keystone.exception.DomainNotFound: Could not find domain: 22f2651cfb6a47da90861297060a4300. Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 22f2651cfb6a47da90861297060a4300. Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:31.498319 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:31.500729 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 22f2651cfb6a47da90861297060a4300. Oct 04 20:58:31.503014 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:31.505942 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3098/6218] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:31 2022] PATCH /identity/v3/domains/22f2651cfb6a47da90861297060a4300 => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:31.505942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.522348 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3121/6219] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:31 2022] PUT /identity/v3/projects/22b8f44c8127471b9d35a93492f2d1c8/users/66a66469515a41d1bb9323751e23860d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:31.525234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.657205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0c398-512b-415e-86c6-b81278a82d03 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.657478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a3baf-28bf-47c3-b656-9273fa0579b4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.664201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.665091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.665377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.665706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.670306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.670505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.670505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.670676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.670751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.670751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.671520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.675247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.685204 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3099/6220] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:31.686450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.713627 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3122/6221] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:31.713627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.728066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:31.735200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7972a-91f9-42c4-83ee-c67e6a80ac91 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.745300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.746322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.747646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.747646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.749058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.752286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.775854 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3123/6222] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:31.777068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.792963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b09c-f592-406f-afde-a2d3d90dcd96 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.800026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.801091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.802057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.802456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] PATH_INFO: `/v3/projects/379adfc187154c999a7426e782951e94/users/0be4e15a72d84e39b900f021c36e161d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.805831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379adfc187154c999a7426e782951e94, user_id=0be4e15a72d84e39b900f021c36e161d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.811293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:31.833263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5019a-dd38-425b-a502-463f7a078077 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:31.835358 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3124/6223] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:31 2022] PUT /identity/v3/projects/379adfc187154c999a7426e782951e94/users/0be4e15a72d84e39b900f021c36e161d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:31.836713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:31.926146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:31.992946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:31.995024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:31.995605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:31.996098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:31.997613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:31.998131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55695c-7d39-4316-9ba7-3eea9f94ef29 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:32.000944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a4de9-ff72-4e64-ba12-a2bed577f944 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:32.008385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:32.010961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.011567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.012243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] PATH_INFO: `/v3/projects/5afeead2f2774e36a4fcb67e8b55c630/users/77c8347d33f2416eb915fac17da5a403/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.016445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afeead2f2774e36a4fcb67e8b55c630, user_id=77c8347d33f2416eb915fac17da5a403, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:32.022749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:32.046669 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3125/6224] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:31 2022] PUT /identity/v3/projects/5afeead2f2774e36a4fcb67e8b55c630/users/77c8347d33f2416eb915fac17da5a403/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:32.048211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:32.142440 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3100/6225] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:58:31 2022] POST /identity/v3/domains => generated 276 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:32.150204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebe84-5866-4755-9877-d5cfca5951c3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.151431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebe84-5866-4755-9877-d5cfca5951c3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.151431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebe84-5866-4755-9877-d5cfca5951c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.194849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97c866-e87a-444e-a0f6-e62c96d5d150 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:32.210500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f37ebe84-5866-4755-9877-d5cfca5951c3 None None] MFA Rules not processed for user `0be4e15a72d84e39b900f021c36e161d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:32.212849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f37ebe84-5866-4755-9877-d5cfca5951c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:32.415809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:32.418198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.419215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.420013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] PATH_INFO: `/v3/projects/22b8f44c8127471b9d35a93492f2d1c8/users/66a66469515a41d1bb9323751e23860d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.424740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b8f44c8127471b9d35a93492f2d1c8, user_id=66a66469515a41d1bb9323751e23860d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:32.432155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:32.454998 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3101/6226] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:32.459966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.459966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.459966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.468067 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3126/6227] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:32 2022] PUT /identity/v3/projects/22b8f44c8127471b9d35a93492f2d1c8/users/66a66469515a41d1bb9323751e23860d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:32.468067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:32.531409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] MFA Rules not processed for user `77c8347d33f2416eb915fac17da5a403`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:32.533832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:32.632063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:32.692469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574754e7-e04e-4b30-a3e3-e5e02273801b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:32.716062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:32.717147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.717534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.717815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.718670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:32.728663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18221269-9b83-46e3-88dd-606d6eb8000f tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:32.745260 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3102/6228] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:32.748541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:32.792612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:32.904802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6f7d-e2db-4d78-a212-f3bbe280c3bf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:32.917322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3127/6229] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:32 2022] POST /identity/v3/users => generated 348 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:32.919022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.920789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:32.921078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.921218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.921863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:32.922349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:32.922842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:32.924095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:32.939403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:32.973906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] MFA Rules not processed for user `66a66469515a41d1bb9323751e23860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:32.975691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:33.137256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3128/6230] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:33.146829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:33.174382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0101-1f94-47b5-b04a-b0b84fca9d75 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:33.184070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:33.185552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:33.186355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:33.188323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:33.189998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:33.196140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:33.221890 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3103/6231] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:32 2022] POST /identity/v3/projects => generated 333 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:33.221890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:33.345447 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3129/6232] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:58:33 2022] POST /identity/v3/roles => generated 235 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:33.349060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:33.353771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:33.483858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85f62f-a1aa-46ac-832a-ae238fdefab0 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:33.507235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:33.508918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:33.509867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:33.510662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:33.512120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:33.521275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:33.543362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c161f-f375-45a1-bd67-f5dde599d722 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:33.711745 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3104/6233] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:33 2022] POST /identity/v3/groups => generated 324 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:33.714346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:33.725405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:33.726579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:33.727082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:33.727656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:33.820764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:33.859259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:33.905499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b956-e1c3-41dd-800e-6e88aa9e4bf4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:33.933254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:33.934332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:33.934821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:33.935353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:33.939571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:33.942898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:33.944089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:33.950798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:33.975562 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3130/6234] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:33.980042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:33.983606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:34.178871 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3105/6235] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:58:33 2022] POST /identity/v3/projects => generated 332 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:34.182363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:34.349327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93a1d-2ef8-4cca-a0d4-865b0470bbbc service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:34.517066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d12615-3890-412e-ae78-f1aac5f24800 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:34.537696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:34.538755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:34.539296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:34.539790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:34.541620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:34.548730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:34.587894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:34.589402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:34.589976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:34.590460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] PATH_INFO: `/v3/projects/a9517b45f1ab4b7ca1b6b984c5ec2c37` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:34.593706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9517b45f1ab4b7ca1b6b984c5ec2c37)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:34.597662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:34.719240 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3106/6236] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:58:34 2022] POST /identity/v3/roles => generated 235 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:34.720043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:34.899226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26538-c227-4449-a804-f2f022e604cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:34.911815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:34.913342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:34.913895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:34.914583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/34bb77967fe5469f9e324c2bd8c84715` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:34.918042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34bb77967fe5469f9e324c2bd8c84715)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:34.921749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:34.979402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:34.981072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:34.995454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9517b45f1ab4b7ca1b6b984c5ec2c37', 'request_id': 'req-f9240dc2-b841-481b-bf2c-409704139aa2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.154138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.160478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.178531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3107/6237] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:34 2022] PATCH /identity/v3/domains/34bb77967fe5469f9e324c2bd8c84715 => generated 277 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:35.180431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:35.181127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9517b45f1ab4b7ca1b6b984c5ec2c37', 'request_id': 'req-f9240dc2-b841-481b-bf2c-409704139aa2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.192536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:35.195870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9517b45f1ab4b7ca1b6b984c5ec2c37', 'request_id': 'req-f9240dc2-b841-481b-bf2c-409704139aa2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.226450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] The token cache is being invalidate because project a9517b45f1ab4b7ca1b6b984c5ec2c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:35.227849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.232060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:35.240839 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3131/6238] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:33 2022] DELETE /identity/v3/projects/a9517b45f1ab4b7ca1b6b984c5ec2c37 => generated 0 bytes in 1264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:35.245300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:35.254325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:35.297026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:35.401416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:35.595358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa3fff-d761-4d79-811f-a4443ed21afc tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:35.648114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:35.656432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:35.657052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:35.659368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:35.662208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:35.682042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:35.706280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9240dc2-b841-481b-bf2c-409704139aa2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:35.960038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3108/6239] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:35 2022] POST /identity/v3/projects => generated 356 bytes in 781 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:35.965415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:35.974497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:36.039742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:36.055308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:36.055823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:36.063724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:36.069059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:36.081130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:36.257246 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3132/6240] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:58:35 2022] POST /identity/v3/roles => generated 234 bytes in 1016 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:36.278782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:36.285883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69127d4e-0cfc-4399-aac9-4dbaa7d84f2f tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:36.286993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:36.306338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:36.309740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:36.310805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:36.311852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/34bb77967fe5469f9e324c2bd8c84715` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:36.352345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34bb77967fe5469f9e324c2bd8c84715)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:36.363423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:36.482628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:36.499186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:36.579084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2493b3-021f-41aa-86a7-0154f4fa9249 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:36.710664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:36.730946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:36.732236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:36.732984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:36.733468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] PATH_INFO: `/v3/users/bd43be1fd9f94690afe4a5bfb418caef` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:36.735822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd43be1fd9f94690afe4a5bfb418caef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:36.739660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:36.932004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:37.163103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd43be1fd9f94690afe4a5bfb418caef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.164567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd43be1fd9f94690afe4a5bfb418caef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.174338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184af4a2a5c64d2897f38287202230f5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.318006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd43be1fd9f94690afe4a5bfb418caef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.401708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd43be1fd9f94690afe4a5bfb418caef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.409756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184af4a2a5c64d2897f38287202230f5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.447485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184af4a2a5c64d2897f38287202230f5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.448707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd43be1fd9f94690afe4a5bfb418caef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.479868 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3133/6241] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:36 2022] DELETE /identity/v3/users/bd43be1fd9f94690afe4a5bfb418caef => generated 0 bytes in 1222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:37.495050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:37.498419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:37.507583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184af4a2a5c64d2897f38287202230f5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.508726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184af4a2a5c64d2897f38287202230f5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.840231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.862885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.889128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:37.890013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460ad46-cf92-4603-8bae-fddeee268058 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.040180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project 34bb77967fe5469f9e324c2bd8c84715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:38.042616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:38.047648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:38.081871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.083252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.083721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.084248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.085568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.087036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:38.090006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:38.103790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:38.104901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34bb77967fe5469f9e324c2bd8c84715', 'request_id': 'req-c48425c7-6a3e-4028-a574-dcc16187cb9b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:38.127617 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3109/6242] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:35 2022] DELETE /identity/v3/domains/34bb77967fe5469f9e324c2bd8c84715 => generated 0 bytes in 2167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:38.129198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.133922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:38.167506 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3134/6243] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 4 20:58:37 2022] GET /identity/v3/projects => generated 8548 bytes in 674 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:38.169301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.172727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:38.224677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:38.346383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48425c7-6a3e-4028-a574-dcc16187cb9b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.370502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.370832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb73-2f42-493f-8bcd-ecf3c41d4dbf tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.371006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.371006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.371006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.371006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.374102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:38.379764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.383125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.384061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.384813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/34bb77967fe5469f9e324c2bd8c84715` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.402110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=34bb77967fe5469f9e324c2bd8c84715)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.408123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find domain: 34bb77967fe5469f9e324c2bd8c84715.: keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:38.435082 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:38.437071 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:38.438793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3135/6244] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:58:38 2022] GET /identity/v3/domains/34bb77967fe5469f9e324c2bd8c84715 => generated 112 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:38.440327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.446151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:38.515122 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3110/6245] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:58:38 2022] POST /identity/v3/domains => generated 276 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:38.518509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbc160-fcc5-4cb7-9d16-9762f4c5a145 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.519931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.771084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.772849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.775127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.778468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.778468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:38.778468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.782400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:38.836375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cc13-9862-4370-96aa-a2bdeaf3ea53 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.858671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.870251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.870251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.870251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/users/184af4a2a5c64d2897f38287202230f5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.873425 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3136/6246] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 4 20:58:38 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:38.876235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.879911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:get_user(user_id=184af4a2a5c64d2897f38287202230f5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.884721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find user: 184af4a2a5c64d2897f38287202230f5.: keystone.exception.UserNotFound: Could not find user: 184af4a2a5c64d2897f38287202230f5. Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 20:58:38.932590 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:38.933755 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 184af4a2a5c64d2897f38287202230f5. Oct 04 20:58:38.935552 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:38.943674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3111/6247] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:58:38 2022] GET /identity/v3/users/184af4a2a5c64d2897f38287202230f5 => generated 110 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:38.945322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:38.971223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b47f41-e422-446b-91e9-c8d10cee3126 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:38.986055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:38.987245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:38.987810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:38.988370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:38.990791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Adding query filter params (parent_id=65318475dde9426c817a5c16fdd07d05) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:38.991003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:38.996879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:39.009726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:39.056345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3112/6248] 10.222.0.78 () {58 vars in 1216 bytes} [Tue Oct 4 20:58:38 2022] GET /identity/v3/projects?parent_id=65318475dde9426c817a5c16fdd07d05 => generated 496 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:39.058705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:39.089343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4caf04-d83a-4728-a840-4a6a42948018 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:39.124232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:39.124428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20949c-1055-40ab-9d02-b56bf00f074e tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:39.127781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:39.128267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:39.128831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/groups/dcc03e150a074daa9dd2685baad7ee2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:39.149001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:get_group(group_id=dcc03e150a074daa9dd2685baad7ee2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:39.151012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:39.152614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:39.156264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:39.166298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:39.167317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:39.169543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:39.174132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find group: dcc03e150a074daa9dd2685baad7ee2d.: keystone.exception.GroupNotFound: Could not find group: dcc03e150a074daa9dd2685baad7ee2d. Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 04 20:58:39.220071 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:39.222109 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: dcc03e150a074daa9dd2685baad7ee2d. Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:39.223874 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3113/6249] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:39 2022] GET /identity/v3/groups/dcc03e150a074daa9dd2685baad7ee2d => generated 111 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:39.232419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:39.284983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a76c6-c8f6-4d6a-898a-0b1d6490b514 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:39.299460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:39.301373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:39.304319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:39.311575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects/355711ba07fd45e8bde9ed2f7d5d8ea0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:39.311575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=355711ba07fd45e8bde9ed2f7d5d8ea0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:39.315073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:39.452530 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3137/6250] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:38 2022] POST /identity/v3/projects => generated 400 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:39.456860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:39.581348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:39.591941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355711ba07fd45e8bde9ed2f7d5d8ea0', 'request_id': 'req-001d9380-b64f-461b-ad22-22a81b7ff138'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:39.614817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355711ba07fd45e8bde9ed2f7d5d8ea0', 'request_id': 'req-001d9380-b64f-461b-ad22-22a81b7ff138'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:39.630795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355711ba07fd45e8bde9ed2f7d5d8ea0', 'request_id': 'req-001d9380-b64f-461b-ad22-22a81b7ff138'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:39.713149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e1af2-33c5-4509-b840-9c49371d4ba5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:39.748005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] The token cache is being invalidate because project 355711ba07fd45e8bde9ed2f7d5d8ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:39.751815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:39.758146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:39.766158 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3114/6251] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:39 2022] DELETE /identity/v3/projects/355711ba07fd45e8bde9ed2f7d5d8ea0 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:39.768144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:39.774898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:39.927947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:39.929754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:39.930746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:39.931809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/groups/dcc03e150a074daa9dd2685baad7ee2d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:39.944129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find group: dcc03e150a074daa9dd2685baad7ee2d.: keystone.exception.GroupNotFound: Could not find group: dcc03e150a074daa9dd2685baad7ee2d. Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 04 20:58:39.960810 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:39.962555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: dcc03e150a074daa9dd2685baad7ee2d. Oct 04 20:58:39.964301 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:39.974356 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3138/6252] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:58:39 2022] DELETE /identity/v3/groups/dcc03e150a074daa9dd2685baad7ee2d => generated 111 bytes in 521 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:39.980539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:39.991270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:40.015211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d9380-b64f-461b-ad22-22a81b7ff138 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.025767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.028751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.028751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.029163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.030629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:40.035269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:40.174051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3115/6253] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:39 2022] POST /identity/v3/groups => generated 301 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:40.180883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:40.186625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:40.207819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dfde4-2298-4805-a6f1-894676c6a85b tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.219275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.220422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.221052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.221636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects/65318475dde9426c817a5c16fdd07d05` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.225162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65318475dde9426c817a5c16fdd07d05)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:40.229640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:40.243485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1fb1b-8db0-45cb-aa22-a4f0581466cb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.269247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.275676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.276700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.281273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/users/184af4a2a5c64d2897f38287202230f5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.301129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_user(user_id=184af4a2a5c64d2897f38287202230f5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:40.307555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find user: 184af4a2a5c64d2897f38287202230f5.: keystone.exception.UserNotFound: Could not find user: 184af4a2a5c64d2897f38287202230f5. Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 04 20:58:40.336245 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:40.338160 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 184af4a2a5c64d2897f38287202230f5. Oct 04 20:58:40.340306 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:40.345620 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3116/6254] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:40 2022] DELETE /identity/v3/users/184af4a2a5c64d2897f38287202230f5 => generated 110 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:40.351819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:40.372266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331e73-6ffe-403e-adf2-a25d232bad82 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.389685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.389685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.389685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.390269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.390269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:40.391794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:40.473813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65318475dde9426c817a5c16fdd07d05', 'request_id': 'req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:40.564816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3117/6255] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:58:40 2022] POST /identity/v3/roles => generated 235 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:40.566159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:40.602694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65318475dde9426c817a5c16fdd07d05', 'request_id': 'req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:40.633940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116df0-3f33-4655-9281-85b876a9cbc1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.635925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65318475dde9426c817a5c16fdd07d05', 'request_id': 'req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:40.700337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] The token cache is being invalidate because project 65318475dde9426c817a5c16fdd07d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:40.700337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:40.700337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:40.704977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3139/6256] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:39 2022] DELETE /identity/v3/projects/65318475dde9426c817a5c16fdd07d05 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:40.706828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:40.709557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:40.823629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.825252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.825653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.825967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/34bb77967fe5469f9e324c2bd8c84715` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.842539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find domain: 34bb77967fe5469f9e324c2bd8c84715.: keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:40.864866 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:40.866910 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:40.872251 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:40.875371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3118/6257] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:40 2022] PATCH /identity/v3/domains/34bb77967fe5469f9e324c2bd8c84715 => generated 112 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:40.889403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:40.898504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:40.925931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4320c-c8e3-49d5-ad7b-85fa3e242e49 tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:40.934484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:40.941121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:40.943061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:40.943650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:40.944159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] PATH_INFO: `/v3/projects/092044b74e2543bc948c906d37608244` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:40.946580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092044b74e2543bc948c906d37608244)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:40.950881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:41.114264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a06356-a811-451e-bdb2-624da8e9e3c4 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:41.135097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:41.136294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:41.136836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:41.137345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:41.138661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:41.142959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:41.181192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092044b74e2543bc948c906d37608244', 'request_id': 'req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.216081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:41.251871 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3119/6258] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:40 2022] POST /identity/v3/users => generated 442 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:41.253682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:41.258405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:41.283751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092044b74e2543bc948c906d37608244', 'request_id': 'req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.310881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092044b74e2543bc948c906d37608244', 'request_id': 'req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.361557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] The token cache is being invalidate because project 092044b74e2543bc948c906d37608244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:41.362298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.364787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.372313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3140/6259] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:40 2022] DELETE /identity/v3/projects/092044b74e2543bc948c906d37608244 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:41.376759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:41.386655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:41.462433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd13a8-1943-4328-b649-768e17619540 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:41.608631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0be4e15a72d84e39b900f021c36e161d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '379adfc187154c999a7426e782951e94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:41.610220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:41.610779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:41.611577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] PATH_INFO: `/v3/projects/f8e006aebb1e40bab00540d175a7676a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:41.614287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8e006aebb1e40bab00540d175a7676a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:41.622304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:41.680531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f3f2-c66c-4077-a7d9-c1e6d13056c4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:41.697425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:41.698540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:41.699082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:41.699722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:41.701049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:41.704264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:41.741050 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3141/6260] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 4 20:58:41 2022] GET /identity/v3/domains => generated 1612 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:41.741050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:41.743586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:41.858778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e006aebb1e40bab00540d175a7676a', 'request_id': 'req-0a8fb7c7-937b-4086-9788-943e471b65ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.890541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e006aebb1e40bab00540d175a7676a', 'request_id': 'req-0a8fb7c7-937b-4086-9788-943e471b65ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.926835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e006aebb1e40bab00540d175a7676a', 'request_id': 'req-0a8fb7c7-937b-4086-9788-943e471b65ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:41.961221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f5240-7925-4354-9b3a-9890c4bf9db0 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:42.034579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] The token cache is being invalidate because project f8e006aebb1e40bab00540d175a7676a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:42.035714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.039000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.053387 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3120/6261] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:41 2022] DELETE /identity/v3/projects/f8e006aebb1e40bab00540d175a7676a => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:42.055490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:42.058182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:42.113482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:42.115885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:42.115885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:42.116601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:42.118319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:42.121127 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:42.121127 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:58:42.121127 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:58:42.125137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:42.235212 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3142/6262] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:58:41 2022] POST /identity/v3/roles => generated 270 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:42.239954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:42.249494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:42.301226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fb7c7-937b-4086-9788-943e471b65ff tempest-ListProjectsTestJSON-649587702 tempest-ListProjectsTestJSON-649587702-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:42.318556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:42.324410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:42.325218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:42.325736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] PATH_INFO: `/v3/users/68f0e690d07b4aa2bb5481795aba65ea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:42.332012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f0e690d07b4aa2bb5481795aba65ea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:42.339255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:42.459283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586fc3-f67e-4d81-b759-11a42ed6d128 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:42.465711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:42.466929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:42.467544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:42.468064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:42.469149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:42.469643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:42.471802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:42.520968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3143/6263] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:42 2022] GET /identity/v3/domains?enabled=True => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:42.526436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:42.529434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:42.563050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ff3cb-8738-4bbf-a8f5-30272f90e165 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:42.573442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:42.574739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:42.575409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:42.575994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] PATH_INFO: `/v3/users/a41b2bdae45f42d0a473c4777e9abe68` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:42.579201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41b2bdae45f42d0a473c4777e9abe68)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:42.583476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:42.718242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f0e690d07b4aa2bb5481795aba65ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.906040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:42.913759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f0e690d07b4aa2bb5481795aba65ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.946116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f0e690d07b4aa2bb5481795aba65ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.975385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f0e690d07b4aa2bb5481795aba65ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.977252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f0e690d07b4aa2bb5481795aba65ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.978345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41b2bdae45f42d0a473c4777e9abe68'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.979771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41b2bdae45f42d0a473c4777e9abe68'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:42.992212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3121/6264] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:42 2022] DELETE /identity/v3/users/68f0e690d07b4aa2bb5481795aba65ea => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:42.994348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:42.998539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:43.072871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41b2bdae45f42d0a473c4777e9abe68'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:43.114490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:43.130594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41b2bdae45f42d0a473c4777e9abe68'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:43.150406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41b2bdae45f42d0a473c4777e9abe68'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:43.169457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3144/6265] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:42 2022] DELETE /identity/v3/users/a41b2bdae45f42d0a473c4777e9abe68 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:43.171295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:43.174224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:43.253237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69b00-d54b-4ce5-ae5a-bd8a2d0fa70b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:43.383634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4e7ec-ba66-4c84-b26c-c2cd8171aaa7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:43.397921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:43.399441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:43.400253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:43.401028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:43.402755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1570321297) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:43.403343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:43.407168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:43.419428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:43.421845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:43.422755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:43.423552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/19754811b87e44b0a942ea446d1356f7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:43.452436 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3145/6266] 10.222.0.78 () {58 vars in 1199 bytes} [Tue Oct 4 20:58:43 2022] GET /identity/v3/domains?name=tempest-test_domain-1570321297 => generated 409 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:43.452436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:43.457859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:43.472557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=19754811b87e44b0a942ea446d1356f7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:43.483191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a48db9-c112-461e-94c8-206c75bca5e1 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:43.631540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8c8b4-c625-4b40-893f-2b0a8e60a251 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:43.638768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:43.639913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:43.640316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:43.640759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:43.644053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:43.669013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3122/6267] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:42 2022] PUT /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/19754811b87e44b0a942ea446d1356f7 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:43.690768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:43.698180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:43.699424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:43.770385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:43.777249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:43.782434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:43.785124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:43.808706 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3146/6268] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:43.811086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:43.837692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727ffc-7ec8-4eef-86f8-9bff34aa5817 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:43.924708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3123/6269] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:43.926209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:43.930544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:44.147734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:44.151073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:44.152678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:44.153346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:44.153994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/34bb77967fe5469f9e324c2bd8c84715` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:44.170133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Could not find domain: 34bb77967fe5469f9e324c2bd8c84715.: keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:44.185034 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:44.187310 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 34bb77967fe5469f9e324c2bd8c84715. Oct 04 20:58:44.189478 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:58:44.192121 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3147/6270] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:43 2022] PATCH /identity/v3/domains/34bb77967fe5469f9e324c2bd8c84715 => generated 112 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:44.195605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:44.196910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd325-78b4-457c-aa01-fafde35b7d4c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:44.211977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:44.216267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:44.217336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:44.218085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:44.220307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Adding query filter params (scope.project.id=52f0f6a70fa64ba4941d22800b21e32b, user.id=f011b077a6d24f8d8e2500fdb2f59bc7) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:44.221572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:44.229856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:44.234845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6963d5-f88e-44d6-94c7-7fb9918751ba tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:44.251887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:44.254470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:44.255853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:44.255853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/afbde0490dcc4121a61e4fa6a6cfe8bd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:44.316633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=afbde0490dcc4121a61e4fa6a6cfe8bd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:44.321962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:44.533616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3124/6271] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:58:43 2022] GET /identity/v3/role_assignments?scope.project.id=52f0f6a70fa64ba4941d22800b21e32b&user.id=f011b077a6d24f8d8e2500fdb2f59bc7&effective => generated 228 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:44.537668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:44.572568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:44.605855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:44.641309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3148/6272] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:44 2022] PATCH /identity/v3/domains/afbde0490dcc4121a61e4fa6a6cfe8bd => generated 277 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:44.645000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:44.711956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92d6b-df37-4e84-86aa-1af4edc251da tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:44.734004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:44.736292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:44.738781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:44.739613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/19754811b87e44b0a942ea446d1356f7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:44.748006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=19754811b87e44b0a942ea446d1356f7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:44.756944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:44.777252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 19754811b87e44b0a942ea446d1356f7 was removed from user f011b077a6d24f8d8e2500fdb2f59bc7 on project 52f0f6a70fa64ba4941d22800b21e32b. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:44.780491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:44.780491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:44.829598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18107f-f02c-4b1b-ba1b-4effa4a58522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:44.857184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:44.862048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:44.863079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:44.863973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:44.881330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:44.924579 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3149/6273] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:58:44 2022] DELETE /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/19754811b87e44b0a942ea446d1356f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:44.929631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:44.939181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:44.959923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:44.968085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:45.045068 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3125/6274] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:45.048655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:45.054815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:45.132901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bb887-1ee2-4934-88dd-70400e192ca9 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:45.338997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0eec7-62c4-4e2f-93c4-099a1b9a2947 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:45.363070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:45.368291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:45.368849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:45.383516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:45.384132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/19754811b87e44b0a942ea446d1356f7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:45.384502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:45.385027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:45.385774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/afbde0490dcc4121a61e4fa6a6cfe8bd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:45.394070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=19754811b87e44b0a942ea446d1356f7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:45.405730 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:45.405730 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:58:45.405730 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:58:45.408000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:45.421588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=afbde0490dcc4121a61e4fa6a6cfe8bd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:45.426541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:45.544536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:45.595612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:45.701459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 19754811b87e44b0a942ea446d1356f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:45.702322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:45.703536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:45.707751 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3126/6275] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:45 2022] DELETE /identity/v3/roles/19754811b87e44b0a942ea446d1356f7 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:45.713158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:45.716043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:45.744059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:45.887120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:45.930056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf869-fa1a-4802-a241-7f959e0123cc tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:46.037361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.052655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.075880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project afbde0490dcc4121a61e4fa6a6cfe8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:46.076632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.078118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.095915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:46.098053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:46.099173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.100019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:46.100830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.101490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] PATH_INFO: `/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:46.102386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'afbde0490dcc4121a61e4fa6a6cfe8bd', 'request_id': 'req-a408f511-570d-4d28-8587-cd0231211e06'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.118258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9a0f02c1234ac593eb8214e8e536f8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:46.127255 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3150/6276] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:44 2022] DELETE /identity/v3/domains/afbde0490dcc4121a61e4fa6a6cfe8bd => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:46.127255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:46.133301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:46.135835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:46.323833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408f511-570d-4d28-8587-cd0231211e06 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:46.338321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:46.342811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:46.345414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:46.345930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/bd9c84e113f749ffb66cd3390137e5ee` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:46.353000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=bd9c84e113f749ffb66cd3390137e5ee)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:46.359246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:46.538363 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3151/6277] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:46 2022] PUT /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/bd9c84e113f749ffb66cd3390137e5ee => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:46.540649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:46.549294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:46.572329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9a0f02c1234ac593eb8214e8e536f8', 'request_id': 'req-c10b6d31-3432-4862-8768-c8da52c20eba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.627617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9a0f02c1234ac593eb8214e8e536f8', 'request_id': 'req-c10b6d31-3432-4862-8768-c8da52c20eba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.656974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9a0f02c1234ac593eb8214e8e536f8', 'request_id': 'req-c10b6d31-3432-4862-8768-c8da52c20eba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.793042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaa92e-dbed-4e36-a4ee-4f094833e9ed tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:46.910014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] The token cache is being invalidate because project 1e9a0f02c1234ac593eb8214e8e536f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:46.910702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.912649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:46.916027 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3127/6278] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:45 2022] DELETE /identity/v3/projects/1e9a0f02c1234ac593eb8214e8e536f8 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:46.917658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:46.918023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:46.920502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:46.927980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:46.929321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:46.930390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:46.931110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/8e1d11b658584c12a5b30b542443596a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:46.970844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8e1d11b658584c12a5b30b542443596a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:46.977654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:47.037610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:47.039216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:47.164556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6d31-3432-4862-8768-c8da52c20eba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:47.211739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:47.215738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-748b5cbf-60d2-4dce-afcc-a3a4a6d48831 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:47.229526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3152/6279] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:46 2022] PATCH /identity/v3/domains/8e1d11b658584c12a5b30b542443596a => generated 276 bytes in 689 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:47.232237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:47.232725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:47.233256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:47.312824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:47.318005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:47.371802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:47.371802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:47.371802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:47.372350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:47.377334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:47.380897 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:47.380897 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:58:47.380897 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:58:47.384227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6443664-9eaa-4042-8eec-eb9959cb351a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:47.539278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3153/6280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:47.539278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:47.539278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:47.585581 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3128/6281] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:58:46 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 521 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:47.596402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:47.597327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:47.597952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:47.694678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:47.696985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:47.755815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:47.836250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89519f4a-1988-49af-a411-ebde9fd6c7a9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:48.059858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3129/6282] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:48.060950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:48.062912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:48.138788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:48.142177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:48.145101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:48.145101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/8e1d11b658584c12a5b30b542443596a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:48.201200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8e1d11b658584c12a5b30b542443596a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:48.205274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:48.299413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:48.378577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:48.399482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:48.446282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8e1d11b658584c12a5b30b542443596a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:48.457829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b3c33-f959-424b-8472-95afeb2d45d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:48.483821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:48.485011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:48.486163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:48.486688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:48.499179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Adding query filter params (scope.project.id=52f0f6a70fa64ba4941d22800b21e32b, user.id=f011b077a6d24f8d8e2500fdb2f59bc7) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:48.500224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:48.507389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:48.766948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:48.800976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3130/6283] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:58:48 2022] GET /identity/v3/role_assignments?scope.project.id=52f0f6a70fa64ba4941d22800b21e32b&user.id=f011b077a6d24f8d8e2500fdb2f59bc7&effective => generated 1061 bytes in 741 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:48.805511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:48.847940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08949a10-77cd-4e4c-ba79-3f9876bf6e71 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:48.950607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:48.989846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.003641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:49.046888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project 8e1d11b658584c12a5b30b542443596a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:49.050157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.051851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.091831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.093520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:49.094759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.097918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:49.098390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8e1d11b658584c12a5b30b542443596a', 'request_id': 'req-d87d994e-bb15-492d-bf51-3b04853fefbb'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.100805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:49.101346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:49.105033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:49.105679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:49.110070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:49.143401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3154/6284] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:47 2022] DELETE /identity/v3/domains/8e1d11b658584c12a5b30b542443596a => generated 0 bytes in 1616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:49.147690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:49.153235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:49.167245 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3131/6285] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:49.168832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:49.178877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:49.198656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:49.377416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d994e-bb15-492d-bf51-3b04853fefbb tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:49.392252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:49.393707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:49.394206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:49.394682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:49.399253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:49.401132 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:49.401132 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:58:49.401132 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:58:49.403383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:49.424111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7d0ae-9bc3-4c67-b98d-f622a1ee774d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:49.433950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:49.435832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:49.435832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:49.436479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/a0ac1d797f4f47da876eda92946542e7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:49.465372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a0ac1d797f4f47da876eda92946542e7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:49.468854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:49.522572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.523899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.587843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3155/6286] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:58:49 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:49.590010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:49.595529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:49.748851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.757970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:49.765576 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3132/6287] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:58:49 2022] PATCH /identity/v3/domains/a0ac1d797f4f47da876eda92946542e7 => generated 278 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:49.773551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:49.778724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:49.846701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6de97e-912c-412d-8e47-0228ec274096 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:49.856507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:49.858187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:49.858922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:49.859748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:49.861072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:49.865445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:50.061366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe296ab9-67d0-4b30-86b3-df279c4b1342 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:50.120812 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3156/6288] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:49 2022] POST /identity/v3/projects => generated 365 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:50.122535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:50.141280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:50.243353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:50.244605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:50.245357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:50.246438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:50.249433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Adding query filter params (scope.project.id=52f0f6a70fa64ba4941d22800b21e32b, user.id=f011b077a6d24f8d8e2500fdb2f59bc7) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:50.249977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:50.254415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:50.329597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:50.435438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bc8d8-981e-4fd4-b896-fefee0eeeffe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:50.453210 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3133/6289] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 4 20:58:49 2022] GET /identity/v3/role_assignments?scope.project.id=52f0f6a70fa64ba4941d22800b21e32b&user.id=f011b077a6d24f8d8e2500fdb2f59bc7&effective => generated 577 bytes in 686 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:50.455466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:50.459086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d14bd70accf48f3a17afb63dcdfca12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0233c160324d87b137e7a878a96452', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:50.459538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:50.460361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:50.460852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:50.461355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] PATH_INFO: `/v3/domains/a0ac1d797f4f47da876eda92946542e7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:50.506439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a0ac1d797f4f47da876eda92946542e7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:50.509790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:50.513406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f3fb9-ed3c-41b9-90d7-658b85d29f3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:50.618899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:50.651887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:50.671161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:50.746005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:50.747171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:50.747670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:50.748173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] PATH_INFO: `/v3/projects/3900b8e7bbd1407cb2fabf04ff39acae` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:50.765148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3900b8e7bbd1407cb2fabf04ff39acae)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:50.768840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:50.857847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:50.879128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:50.969791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.005214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3900b8e7bbd1407cb2fabf04ff39acae', 'request_id': 'req-99b42eb3-335c-4835-8a92-7c6241d25183'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.005536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.023823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3900b8e7bbd1407cb2fabf04ff39acae', 'request_id': 'req-99b42eb3-335c-4835-8a92-7c6241d25183'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.043436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3900b8e7bbd1407cb2fabf04ff39acae', 'request_id': 'req-99b42eb3-335c-4835-8a92-7c6241d25183'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.048046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] The token cache is being invalidate because project a0ac1d797f4f47da876eda92946542e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:51.056073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.057216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.095114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.097057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.100372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a0ac1d797f4f47da876eda92946542e7', 'request_id': 'req-10852381-1f25-4ebf-9c26-10fb814c6a18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.122485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3157/6290] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:58:50 2022] DELETE /identity/v3/domains/a0ac1d797f4f47da876eda92946542e7 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:51.124421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:51.129599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:51.176704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] The token cache is being invalidate because project 3900b8e7bbd1407cb2fabf04ff39acae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:51.177682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.181582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:51.190876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3134/6291] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:50 2022] DELETE /identity/v3/projects/3900b8e7bbd1407cb2fabf04ff39acae => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:51.195633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:51.202609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:51.404037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852381-1f25-4ebf-9c26-10fb814c6a18 tempest-DomainsTestJSON-156073590 tempest-DomainsTestJSON-156073590-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:51.525346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42eb3-335c-4835-8a92-7c6241d25183 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:51.544425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:51.545829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:51.547758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:51.547758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:51.558507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:51.565188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:51.660905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:51.663127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:51.663955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:51.664756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] PATH_INFO: `/v3/users/68fe1ce265704ce4a3de83358e5ae1ee` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:51.669379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fe1ce265704ce4a3de83358e5ae1ee)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:51.674807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:51.739379 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3135/6292] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:51 2022] POST /identity/v3/users => generated 283 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:51.741129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:51.755827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:51.948546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:51.959087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9085a09-b02c-444f-a10e-cbc2edda04d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:51.970680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:51.972106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:51.972592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:51.973090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:51.977081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:51.980515 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:51.980515 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:58:51.980515 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:58:52.007577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:52.065991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fe1ce265704ce4a3de83358e5ae1ee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.065991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fe1ce265704ce4a3de83358e5ae1ee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9.: keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = query.one() Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._iter().one() Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._only_one_row( Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:52.069945 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 04 20:58:52.072015 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 04 20:58:52.073901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 04 20:58:52.073901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 04 20:58:52.073901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 04 20:58:52.073901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:58:52.073901 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:52.082785 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3136/6293] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:58:51 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 137 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:52.085652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:52.089983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:52.127242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2102-d57d-4bd8-9ed3-d9a94f324ea4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:52.138095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:52.146104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:52.146104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:52.146104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] PATH_INFO: `/v3/users/4beadad11f48498f8aa945abbc4e5cfd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:52.147471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4beadad11f48498f8aa945abbc4e5cfd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:52.154763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:52.203885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:52.230659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fe1ce265704ce4a3de83358e5ae1ee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.254367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fe1ce265704ce4a3de83358e5ae1ee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.266229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fe1ce265704ce4a3de83358e5ae1ee'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.275084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3158/6294] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:51 2022] DELETE /identity/v3/users/68fe1ce265704ce4a3de83358e5ae1ee => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:52.276409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:52.278600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:52.413190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87171f7-c546-43cc-8470-027ee6aa615d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:52.423348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:52.425378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:52.426035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:52.426629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] PATH_INFO: `/v3/users/0be4e15a72d84e39b900f021c36e161d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:52.430931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be4e15a72d84e39b900f021c36e161d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:52.441881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:52.540164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4beadad11f48498f8aa945abbc4e5cfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.700027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4beadad11f48498f8aa945abbc4e5cfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.717681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4beadad11f48498f8aa945abbc4e5cfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.744072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4beadad11f48498f8aa945abbc4e5cfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.746035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4beadad11f48498f8aa945abbc4e5cfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.762337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3137/6295] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:52 2022] DELETE /identity/v3/users/4beadad11f48498f8aa945abbc4e5cfd => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:52.766467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:52.771415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:52.835489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be4e15a72d84e39b900f021c36e161d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.841932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be4e15a72d84e39b900f021c36e161d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.963755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2226d7-5397-4819-989e-00eb88030da6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:52.973944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:52.975505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:52.976301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:52.977547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:52.978919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:52.979419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be4e15a72d84e39b900f021c36e161d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:52.984421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:53.013157 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3138/6296] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:52 2022] GET /identity/v3/roles => generated 2323 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:53.013891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be4e15a72d84e39b900f021c36e161d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:53.015323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:53.023423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.043615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4b3e9da-2029-42fb-99a4-f83165d35a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be4e15a72d84e39b900f021c36e161d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:53.058534 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3159/6297] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:52 2022] DELETE /identity/v3/users/0be4e15a72d84e39b900f021c36e161d => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:53.058534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fd23-a73a-41b4-9577-cc00022fcaff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.058534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fd23-a73a-41b4-9577-cc00022fcaff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.058534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242fd23-a73a-41b4-9577-cc00022fcaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.107530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5242fd23-a73a-41b4-9577-cc00022fcaff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:53.117816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5242fd23-a73a-41b4-9577-cc00022fcaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.218226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a94acc-6aa9-4525-aeaf-c21f31f430d1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:53.299084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3160/6298] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:53.299084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.303815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.304449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.365431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:53.368614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.389250 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3161/6299] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:53.391569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:53.394542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.395955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:53.397714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.398518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.399160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/bd9c84e113f749ffb66cd3390137e5ee` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.405040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=bd9c84e113f749ffb66cd3390137e5ee)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:53.409963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:53.423022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708548de-b566-41f7-b96a-7f67b7261949 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:53.428244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role bd9c84e113f749ffb66cd3390137e5ee was removed from user f011b077a6d24f8d8e2500fdb2f59bc7 on project 52f0f6a70fa64ba4941d22800b21e32b. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:53.429395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:53.431275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:53.440843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:53.443688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.447617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.447617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.447617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:53.452125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:53.492741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3162/6300] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:53 2022] GET /identity/v3/roles => generated 2323 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:53.494658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:53.504027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.555879 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3139/6301] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:58:53 2022] DELETE /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/bd9c84e113f749ffb66cd3390137e5ee => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:53.557457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:53.560057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.701896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a761b6-5dc0-4a77-8c9c-3d74b5757be2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:53.742732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bf3f-00bb-4c9e-b0c9-b9ca41dfd18e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:53.756196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:53.757945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.760148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.761042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.765419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.774390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:53.859696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:53.861236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:53.861840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:53.862490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:53.866491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:53.898809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:53.966063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:53.969825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:53.994449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3140/6302] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:53.996128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:53.999543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:54.027275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ea0b-a72f-46ce-a1d7-dcfe850c1e3e service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:54.035897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:54.037507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:54.038865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:54.039547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] PATH_INFO: `/v3/projects/c5eddb4c0d754757abe8629a558e532f/users/cfdc24219b1a4560a7c0aa721262744c/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:54.045732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:54.049172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:54.074763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eddb4c0d754757abe8629a558e532f, user_id=cfdc24219b1a4560a7c0aa721262744c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:54.080430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57399e24-783b-4784-a60d-458886dc2186 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:54.088819 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3163/6303] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:54.093140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:54.095836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:54.236489 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3141/6304] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:53 2022] PUT /identity/v3/projects/c5eddb4c0d754757abe8629a558e532f/users/cfdc24219b1a4560a7c0aa721262744c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:54.258623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:54.259340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:54.260139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:54.262112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207f1c3-2487-4558-94cb-90b1a7309cdd service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:54.329248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] MFA Rules not processed for user `cfdc24219b1a4560a7c0aa721262744c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:54.331845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:54.475475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:54.477952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:54.478520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:54.479033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:54.480620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:54.483824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:54.549472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3142/6305] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 20:58:54.551312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:54.554609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:54.611561 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3164/6306] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:54 2022] POST /identity/v3/roles => generated 271 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:54.618442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:54.764452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822701c9-aa6e-43f8-affa-0ad9829753bd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:54.781483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:54.783035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:54.783649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:54.784231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] PATH_INFO: `/v3/projects/379adfc187154c999a7426e782951e94` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:54.790296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=379adfc187154c999a7426e782951e94)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:54.800817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:54.808338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df70c1-5b9a-4585-9fcf-ee7a77b8ea08 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:54.827418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:54.827418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:54.827418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:54.828218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:54.829145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:54.833906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:55.027980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3165/6307] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:54 2022] POST /identity/v3/projects => generated 365 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:55.029503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:55.100182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379adfc187154c999a7426e782951e94', 'request_id': 'req-4ca8ff18-dbd4-4421-9bff-297b59f89386'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.114923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379adfc187154c999a7426e782951e94', 'request_id': 'req-4ca8ff18-dbd4-4421-9bff-297b59f89386'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.127999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379adfc187154c999a7426e782951e94', 'request_id': 'req-4ca8ff18-dbd4-4421-9bff-297b59f89386'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.178011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f78da-d575-42c9-a2ff-bcfc2f4e5873 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:55.275570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:55.276465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.276909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.277286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:55.278234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Adding query filter params (domain_id=212e28d8157d4752be34b5c4135ff1bf) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:55.278603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:55.280123 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:58:55.280123 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:58:55.280123 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:58:55.281726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:55.298271 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3166/6308] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 4 20:58:55 2022] GET /identity/v3/roles?domain_id=212e28d8157d4752be34b5c4135ff1bf => generated 408 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:55.298271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:55.324855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] The token cache is being invalidate because project 379adfc187154c999a7426e782951e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:55.325369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.326960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.330369 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3143/6309] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:54 2022] DELETE /identity/v3/projects/379adfc187154c999a7426e782951e94 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:55.331887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:55.335549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:55.366258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8ff18-dbd4-4421-9bff-297b59f89386 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:55.376229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:55.377532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.383401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.383401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/0e90673286e64fd1a840c6c3f8a4d39f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:55.383401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0e90673286e64fd1a840c6c3f8a4d39f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:55.385607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:55.419231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5e05-1fc8-4351-bfc2-7eb0c1ed4e73 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:55.427866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:55.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:55.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:55.435428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd5bb6-3cdd-4060-924c-4b953d210b72 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:55.513009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:55.650951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3167/6310] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:55 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:55.653313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.653601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.653930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:55.667118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 0e90673286e64fd1a840c6c3f8a4d39f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:55.667694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.669830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:55.673513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3144/6311] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:55 2022] DELETE /identity/v3/roles/0e90673286e64fd1a840c6c3f8a4d39f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:55.689856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:55.694329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:55.701070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:55.703742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:55.791359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:55.890400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99626d99-0c33-48f8-8513-d91aeca83fc8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:55.892364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3168/6312] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:55.896195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:55.924308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:55.925054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:55.926501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.926959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.927486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:55.928953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:55.937800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c300b-95a8-4823-b49a-f17c98c5cab3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:55.984573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3145/6313] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:55 2022] GET /identity/v3/roles => generated 2323 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:55.984573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:55.984573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:55.984573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.038227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:56.044820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:56.082796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3146/6314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:56.084944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.117462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fc859-6f5f-4588-b1fe-25233d11989c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.125633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.126582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.126960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.127699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] PATH_INFO: `/v3/projects/69579102526e48e1b18217c5d0545c36/users/c3f5e84bd21441a6b36e101eb43339eb/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.144632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59193e5-325a-4964-a0d9-a37983cb742a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.153928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.155025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.155734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.156025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.156964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69579102526e48e1b18217c5d0545c36, user_id=c3f5e84bd21441a6b36e101eb43339eb, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.163052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.165389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Adding query filter params (domain_id=212e28d8157d4752be34b5c4135ff1bf) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:56.165868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.169041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.186491 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3169/6315] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 4 20:58:55 2022] GET /identity/v3/roles?domain_id=212e28d8157d4752be34b5c4135ff1bf => generated 148 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:56.187961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.215609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f59ae2-5453-4837-a3f0-df02ee8e001f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.243930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.250458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.251576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.253005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3147/6316] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:56 2022] PUT /identity/v3/projects/69579102526e48e1b18217c5d0545c36/users/c3f5e84bd21441a6b36e101eb43339eb/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:56.254761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.270343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.273200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:58:56.273983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.277622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.338277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3170/6317] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:56.339688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.349244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:56.389409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611edefb-6cd0-4abb-8d5a-42ea723da9d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.466579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2cfe-6bca-436a-941c-25c3df3f524c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.478588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.480069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.480299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.480690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/0e90673286e64fd1a840c6c3f8a4d39f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.506220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Could not find role: 0e90673286e64fd1a840c6c3f8a4d39f.: keystone.exception.RoleNotFound: Could not find role: 0e90673286e64fd1a840c6c3f8a4d39f. Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 04 20:58:56.518091 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 20:58:56.519538 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0e90673286e64fd1a840c6c3f8a4d39f. Oct 04 20:58:56.521144 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:58:56.528299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3148/6318] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:56 2022] DELETE /identity/v3/roles/0e90673286e64fd1a840c6c3f8a4d39f => generated 110 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:58:56.528784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.530026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.530173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.531181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.531181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] PATH_INFO: `/v3/projects/7322f650ca514b71a687715bcf398d52` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.536227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7322f650ca514b71a687715bcf398d52)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.546218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.558531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79e2bd-f915-4075-9d6e-2dbf54295616 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.565439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.567289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.568798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.569417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.570656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.573775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.598013 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3149/6319] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:56 2022] GET /identity/v3/roles => generated 2323 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:56.600273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.620823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863245d-05cb-4ac3-8598-e9c368100aae admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.632422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.633499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.634154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.634581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.635310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.637624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.750355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7322f650ca514b71a687715bcf398d52', 'request_id': 'req-665a56e3-fb1c-472b-b3ac-ada82a4cab90'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:56.767189 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3150/6320] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:58:56 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:56.769032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.889253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dd4bf-3ca5-4df3-9772-eb13db473d29 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:56.896417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:56.897537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:56.897927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:56.898283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:56.908369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7322f650ca514b71a687715bcf398d52', 'request_id': 'req-665a56e3-fb1c-472b-b3ac-ada82a4cab90'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:56.911860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:56.914010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:56.917623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:56.926106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7322f650ca514b71a687715bcf398d52', 'request_id': 'req-665a56e3-fb1c-472b-b3ac-ada82a4cab90'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:56.947086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] The token cache is being invalidate because project 7322f650ca514b71a687715bcf398d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:56.947929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:56.948932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:56.951118 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3171/6321] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:56 2022] DELETE /identity/v3/projects/7322f650ca514b71a687715bcf398d52 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:56.956022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:56.957836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:56.997925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:57.056059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3151/6322] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:56 2022] PUT /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:57.058018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:57.061581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:57.072930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a56e3-fb1c-472b-b3ac-ada82a4cab90 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:57.215254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:57.217501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:57.217727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:57.218642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] PATH_INFO: `/v3/projects/69579102526e48e1b18217c5d0545c36/users/c3f5e84bd21441a6b36e101eb43339eb/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:57.221202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0ce07-7e2f-4148-84da-d292adeb5808 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:57.223282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=69579102526e48e1b18217c5d0545c36, user_id=c3f5e84bd21441a6b36e101eb43339eb, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:57.230447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:57.237100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:57.240828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:57.240828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:57.240828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] PATH_INFO: `/v3/projects/4108981a7f8b42c9a29067d2f5f7c14a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:57.242915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4108981a7f8b42c9a29067d2f5f7c14a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:57.247964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:57.274206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3172/6323] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:56 2022] PUT /identity/v3/projects/69579102526e48e1b18217c5d0545c36/users/c3f5e84bd21441a6b36e101eb43339eb/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:57.274206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:57.274206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:57.400101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a029be-d081-4390-96ec-66eb736229fd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:57.407486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:57.417255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:57.417255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:57.417255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:57.417255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:57.417255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:57.486205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4108981a7f8b42c9a29067d2f5f7c14a', 'request_id': 'req-d6188931-75a5-44b7-ba0b-46f1e795455a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:57.496181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4108981a7f8b42c9a29067d2f5f7c14a', 'request_id': 'req-d6188931-75a5-44b7-ba0b-46f1e795455a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:57.521238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4108981a7f8b42c9a29067d2f5f7c14a', 'request_id': 'req-d6188931-75a5-44b7-ba0b-46f1e795455a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:57.616991 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3173/6324] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:58:57 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:58:57.621521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:57.626178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:57.656221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11d42-6efd-467c-96f8-8c106b7a575b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:57.692521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] The token cache is being invalidate because project 4108981a7f8b42c9a29067d2f5f7c14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:57.693418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:57.696758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:57.703916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3152/6325] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:57 2022] DELETE /identity/v3/projects/4108981a7f8b42c9a29067d2f5f7c14a => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:57.707676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:57.714365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:57.921161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188931-75a5-44b7-ba0b-46f1e795455a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:57.927703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:57.928951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:57.929503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:57.930046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] PATH_INFO: `/v3/users/0d14bd70accf48f3a17afb63dcdfca12` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:57.932450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:57.932874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d14bd70accf48f3a17afb63dcdfca12)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:57.934310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:57.935058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:57.935913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:57.937316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:57.939793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=212e28d8157d4752be34b5c4135ff1bf, group_id=e9a5491ed4584cd1b078142e61e44ac9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:57.946011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef088dc-0c5e-4e84-8da6-d9e2173f3b83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:58.008842 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3153/6326] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 4 20:58:57 2022] GET /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles => generated 410 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:58:58.010343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:58.010916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:58.011799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:58.079726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] MFA Rules not processed for user `c3f5e84bd21441a6b36e101eb43339eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:58:58.082510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:58.269527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d14bd70accf48f3a17afb63dcdfca12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.272688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d14bd70accf48f3a17afb63dcdfca12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.294092 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3154/6327] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:58:58.295779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:58.298452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:58.348303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3bcc-c7a1-4af8-9eb2-c5fd17694238 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:58.361715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:58.363481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:58.364709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:58.365578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:58.369290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:58.374319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:58.412160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3155/6328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:58 2022] GET /identity/v3/roles => generated 2323 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:58.414506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:58.419999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:58.420310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d14bd70accf48f3a17afb63dcdfca12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.449538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bbc79-c43d-4b48-9f71-ffabbf887c5d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:58.461569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:58.462655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d14bd70accf48f3a17afb63dcdfca12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.463920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:58.464753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:58.465491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] PATH_INFO: `/v3/users/66a66469515a41d1bb9323751e23860d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:58.468093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a66469515a41d1bb9323751e23860d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:58.472787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:58.483706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d14bd70accf48f3a17afb63dcdfca12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.529357 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3174/6329] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:57 2022] DELETE /identity/v3/users/0d14bd70accf48f3a17afb63dcdfca12 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:58.529357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:58.534499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:58.571626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:58.731111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c35f-5f9b-48d6-8603-f0714b96c320 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:58.740204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:58.741185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:58.741605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:58.741995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:58.749690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:58.757953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:58.770435 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3175/6330] 10.222.0.78 () {58 vars in 1465 bytes} [Tue Oct 4 20:58:58 2022] HEAD /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:58.777145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:58.779359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:58.901211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:58.943184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a66469515a41d1bb9323751e23860d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:58.969113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee1f-43eb-4a7e-b9ae-aac39d7dfa20 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:58.978911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:58.980504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:58.981420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:58.982434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:58.986737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:59.156554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a66469515a41d1bb9323751e23860d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.211579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a66469515a41d1bb9323751e23860d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.241685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:59.247593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:59.251845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a66469515a41d1bb9323751e23860d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.253513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a66469515a41d1bb9323751e23860d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.273568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:59.280763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3156/6331] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:58:58 2022] DELETE /identity/v3/users/66a66469515a41d1bb9323751e23860d => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:59.283200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:59.287121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:59.300428 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3176/6332] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:59.303520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:59.360084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b39-2ec1-4aa6-93b6-8bef1b95f995 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:59.568142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8a9af-ef1e-4a07-a46c-9f31bb96d874 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:59.602797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:59.604136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:59.604599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:59.605032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:59.606351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:59.613404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:59.636614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:59.639227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:59.640317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:59.641250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:59.648692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:59.657068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:59.663753 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3157/6333] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:58:59 2022] GET /identity/v3/roles => generated 2323 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:58:59.671039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:59.694984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cb23-9441-4693-ad3d-872de02fa28b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:58:59.696965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 506eec8115a14e92884baf14c04ad501 was removed from group e9a5491ed4584cd1b078142e61e44ac9 on domain 212e28d8157d4752be34b5c4135ff1bf. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:58:59.697494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.701522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:58:59.707854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:58:59.710162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:58:59.711483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:58:59.712362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] PATH_INFO: `/v3/projects/858ebfaaa6594e938e79b39bf10898b1/users/81bf1d833f5140b78ff59dfae42ff054/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:58:59.788561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858ebfaaa6594e938e79b39bf10898b1, user_id=81bf1d833f5140b78ff59dfae42ff054, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:58:59.794489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:58:59.855539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3177/6334] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:58:59 2022] DELETE /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:59.857617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:59.864011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:58:59.909221 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3158/6335] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:58:59 2022] PUT /identity/v3/projects/858ebfaaa6594e938e79b39bf10898b1/users/81bf1d833f5140b78ff59dfae42ff054/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:58:59.912343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:58:59.923253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:00.106233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f8d8a-9f35-49c1-91eb-42faf00c260f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:00.198264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d400-502e-4f1a-9380-22be0f097868 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:00.215504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:00.217550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:00.218388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:00.219308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:00.226057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:00.232250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b48e5-38ed-4810-b779-4a06ce94891f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:00.292902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:00.294290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:00.294910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:00.295979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:00.301211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:00.442188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3159/6336] 10.222.0.78 () {60 vars in 1486 bytes} [Tue Oct 4 20:58:59 2022] PUT /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:00.460761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:00.461270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:00.461768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:00.469599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:00.559614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:00.566591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:00.579278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:00.598896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3178/6337] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:00.615488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:00.623179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:00.681865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] MFA Rules not processed for user `81bf1d833f5140b78ff59dfae42ff054`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:00.683089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:00.935116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74235-298d-48ae-8b5b-e849d819175f service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:01.071941 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3160/6338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 623 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:01.071941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:01.266632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:01.268395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:01.275572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:01.277922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] PATH_INFO: `/v3/projects/7f0233c160324d87b137e7a878a96452` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:01.281052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0233c160324d87b137e7a878a96452)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:01.290878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:01.389880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e265b-0e8a-43ae-9abd-e6bb2ceb5867 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:01.405327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:01.407094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:01.412055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:01.412055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:01.416614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_grants(project_id=52f0f6a70fa64ba4941d22800b21e32b, group_id=e9a5491ed4584cd1b078142e61e44ac9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:01.424096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:01.477932 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3161/6339] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 20:59:01 2022] GET /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles => generated 411 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:01.484966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:01.492777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:01.540420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb37866-50a0-4555-893e-67616331c4ec tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:01.552540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:01.556133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:01.557224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:01.557224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:01.562018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:01.572291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:01.695802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0233c160324d87b137e7a878a96452', 'request_id': 'req-ebe815ca-366c-42ed-b36d-36090540d5b9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:01.717895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:01.799829 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3162/6340] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:01 2022] POST /identity/v3/projects => generated 369 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:01.810912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:01.883428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0233c160324d87b137e7a878a96452', 'request_id': 'req-ebe815ca-366c-42ed-b36d-36090540d5b9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:01.906658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0233c160324d87b137e7a878a96452', 'request_id': 'req-ebe815ca-366c-42ed-b36d-36090540d5b9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:01.979019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] The token cache is being invalidate because project 7f0233c160324d87b137e7a878a96452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:01.979578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:01.992016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:01.995243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3179/6341] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:00 2022] DELETE /identity/v3/projects/7f0233c160324d87b137e7a878a96452 => generated 0 bytes in 1392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:01.996892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:01.999419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:02.146798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15500e0-32d4-4ea4-abf5-c1c8ef0f66b2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:02.157051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:02.158564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:02.160329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:02.160329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/groups/e9a5491ed4584cd1b078142e61e44ac9/users/f011b077a6d24f8d8e2500fdb2f59bc7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:02.163648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e9a5491ed4584cd1b078142e61e44ac9, user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:02.168667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:02.266196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe815ca-366c-42ed-b36d-36090540d5b9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:02.349600 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3163/6342] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:59:01 2022] PUT /identity/v3/groups/e9a5491ed4584cd1b078142e61e44ac9/users/f011b077a6d24f8d8e2500fdb2f59bc7 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:02.354501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:02.363957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:02.540599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:02.542210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:02.547900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:02.548820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] PATH_INFO: `/v3/projects/22b8f44c8127471b9d35a93492f2d1c8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:02.553665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b8f44c8127471b9d35a93492f2d1c8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:02.559375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:02.582462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:02.663469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e10f8-be23-49ba-8fcc-a8e0f47f1522 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:02.668103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:02.668103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:02.668103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:02.668103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:02.670045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:02.675080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78de31-2583-433f-92e5-4ca3effdacf1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:02.874130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3164/6343] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:02 2022] POST /identity/v3/users => generated 291 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:02.877088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830f49-b23f-424e-ad49-626573d8ad6e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:02.877648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830f49-b23f-424e-ad49-626573d8ad6e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:02.878456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830f49-b23f-424e-ad49-626573d8ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:02.919593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-47830f49-b23f-424e-ad49-626573d8ad6e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:02.922464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-47830f49-b23f-424e-ad49-626573d8ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:02.961655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b8f44c8127471b9d35a93492f2d1c8', 'request_id': 'req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:03.207685 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3165/6344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:03.212412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:03.214055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:03.214562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:03.220405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b8f44c8127471b9d35a93492f2d1c8', 'request_id': 'req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:03.264845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b8f44c8127471b9d35a93492f2d1c8', 'request_id': 'req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:03.329617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] The token cache is being invalidate because project 22b8f44c8127471b9d35a93492f2d1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:03.330616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:03.333455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:03.339417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] MFA Rules not processed for user `f011b077a6d24f8d8e2500fdb2f59bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:03.341190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3180/6345] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:01 2022] DELETE /identity/v3/projects/22b8f44c8127471b9d35a93492f2d1c8 => generated 0 bytes in 1346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:03.341417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:03.345185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:03.347616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:03.440490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ae5dd-c082-4f14-8ba1-9f7ae186ebb0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:03.470670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:03.472095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:03.479234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:03.479787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:03.481573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:03.485127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d5190-e1ca-4990-91a6-fc625175e5ed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:03.577221 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3181/6346] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:03 2022] GET /identity/v3/roles => generated 2323 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:03.577221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9183c-6167-4de7-9466-b94a9d3f5590 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:03.584117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9183c-6167-4de7-9466-b94a9d3f5590 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:03.584995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9183c-6167-4de7-9466-b94a9d3f5590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:03.710872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3ee9183c-6167-4de7-9466-b94a9d3f5590 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:03.713560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3ee9183c-6167-4de7-9466-b94a9d3f5590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:03.772162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:03.787850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3182/6347] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:03.792460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:03.792962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:03.793457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:03.883576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:03.893887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:03.918522 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3166/6348] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 710 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:03.924716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:03.944288 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3183/6349] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:03.952716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:03.957527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9c04c-1329-40e5-880e-cae616610f2e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:03.967304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:03.969528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:03.970374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:03.973256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] PATH_INFO: `/v3/projects/53abb09a4275438aa28bca0ada5565df/users/660909b1faf74d35bdf949e9aeafbe6a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:03.996839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae86a-8094-47a7-b8b3-c50804cd13e3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:04.007896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abb09a4275438aa28bca0ada5565df, user_id=660909b1faf74d35bdf949e9aeafbe6a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.017669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b878-2d6f-42bf-9297-70926de46660 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.019428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:04.020596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.021119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.021618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.023012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:59:04.026615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.034818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.084044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3184/6350] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:04.092459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.096867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:04.160018 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3167/6351] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:03 2022] PUT /identity/v3/projects/53abb09a4275438aa28bca0ada5565df/users/660909b1faf74d35bdf949e9aeafbe6a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:04.177887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.178652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.182406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.307670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:04.313006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:04.431179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9895f-e0f0-4c30-8cf6-021f4ba8838c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:04.540188 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3168/6352] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:04.542892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.577211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dccd1f-de00-4ef2-9b24-1019d9eaded2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:04.596908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:04.598518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.598807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:04.599302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.599669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.599948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.600107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.600560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.604103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.605113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.608289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.610584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.622441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:04.625470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3185/6353] 10.222.0.78 () {58 vars in 1468 bytes} [Tue Oct 4 20:59:04 2022] HEAD /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:04.627065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.678311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7ae7-7604-4158-827f-fc2bac404241 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:04.696027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:04.697013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.697874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.699509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.701017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.704793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.740804 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3186/6354] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:04 2022] GET /identity/v3/roles => generated 2323 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:04.742971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.770873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc67cd5-065c-435b-9083-b72896d413d4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:04.784915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:04.785424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:04.785734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:04.786208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:04.788192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:59:04.789063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:04.794004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:04.825884 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3187/6355] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:04.829112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.851665 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3169/6356] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:04 2022] POST /identity/v3/projects => generated 369 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:04.855282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:04.878094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093cc68-8ae4-4267-98f8-a3b307ab3c1c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:05.101031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396635-eabe-4851-9975-375bb830e6e5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:05.122819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:05.123834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:05.124298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:05.124770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] PATH_INFO: `/v3/projects/53abb09a4275438aa28bca0ada5565df/users/660909b1faf74d35bdf949e9aeafbe6a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:05.131184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:05.132646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:05.133226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:05.135856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:05.136812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abb09a4275438aa28bca0ada5565df, user_id=660909b1faf74d35bdf949e9aeafbe6a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:05.141547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:05.142372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:05.150054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:05.164038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 506eec8115a14e92884baf14c04ad501 was removed from group e9a5491ed4584cd1b078142e61e44ac9 on project 52f0f6a70fa64ba4941d22800b21e32b. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:05.164613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:05.168240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:05.208814 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3170/6357] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:04 2022] PUT /identity/v3/projects/53abb09a4275438aa28bca0ada5565df/users/660909b1faf74d35bdf949e9aeafbe6a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:05.211181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:05.215439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:05.221812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:05.422119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932760b-03d4-4704-8218-0f4a5c68d2d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:05.429475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:05.430633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:05.431166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:05.431662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:05.432732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:05.436096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83ce2-9e11-4d98-966e-2602632cc337 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:05.472381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3188/6358] 10.222.0.78 () {58 vars in 1470 bytes} [Tue Oct 4 20:59:04 2022] DELETE /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:05.473963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:05.476365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:05.641637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:05.676044 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3171/6359] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:05 2022] POST /identity/v3/projects => generated 383 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:05.693081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:05.693657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:05.695117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:05.767674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4fd7-7436-4e5e-af9d-ea3810d1964a tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:05.816248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] MFA Rules not processed for user `660909b1faf74d35bdf949e9aeafbe6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:05.820054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:06.004207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:06.005574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:06.007012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:06.007012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:06.009461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:06.014832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:06.073025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3172/6360] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:06.073025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:06.073025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:06.078696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:06.202738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:06.220550 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3189/6361] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:05 2022] POST /identity/v3/users => generated 285 bytes in 743 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:06.220550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:06.229659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302baffe-57d3-4aad-be95-6d5c9518f509 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:06.243127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:06.245185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:06.245469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fff69-d706-4ba7-8e03-b24cfb54ae67 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:06.246667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:06.247751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/groups/e9a5491ed4584cd1b078142e61e44ac9/users/f011b077a6d24f8d8e2500fdb2f59bc7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:06.250723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e9a5491ed4584cd1b078142e61e44ac9, user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:06.252589 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:06.252589 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:06.252589 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:06.254465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:06.256935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:06.258803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:06.259876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:06.260624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:06.262116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:06.266553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:06.398949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:06.413957 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3190/6362] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:06 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:06.416885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:06.471933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a967f-cbda-4a56-af27-9da974997064 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:06.498249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:06.499958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:06.500486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:06.500990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:06.502235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:06.508314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:06.535005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3173/6363] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:59:06 2022] DELETE /identity/v3/groups/e9a5491ed4584cd1b078142e61e44ac9/users/f011b077a6d24f8d8e2500fdb2f59bc7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:06.540926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:06.724619 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3191/6364] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:59:06 2022] POST /identity/v3/projects => generated 329 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:06.734603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:06.747247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:06.847981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef5f0c-4d2b-4c05-8d9a-c57340df6312 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:06.945640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:07.014704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cfcc5-2d52-4541-9051-1444bf03d70e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.030046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.031599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.032423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.032994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.034561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.039071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.065675 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3192/6365] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:06 2022] GET /identity/v3/roles => generated 2323 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:07.067166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.082992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.084480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.090703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.090703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.090703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.090703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.135035 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3174/6366] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:06 2022] GET /identity/v3/roles => generated 2323 bytes in 599 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:07.141741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.265927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7055-78fb-4d60-9f5d-c87edbd2ce78 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.279933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.281512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.282500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.283259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.288662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.292656 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:07.292656 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:07.292656 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:07.295816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.308933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa673c-1702-4974-8556-54a97d944cc9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.320486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.321796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.322536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.323190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.325131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.329426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.537452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3193/6367] 10.222.0.78 () {60 vars in 1381 bytes} [Tue Oct 4 20:59:07 2022] PUT /identity/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:07.537452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.558959 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3175/6368] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:07 2022] POST /identity/v3/users => generated 413 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:07.579509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3553-3400-4181-badc-c2f07fa0e216 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.580593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.593906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.593906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.593906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.593906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.594618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.594618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.623891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3194/6369] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:07 2022] GET /identity/v3/roles => generated 2323 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:07.625937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.647979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651c7d1-2340-42ea-9750-89fe0d222fb2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.676127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb961c-39d7-45ee-af3e-fa623cf29c69 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.677042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.678310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.678831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.679380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.682096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.689136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.700389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.702160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.702930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.703828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.709181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=e9a5491ed4584cd1b078142e61e44ac9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.712385 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:07.712385 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:07.712385 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:07.716534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.726498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:07.726498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3176/6370] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:07 2022] GET /identity/v3/roles => generated 2323 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:07.726498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.750696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6738-3c1b-4f8f-9a0f-479437c1227f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.753060 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3195/6371] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 4 20:59:07 2022] GET /identity/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles => generated 376 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:07.755429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:07.765776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.767085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.768120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.769254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.771818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.789741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.790207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f6c3-8a58-40fd-a7d4-6fc7ca9d7af0 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:07.799493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:07.800776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:07.801278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:07.801791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] PATH_INFO: `/v3/projects/df890d7e8efa4d99a313257647a03b76/users/6f9e139c74794adebd0ef847a4919880/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:07.824034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df890d7e8efa4d99a313257647a03b76, user_id=6f9e139c74794adebd0ef847a4919880, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:07.826931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:07.999576 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3177/6372] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:07 2022] POST /identity/v3/roles => generated 243 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:07.999576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:08.020280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfcfdf-580a-47bd-8f07-cb0e176b9ed4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:08.034975 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3196/6373] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:07 2022] PUT /identity/v3/projects/df890d7e8efa4d99a313257647a03b76/users/6f9e139c74794adebd0ef847a4919880/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:08.051619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:08.148071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:08.153023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.153023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.153023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] PATH_INFO: `/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/d8387fc633ae44b6a7799430fb730045/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.185124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6e751fcaaf430d964cd0eb9399aab6, user_id=d8387fc633ae44b6a7799430fb730045, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:08.191981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061fd5-3c7b-4a0f-8259-e36d9e1bd1f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:08.260926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0507-9b1f-4e63-9d4f-ba1b51985096 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:08.273426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:08.276224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.276768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.277301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.281786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:08.284077 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:08.284077 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:08.284077 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:08.285972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:08.309793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3197/6374] 10.222.0.78 () {58 vars in 1363 bytes} [Tue Oct 4 20:59:08 2022] HEAD /identity/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:08.311197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:08.338544 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3178/6375] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:07 2022] PUT /identity/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/d8387fc633ae44b6a7799430fb730045/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:08.341716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.342238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.342730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.446865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] MFA Rules not processed for user `6f9e139c74794adebd0ef847a4919880`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:08.452963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:08.488812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:08.547944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7de1a-0cfe-4ecc-bf1d-cfdec24c4dd8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:08.710223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3179/6376] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:08.712028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:08.758213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:08.759765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.760518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.761606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.764832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:08.768370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0d0fe-185b-402d-a972-5a7374176e11 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:08.891023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd356ef0-30ee-4b48-9338-40b6ba5b5b2d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:08.900373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:08.902588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.903044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.903573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.905644 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3198/6377] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:08 2022] POST /identity/v3/roles => generated 246 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:08.906764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=e9a5491ed4584cd1b078142e61e44ac9, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:08.907978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:08.908546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:08.908867 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:08.908867 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:08.908867 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:08.909660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:08.910982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:09.003837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] MFA Rules not processed for user `d8387fc633ae44b6a7799430fb730045`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:09.006644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:09.032635 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3180/6378] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 4 20:59:08 2022] DELETE /identity/v3/system/groups/e9a5491ed4584cd1b078142e61e44ac9/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:09.034263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:09.198483 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3199/6379] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:09.200670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:09.249731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43766-bf0b-4e60-a342-03e7b57dc2d0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:09.249731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:09.250663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:09.250999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:09.251472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/de19dded973b409e8821b832fc0cd19d/users/5d8794fb6d904d1e9c73b8f0da579d20/roles/ad0e1e376f3c45c39ce853af9a2db2ed` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:09.259371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6a55-0e88-4145-b4ac-a93ca7ca22d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:09.278024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:09.279099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:09.279732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:09.280225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:09.281437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:09.285371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:09.313788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de19dded973b409e8821b832fc0cd19d, user_id=5d8794fb6d904d1e9c73b8f0da579d20, role_id=ad0e1e376f3c45c39ce853af9a2db2ed)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:09.322267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:09.591470 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3181/6380] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:09 2022] POST /identity/v3/projects => generated 383 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:09.594252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:09.615421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3200/6381] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:09 2022] PUT /identity/v3/projects/de19dded973b409e8821b832fc0cd19d/users/5d8794fb6d904d1e9c73b8f0da579d20/roles/ad0e1e376f3c45c39ce853af9a2db2ed => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:09.619068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:09.793156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:09.938247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802424-bdae-4d90-bd0f-6757d722e0f3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:09.963513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:09.963835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e776a9-1cb4-4417-bed7-8d8569efaa2c tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:09.964801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:09.965165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:09.965664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:09.981495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:09.995115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:10.182266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:10.183507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:10.183970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:10.184439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:10.185622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:10.190128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:10.199858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3182/6382] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 4 20:59:09 2022] PUT /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:10.201665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:10.354309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3201/6383] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:09 2022] POST /identity/v3/projects => generated 369 bytes in 738 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:10.355903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:10.473280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da28a68-e11f-460d-b01a-f4aefb7cb4ac tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:10.504588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:10.664233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308319-83f6-4d8c-a843-46e996bdbf6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:10.690225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:10.693744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:10.695367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:10.695367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/de19dded973b409e8821b832fc0cd19d/users/5d8794fb6d904d1e9c73b8f0da579d20/roles/4c4688330e9b41609579aae590d8e760` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:10.706171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de19dded973b409e8821b832fc0cd19d, user_id=5d8794fb6d904d1e9c73b8f0da579d20, role_id=4c4688330e9b41609579aae590d8e760)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:10.706817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:10.711877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:10.746206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:10.747593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:10.748137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:10.748646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:10.749953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:10.753768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:10.884560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3202/6384] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:10 2022] PUT /identity/v3/projects/de19dded973b409e8821b832fc0cd19d/users/5d8794fb6d904d1e9c73b8f0da579d20/roles/4c4688330e9b41609579aae590d8e760 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:10.887295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:10.895446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:10.939474 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3183/6385] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:10 2022] POST /identity/v3/users => generated 298 bytes in 738 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:10.940890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:11.237322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7a08-1371-41a4-ab2f-6c69adfcfcc0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:11.469154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:11.498065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:11.502570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:11.508047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:11.508047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:11.508047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:11.516632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=212e28d8157d4752be34b5c4135ff1bf, user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:11.522261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:11.549725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3184/6386] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 4 20:59:10 2022] GET /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles => generated 409 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:11.551608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:11.613888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73107cef-9891-41fa-aab9-e3f408e724e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:11.641246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:11.653423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:11.653423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:11.653423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:11.654521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:11.716118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:11.719605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:11.757397 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3203/6387] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:11.761725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:11.764057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:11.840490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a25b-693c-482b-9477-19450336e8ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:11.867468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:11.868749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:11.869254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:11.870310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:11.871097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:11.881251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:11.922694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da01018-953d-4ae2-b8b8-029f3d334745 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:11.935900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:11.937963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:11.939506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:11.939893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:11.941217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:11.945440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.061769 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3204/6388] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:11 2022] GET /identity/v3/users => generated 9572 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:12.063820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.092337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b467-62ac-498a-bb7b-4fa6326d89f3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:12.104425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:12.105952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.106691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.107629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.109568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:12.119206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3185/6389] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:11 2022] POST /identity/v3/users => generated 291 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:12.119973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.121896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660a95-e776-462c-a6bd-ca1175cf2e92 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.126877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:12.161955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3205/6390] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:12 2022] GET /identity/v3/roles => generated 2794 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:12.165167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.166052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.166817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.176024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b2e20-f05a-4578-8a85-353e29b15410 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:12.202700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:12.205695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.207417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.208784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.225688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:12.226050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:12.227316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.253238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3186/6391] 10.222.0.78 () {58 vars in 1462 bytes} [Tue Oct 4 20:59:12 2022] HEAD /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:12.254061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.274575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] MFA Rules not processed for user `5d8794fb6d904d1e9c73b8f0da579d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:12.278051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:12.278584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e1466-829a-4d3f-9cdd-2cde8d272f83 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:12.293821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:12.300323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.300323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.300323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.300323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:12.300323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.331865 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3187/6392] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:12 2022] GET /identity/v3/roles => generated 2794 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:12.334996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.366488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd77cd-6f9d-4379-a121-48d067229bd6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:12.379258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:12.382416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.382818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.383111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] PATH_INFO: `/v3/projects/b894801f67884d7a95297f4031f8c936/users/3376a5b2f9384a2bbdb751f3577c797c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.431996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b894801f67884d7a95297f4031f8c936, user_id=3376a5b2f9384a2bbdb751f3577c797c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:12.441780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.556598 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3206/6393] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:12.557586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.579026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a841-362f-471d-b3a2-0dadd3f722a6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:12.587996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:12.589560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.590911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.595561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.602394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=212e28d8157d4752be34b5c4135ff1bf, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:12.609155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:12.624547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 506eec8115a14e92884baf14c04ad501 was removed from user f011b077a6d24f8d8e2500fdb2f59bc7 on domain 212e28d8157d4752be34b5c4135ff1bf. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:12.630835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:12.630835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-50a6b621-68a3-4393-a99d-95aea502595c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:12.636984 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3188/6394] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:12 2022] PUT /identity/v3/projects/b894801f67884d7a95297f4031f8c936/users/3376a5b2f9384a2bbdb751f3577c797c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:12.638778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:12.642982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:12.832230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3207/6395] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 4 20:59:12 2022] DELETE /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:12.834422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f40-a832-4431-87c5-d262165432ed None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:12.835173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f40-a832-4431-87c5-d262165432ed None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:12.836539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f40-a832-4431-87c5-d262165432ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:12.870065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:12.877229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e8320f40-a832-4431-87c5-d262165432ed None None] MFA Rules not processed for user `5d8794fb6d904d1e9c73b8f0da579d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:12.879741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8320f40-a832-4431-87c5-d262165432ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:12.902934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a33da7-d8e9-4aa5-8753-7fa5a79e0c81 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:13.036056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3208/6396] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:13.040363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320f40-a832-4431-87c5-d262165432ed None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:13.051042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:13.052127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:13.052798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:13.053452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] PATH_INFO: `/v3/projects/fada00d6c093462d9c08c33cd52626b4/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:13.058609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8320f40-a832-4431-87c5-d262165432ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:13.114956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fada00d6c093462d9c08c33cd52626b4, user_id=5bb3eba82f04487689cae784b5bd92c7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:13.120904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320f40-a832-4431-87c5-d262165432ed None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:13.123594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:13.136250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:13.137361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:13.137862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:13.138574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:13.140158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:13.143731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:13.174139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3209/6397] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:13 2022] GET /identity/v3/roles => generated 2794 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:13.179640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:13.183530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:13.279975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3189/6398] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:12 2022] PUT /identity/v3/projects/fada00d6c093462d9c08c33cd52626b4/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:13.283699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:13.288862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:13.349519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ae433-52d0-437b-b44b-3ce2ae8d71c6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:13.459118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a013a44-7b24-44ae-baac-51a4340fd9b0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:13.469647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d8794fb6d904d1e9c73b8f0da579d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de19dded973b409e8821b832fc0cd19d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-274763335', 'tempest-DelegatedRole-286363347'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:13.473314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:13.474421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:13.475201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:13.479439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: Authorizing `identity:create_trust()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:13.482499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:13.546670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:13.548053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:13.548758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:13.549250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:13.560989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:13.568665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:13.777340 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3210/6399] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:13 2022] PUT /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:13.779788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:13.875568 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3190/6400] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:59:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:13.891857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:14.031455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:14.097406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4ad2-8d7d-4bb1-b071-dd60643d9edd tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:14.120709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:14.122144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.122745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.123417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] PATH_INFO: `/v3/projects/b894801f67884d7a95297f4031f8c936/users/3376a5b2f9384a2bbdb751f3577c797c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.141303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b894801f67884d7a95297f4031f8c936, user_id=3376a5b2f9384a2bbdb751f3577c797c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:14.145326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:14.195734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a735b-1d29-4789-9be6-d27bee403e0c tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:14.219790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3211/6401] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:13 2022] PUT /identity/v3/projects/b894801f67884d7a95297f4031f8c936/users/3376a5b2f9384a2bbdb751f3577c797c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:14.222054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:14.406011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:14.409705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.412293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.412844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.414178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:14.417929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:14.464152 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3191/6402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:13 2022] GET /identity/v3/roles => generated 2794 bytes in 588 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:14.465966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:14.469695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:14.488032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e927-aa59-4b2e-94d1-adaa173d0184 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:14.513900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:14.518746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.530300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.530300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.530300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_grants(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:14.539063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc221e35-58ec-4dda-8c46-39d7942bec7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:14.598588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3212/6403] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 4 20:59:14 2022] GET /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles => generated 410 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:14.607105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.607808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.608145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.643064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:14.741395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] MFA Rules not processed for user `3376a5b2f9384a2bbdb751f3577c797c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:14.746785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:14.757795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f76d2-3479-4e2c-8ede-db0ce3e8c666 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:14.781587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:14.782738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.783270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.783705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.784865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:14.787342 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:14.787342 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:14.787342 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:14.792380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:14.830386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3192/6404] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 4 20:59:14 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:14.830970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:14.874472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321ef78-b512-4511-be5d-3b5194e21d09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:14.888937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:14.892260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:14.921181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:14.922600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] PATH_INFO: `/v3/projects/fada00d6c093462d9c08c33cd52626b4/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:14.929919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fada00d6c093462d9c08c33cd52626b4, user_id=5bb3eba82f04487689cae784b5bd92c7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:14.936952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:14.966987 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3193/6405] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:14 2022] PUT /identity/v3/projects/fada00d6c093462d9c08c33cd52626b4/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:14.970214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:15.011663 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3213/6406] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:15.013379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:15.149269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:15.187421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85022ee-b5d7-4cda-9f39-736a1b719d65 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:15.202722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:15.204671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:15.205446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:15.206200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:15.214896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:15.220191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e6e5-433d-49be-80b0-e367734f767c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:15.227306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939c0ad-7fac-4261-ac38-1b0ffc8312b6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:15.242616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3194/6407] 10.222.0.78 () {58 vars in 1465 bytes} [Tue Oct 4 20:59:14 2022] HEAD /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:15.246040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:15.247160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:15.247927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:15.321955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] MFA Rules not processed for user `5bb3eba82f04487689cae784b5bd92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:15.324769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:15.400746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d8794fb6d904d1e9c73b8f0da579d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de19dded973b409e8821b832fc0cd19d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-274763335', 'tempest-DelegatedRole-286363347'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:15.402145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:15.405204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:15.405907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] PATH_INFO: `/v3/OS-TRUST/trusts/8255ada0a5094c0e99d83778d9b7ba68` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:15.460399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: Authorizing `identity:delete_trust(trust_id=8255ada0a5094c0e99d83778d9b7ba68)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:15.466212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:15.584212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3195/6408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:15.584212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:15.584695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:15.753283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdca8b-e8c3-4c1d-83aa-a9a5f009d093 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:15.762822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:15.763541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8255ada0a5094c0e99d83778d9b7ba68', 'request_id': 'req-e1cce18b-6d39-4985-a0b0-7eea339e417d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:15.764990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8255ada0a5094c0e99d83778d9b7ba68', 'request_id': 'req-e1cce18b-6d39-4985-a0b0-7eea339e417d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:15.765462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:15.766190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:15.766366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8255ada0a5094c0e99d83778d9b7ba68', 'request_id': 'req-e1cce18b-6d39-4985-a0b0-7eea339e417d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:15.767098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:15.771566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:15.882836 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3214/6409] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 20:59:15 2022] DELETE /identity/v3/OS-TRUST/trusts/8255ada0a5094c0e99d83778d9b7ba68 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:15.884622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:15.886992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:15.914671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cce18b-6d39-4985-a0b0-7eea339e417d tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:15.923510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:15.924981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:15.925466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:15.925957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:15.934129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=52f0f6a70fa64ba4941d22800b21e32b, user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:15.939383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:15.954896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 506eec8115a14e92884baf14c04ad501 was removed from user f011b077a6d24f8d8e2500fdb2f59bc7 on project 52f0f6a70fa64ba4941d22800b21e32b. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:15.955259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:15.956821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:15.964174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:16.009454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:16.014930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:16.059556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3196/6410] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:16.061686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:16.066152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:16.094470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3215/6411] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:59:15 2022] DELETE /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:16.096431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:16.108016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:16.171912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:16.298350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12df9-3488-4c18-8826-0a38c47415cd service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:16.302875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aa7ed-98ea-494f-bb95-caca1e1675fb tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:16.314682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d8794fb6d904d1e9c73b8f0da579d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de19dded973b409e8821b832fc0cd19d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-274763335', 'tempest-DelegatedRole-286363347'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:16.316411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:16.320158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:16.332563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] PATH_INFO: `/v3/OS-TRUST/trusts/8255ada0a5094c0e99d83778d9b7ba68` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Could not find trust: 8255ada0a5094c0e99d83778d9b7ba68.: keystone.exception.TrustNotFound: Could not find trust: 8255ada0a5094c0e99d83778d9b7ba68. Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 04 20:59:16.395625 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8255ada0a5094c0e99d83778d9b7ba68. Oct 04 20:59:16.397923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:59:16.405800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3216/6412] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:59:16 2022] GET /identity/v3/OS-TRUST/trusts/8255ada0a5094c0e99d83778d9b7ba68 => generated 111 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:59:16.411069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:16.415431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:16.478326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:16.479966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:16.481270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:16.482076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:16.485249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:16.495279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:16.623511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ed67-90f8-465f-b0ea-fcca6239828f tempest-TrustsV3TestJSON-1002669484 tempest-user-936605673] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:16.634496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:16.636677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:16.639128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:16.640041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:16.644967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:16.649069 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:16.649069 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:16.649069 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:16.652717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:16.750864 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3197/6413] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:16 2022] POST /identity/v3/projects => generated 369 bytes in 685 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:16.750864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:16.755758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:16.769708 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3217/6414] 10.222.0.78 () {60 vars in 1378 bytes} [Tue Oct 4 20:59:16 2022] PUT /identity/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:16.769708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:16.775763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:16.807468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307111-0229-4d2d-ad7e-ebbb1af64ae8 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:16.988382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc176-0bb8-4e04-9c5a-72ec2f03ea48 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:17.000359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.008001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.008001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.008001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/4c4688330e9b41609579aae590d8e760` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.008001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c4688330e9b41609579aae590d8e760)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.011911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:17.014636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.016409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.016908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.018700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.020084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.034017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:17.219306 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3218/6415] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:16 2022] POST /identity/v3/users => generated 285 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:17.224545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:17.305096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:17.400257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5051a-21b6-41df-ba2c-a655f64d8e76 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:17.401380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 4c4688330e9b41609579aae590d8e760 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:17.401914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:17.404579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:17.413131 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3198/6416] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:16 2022] DELETE /identity/v3/roles/4c4688330e9b41609579aae590d8e760 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:17.416118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:17.423714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:17.424012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.426106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.426587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.427813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.431455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.433456 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:17.433456 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:17.433456 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:17.435253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:17.467532 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3219/6417] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 4 20:59:17 2022] GET /identity/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles => generated 375 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:17.470765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:17.480384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:17.504456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:17.550109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22584a-b8dc-4762-8544-1fe6fcc329aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:17.619642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6bbd-38fd-4206-be90-99eb93331f93 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:17.659040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.660415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.660911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.661918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.663266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.667909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:17.793342 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3199/6418] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:17 2022] GET /identity/v3/roles => generated 2557 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:17.793342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:17.793342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:17.873485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.875033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.875671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.876350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/ad0e1e376f3c45c39ce853af9a2db2ed` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.880638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad0e1e376f3c45c39ce853af9a2db2ed)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.889265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:17.973336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae42db1-c48d-432d-8c62-dc4bb5d8cf30 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:17.986114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:17.988581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:17.989298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:17.991416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:17.994959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:17.998438 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:17.998438 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:17.998438 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:18.001528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:18.022572 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3200/6419] 10.222.0.78 () {58 vars in 1360 bytes} [Tue Oct 4 20:59:17 2022] HEAD /identity/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:18.022572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:18.057684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d88-1787-4c25-b591-73f4e732b20f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:18.072263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:18.080060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:18.080060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:18.080060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:18.080801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:18.090214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:18.135248 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3201/6420] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:18 2022] GET /identity/v3/roles => generated 2557 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:18.135248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:18.168792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36bb0-c62e-4170-abad-da6e76b9df13 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:18.182944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:18.184709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:18.185384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:18.185995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:18.190760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=f011b077a6d24f8d8e2500fdb2f59bc7, role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:18.192927 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:18.192927 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:18.192927 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:18.195467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:18.232783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role ad0e1e376f3c45c39ce853af9a2db2ed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:18.233268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:18.234475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:18.243561 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3220/6421] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:17 2022] DELETE /identity/v3/roles/ad0e1e376f3c45c39ce853af9a2db2ed => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:18.243561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:18.245918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:18.332598 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3202/6422] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 4 20:59:18 2022] DELETE /identity/v3/system/users/f011b077a6d24f8d8e2500fdb2f59bc7/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:18.339202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:18.341796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:18.393939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e5b5-5c5b-4a9f-aa31-17b802d09012 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:18.521990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bcc1d-b46d-48cf-a830-8f867f4858d3 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:18.542826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:18.544342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:18.544942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:18.545540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] PATH_INFO: `/v3/projects/8df610a8884f449b9d4723d97957a2a6/users/66be740f793641daa240fb18364ea410/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:18.615092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df610a8884f449b9d4723d97957a2a6, user_id=66be740f793641daa240fb18364ea410, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:18.624211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:18.632627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:18.634674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:18.636358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:18.638391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/5d8794fb6d904d1e9c73b8f0da579d20` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:18.642870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d8794fb6d904d1e9c73b8f0da579d20)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:18.648446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:18.801373 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3221/6423] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:18 2022] PUT /identity/v3/projects/8df610a8884f449b9d4723d97957a2a6/users/66be740f793641daa240fb18364ea410/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:18.803514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:18.814924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:18.839093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:18.992627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a6e37-0554-494d-a201-e882852fd2a5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:19.002511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:19.003973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:19.004430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:19.004811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:19.005108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:19.007034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:19.010642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51191209-df31-43ec-9248-55de4b272c7d tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:19.027934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8794fb6d904d1e9c73b8f0da579d20'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:19.164896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3222/6424] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:18 2022] POST /identity/v3/roles => generated 269 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:19.165250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8794fb6d904d1e9c73b8f0da579d20'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:19.173548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:19.176833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:19.177776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:19.193792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8794fb6d904d1e9c73b8f0da579d20'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:19.241745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8794fb6d904d1e9c73b8f0da579d20'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:19.244737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8794fb6d904d1e9c73b8f0da579d20'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:19.254550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] MFA Rules not processed for user `66be740f793641daa240fb18364ea410`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:19.260356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:19.270597 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3203/6425] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:18 2022] DELETE /identity/v3/users/5d8794fb6d904d1e9c73b8f0da579d20 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:19.275007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:19.285351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:19.519258 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3223/6426] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:19.522635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:19.530229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:19.607067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c502-e426-4033-83fd-5ae6621271c1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:19.622288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:19.624350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:19.624928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:19.625754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:19.627110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:19.630193 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:19.630193 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:19.630193 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:19.634883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:19.802909 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3204/6427] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:19 2022] POST /identity/v3/roles => generated 269 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:19.809024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:19.813354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:19.936562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f78250-0b76-47b6-bdac-d2a6ca1f4b46 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:20.174471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:20.230879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cde28d-f368-4ef5-a8eb-cfe7d7eec0a3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:20.254617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:20.258540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:20.258942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:20.261889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:20.263338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:20.267114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:20.297529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:20.299285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:20.299785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:20.300944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/de19dded973b409e8821b832fc0cd19d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:20.304073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de19dded973b409e8821b832fc0cd19d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:20.310291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:20.459708 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3205/6428] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:59:19 2022] POST /identity/v3/domains => generated 277 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:20.459708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:20.640802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:20.693834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd51cf5-2cfa-4f5d-8751-91ef83566794 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:20.707305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:20.714321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:20.714321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:20.714321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/707aa11d6b9d40b2bbc0b1aa918d9500` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:20.714321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=707aa11d6b9d40b2bbc0b1aa918d9500)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:20.719667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:20.988878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de19dded973b409e8821b832fc0cd19d', 'request_id': 'req-dc221870-5175-40d8-8934-9a95ffa252d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:21.041089 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3206/6429] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:20 2022] PUT /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/707aa11d6b9d40b2bbc0b1aa918d9500 => generated 529 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:21.041089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:21.152139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de19dded973b409e8821b832fc0cd19d', 'request_id': 'req-dc221870-5175-40d8-8934-9a95ffa252d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:21.176462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de19dded973b409e8821b832fc0cd19d', 'request_id': 'req-dc221870-5175-40d8-8934-9a95ffa252d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:21.222952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project de19dded973b409e8821b832fc0cd19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:21.231748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:21.235290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:21.243422 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3224/6430] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:19 2022] DELETE /identity/v3/projects/de19dded973b409e8821b832fc0cd19d => generated 0 bytes in 1723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:21.245395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:21.251603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:21.344567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db56a08-79b7-4afc-8e1d-7c88487a25c4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:21.368478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:21.369646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:21.370158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:21.370645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:21.375452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:21.384335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:21.507286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc221870-5175-40d8-8934-9a95ffa252d1 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:21.515566 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3207/6431] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:21 2022] POST /identity/v3/roles => generated 238 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:21.522322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:21.535289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:21.784416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:21.790207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:21.790207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:21.790207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] PATH_INFO: `/v3/users/cfdc24219b1a4560a7c0aa721262744c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:21.797809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdc24219b1a4560a7c0aa721262744c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:21.801933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:21.864378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:21.876083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51cf7-e95b-46ce-b7a2-85a6c2176d67 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:21.900995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:21.901298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:21.901823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:21.902326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:21.904373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:21.919582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:22.106254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3208/6432] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:59:21 2022] POST /identity/v3/domains => generated 276 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:22.107915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:22.126034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:22.286085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdc24219b1a4560a7c0aa721262744c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:22.290972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdc24219b1a4560a7c0aa721262744c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:22.422589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdc24219b1a4560a7c0aa721262744c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:22.460497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01253-d231-4ee3-9002-e3542b75abca tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:22.494778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:22.495603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:22.495894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:22.496177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:22.497723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:22.499780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdc24219b1a4560a7c0aa721262744c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:22.501960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:22.544419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdc24219b1a4560a7c0aa721262744c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:22.585151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3225/6433] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:21 2022] DELETE /identity/v3/users/cfdc24219b1a4560a7c0aa721262744c => generated 0 bytes in 1333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:22.587701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:22.590580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:22.701407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3209/6434] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:59:22 2022] POST /identity/v3/projects => generated 328 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:22.706802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:22.728159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:22.763282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc62-d10c-46ae-8896-b0853250a33e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:22.843181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:23.033604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d8e2-4cf8-4e7a-94ff-7d7bb39ee023 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:23.037771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:23.039571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.043165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.043942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/8cbdff4388a24d5daf19bbe5519f8390/users/66be740f793641daa240fb18364ea410/roles/c029859831a342f9ae5bdb3de9652d58` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.044637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:23.046030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.046806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.047561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.049153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:23.053376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccb363-eac4-4adf-b865-d5ad4305d6a7 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:23.085890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8cbdff4388a24d5daf19bbe5519f8390, user_id=66be740f793641daa240fb18364ea410, role_id=c029859831a342f9ae5bdb3de9652d58)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:23.093924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:23.212213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3210/6435] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:22 2022] POST /identity/v3/roles => generated 270 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:23.212213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.212213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.212213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.249642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:23.254325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:23.269608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3226/6436] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 4 20:59:22 2022] PUT /identity/v3/domains/8cbdff4388a24d5daf19bbe5519f8390/users/66be740f793641daa240fb18364ea410/roles/c029859831a342f9ae5bdb3de9652d58 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:23.274337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:23.277083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:23.476681 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3211/6437] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:23.477986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:23.521394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9c275-cf5e-40be-a72d-fb20321bdcff tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:23.551422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:23.553609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.554097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.558389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.559618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:23.564437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:23.686568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0eb2a-4792-4f09-b131-17ea34af54c2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:23.709449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:23.710727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.711279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.711749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/c27bcb28a1834eff94843ed6a2dd1a12` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.715122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=c27bcb28a1834eff94843ed6a2dd1a12)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:23.725935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:23.748249 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3227/6438] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:23 2022] POST /identity/v3/users => generated 413 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:23.748249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:23.895063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54e864-5894-4379-bd3a-527ef3e69ab2 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:23.909107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:23.909520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:23.909864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:23.910150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:23.910966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:23.914968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:23.951970 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3212/6439] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:23 2022] PUT /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/c27bcb28a1834eff94843ed6a2dd1a12 => generated 530 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:23.953052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:23.955628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:24.113344 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3228/6440] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:59:23 2022] POST /identity/v3/domains => generated 275 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:24.116129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:24.169292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066a8e-c7f6-422d-8b8d-681aa81c866b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:24.247576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:24.357524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:24.358324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:24.358769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:24.359234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:24.420724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47061-d6a9-4d58-8d42-8ba1e4ce6f60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:24.440584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:24.442012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:24.442233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:24.442863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:24.444247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:24.449903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:24.513914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:24.595056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3229/6441] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:24 2022] POST /identity/v3/roles => generated 243 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:24.600869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:24.611880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:24.614549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:24.679417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3213/6442] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:24.682456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:24.867065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1643d-3ebe-4394-9770-ce15b2af9ea4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:24.876986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:24.878161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:24.878848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:24.879103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:24.884942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:24.886787 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:24.886787 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:24.886787 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:24.888491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:24.929770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09864-ebcd-4e2f-b94d-217e613deadc service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:24.937479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:24.941802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:24.941802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:24.941802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:24.941802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:24.945478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:25.053883 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3230/6443] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:24 2022] PUT /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/506eec8115a14e92884baf14c04ad501 => generated 525 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:25.055782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.144469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3214/6444] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:24 2022] POST /identity/v3/roles => generated 240 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:25.146350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.206170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a50-0051-4b67-9a6a-0d279fe0b370 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:25.311894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff24f-a115-4680-8d38-31bcbba7ed3c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:25.322766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:25.324050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:25.324793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:25.325381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:25.327092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:25.332147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:25.362923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:25.363996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:25.364447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:25.364941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/506eec8115a14e92884baf14c04ad501/implies/7e8806c5b2fd4cd186b98399e90f81f7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:25.371828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=506eec8115a14e92884baf14c04ad501, implied_role_id=7e8806c5b2fd4cd186b98399e90f81f7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:25.375348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:25.416870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] 7e8806c5b2fd4cd186b98399e90f81f7 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7e8806c5b2fd4cd186b98399e90f81f7 cannot be an implied roles. Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 04 20:59:25.448620 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 7e8806c5b2fd4cd186b98399e90f81f7 cannot be an implied roles. Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3215/6445] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:25 2022] PUT /identity/v3/roles/506eec8115a14e92884baf14c04ad501/implies/7e8806c5b2fd4cd186b98399e90f81f7 => generated 116 bytes in 306 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:59:25.455462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.506737 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3231/6446] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:25 2022] POST /identity/v3/roles => generated 247 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:25.507833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.546056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa175a-ef92-483c-b53a-7161add7ee61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:25.560658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:25.564972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:25.565802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:25.569361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:25.576682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:25.581042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:25.700244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1e5a-205e-4602-a1e7-4a4b9fc491ea tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:25.710636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:25.712269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:25.713797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:25.713797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:25.716417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:25.721060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:25.737470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3232/6447] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:25 2022] DELETE /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:25.740217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.860680 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3216/6448] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:25 2022] POST /identity/v3/groups => generated 327 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:25.862419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:25.916496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44372-85ff-4ff3-863b-04ec6335b468 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:25.998527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55c92c-57d2-4a7d-ad22-562664585aae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:26.019928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:26.022185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:26.022649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:26.023119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/160c6bbd4a624a4796da83845610d656/users/05cde8c332d8425090b1b47cbdcfe53d/roles/5981d582ecb448f8aee13c668cb37eca` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:26.097323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=160c6bbd4a624a4796da83845610d656, user_id=05cde8c332d8425090b1b47cbdcfe53d, role_id=5981d582ecb448f8aee13c668cb37eca)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:26.110485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:26.128329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:26.129586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:26.130050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:26.131046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/c27bcb28a1834eff94843ed6a2dd1a12` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:26.136322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=c27bcb28a1834eff94843ed6a2dd1a12)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:26.139920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:26.253547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3233/6449] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:25 2022] PUT /identity/v3/projects/160c6bbd4a624a4796da83845610d656/users/05cde8c332d8425090b1b47cbdcfe53d/roles/5981d582ecb448f8aee13c668cb37eca => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:26.253547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:26.275536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3217/6450] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:25 2022] DELETE /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/c27bcb28a1834eff94843ed6a2dd1a12 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:26.284604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:26.285770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:26.479248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:26.600880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae5a73-d487-4810-a16f-1184b33ada13 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:26.624658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:26.625951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:26.627354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:26.627842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/160c6bbd4a624a4796da83845610d656/users/05cde8c332d8425090b1b47cbdcfe53d/roles/df8e734878bb47368a4239b0d4e5f9aa` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:26.637491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=160c6bbd4a624a4796da83845610d656, user_id=05cde8c332d8425090b1b47cbdcfe53d, role_id=df8e734878bb47368a4239b0d4e5f9aa)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:26.659698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:26.689441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57bf2e-2c22-46a3-a244-8bdc45fae496 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:26.791025 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3218/6451] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:26 2022] PUT /identity/v3/projects/160c6bbd4a624a4796da83845610d656/users/05cde8c332d8425090b1b47cbdcfe53d/roles/df8e734878bb47368a4239b0d4e5f9aa => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:26.792844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:26.959758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:26.961831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:26.962204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:26.962597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/966c1aa98b184b2a8b396f363b47fe54/users/66be740f793641daa240fb18364ea410` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:27.005899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=966c1aa98b184b2a8b396f363b47fe54, user_id=66be740f793641daa240fb18364ea410)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:27.028491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:27.045078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:27.147313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba99231-b8f5-4bbd-b57e-660d81e69336 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:27.160031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:27.162372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:27.166085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:27.168388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/c27bcb28a1834eff94843ed6a2dd1a12` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:27.180963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c27bcb28a1834eff94843ed6a2dd1a12)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:27.184943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:27.290710 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3234/6452] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:59:26 2022] PUT /identity/v3/groups/966c1aa98b184b2a8b396f363b47fe54/users/66be740f793641daa240fb18364ea410 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:27.290990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:27.423981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role c27bcb28a1834eff94843ed6a2dd1a12 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:27.428225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:27.438193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:27.448138 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3219/6453] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:26 2022] DELETE /identity/v3/roles/c27bcb28a1834eff94843ed6a2dd1a12 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:27.452360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:27.461074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:27.558965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e6ac-9d65-4854-a919-c27ab937d757 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:27.695086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b307d05-72da-4a8f-8294-a6e530c0b051 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:27.710795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:27.712036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:27.712387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:27.713549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/23e29e71d547485caabffb7bd158433b/groups/966c1aa98b184b2a8b396f363b47fe54/roles/94ccb8c895a54310b60b47981e0bd81b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:27.721180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=23e29e71d547485caabffb7bd158433b, group_id=966c1aa98b184b2a8b396f363b47fe54, role_id=94ccb8c895a54310b60b47981e0bd81b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:27.727594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:27.780865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:27.785553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:27.785553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:27.785553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:27.785553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:27.790720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:27.887184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3220/6454] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:27 2022] PUT /identity/v3/domains/23e29e71d547485caabffb7bd158433b/groups/966c1aa98b184b2a8b396f363b47fe54/roles/94ccb8c895a54310b60b47981e0bd81b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:27.888774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:27.904383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:27.929241 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3235/6455] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:27 2022] GET /identity/v3/users => generated 9856 bytes in 634 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:27.929241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:27.929241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:28.129022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:28.181187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-cbd8-4469-a348-50a122a064cd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:28.209351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe1a82-c690-4219-bbfa-36c8feabaa08 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:28.215420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:28.216647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:28.217495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:28.218002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:28.265319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ed9ebdd4e8764c9a9be6c6431db833e8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:28.268762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:28.374678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.377176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.442330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:28.443922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:28.444400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:28.444821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] PATH_INFO: `/v3/projects/c5eddb4c0d754757abe8629a558e532f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:28.447003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5eddb4c0d754757abe8629a558e532f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:28.451385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:28.546825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.548350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.555258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:28.560033 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3221/6456] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:59:27 2022] PATCH /identity/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8 => generated 277 bytes in 672 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:28.561732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:28.565946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:28.685678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5eddb4c0d754757abe8629a558e532f', 'request_id': 'req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.775899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2fbd-7a75-4c4a-a094-03b3779ecb30 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:28.886608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5eddb4c0d754757abe8629a558e532f', 'request_id': 'req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.909606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5eddb4c0d754757abe8629a558e532f', 'request_id': 'req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.954838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] The token cache is being invalidate because project c5eddb4c0d754757abe8629a558e532f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:28.958925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.964930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80fdf841-5c13-4fe0-84b1-395bad0bc4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:28.970833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:28.970833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:28.970833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:28.971889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:28.976410 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3236/6457] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:27 2022] DELETE /identity/v3/projects/c5eddb4c0d754757abe8629a558e532f => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:28.978892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:28.979229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:28.980448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:28.983001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:28.986456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:29.119031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] MFA Rules not processed for user `05cde8c332d8425090b1b47cbdcfe53d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:29.121383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:29.183660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3222/6458] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:59:28 2022] POST /identity/v3/domains => generated 276 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:29.188051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:29.195171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:29.246035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:29.363651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3237/6459] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:29.363651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:29.384968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:29.393137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c29e2-1e97-4a41-a692-3ee47ff754a2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:29.403463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:29.404979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:29.405543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:29.406114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] PATH_INFO: `/v3/users/6f9e139c74794adebd0ef847a4919880` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:29.409343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9e139c74794adebd0ef847a4919880)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:29.414229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:29.578071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:29.606049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b740dc-73b6-4e29-a5de-d95cfe4ee016 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:29.777887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9e139c74794adebd0ef847a4919880'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.824767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:29.825921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:29.826414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:29.832183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:29.876918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ed9ebdd4e8764c9a9be6c6431db833e8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:29.884344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:29.900544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9e139c74794adebd0ef847a4919880'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.928936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9e139c74794adebd0ef847a4919880'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.964409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.989025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9e139c74794adebd0ef847a4919880'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.991996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9e139c74794adebd0ef847a4919880'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:29.998847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.024678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3223/6460] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:29 2022] DELETE /identity/v3/users/6f9e139c74794adebd0ef847a4919880 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:30.026844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:30.034943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:30.216153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.290090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849836-b59f-446b-a2d0-feeaed9e9391 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:30.352062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.399598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.472432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] The token cache is being invalidate because project ed9ebdd4e8764c9a9be6c6431db833e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:30.472975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.475218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.535500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.539704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.542355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ed9ebdd4e8764c9a9be6c6431db833e8', 'request_id': 'req-d125d21f-cb2e-4552-9411-5ff52366befe'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:30.561672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:30.565464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:30.566545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:30.568797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] PATH_INFO: `/v3/users/c3f5e84bd21441a6b36e101eb43339eb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:30.578524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f5e84bd21441a6b36e101eb43339eb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:30.590267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:30.598144 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3238/6461] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:59:29 2022] DELETE /identity/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8 => generated 0 bytes in 1227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:30.599497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:30.607018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:30.894841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125d21f-cb2e-4552-9411-5ff52366befe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:30.907459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:30.908450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:30.908967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:30.909483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:30.912787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:30.917097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1dff8-1f3c-431a-a586-dd1eb4388fb6 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:30.969711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:31.095595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f5e84bd21441a6b36e101eb43339eb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:31.167756 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3239/6462] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:30 2022] POST /identity/v3/roles => generated 240 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:31.171985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:31.172736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:31.174718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:31.239121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f5e84bd21441a6b36e101eb43339eb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:31.261287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] MFA Rules not processed for user `05cde8c332d8425090b1b47cbdcfe53d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:31.263827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:31.272651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f5e84bd21441a6b36e101eb43339eb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:31.278912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:31.334852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f5e84bd21441a6b36e101eb43339eb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:31.341492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e26cfc4-0d1a-4186-8d07-2eeb029b6d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f5e84bd21441a6b36e101eb43339eb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:31.359804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3224/6463] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:30 2022] DELETE /identity/v3/users/c3f5e84bd21441a6b36e101eb43339eb => generated 0 bytes in 1334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:31.362794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:31.363523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:31.364301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:31.418139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:31.420749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:31.484290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3240/6464] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:31.487330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:31.491433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:31.697301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3225/6465] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:31.702040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:31.709798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:31.777108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604d6e-1a30-471f-ba69-baa6b29bab52 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:31.783938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d305e-ebf2-4b83-8c61-0ec4bd256600 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:31.796723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:31.799402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:31.799938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:31.800398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] PATH_INFO: `/v3/users/c9d5a01f00e345aaa6c53fe5ee71bd3b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:31.807784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d5a01f00e345aaa6c53fe5ee71bd3b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:31.816340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:31.976680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:31.978151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:31.978673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:31.979218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/707aa11d6b9d40b2bbc0b1aa918d9500` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:31.982822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7e8806c5b2fd4cd186b98399e90f81f7, implied_role_id=707aa11d6b9d40b2bbc0b1aa918d9500)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:31.988651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:32.153476 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3241/6466] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:31 2022] DELETE /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7/implies/707aa11d6b9d40b2bbc0b1aa918d9500 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:32.155064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:32.160807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:32.268983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d5a01f00e345aaa6c53fe5ee71bd3b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:32.402284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192256b-0f27-4183-bba8-27d785fd1548 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:32.414226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:32.416084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:32.416687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:32.417549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf/users/66be740f793641daa240fb18364ea410/roles/8defef3ff04e44f4a4d84ac86c47d4a6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:32.448913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3d87f3010fd54f4a86cc236c4e2405cf, user_id=66be740f793641daa240fb18364ea410, role_id=8defef3ff04e44f4a4d84ac86c47d4a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:32.459321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:32.501422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d5a01f00e345aaa6c53fe5ee71bd3b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:32.518374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d5a01f00e345aaa6c53fe5ee71bd3b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:32.546935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d5a01f00e345aaa6c53fe5ee71bd3b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:32.549481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d5a01f00e345aaa6c53fe5ee71bd3b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:32.568449 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3226/6467] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:31 2022] DELETE /identity/v3/users/c9d5a01f00e345aaa6c53fe5ee71bd3b => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:32.568449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:32.569922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:32.688266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3242/6468] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 4 20:59:32 2022] PUT /identity/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf/users/66be740f793641daa240fb18364ea410/roles/8defef3ff04e44f4a4d84ac86c47d4a6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:32.690847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:32.699693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:32.825493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0d058-1e06-4ab7-891b-0241a1a39d48 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:32.854343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:32.946191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86e15-05bb-45e6-a69e-942358129a26 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:32.953951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:32.955735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:32.956418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:32.957099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:32.961545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:33.032386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cde8c332d8425090b1b47cbdcfe53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '160c6bbd4a624a4796da83845610d656', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-901628340', 'tempest-NotDelegatedRole-1618846955'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:33.033456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:33.033932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:33.034413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:33.035707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorizing `identity:create_trust()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:33.038704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657447e2-7d53-4905-9ea5-4cdd14ea0695 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:33.173521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:33.180644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:33.206452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3243/6469] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:33.209045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:33.213447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:33.355537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff482ba1-d660-4f33-a3da-6b4989eb860d service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:33.365267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:33.366741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:33.367455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:33.367967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/707aa11d6b9d40b2bbc0b1aa918d9500` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:33.379321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=707aa11d6b9d40b2bbc0b1aa918d9500)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:33.379321 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:33.379321 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:33.379321 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:33.379321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:33.455274 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3227/6470] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:59:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 888 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:33.456131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:33.456273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:33.456643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:33.496410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:33.499239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:33.515291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3228/6471] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:33.518337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:33.518901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:33.615714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 707aa11d6b9d40b2bbc0b1aa918d9500 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:33.616237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:33.621340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:33.625695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3244/6472] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:33 2022] DELETE /identity/v3/roles/707aa11d6b9d40b2bbc0b1aa918d9500 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:33.626942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:33.629641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:33.669429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908f86-b7da-4d86-95ad-b41c7951c408 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:33.826284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf862f-137f-46f6-96a1-55235fafeb51 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:33.829040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:33.831195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:33.831195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:33.831532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:33.833156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:33.837284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:33.842441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:33.844399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:33.845710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:33.846673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] PATH_INFO: `/v3/projects/69579102526e48e1b18217c5d0545c36` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:33.850142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69579102526e48e1b18217c5d0545c36)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:33.856489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:34.061291 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3229/6473] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 4 20:59:33 2022] POST /identity/v3/domains => generated 275 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:34.062939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:34.067037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:34.116405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:34.170327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69579102526e48e1b18217c5d0545c36', 'request_id': 'req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.216053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04ad34-7010-4dc1-92d4-e5ed65c5ba9e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:34.336443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69579102526e48e1b18217c5d0545c36', 'request_id': 'req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.360879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69579102526e48e1b18217c5d0545c36', 'request_id': 'req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.401324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cde8c332d8425090b1b47cbdcfe53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '160c6bbd4a624a4796da83845610d656', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-901628340', 'tempest-NotDelegatedRole-1618846955'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:34.404199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:34.405833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:34.408526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:34.410580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:34.418050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] The token cache is being invalidate because project 69579102526e48e1b18217c5d0545c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:34.419100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.419740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:34.422412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.431687 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3245/6474] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:33 2022] DELETE /identity/v3/projects/69579102526e48e1b18217c5d0545c36 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:34.438605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:34.445456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:34.450313 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3230/6475] 10.222.0.78 () {58 vars in 1252 bytes} [Tue Oct 4 20:59:34 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=05cde8c332d8425090b1b47cbdcfe53d => generated 611 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:34.452645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:34.457568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:34.640191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f7672-6dfc-4748-8bff-44a571e445f5 tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:34.653018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:34.655167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:34.655895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:34.657360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:34.659588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7e8806c5b2fd4cd186b98399e90f81f7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:34.664972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:34.671856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6d136-0e2c-44e6-b63e-ff8d5cb076e3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:34.691116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:34.692497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:34.693048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:34.693729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:34.701488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:34.897078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:34.914041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:34.941277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 7e8806c5b2fd4cd186b98399e90f81f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:34.941700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.946252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f2fc92bd-6602-477c-9754-de3afeadc288 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:34.951774 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3246/6476] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:34.961876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:34.962359 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3231/6477] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:34 2022] DELETE /identity/v3/roles/7e8806c5b2fd4cd186b98399e90f81f7 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:34.962359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:34.962359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:34.962359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:34.964543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:35.053281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:35.055640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:35.205751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f212f4-ce53-4549-89bd-2eb1905287d4 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:35.295102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3232/6478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:35.295102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:35.295102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:35.325014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:35.433089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:35.434343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:35.441800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:35.441800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:35.442733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:35.446593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:35.497217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:35.529104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccc9f-d1d1-4061-a097-85af3100b1f3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:35.539632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cde8c332d8425090b1b47cbdcfe53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '160c6bbd4a624a4796da83845610d656', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-901628340', 'tempest-NotDelegatedRole-1618846955'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:35.541726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:35.542854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:35.543862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] PATH_INFO: `/v3/OS-TRUST/trusts/02939582273b416c9c4d0f0d9551a70c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:35.568735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorizing `identity:delete_trust(trust_id=02939582273b416c9c4d0f0d9551a70c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:35.572429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:35.637453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3247/6479] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:34 2022] POST /identity/v3/roles => generated 239 bytes in 685 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:35.641285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:35.644237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:35.780657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '02939582273b416c9c4d0f0d9551a70c', 'request_id': 'req-d748736b-5d52-46c5-a98a-6d3e78901aab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:35.782039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '02939582273b416c9c4d0f0d9551a70c', 'request_id': 'req-d748736b-5d52-46c5-a98a-6d3e78901aab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:35.783344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d748736b-5d52-46c5-a98a-6d3e78901aab tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '02939582273b416c9c4d0f0d9551a70c', 'request_id': 'req-d748736b-5d52-46c5-a98a-6d3e78901aab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:35.851648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e889-17f2-4129-953b-5b2a465b57a1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:35.863980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:35.869228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:35.870680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:35.871680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:35.876255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:35.881121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:35.969182 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3233/6480] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 20:59:35 2022] DELETE /identity/v3/OS-TRUST/trusts/02939582273b416c9c4d0f0d9551a70c => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:35.971481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:35.972005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:35.980133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:36.056342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:36.058891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:36.095925 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3234/6481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:36.097710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:36.102297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:36.136307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3248/6482] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:35 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 521 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:36.153486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:36.153850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0a5b-4249-4795-a642-a3a2ede22d71 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:36.165491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:36.428374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:36.430355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:36.430980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:36.431510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:36.432933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:36.437086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:36.480698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac8ba-c4c9-42bd-b85d-bd054d3a2842 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:36.493828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:36.495695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:36.496518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:36.497296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] PATH_INFO: `/v3/projects/df890d7e8efa4d99a313257647a03b76` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:36.500891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=df890d7e8efa4d99a313257647a03b76)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:36.505972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:36.654609 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3235/6483] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:36 2022] POST /identity/v3/groups => generated 324 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:36.665262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:36.668592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:36.776527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df890d7e8efa4d99a313257647a03b76', 'request_id': 'req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:36.957358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3dd2f-5212-4483-95a3-bfad37b4a10b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:36.958207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df890d7e8efa4d99a313257647a03b76', 'request_id': 'req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:36.972390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df890d7e8efa4d99a313257647a03b76', 'request_id': 'req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.034300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] The token cache is being invalidate because project df890d7e8efa4d99a313257647a03b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:37.034828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.036444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.044526 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3249/6484] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:36 2022] DELETE /identity/v3/projects/df890d7e8efa4d99a313257647a03b76 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:37.044526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:37.046615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:37.129232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cde8c332d8425090b1b47cbdcfe53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '160c6bbd4a624a4796da83845610d656', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-901628340', 'tempest-NotDelegatedRole-1618846955'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:37.131309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:37.131850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:37.132365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] PATH_INFO: `/v3/OS-TRUST/trusts/02939582273b416c9c4d0f0d9551a70c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Could not find trust: 02939582273b416c9c4d0f0d9551a70c.: keystone.exception.TrustNotFound: Could not find trust: 02939582273b416c9c4d0f0d9551a70c. Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 04 20:59:37.155101 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 02939582273b416c9c4d0f0d9551a70c. Oct 04 20:59:37.156994 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:59:37.163931 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3236/6485] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:59:36 2022] GET /identity/v3/OS-TRUST/trusts/02939582273b416c9c4d0f0d9551a70c => generated 111 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:59:37.165705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:37.169005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:37.290710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb4a2-30e6-4de1-98ce-69d69cb1c5db admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:37.307720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:37.310343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:37.312710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:37.313753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:37.315543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:59:37.316705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:37.326521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:37.362632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:37.370531 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3250/6486] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:37.374105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:37.382264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:37.392582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635486a2-55e6-4177-ba7d-dd19dec526ac tempest-TrustsV3TestJSON-321321875 tempest-user-536378993] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:37.419544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:37.421384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:37.423389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:37.423872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:37.424344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:37.427780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:37.429816 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:37.429816 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:37.429816 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:37.431612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:37.433891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:37.435823 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:37.435823 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 20:59:37.435823 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 20:59:37.437621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:37.457021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3237/6487] 10.222.0.78 () {58 vars in 1345 bytes} [Tue Oct 4 20:59:37 2022] HEAD /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:37.459602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:37.463005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:37.519954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eb350-24f6-4911-9d41-37182e86ee77 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:37.541830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:37.543074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:37.543640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:37.544176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] PATH_INFO: `/v3/projects/53e74ec889da4c90a905a6ecd57243cf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:37.550164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e74ec889da4c90a905a6ecd57243cf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:37.554478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:37.620536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf4c2-3b2c-49f1-9a56-491c99473fd4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:37.637271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:37.639348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:37.640102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:37.640623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71/users/66be740f793641daa240fb18364ea410` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:37.660323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fd66bcd1d73644df948ffe3d2cb4bd71, user_id=66be740f793641daa240fb18364ea410)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:37.666805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:37.823672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e74ec889da4c90a905a6ecd57243cf', 'request_id': 'req-7b639343-8dbf-4022-ac1b-b1af7856d601'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.834810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e74ec889da4c90a905a6ecd57243cf', 'request_id': 'req-7b639343-8dbf-4022-ac1b-b1af7856d601'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.844775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e74ec889da4c90a905a6ecd57243cf', 'request_id': 'req-7b639343-8dbf-4022-ac1b-b1af7856d601'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:37.986574 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3251/6488] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 4 20:59:37 2022] PUT /identity/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71/users/66be740f793641daa240fb18364ea410 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:37.988454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:37.992029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:38.028708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] The token cache is being invalidate because project 53e74ec889da4c90a905a6ecd57243cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:38.029624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.032835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.045555 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3238/6489] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:37 2022] DELETE /identity/v3/projects/53e74ec889da4c90a905a6ecd57243cf => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:38.047241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:38.051659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:38.166357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b351-c66e-49ea-93f8-f34758c81db0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:38.186538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:38.188996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:38.198295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:38.198295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] PATH_INFO: `/v3/users/3376a5b2f9384a2bbdb751f3577c797c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:38.198295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3376a5b2f9384a2bbdb751f3577c797c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:38.201674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:38.289856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639343-8dbf-4022-ac1b-b1af7856d601 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:38.468788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:38.471410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:38.471410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:38.472389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/df8e734878bb47368a4239b0d4e5f9aa` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:38.475672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:38.477960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=df8e734878bb47368a4239b0d4e5f9aa)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:38.481767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:38.578610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:38.586921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3376a5b2f9384a2bbdb751f3577c797c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.589070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3376a5b2f9384a2bbdb751f3577c797c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.702738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3376a5b2f9384a2bbdb751f3577c797c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.741281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3376a5b2f9384a2bbdb751f3577c797c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.777229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3376a5b2f9384a2bbdb751f3577c797c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.802498 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3252/6490] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:37 2022] DELETE /identity/v3/users/3376a5b2f9384a2bbdb751f3577c797c => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:38.806597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:38.815904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:38.861050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role df8e734878bb47368a4239b0d4e5f9aa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:38.861878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.863574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:38.883533 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3239/6491] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:38 2022] DELETE /identity/v3/roles/df8e734878bb47368a4239b0d4e5f9aa => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:38.888138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:38.894284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:39.036059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc0eb-adb5-42e7-9fe2-b03eee5c0675 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:39.120231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf13a2e-8ebc-4e4d-b91a-f67e519cc914 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:39.141907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:39.144578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:39.144578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:39.145029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:39.148613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:39.153386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:39.174802 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3240/6492] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:59:38 2022] GET /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 521 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:39.186256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:39.186256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:39.226187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:39.227663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:39.232120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:39.232120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:39.232120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:39.234602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:39.349056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806073-e534-4762-a214-8109db92cb93 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:39.367339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:39.368972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:39.369490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:39.369993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d/groups/fd66bcd1d73644df948ffe3d2cb4bd71/roles/3c5267b6c992486684b3ba96a86749b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:39.374968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2d8d7f0eda254a0a856c9e2a690dd19d, group_id=fd66bcd1d73644df948ffe3d2cb4bd71, role_id=3c5267b6c992486684b3ba96a86749b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:39.381401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:39.452896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3253/6493] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:38 2022] POST /identity/v3/projects => generated 379 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:39.455001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:39.460792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:39.590675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3241/6494] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:39 2022] PUT /identity/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d/groups/fd66bcd1d73644df948ffe3d2cb4bd71/roles/3c5267b6c992486684b3ba96a86749b7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:39.597875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:39.606077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:39.727811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530306d5-2d2e-44cb-9281-5295de9bbb08 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:39.806290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5d9a8-2698-40a5-80ee-83fad17fadd4 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:39.823315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:39.824615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:39.825135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:39.825664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/5981d582ecb448f8aee13c668cb37eca` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:39.829175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5981d582ecb448f8aee13c668cb37eca)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:39.833290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:39.909023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:39.910062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:39.910568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:39.911056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] PATH_INFO: `/v3/users/39f91239ad1a4d498c01177d6fc4f3ab` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:39.914534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f91239ad1a4d498c01177d6fc4f3ab)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:39.920341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:39.925133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:40.154798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 5981d582ecb448f8aee13c668cb37eca has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:40.157585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.169513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.182732 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3242/6495] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:39 2022] DELETE /identity/v3/roles/5981d582ecb448f8aee13c668cb37eca => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:40.184260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:40.188724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:40.297086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:40.352571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f91239ad1a4d498c01177d6fc4f3ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.356066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f91239ad1a4d498c01177d6fc4f3ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.445927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021badd3-df93-4981-b082-774064e300bb tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:40.455729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:40.457081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:40.457986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:40.458877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:40.462842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:40.467239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:40.489550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f91239ad1a4d498c01177d6fc4f3ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.533478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f91239ad1a4d498c01177d6fc4f3ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.554141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f91239ad1a4d498c01177d6fc4f3ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:40.570905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3254/6496] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:39 2022] DELETE /identity/v3/users/39f91239ad1a4d498c01177d6fc4f3ab => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:40.575696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:40.577408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:40.612256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3243/6497] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:40 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:40.619416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:40.624446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:40.789890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad7a2-7b92-424c-b3aa-9b0fd3672204 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:40.927174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2d85e-fec3-4e09-9d2e-0a8c5250d510 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:40.936050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66be740f793641daa240fb18364ea410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8df610a8884f449b9d4723d97957a2a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:40.942157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:40.943441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:40.949534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] PATH_INFO: `/v3/auth/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:40.961534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:40.961534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:41.012364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:41.016210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:41.016600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:41.017030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:41.018218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:41.036637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:41.186434 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3244/6498] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 4 20:59:40 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:41.187690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:41.194887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:41.233795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743b6b-7310-4105-9f0d-470ed5311a91 tempest-TokensV3TestJSON-1419717969 tempest-TokensV3TestJSON-1419717969-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:41.258047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:41.259414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:41.260202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:41.261442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] PATH_INFO: `/v3/projects/b894801f67884d7a95297f4031f8c936` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:41.264372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b894801f67884d7a95297f4031f8c936)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:41.270238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3255/6499] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:40 2022] POST /identity/v3/users => generated 290 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:41.270624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:41.275425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:41.283795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:41.514809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb4051-4715-49ec-b695-f24151ae1313 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:41.541800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b894801f67884d7a95297f4031f8c936', 'request_id': 'req-a4f738d1-7338-47c6-923e-97e039a96a7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.555357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b894801f67884d7a95297f4031f8c936', 'request_id': 'req-a4f738d1-7338-47c6-923e-97e039a96a7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.569830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b894801f67884d7a95297f4031f8c936', 'request_id': 'req-a4f738d1-7338-47c6-923e-97e039a96a7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.664089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:41.664906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:41.665115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:41.665400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/05cde8c332d8425090b1b47cbdcfe53d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:41.666885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=05cde8c332d8425090b1b47cbdcfe53d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:41.670739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:41.743698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] The token cache is being invalidate because project b894801f67884d7a95297f4031f8c936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:41.743940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.744934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.746924 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3245/6500] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:41 2022] DELETE /identity/v3/projects/b894801f67884d7a95297f4031f8c936 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:41.748764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:41.751329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:41.844858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f738d1-7338-47c6-923e-97e039a96a7f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:41.851285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:41.852306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:41.852746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:41.853067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:41.854976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:41.857494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:41.858794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cde8c332d8425090b1b47cbdcfe53d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.860102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cde8c332d8425090b1b47cbdcfe53d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9.: keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = query.one() Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._iter().one() Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._only_one_row( Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:41.877028 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 04 20:59:41.879092 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 04 20:59:41.881058 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 04 20:59:41.881058 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:59:41.881058 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 20:59:41.881058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3246/6501] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:59:41 2022] GET /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 137 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:59:41.882419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:41.889131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.016390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cde8c332d8425090b1b47cbdcfe53d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.046836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cde8c332d8425090b1b47cbdcfe53d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.050837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254445c9-8068-4dce-a637-05220f15ac34 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.060578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.061603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.062125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cde8c332d8425090b1b47cbdcfe53d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.062316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.062604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d/groups/fd66bcd1d73644df948ffe3d2cb4bd71/roles/3c5267b6c992486684b3ba96a86749b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.067511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2d8d7f0eda254a0a856c9e2a690dd19d, group_id=fd66bcd1d73644df948ffe3d2cb4bd71, role_id=3c5267b6c992486684b3ba96a86749b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.071965 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3256/6502] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:41 2022] DELETE /identity/v3/users/05cde8c332d8425090b1b47cbdcfe53d => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:42.072731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:42.073165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:42.077730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.082363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 3c5267b6c992486684b3ba96a86749b7 was removed from group fd66bcd1d73644df948ffe3d2cb4bd71 on domain 2d8d7f0eda254a0a856c9e2a690dd19d. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:42.083016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.088028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.189214 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3247/6503] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:59:41 2022] DELETE /identity/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d/groups/fd66bcd1d73644df948ffe3d2cb4bd71/roles/3c5267b6c992486684b3ba96a86749b7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:42.197031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:42.198718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.226708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5c138-3f5f-4762-8405-9b1637647417 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.288123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:42.327609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda99c5-c4e3-41a5-bb1a-7201e08bcacf tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.334254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.336552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.336552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.336552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] PATH_INFO: `/v3/projects/df47136960274b22997db6ade5066ecf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.336955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df47136960274b22997db6ade5066ecf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.338822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.339102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:42.339516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.339848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.340187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.341020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.343352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe00674-e26d-4320-9d30-4073ad8164db admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:42.364317 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3257/6504] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:42 2022] GET /identity/v3/roles => generated 3244 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:42.367116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.367586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.368067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.420899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:42.423441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.439293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:42.450307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3258/6505] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:42.450307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:42.453994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.533474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df47136960274b22997db6ade5066ecf', 'request_id': 'req-a21d6920-99da-4e62-8ad7-10029c41ab79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.550755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df47136960274b22997db6ade5066ecf', 'request_id': 'req-a21d6920-99da-4e62-8ad7-10029c41ab79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.563063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df47136960274b22997db6ade5066ecf', 'request_id': 'req-a21d6920-99da-4e62-8ad7-10029c41ab79'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.600738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171bd53-56af-4433-87c5-e5d501491ce4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.683737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] The token cache is being invalidate because project df47136960274b22997db6ade5066ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:42.685330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.687158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:42.692238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3248/6506] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:42 2022] DELETE /identity/v3/projects/df47136960274b22997db6ade5066ecf => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:42.695107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:42.698697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.713907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.717345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.717345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.717345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.720760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.728896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9.: keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = query.one() Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._iter().one() Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._only_one_row( Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 20:59:42.765165 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 04 20:59:42.766254 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 04 20:59:42.767972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 04 20:59:42.767972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 04 20:59:42.767972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 04 20:59:42.767972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bd9c84e113f749ffb66cd3390137e5ee does not imply be9e416819a04e0eb9fbee6414d5a1e9. Oct 04 20:59:42.767972 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 20:59:42.772717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3259/6507] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:42 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 137 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 20:59:42.776516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:42.781082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:42.841723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d6920-99da-4e62-8ad7-10029c41ab79 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.853442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.854895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.855628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.857289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/160c6bbd4a624a4796da83845610d656` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.858897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=160c6bbd4a624a4796da83845610d656)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.862780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:42.954856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb042-489c-4701-81bb-4c28566316d2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:42.963173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:42.964523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:42.965095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:42.965664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71/users/66be740f793641daa240fb18364ea410` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:42.969019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fd66bcd1d73644df948ffe3d2cb4bd71, user_id=66be740f793641daa240fb18364ea410)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:42.972937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:43.083922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.179741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160c6bbd4a624a4796da83845610d656', 'request_id': 'req-5eb190c7-7385-4c0c-8a35-51e46e365444'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.199018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160c6bbd4a624a4796da83845610d656', 'request_id': 'req-5eb190c7-7385-4c0c-8a35-51e46e365444'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.215350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160c6bbd4a624a4796da83845610d656', 'request_id': 'req-5eb190c7-7385-4c0c-8a35-51e46e365444'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.228953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3260/6508] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:59:42 2022] DELETE /identity/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71/users/66be740f793641daa240fb18364ea410 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:43.230595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:43.234036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:43.374095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project 160c6bbd4a624a4796da83845610d656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:43.375203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.377471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5eb190c7-7385-4c0c-8a35-51e46e365444 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:43.381140 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3249/6509] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 20:59:42 2022] DELETE /identity/v3/projects/160c6bbd4a624a4796da83845610d656 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:43.384107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b026-a7cc-49f9-8dfd-d118d30c281c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:43.384902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b026-a7cc-49f9-8dfd-d118d30c281c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:43.385622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b026-a7cc-49f9-8dfd-d118d30c281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:43.447081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2965b026-a7cc-49f9-8dfd-d118d30c281c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:43.450971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2965b026-a7cc-49f9-8dfd-d118d30c281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:43.471038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9938-616d-4115-9c27-3ac8fca8ea77 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:43.485783 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3250/6510] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:43.488719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:43.489241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:43.490303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:43.490947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:43.491068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:43.491591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:43.492322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:43.497828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:43.501698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:43.525312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:43.528116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:43.537967 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3261/6511] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:43 2022] GET /identity/v3/roles => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:43.537967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:43.549973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:43.562472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3251/6512] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:43.564423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:43.573411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:43.726224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:43.744809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5528472-671c-49b9-80c7-82207ce1de41 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:43.751993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781cd6-c0f2-4f86-85bf-7c44749f96dc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:43.763323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:43.767527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:43.769172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:43.769890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:43.770534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:43.772240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:43.772769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:43.773266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:43.775968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fd66bcd1d73644df948ffe3d2cb4bd71)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:43.780235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:43.782045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:43.787382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:43.815639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:44.012560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3262/6513] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:43 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 521 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:44.016168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:44.019396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:44.081911 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3252/6514] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:59:43 2022] DELETE /identity/v3/groups/fd66bcd1d73644df948ffe3d2cb4bd71 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:44.081911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:44.225004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fdc6-e414-4f9e-a453-39af2fcd3e19 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:44.263119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1f6-2b45-4ec9-885a-cfdcc50e0a3f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:44.272835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:44.274288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:44.274857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:44.275529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:44.276934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:59:44.277606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:44.282238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:44.319218 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3253/6515] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:44.319218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:44.323244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:44.360314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ed8e2-f19d-4ea8-b80e-b706cfb1de98 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:44.381230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:44.382781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:44.383430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:44.384507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] PATH_INFO: `/v3/projects/7413998281214512b44bf54e8659694a/users/82c2634debdc4d8eb199a01f65670cfc/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:44.431566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7413998281214512b44bf54e8659694a, user_id=82c2634debdc4d8eb199a01f65670cfc, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:44.437092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c61e53-5c65-408a-8017-d4d632bce05d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:44.450469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:44.451689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:44.452594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:44.453270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:44.454425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:44.460032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:44.629668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3254/6516] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:44 2022] PUT /identity/v3/projects/7413998281214512b44bf54e8659694a/users/82c2634debdc4d8eb199a01f65670cfc/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:44.638044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:44.638044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:44.638044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:44.639826 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3263/6517] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 20:59:44 2022] POST /identity/v3/projects => generated 328 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:44.641709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:44.710602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:44.713439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:44.826513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334ab2-390d-45bd-a2ed-6c051e99a0ea tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:44.847269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:44.849167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:44.850171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:44.850838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:44.854383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:44.859214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:44.901408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:44.907387 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3255/6518] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:44.909531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:45.041799 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3264/6519] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:44 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea => generated 520 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:45.043070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:45.074713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:45.102565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bcbc6-a20a-4e80-88a7-c34891aa79f7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:45.250410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4026b4-88bd-43d8-b8b9-b50097d9b7ae tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:45.257150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:45.259659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:45.263982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:45.265342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:45.266023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:45.266649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:45.278953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:45.290715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles/3c5267b6c992486684b3ba96a86749b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:45.293264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:45.293831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c5267b6c992486684b3ba96a86749b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:45.293993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:45.300169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:45.509143 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3265/6520] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:45 2022] POST /identity/v3/projects => generated 381 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:45.511128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:45.602261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 3c5267b6c992486684b3ba96a86749b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:45.603525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:45.605872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f4a2807-c333-4323-a517-8df03db3fd96 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:45.618431 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3256/6521] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:44 2022] DELETE /identity/v3/roles/3c5267b6c992486684b3ba96a86749b7 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:45.618431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:45.618431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:45.622553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:45.703455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] MFA Rules not processed for user `82c2634debdc4d8eb199a01f65670cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:45.708226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:45.756860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90fbca-cfa5-4369-bccb-353c386b3e6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:45.937186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:45.938080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:45.938769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:45.939113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:45.940279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:45.946968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:45.959599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3257/6522] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:45.962912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:45.966156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:45.987813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:46.106403 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3266/6523] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:45 2022] POST /identity/v3/users => generated 413 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:46.107739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:46.116370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:46.208808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8600-1935-4210-8978-f3b02167f4f7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:46.235492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:46.238238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:46.239476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:46.241306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:46.243216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 20:59:46.244055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:46.249366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:46.287057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3258/6524] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 20:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:46.289004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:46.294358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:46.320793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30493d15-a8d0-4aa3-ac67-06d8c1e1311d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:46.327881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b16-318e-4e8b-8dd7-bc26fd881748 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:46.329911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:46.331200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:46.331829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:46.332424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:46.333237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:46.337884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:46.344580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:46.344580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:46.344580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:46.345092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:46.347955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8faedbf6a3f34c349b9de33e7848b6ea, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:46.354470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:46.466475 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3259/6525] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:46 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:46.468512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:46.471977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:46.500673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3267/6526] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 20:59:46 2022] PUT /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501 => generated 520 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:46.502944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:46.514096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:46.635482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:46.642167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eac26-92e7-41fe-afb9-0d493d4becb0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:46.716119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443775-9e21-42ca-bd3b-fa7e47c93126 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:46.728907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:46.729977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:46.730462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:46.730990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:46.732789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:46.736428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:46.781784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:46.783548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:46.783548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:46.784143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:46.798255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d8d7f0eda254a0a856c9e2a690dd19d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:46.801651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:46.844113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:46.845141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:46.884578 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3268/6527] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:46 2022] POST /identity/v3/projects => generated 381 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:46.886288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:46.890142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:47.042134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081d11-33a5-4237-b557-bbc01683f4d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:47.052809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:47.053477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:47.054638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:47.054971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:47.056504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:47.057398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:47.058935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:47.064663 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3260/6528] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:59:46 2022] PATCH /identity/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d => generated 276 bytes in 593 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:47.064663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:47.065112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:47.069121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:47.219568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87493ad-0d18-4988-93bd-964a26b647b1 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:47.237964 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3269/6529] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:46 2022] POST /identity/v3/roles => generated 244 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:47.239083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:47.249554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:47.424444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:47.425582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:47.426087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:47.426592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:47.428133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:47.432582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:47.479528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25b03-6f0b-4f87-99df-840cbe24094e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:47.496634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:47.497909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:47.498751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:47.499430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:47.502408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:47.506469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:47.538812 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3270/6530] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:47 2022] GET /identity/v3/roles => generated 3249 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:47.540827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:47.547240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:47.640681 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3261/6531] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:47 2022] POST /identity/v3/projects => generated 391 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:47.642629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:47.660313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:47.722898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6b2-d2cb-4644-951f-f655cb761269 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:47.864074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b3dd-99e1-4a7a-9db0-754a6940b967 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:47.877659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:47.879347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:47.880884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:47.881636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:47.883568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:47.889587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:47.895170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:47.896910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:47.897487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:47.898054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:47.899031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:47.900834 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:47.900834 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:47.900834 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:47.902265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:47.940052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3271/6532] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 20:59:47 2022] GET /identity/v3/role_inferences => generated 1606 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:47.941644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:47.946193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:48.092440 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3262/6533] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:47 2022] POST /identity/v3/users => generated 297 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:48.093439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:48.105745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:48.205621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:48.209457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6fac-39c7-4a9e-9180-b1725923b99e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:48.225404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:48.225927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:48.226459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:48.226944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:48.251403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d8d7f0eda254a0a856c9e2a690dd19d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:48.255039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:48.298918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464e917-f75b-4802-ad62-762749ad8e1f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:48.321997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:48.323502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:48.325104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:48.325331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:48.325960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:48.328640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:48.332053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:48.352348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:48.458896 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3263/6534] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:48 2022] POST /identity/v3/roles => generated 247 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:48.458896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:48.491409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:48.501066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10a7d-a99b-4f1a-95a7-2badb4608b92 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:48.516368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:48.517478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:48.517986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:48.518495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:48.523455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:48.528681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:48.574549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3264/6535] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:48 2022] GET /identity/v3/roles => generated 3487 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:48.576519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:48.623066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:48.630956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd11b-9d28-4910-a8a7-8b5e55e5ad34 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:48.804821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:48.805714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:48.806109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:48.806707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:48.808121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:48.812222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:48.923825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:48.949101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.026618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project 2d8d7f0eda254a0a856c9e2a690dd19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:49.026926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.028741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.057250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.059324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.063558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d8d7f0eda254a0a856c9e2a690dd19d', 'request_id': 'req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:49.091194 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3272/6536] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:59:47 2022] DELETE /identity/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:49.093442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.097208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:49.114077 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3265/6537] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:48 2022] POST /identity/v3/users => generated 296 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:49.114319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.120959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:49.218046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb0dd9-830d-4312-8005-dd43d8251ce8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:49.243270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:49.244710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:49.245147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:49.245877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:49.247061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:49.261067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:49.315262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3266/6538] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:49 2022] GET /identity/v3/roles => generated 3487 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:49.318528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.324571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:49.391028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c413f-ae1e-4ab4-b2c5-0aa95fd71106 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:49.403959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:49.404607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:49.405164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:49.405682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:49.409971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8faedbf6a3f34c349b9de33e7848b6ea, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:49.413966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:49.514557 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3273/6539] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:49 2022] DELETE /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:49.517038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.521866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:49.591018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790355ad-be17-45d6-8918-8055bfa56d8f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:49.730195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6837-d669-448a-859e-753e635a9753 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:49.747989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:49.749517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:49.750046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:49.752601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] PATH_INFO: `/v3/projects/6f835a04a6144c6498f0ac2e720dd347/users/46dc089447bc4483aa36a607473a1c04/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:49.786009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:49.788972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:49.794758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:49.794758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/feb529f12618499e86bed471afa1663f/users/aae5dcb728804679a5be14f049c45e34/roles/eae8e5d3de8c48269b07ccb5c56e0733` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:49.804031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f835a04a6144c6498f0ac2e720dd347, user_id=46dc089447bc4483aa36a607473a1c04, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:49.810816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:49.830515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=feb529f12618499e86bed471afa1663f, user_id=aae5dcb728804679a5be14f049c45e34, role_id=eae8e5d3de8c48269b07ccb5c56e0733)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:49.836634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:49.942233 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3274/6540] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:49 2022] PUT /identity/v3/projects/6f835a04a6144c6498f0ac2e720dd347/users/46dc089447bc4483aa36a607473a1c04/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:49.943656 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3267/6541] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:49 2022] PUT /identity/v3/projects/feb529f12618499e86bed471afa1663f/users/aae5dcb728804679a5be14f049c45e34/roles/eae8e5d3de8c48269b07ccb5c56e0733 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:49.945409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.946388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:49.949943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:49.950952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:50.111124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c652-ae43-423d-b2e9-1b319cfa661d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:50.149359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623aee-0d54-4902-bee8-79070058f169 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:50.158436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:50.159743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:50.160166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:50.160481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:50.162469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:50.168451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:50.178695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:50.214660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3268/6542] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:49 2022] GET /identity/v3/roles => generated 3487 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:50.215641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:50.239457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d277a-c891-4fd9-9753-d81e9227cb08 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:50.250677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:50.251483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:50.251776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:50.259379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] PATH_INFO: `/v3/projects/733bfbd0a8224f3183368997461b3deb/users/3ee2fe601bcf43049a15fc7d255052a7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:50.297100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=733bfbd0a8224f3183368997461b3deb, user_id=3ee2fe601bcf43049a15fc7d255052a7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:50.305006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:50.326026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:50.329339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:50.330314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:50.331065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf/users/66be740f793641daa240fb18364ea410/roles/8defef3ff04e44f4a4d84ac86c47d4a6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:50.336124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3d87f3010fd54f4a86cc236c4e2405cf, user_id=66be740f793641daa240fb18364ea410, role_id=8defef3ff04e44f4a4d84ac86c47d4a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:50.342524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:50.356529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 8defef3ff04e44f4a4d84ac86c47d4a6 was removed from user 66be740f793641daa240fb18364ea410 on domain 3d87f3010fd54f4a86cc236c4e2405cf. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:50.357487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:50.359815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:50.480652 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3269/6543] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:50 2022] PUT /identity/v3/projects/733bfbd0a8224f3183368997461b3deb/users/3ee2fe601bcf43049a15fc7d255052a7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:50.487935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:50.494438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:50.499207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:50.542700 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3275/6544] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 4 20:59:49 2022] DELETE /identity/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf/users/66be740f793641daa240fb18364ea410/roles/8defef3ff04e44f4a4d84ac86c47d4a6 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:50.546520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:50.553823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:50.811969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915195d-81b2-4267-9077-4a2c11d39e9d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:50.862871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8a05-2635-40e5-9cb1-6001d271651a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:50.876596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:50.878356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:50.879425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:50.882918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/feb529f12618499e86bed471afa1663f/users/aae5dcb728804679a5be14f049c45e34/roles/760583f721d5484db01c179206c64155` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:50.888092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=feb529f12618499e86bed471afa1663f, user_id=aae5dcb728804679a5be14f049c45e34, role_id=760583f721d5484db01c179206c64155)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:50.896803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f08a3-2b4b-42d3-b99b-4267e3f57fc6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:50.979384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:50.980686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:50.981539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:50.982885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:50.987283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:50.996865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:51.106256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3276/6545] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:50 2022] PUT /identity/v3/projects/feb529f12618499e86bed471afa1663f/users/aae5dcb728804679a5be14f049c45e34/roles/760583f721d5484db01c179206c64155 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:51.106256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:51.106686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:51.107360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:51.150554 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3270/6546] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:50 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:51.152165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:51.160258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:51.202029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] MFA Rules not processed for user `46dc089447bc4483aa36a607473a1c04`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:51.210055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:51.444891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0c718-2b91-42e0-bc1c-3b7051bf46ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:51.457061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:51.458652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:51.459329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:51.459948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:51.462536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:51.467241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:51.485354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:51.503539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3277/6547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:51.504351 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3271/6548] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:51 2022] GET /identity/v3/roles => generated 3487 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:51.505742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:51.506453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:51.508694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:51.513413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:51.561954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183f2b4-23e1-4525-bb1b-7a06bcb7c4b9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:51.572387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:51.576077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:51.576077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:51.576077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:51.577010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:51.596485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:51.641721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3278/6549] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:51 2022] GET /identity/v3/roles => generated 3487 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:51.644745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:51.800931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef688d-5cd9-4f11-b05c-5d12662767e8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:51.813976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:51.818837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:51.819661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:51.820455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles/8defef3ff04e44f4a4d84ac86c47d4a6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:51.825619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8defef3ff04e44f4a4d84ac86c47d4a6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:51.834984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:51.933614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70e050-bd06-4b73-affb-e1c7bcfb32f6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:51.950193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:51.952713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:51.953552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:51.954325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:51.956053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:51.960832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:52.039667 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3279/6550] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:51 2022] GET /identity/v3/users => generated 9585 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:52.042631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:52.074283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 8defef3ff04e44f4a4d84ac86c47d4a6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:52.075283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:52.085006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:52.101519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3272/6551] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:51 2022] DELETE /identity/v3/roles/8defef3ff04e44f4a4d84ac86c47d4a6 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:52.106913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:52.116173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:52.159010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:52.349894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:52.375649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629a7a9-4d7d-4e61-af9e-ac3105168307 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:52.408856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0dc0-00d4-4b6b-a70d-6e8ff4391809 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:52.437799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:52.440585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:52.441395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:52.442102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] PATH_INFO: `/v3/projects/96afd63f40424915a4daa8d6e831fd90/users/da0560ce4b7a4b3b8a0228c33a0f5ac9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:52.536460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96afd63f40424915a4daa8d6e831fd90, user_id=da0560ce4b7a4b3b8a0228c33a0f5ac9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:52.551004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:52.590017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:52.616698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:52.617936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:52.624705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:52.625571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:52.632381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:52.641361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:52.732765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3273/6552] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:52 2022] PUT /identity/v3/projects/96afd63f40424915a4daa8d6e831fd90/users/da0560ce4b7a4b3b8a0228c33a0f5ac9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:52.734438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:52.746659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:52.758664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:52.762453 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3280/6553] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 20:59:52 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:52.764095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:52.773468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:52.971167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8768c0-54ea-43b1-8d61-d1ec1899084c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:53.092709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d465cd-7c71-46fd-ad6d-2403a5bad58e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:53.109554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:53.117008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:53.118078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:53.118933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] PATH_INFO: `/v3/projects/733bfbd0a8224f3183368997461b3deb/users/3ee2fe601bcf43049a15fc7d255052a7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:53.132753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733bfbd0a8224f3183368997461b3deb, user_id=3ee2fe601bcf43049a15fc7d255052a7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:53.159424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01210e-5d57-4717-b5b6-a591fe8cd0e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:53.174738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:53.176304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:53.177052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:53.177857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:53.181965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:53.210830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3281/6554] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:52 2022] PUT /identity/v3/projects/733bfbd0a8224f3183368997461b3deb/users/3ee2fe601bcf43049a15fc7d255052a7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:53.213139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e041-444f-44eb-a328-f2a0522be729 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:53.213634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e041-444f-44eb-a328-f2a0522be729 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:53.214308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e041-444f-44eb-a328-f2a0522be729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:53.245993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:53.343568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:53.381444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9e56e041-444f-44eb-a328-f2a0522be729 None None] MFA Rules not processed for user `aae5dcb728804679a5be14f049c45e34`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:53.383849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e56e041-444f-44eb-a328-f2a0522be729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:53.523369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:53.526197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:53.545802 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3274/6555] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:53.547300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:53.549662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:53.588192 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3282/6556] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:53.591620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:53.592647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:53.593403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:53.611806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:53.672603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] MFA Rules not processed for user `da0560ce4b7a4b3b8a0228c33a0f5ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:53.678236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:53.747073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9943-0495-4c30-8c6c-6dd73b5d2cf4 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:53.831928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:53.911859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:53.913260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:53.913795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:53.914225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:53.916453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3d87f3010fd54f4a86cc236c4e2405cf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:53.919512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:53.944281 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3283/6557] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:53.946964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:53.951042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:53.974530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:53.976195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:54.125132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe658d19-e15f-4049-99c6-59222a1b593a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:54.186936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:54.188155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4997bbbe-2e12-444e-ae9d-a74473935731 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:54.194472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3275/6558] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 20:59:53 2022] PATCH /identity/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf => generated 277 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:54.201582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:54.209225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:54.209225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:54.293557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] MFA Rules not processed for user `3ee2fe601bcf43049a15fc7d255052a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:54.296522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:54.326992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:54.328462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:54.328987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:54.329517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:54.330942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:54.334749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad28e6-97a5-49bf-a646-e9ca8608c2b3 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:54.373708 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3284/6559] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:53 2022] GET /identity/v3/roles => generated 3256 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:54.376777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:54.377245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:54.377688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:54.450300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] MFA Rules not processed for user `aae5dcb728804679a5be14f049c45e34`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 20:59:54.453090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:54.487789 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3276/6560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:54.489767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:54.494698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:54.603347 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3285/6561] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 20:59:54.605735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:54.608247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:54.645743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8593-d3f2-4320-a3a7-401b53c358b3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:54.677060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:54.681942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:54.682370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:54.693138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:54.694515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:54.711592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:54.784067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:54.857625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:54.870190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca5d64-9bb3-444d-9a46-45e140edcbcf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:54.897495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:54.898947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:54.899957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:54.900728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:54.925093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3d87f3010fd54f4a86cc236c4e2405cf)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:54.929342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:54.982912 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3277/6562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 20:59:54 2022] POST /identity/v3/projects => generated 393 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:54.982912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:54.990426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:54.991580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.015988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.212551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0f98-ec0d-435f-ba50-327f2bc22293 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:55.284415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.377412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:55.378983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:55.387110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:55.387110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:55.387767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.387922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:55.387922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:55.401863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.428106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project 3d87f3010fd54f4a86cc236c4e2405cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:55.428696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.430009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.461693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.463395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.464459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3d87f3010fd54f4a86cc236c4e2405cf', 'request_id': 'req-4d88b52a-e634-41d1-8c9e-95067a72d6d7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:55.490667 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3286/6563] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 20:59:54 2022] DELETE /identity/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:55.490667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:55.491374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:55.539662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3278/6564] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 20:59:54 2022] POST /identity/v3/roles => generated 235 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:55.547755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:55.559274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:55.726515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88b52a-e634-41d1-8c9e-95067a72d6d7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:55.736900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:55.738911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:55.741403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:55.742210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:55.747856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:55.817093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9217d-22af-4daf-9bdf-d2692d46c0d5 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:55.837303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:55.838874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:55.842252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:55.843032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:55.844275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:create_trust()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:55.853305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:55.974781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:55.978029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:56.017383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:56.030575 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3287/6565] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 20:59:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 20:59:56.032235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:56.040836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:56.252272 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3279/6566] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 20:59:55 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:56.254204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094b41-146f-469b-bfd5-19b4f07eeeab service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:56.260770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:56.268386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:56.268854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:56.271004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:56.272385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:56.273241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:56.274887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:56.280563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:56.500752 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3288/6567] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 20:59:56 2022] POST /identity/v3/users => generated 303 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 20:59:56.503876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:56.509027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:56.631431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1faa7d-51d6-4eac-9698-cbe3f251a3e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:56.657861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b449f78-7b13-4cab-ac5a-2f3e5d2a120a tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:56.668615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:56.669757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:56.670326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:56.670836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:56.683190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:update_role(role_id=882e6a1310fa4f3388bf61e2cc61fbb2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:56.687489 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 20:59:56.687489 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 20:59:56.687489 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 20:59:56.687884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:56.689191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:56.689731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:56.692205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:56.695679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/23e29e71d547485caabffb7bd158433b/groups/966c1aa98b184b2a8b396f363b47fe54/roles/94ccb8c895a54310b60b47981e0bd81b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:56.724052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=23e29e71d547485caabffb7bd158433b, group_id=966c1aa98b184b2a8b396f363b47fe54, role_id=94ccb8c895a54310b60b47981e0bd81b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:56.732217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:56.766147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:56.774018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 94ccb8c895a54310b60b47981e0bd81b was removed from group 966c1aa98b184b2a8b396f363b47fe54 on domain 23e29e71d547485caabffb7bd158433b. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:56.774605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:56.776690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:56.906816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3280/6568] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 20:59:56 2022] DELETE /identity/v3/domains/23e29e71d547485caabffb7bd158433b/groups/966c1aa98b184b2a8b396f363b47fe54/roles/94ccb8c895a54310b60b47981e0bd81b => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:56.908387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:56.913626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:56.954543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3289/6569] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 4 20:59:56 2022] PATCH /identity/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2 => generated 236 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:56.956626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:56.967673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:57.049180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb5e17-be0e-4882-b398-a3639db898f2 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:57.228224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591281e-1367-4084-8925-08b1fa863a6b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:57.250807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:57.252785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:57.255050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:57.257956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:57.285805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:57.288410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:get_trust(trust_id=fde0934ca2164ddba89535645a7cf868)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:57.293403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:57.345997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3281/6570] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 20:59:56 2022] GET /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868 => generated 859 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:57.348890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:57.373113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:57.377115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:57.378274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:57.385036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:57.385036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:57.396233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:57.401876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:57.460963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3290/6571] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:56 2022] GET /identity/v3/roles => generated 3483 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:57.463616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:57.469218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:57.710687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:57.753180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7777-980b-4037-b479-49ad0dfdd8a7 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:57.772706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:57.777383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:57.777937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:57.780105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/966c1aa98b184b2a8b396f363b47fe54/users/66be740f793641daa240fb18364ea410` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:57.788356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620747a1-f856-4f81-b6e9-0d200ab56cfb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:57.790918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=966c1aa98b184b2a8b396f363b47fe54, user_id=66be740f793641daa240fb18364ea410)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:57.799529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:57.816978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:57.819245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:57.819498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:57.820099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:57.846096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:get_role(role_id=882e6a1310fa4f3388bf61e2cc61fbb2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:57.850779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:57.853349 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3291/6572] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 4 20:59:57 2022] GET /identity/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2 => generated 236 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:57.855594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:57.882667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70296e4-7e03-4ce8-804f-9260110447ee tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:57.889661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:57.897771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:57.907512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:57.908428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:57.909247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:57.926196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=fde0934ca2164ddba89535645a7cf868)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:57.930610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:57.957386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3292/6573] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 20:59:57 2022] GET /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles => generated 371 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:57.959932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:57.986960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f22b0-4b33-4ac6-91c5-6f2f611ebe1b tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:58.014517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:58.017460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:58.018694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:58.019671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] PATH_INFO: `/v3/projects/978ff0301b2d496584a4a4a86233df46/users/86fb2f56c07b4985a10338ec5ca600a2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:58.055829 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3282/6574] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 4 20:59:57 2022] DELETE /identity/v3/groups/966c1aa98b184b2a8b396f363b47fe54/users/66be740f793641daa240fb18364ea410 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:58.057055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:58.062241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:58.065702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978ff0301b2d496584a4a4a86233df46, user_id=86fb2f56c07b4985a10338ec5ca600a2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:58.074997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:58.180946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3293/6575] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 20:59:57 2022] PUT /identity/v3/projects/978ff0301b2d496584a4a4a86233df46/users/86fb2f56c07b4985a10338ec5ca600a2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:58.182145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:58.324051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698b31-9445-48e1-a080-41de1dc6755b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:58.367617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:58.373243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83caca-5bfe-4ddc-b0fe-864fd4f47da4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:58.392242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:58.396605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:58.397562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:58.398524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:58.400622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:58.404991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:58.491411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3294/6576] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:58 2022] GET /identity/v3/roles => generated 3483 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:58.494671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:58.553528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:58.554744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:58.555361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:58.555877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] PATH_INFO: `/v3/users/82c2634debdc4d8eb199a01f65670cfc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:58.560060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c2634debdc4d8eb199a01f65670cfc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:58.567003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:58.691273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:58.694650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09223c-a85b-43d5-8d4a-a80843033514 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:58.704835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:58.706763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:58.707326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:58.707855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/eae8e5d3de8c48269b07ccb5c56e0733` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:58.721262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde0934ca2164ddba89535645a7cf868, role_id=eae8e5d3de8c48269b07ccb5c56e0733)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:58.723463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:58.750404 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3295/6577] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 20:59:58 2022] GET /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/eae8e5d3de8c48269b07ccb5c56e0733 => generated 244 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 20:59:58.753761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:58.782475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:58.911587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c2634debdc4d8eb199a01f65670cfc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.012381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378532-326c-4179-a9a7-00e75e5ff33c tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:59.046181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:59.047523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:59.051367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:59.051367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/groups/966c1aa98b184b2a8b396f363b47fe54` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:59.052805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_group(group_id=966c1aa98b184b2a8b396f363b47fe54)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:59.059992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:59.076701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c2634debdc4d8eb199a01f65670cfc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.116088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c2634debdc4d8eb199a01f65670cfc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.168145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c2634debdc4d8eb199a01f65670cfc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.172617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c2634debdc4d8eb199a01f65670cfc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.178834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:59.196295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3283/6578] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:58 2022] DELETE /identity/v3/users/82c2634debdc4d8eb199a01f65670cfc => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:59.197915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:59.200722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:59.338495 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3296/6579] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 20:59:58 2022] DELETE /identity/v3/groups/966c1aa98b184b2a8b396f363b47fe54 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:59.345950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:59.351796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:59.529764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9167685-23a7-4f79-a5aa-e7d034b2976b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:59.630318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:59.641214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04045a2-7306-48a0-9260-fb0462506b12 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 20:59:59.660210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:59.661378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:59.665209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:59.666007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:59.673359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=882e6a1310fa4f3388bf61e2cc61fbb2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:59.676446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:59.819501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:59.850675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 20:59:59.852022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:59.852824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:59.853662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 20:59:59.855448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 20:59:59.859937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 20:59:59.907156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3284/6580] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 20:59:59 2022] GET /identity/v3/roles => generated 3483 bytes in 710 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 20:59:59.909413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 20:59:59.909794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 882e6a1310fa4f3388bf61e2cc61fbb2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 20:59:59.910268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.911812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e05375a0-80f8-448e-9f37-ba35267d54df tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 20:59:59.913589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 20:59:59.915482 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3297/6581] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 20:59:59 2022] DELETE /identity/v3/roles/882e6a1310fa4f3388bf61e2cc61fbb2 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 20:59:59.922618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 20:59:59.922618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 20:59:59.922618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:00.044483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:00.049530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:00.249956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396807f-db2e-4be7-9cb4-c9da749585a4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:00.338031 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3298/6582] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:00.352330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:00.358142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:00.372954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:00.510589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:00.512524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:00.512914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:00.513232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/eae8e5d3de8c48269b07ccb5c56e0733` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:00.544810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde0934ca2164ddba89535645a7cf868, role_id=eae8e5d3de8c48269b07ccb5c56e0733)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:00.547826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:00.582424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:00.611053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3285/6583] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 20:59:59 2022] HEAD /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/eae8e5d3de8c48269b07ccb5c56e0733 => generated 0 bytes in 703 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 04 21:00:00.612885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:00.617200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:00.642798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947068-0c0b-4823-9f81-1c7547a2df28 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:00.654126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:00.656124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:00.656838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:00.657392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] PATH_INFO: `/v3/projects/978ff0301b2d496584a4a4a86233df46/users/86fb2f56c07b4985a10338ec5ca600a2/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:00.666010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:00.668331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=978ff0301b2d496584a4a4a86233df46, user_id=86fb2f56c07b4985a10338ec5ca600a2, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:00.679207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:00.771989 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3286/6584] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:00 2022] PUT /identity/v3/projects/978ff0301b2d496584a4a4a86233df46/users/86fb2f56c07b4985a10338ec5ca600a2/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:00.776780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:00.780021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:00.783688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bda785-c602-478a-8093-c7907f2872e8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:01.001834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:01.003525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:01.004362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:01.004844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles/94ccb8c895a54310b60b47981e0bd81b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:01.008668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_role(role_id=94ccb8c895a54310b60b47981e0bd81b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:01.012422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:01.057143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e651c2a-8fd8-4c92-a02d-4963d3976fbf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:01.087635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:01.088881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:01.089421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:01.089921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:01.116056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:01.133470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:01.235493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 94ccb8c895a54310b60b47981e0bd81b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:01.236310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:01.237711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:01.247770 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3299/6585] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:00 2022] DELETE /identity/v3/roles/94ccb8c895a54310b60b47981e0bd81b => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:01.250194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:01.252882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:01.259049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:01.335177 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3287/6586] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 21:00:00 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 521 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:01.336244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:01.339391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:01.558755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339399df-4d53-4ab9-83e2-9b80b19cbb7b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:01.564533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4074c2-da7c-4ecf-843c-ce2bf1a996dd tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:01.576271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:01.580233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:01.581259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:01.582261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:01.591620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:01.835807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:01.838079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:01.838871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:01.839635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:01.844916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:01.879237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:01.882211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:01.895459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:01.900776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d2b3f-9285-46e4-b5d4-532f226d6982 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:01.911981 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3300/6587] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:01.913766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:01.916151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:01.930915 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3288/6588] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:01.934599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:01.937336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:01.937336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:01.989420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:02.052307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] MFA Rules not processed for user `86fb2f56c07b4985a10338ec5ca600a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:02.056743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:02.109210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:02.210112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f96ea-9dc4-44b2-9f8d-2667cc8be9dd service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:02.239122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:02.240490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:02.241562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:02.242626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/760583f721d5484db01c179206c64155` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:02.277128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde0934ca2164ddba89535645a7cf868, role_id=760583f721d5484db01c179206c64155)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:02.277128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Could not find role: 760583f721d5484db01c179206c64155.: keystone.exception.RoleNotFound: Could not find role: 760583f721d5484db01c179206c64155. Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:00:02.331661 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 760583f721d5484db01c179206c64155. Oct 04 21:00:02.333901 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:02.344209 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3301/6589] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 21:00:01 2022] GET /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/760583f721d5484db01c179206c64155 => generated 110 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:02.344209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:02.352478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:02.411714 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3289/6590] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:02.413267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:02.420406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:02.619350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29cba-7b61-4482-96b0-d273419ab9d3 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:02.631928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:02.633170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:02.633920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:02.634434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/23e29e71d547485caabffb7bd158433b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:02.637762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=23e29e71d547485caabffb7bd158433b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:02.642628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:02.730616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:02.734717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:02.744865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdea2e-a314-4e9f-94da-cfa1aa682531 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:02.930088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:02.935550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:02.949573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3302/6591] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:02 2022] PATCH /identity/v3/domains/23e29e71d547485caabffb7bd158433b => generated 276 bytes in 603 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:02.949573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:02.958370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:02.992861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:02.995555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:02.996267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:02.996927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:03.001790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:03.006594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:03.059121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:03.150883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:03.254781 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3290/6592] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 21:00:02 2022] PUT /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea => generated 520 bytes in 842 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:03.257021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:03.266105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:03.266432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c207f-36c2-4e46-8032-481d2c61dc98 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:03.506111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f416be8-fc6d-469b-9281-4022d5adbe69 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:03.524593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:03.525873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:03.526380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:03.526896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/760583f721d5484db01c179206c64155` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:03.533117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:03.535545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:03.536018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:03.540455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:03.543334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fde0934ca2164ddba89535645a7cf868, role_id=760583f721d5484db01c179206c64155)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:03.547885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:03.549774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Could not find role: 760583f721d5484db01c179206c64155.: keystone.exception.RoleNotFound: Could not find role: 760583f721d5484db01c179206c64155. Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:00:03.603105 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 760583f721d5484db01c179206c64155. Oct 04 21:00:03.605185 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:03.617668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3303/6593] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 21:00:02 2022] HEAD /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868/roles/760583f721d5484db01c179206c64155 => generated 0 bytes in 666 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 04 21:00:03.619685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:03.631319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:03.880172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:03.946783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:03.955304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:03.964858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c04f7-1699-4038-be8c-f9ccb723d5af tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:03.978763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:03.986107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:03.987026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:03.988907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:03.990977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/23e29e71d547485caabffb7bd158433b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:04.015299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3291/6594] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:04.017992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:04.024513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:04.054751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=23e29e71d547485caabffb7bd158433b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:04.061108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:04.137877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.166675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '23e29e71d547485caabffb7bd158433b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.266769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f322-814d-4fd1-90dc-8a59516463c3 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:04.280454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:04.282390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:04.283546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:04.284511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:04.288741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8faedbf6a3f34c349b9de33e7848b6ea, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:04.292981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:04.400089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.453949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3292/6595] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 4 21:00:04 2022] PUT /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501 => generated 520 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:04.457737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:04.550220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.572131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.620891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project 23e29e71d547485caabffb7bd158433b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:04.623932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.627852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.667523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.670424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.677859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '23e29e71d547485caabffb7bd158433b', 'request_id': 'req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:04.740552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3304/6596] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 21:00:03 2022] DELETE /identity/v3/domains/23e29e71d547485caabffb7bd158433b => generated 0 bytes in 1121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:04.745415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:04.751609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:04.773360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e2891-662a-4f17-a0c1-82695f267cfe tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:04.790162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:04.792042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:04.793520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:04.793520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:04.816709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorizing `identity:delete_trust(trust_id=fde0934ca2164ddba89535645a7cf868)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:04.825832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:04.907545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:05.074022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fde0934ca2164ddba89535645a7cf868', 'request_id': 'req-a23075ae-038d-46ca-a76f-9d3b03d55140'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:05.074912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fde0934ca2164ddba89535645a7cf868', 'request_id': 'req-a23075ae-038d-46ca-a76f-9d3b03d55140'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:05.075900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'fde0934ca2164ddba89535645a7cf868', 'request_id': 'req-a23075ae-038d-46ca-a76f-9d3b03d55140'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:05.154173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8689d-bc86-4b2b-8b39-1c7eceea6c88 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:05.232639 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3293/6597] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:00:04 2022] DELETE /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:05.234301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:05.244872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:05.323227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:05.485897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:05.486699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:05.486991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:05.487312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:05.501389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:05.501389 n-d-852085-12 devstack@keystone.service[82440]: WARNING py.warnings [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 21:00:05.501389 n-d-852085-12 devstack@keystone.service[82440]: warnings.warn(msg) Oct 04 21:00:05.501389 n-d-852085-12 devstack@keystone.service[82440]: Oct 04 21:00:05.506295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:05.559896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3305/6598] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:04 2022] GET /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies => generated 489 bytes in 818 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:05.561730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:05.570801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:05.571572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23075ae-038d-46ca-a76f-9d3b03d55140 tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:05.606405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:05.607632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:05.608145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:05.608658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/8cbdff4388a24d5daf19bbe5519f8390/users/66be740f793641daa240fb18364ea410/roles/c029859831a342f9ae5bdb3de9652d58` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:05.616819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8cbdff4388a24d5daf19bbe5519f8390, user_id=66be740f793641daa240fb18364ea410, role_id=c029859831a342f9ae5bdb3de9652d58)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:05.628758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:05.650010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role c029859831a342f9ae5bdb3de9652d58 was removed from user 66be740f793641daa240fb18364ea410 on domain 8cbdff4388a24d5daf19bbe5519f8390. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:05.650568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:05.671310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:05.841389 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3294/6599] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 4 21:00:05 2022] DELETE /identity/v3/domains/8cbdff4388a24d5daf19bbe5519f8390/users/66be740f793641daa240fb18364ea410/roles/c029859831a342f9ae5bdb3de9652d58 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:05.857465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:05.864690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:05.934194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e7e61-b230-44c0-8759-6ee2609e7c5f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:06.213162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:06.228652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:06.229060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:06.229475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] PATH_INFO: `/v3/projects/7413998281214512b44bf54e8659694a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:06.231962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] RBAC: Authorizing `identity:delete_project(project_id=7413998281214512b44bf54e8659694a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:06.241238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:06.265859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069222-e41f-4d3d-acd7-8acad9137536 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:06.289130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae5dcb728804679a5be14f049c45e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb529f12618499e86bed471afa1663f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1456780404', 'tempest-DelegatedRole-2000237603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:06.290496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:06.291028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:06.291674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] PATH_INFO: `/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Could not find trust: fde0934ca2164ddba89535645a7cf868.: keystone.exception.TrustNotFound: Could not find trust: fde0934ca2164ddba89535645a7cf868. Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 04 21:00:06.314702 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: fde0934ca2164ddba89535645a7cf868. Oct 04 21:00:06.316789 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:00:06.319794 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3295/6600] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:00:05 2022] GET /identity/v3/OS-TRUST/trusts/fde0934ca2164ddba89535645a7cf868 => generated 111 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:06.327866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:06.331106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:06.542878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7413998281214512b44bf54e8659694a', 'request_id': 'req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:06.585750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924f05-ca0c-4e1d-a4d8-fbe21eb4e1fd tempest-TrustsV3TestJSON-313474725 tempest-user-903244166] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:06.687984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7413998281214512b44bf54e8659694a', 'request_id': 'req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:06.699874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7413998281214512b44bf54e8659694a', 'request_id': 'req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:06.729156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] The token cache is being invalidate because project 7413998281214512b44bf54e8659694a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:06.729574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:06.730964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:06.734682 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3306/6601] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:05 2022] DELETE /identity/v3/projects/7413998281214512b44bf54e8659694a => generated 0 bytes in 1174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:06.737689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:06.741078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:06.792736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:06.795762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:06.797063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:06.798044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:06.801742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:06.804789 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 21:00:06.804789 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 21:00:06.804789 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 21:00:06.808215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:06.843938 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3296/6602] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:06 2022] GET /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies => generated 660 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:06.853106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:06.857009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:06.965401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c6e-7b71-404b-809e-8ba9ad1ceada admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:06.992985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:06.998220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:06.998945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:07.001148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles/c029859831a342f9ae5bdb3de9652d58` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:07.009076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c029859831a342f9ae5bdb3de9652d58)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:07.019831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:07.080922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b7b0d-9494-4461-af21-6c983f56b36c tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:07.096330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:07.098143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:07.100956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:07.101293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/760583f721d5484db01c179206c64155` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:07.104837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=760583f721d5484db01c179206c64155)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:07.109399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:07.267859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:07.278827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role c029859831a342f9ae5bdb3de9652d58 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:07.281448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:07.284333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:07.298616 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3307/6603] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:06 2022] DELETE /identity/v3/roles/c029859831a342f9ae5bdb3de9652d58 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:07.303198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:07.307847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:07.425396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 760583f721d5484db01c179206c64155 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:07.426291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:07.432410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:07.447346 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3297/6604] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:06 2022] DELETE /identity/v3/roles/760583f721d5484db01c179206c64155 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:07.456949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:07.463576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:07.612880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3947-2c0a-475b-933f-320832cf5f2a tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:07.671816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:07.763550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1268-9cd1-4e13-b588-6012821cb311 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:07.781290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:07.782637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:07.782637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:07.783051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:07.794490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:07.797070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8faedbf6a3f34c349b9de33e7848b6ea, implied_role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:07.801535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:07.895702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:07.897491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:07.898014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:07.898644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] PATH_INFO: `/v3/users/3ee2fe601bcf43049a15fc7d255052a7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:07.901986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee2fe601bcf43049a15fc7d255052a7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:07.906674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:07.957732 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3298/6605] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 21:00:07 2022] DELETE /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea/implies/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:07.960171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:07.966055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:08.141332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad222932-1f52-4d26-93d7-9f2d1a2d92a6 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:08.153908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:08.155124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:08.155735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:08.156218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/8cbdff4388a24d5daf19bbe5519f8390` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:08.160680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8cbdff4388a24d5daf19bbe5519f8390)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:08.164142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:08.218569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.220420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.356895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee2fe601bcf43049a15fc7d255052a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.357726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee2fe601bcf43049a15fc7d255052a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.434927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.435859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.459845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3299/6606] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:07 2022] PATCH /identity/v3/domains/8cbdff4388a24d5daf19bbe5519f8390 => generated 278 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:08.465452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:08.473697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee2fe601bcf43049a15fc7d255052a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.477266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:08.526375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee2fe601bcf43049a15fc7d255052a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.559599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee2fe601bcf43049a15fc7d255052a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:08.587501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3308/6607] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:07 2022] DELETE /identity/v3/users/3ee2fe601bcf43049a15fc7d255052a7 => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:08.594171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:08.606412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:08.917862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae9e3-7aaa-4af0-95cc-2d3fd7cedd23 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:09.005341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976112b-36b4-4e8c-8378-4e008fbd62ea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:09.030687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:09.035601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:09.035601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:09.035601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:09.044253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:09.048465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:09.196354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3309/6608] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 21:00:08 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/8faedbf6a3f34c349b9de33e7848b6ea => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:09.198779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:09.205054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:09.222804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:09.224116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:09.224745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:09.228815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/eae8e5d3de8c48269b07ccb5c56e0733` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:09.234342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eae8e5d3de8c48269b07ccb5c56e0733)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:09.246141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:09.341313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:09.487270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82b9d2-00d9-4e8f-bc9c-87ed4c194020 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:09.511412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:09.512623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:09.513141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:09.513649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/8cbdff4388a24d5daf19bbe5519f8390` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:09.523061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role eae8e5d3de8c48269b07ccb5c56e0733 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:09.525508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:09.531090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:09.545546 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3300/6609] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:08 2022] DELETE /identity/v3/roles/eae8e5d3de8c48269b07ccb5c56e0733 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:09.547356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:09.551758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:09.585188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8cbdff4388a24d5daf19bbe5519f8390)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:09.587786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:09.710423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:09.726592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:09.741316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:09.809670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ceceb-cb76-4cb7-9f4e-1192fb545bf5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:09.841687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:09.843825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:09.847247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:09.860399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:09.860399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bd9c84e113f749ffb66cd3390137e5ee, implied_role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:09.862981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:09.992683 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3301/6610] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 4 21:00:09 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee/implies/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:10.002808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:10.007068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:10.035626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.194459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.222661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93f8e-785b-4f63-b003-613e7c619778 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:10.224361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.252000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:10.257295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:10.258469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:10.259949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/aae5dcb728804679a5be14f049c45e34` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:10.269125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aae5dcb728804679a5be14f049c45e34)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:10.279630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project 8cbdff4388a24d5daf19bbe5519f8390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:10.280475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:10.280668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.282829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.325246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.327791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.330645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8cbdff4388a24d5daf19bbe5519f8390', 'request_id': 'req-8b82b934-e53e-4505-9801-cf31f8067683'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.373324 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3310/6611] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 21:00:09 2022] DELETE /identity/v3/domains/8cbdff4388a24d5daf19bbe5519f8390 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:10.375081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:10.378609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:10.518277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:10.567851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae5dcb728804679a5be14f049c45e34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.570044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82b934-e53e-4505-9801-cf31f8067683 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:10.691063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae5dcb728804679a5be14f049c45e34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.712986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae5dcb728804679a5be14f049c45e34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.743636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae5dcb728804679a5be14f049c45e34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.747469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae5dcb728804679a5be14f049c45e34'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:10.757779 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3302/6612] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:09 2022] DELETE /identity/v3/users/aae5dcb728804679a5be14f049c45e34 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:10.759299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:10.761059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:10.762391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:10.764191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:10.765097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:10.765908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:10.799872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Could not find domain: ed9ebdd4e8764c9a9be6c6431db833e8.: keystone.exception.DomainNotFound: Could not find domain: ed9ebdd4e8764c9a9be6c6431db833e8. Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ed9ebdd4e8764c9a9be6c6431db833e8. Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:10.823014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:10.825109 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ed9ebdd4e8764c9a9be6c6431db833e8. Oct 04 21:00:10.826925 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:10.834968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3311/6613] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:10 2022] PATCH /identity/v3/domains/ed9ebdd4e8764c9a9be6c6431db833e8 => generated 112 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:10.837013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:10.855998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:10.897299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a270-3449-4d1b-847a-62d59094216e tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:10.942774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1ccb-03fc-4b25-8151-3bb8ec7b4b29 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:10.956632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:10.956632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:10.956632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:10.957140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:10.969479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:10.982158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:11.056857 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3303/6614] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:10 2022] GET /identity/v3/roles => generated 2323 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:11.060630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:11.068782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:11.073657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:11.121120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:11.123431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:11.127687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:11.127687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/feb529f12618499e86bed471afa1663f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:11.128464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=feb529f12618499e86bed471afa1663f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:11.133648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:11.392634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeaa8b-984e-4dcb-83a3-47eafd642c4f tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:11.514123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb529f12618499e86bed471afa1663f', 'request_id': 'req-2082fd0b-2e2a-46fb-95db-2533984cc941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.644646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:11.647740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb529f12618499e86bed471afa1663f', 'request_id': 'req-2082fd0b-2e2a-46fb-95db-2533984cc941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.653323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:11.655450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:11.655450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/users/f011b077a6d24f8d8e2500fdb2f59bc7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:11.658611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f011b077a6d24f8d8e2500fdb2f59bc7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:11.663633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:11.685475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb529f12618499e86bed471afa1663f', 'request_id': 'req-2082fd0b-2e2a-46fb-95db-2533984cc941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.732170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project feb529f12618499e86bed471afa1663f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:11.733089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.734721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.741814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3312/6615] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:10 2022] DELETE /identity/v3/projects/feb529f12618499e86bed471afa1663f => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:11.758520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:11.761794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:11.929304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:11.973239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:11.999394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082fd0b-2e2a-46fb-95db-2533984cc941 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:12.022043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:12.022966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:12.023488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:12.023994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:12.033554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9e6e751fcaaf430d964cd0eb9399aab6, user_id=5bb3eba82f04487689cae784b5bd92c7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:12.043612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:12.101024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:12.133968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:12.185501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3313/6616] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:11 2022] PUT /identity/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:12.190408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:12.192692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:12.197249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:12.202157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f011b077a6d24f8d8e2500fdb2f59bc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:12.226500 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3304/6617] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:11 2022] DELETE /identity/v3/users/f011b077a6d24f8d8e2500fdb2f59bc7 => generated 0 bytes in 1169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:12.228489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:12.234582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:12.406312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:12.486816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61d4fc-86fe-41db-bc97-fcc264b31268 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:12.520372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a41a-8a60-4e0d-bdc2-6090c2a5e665 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:12.548251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:12.549338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:12.549811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:12.550455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:12.552009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:12.555874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:12.695734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:12.697129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:12.700560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:12.700560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] PATH_INFO: `/v3/projects/733bfbd0a8224f3183368997461b3deb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:12.701959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733bfbd0a8224f3183368997461b3deb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:12.707045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:12.748337 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3305/6618] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 21:00:12 2022] POST /identity/v3/projects => generated 329 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:12.751278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:12.765102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:13.035177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733bfbd0a8224f3183368997461b3deb', 'request_id': 'req-be5c6a44-1932-4268-909e-869abf4e8296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.039824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200741-aec5-4604-a7ce-91ad43840069 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:13.090467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:13.182150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733bfbd0a8224f3183368997461b3deb', 'request_id': 'req-be5c6a44-1932-4268-909e-869abf4e8296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.210896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733bfbd0a8224f3183368997461b3deb', 'request_id': 'req-be5c6a44-1932-4268-909e-869abf4e8296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.229270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:13.232636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:13.233420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:13.233945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:13.235119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:13.238296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:13.242781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] The token cache is being invalidate because project 733bfbd0a8224f3183368997461b3deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:13.253861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.253861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.258707 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3314/6619] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:12 2022] DELETE /identity/v3/projects/733bfbd0a8224f3183368997461b3deb => generated 0 bytes in 1065 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:13.261679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:13.265385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:13.457495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3306/6620] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 4 21:00:12 2022] GET /identity/v3/auth/projects => generated 828 bytes in 708 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:13.460402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:13.465153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:13.522314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6a44-1932-4268-909e-869abf4e8296 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:13.546923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:13.547953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:13.548350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:13.548783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/506eec8115a14e92884baf14c04ad501` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:13.553063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=506eec8115a14e92884baf14c04ad501)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:13.562788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:13.686115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a386914-1b8a-4234-993d-7d2da53d67c0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:13.715115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:13.716080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:13.716555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:13.718502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:13.722047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:13.726473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:13.801568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 506eec8115a14e92884baf14c04ad501 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:13.801568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.803909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-83631307-31a8-4e99-be3e-00e42c9dd1aa tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:13.808644 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3315/6621] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:13 2022] DELETE /identity/v3/roles/506eec8115a14e92884baf14c04ad501 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:13.811484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:13.812105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:13.812716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:13.858036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:13.865746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:13.910451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3307/6622] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:13 2022] POST /identity/v3/users => generated 416 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:13.914810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:13.918469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:13.964598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9569c-de03-4078-96b7-3054570f32e4 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:14.144927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3316/6623] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:14.151648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:14.159204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:14.233291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:14.236176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:14.242720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:14.242720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:14.244374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9e6e751fcaaf430d964cd0eb9399aab6, user_id=5bb3eba82f04487689cae784b5bd92c7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:14.253603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:14.269686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 752f2c38dc7242cca4d4703d29369911 was removed from user 5bb3eba82f04487689cae784b5bd92c7 on project 9e6e751fcaaf430d964cd0eb9399aab6. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:14.270434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:14.272766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:14.383691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1452c-fb32-41e6-ae09-93ae235acd64 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:14.395181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:14.403184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:14.403184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:14.403184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/groups/e9a5491ed4584cd1b078142e61e44ac9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:14.403184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e9a5491ed4584cd1b078142e61e44ac9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:14.408794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884064-2849-4363-8517-736082ad3064 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:14.462160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3308/6624] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 4 21:00:13 2022] DELETE /identity/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6/users/5bb3eba82f04487689cae784b5bd92c7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:14.467469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:14.472656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:14.608472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:14.671694 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3317/6625] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 4 21:00:14 2022] DELETE /identity/v3/groups/e9a5491ed4584cd1b078142e61e44ac9 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:14.676696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:14.677412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:14.678019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:14.724165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:14.728137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:14.732177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:14.758989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7ea81-343c-4a89-9f58-beec8057ec5c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:14.955194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:14.957749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:14.959533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:14.960463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:14.965262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:14.974460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3318/6626] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:14.974460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:14.975410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:14.975582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:15.133477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3309/6627] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:14 2022] POST /identity/v3/roles => generated 244 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:15.138027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:15.149262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:15.186968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7ec3-575d-48f9-94c0-101ee26e4047 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:15.211850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:15.212584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:15.213114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:15.213654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:15.214994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:15.224282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:15.405010 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3319/6628] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:14 2022] POST /identity/v3/users => generated 321 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:15.407522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be250d06-2ed8-4665-8c74-0996c9814bee tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:15.409422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:15.445273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:15.449935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:15.451097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:15.454245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/projects/52f0f6a70fa64ba4941d22800b21e32b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:15.461254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52f0f6a70fa64ba4941d22800b21e32b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:15.471445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:15.476920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9adf-7928-4871-8ba9-4b392bb8be93 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:15.503492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:15.507860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:15.510820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:15.515806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:15.518612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:15.529350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:15.531874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:15.607045 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3320/6629] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:15.608763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:15.676012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d334a04-877a-475c-a261-0e98438a7be6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:15.713330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:15.720062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:15.721028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:15.736661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:15.747406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:15.756340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:15.834340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f0f6a70fa64ba4941d22800b21e32b', 'request_id': 'req-2b1c1d02-b874-41b2-8928-af847982498f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:15.857378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f0f6a70fa64ba4941d22800b21e32b', 'request_id': 'req-2b1c1d02-b874-41b2-8928-af847982498f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:15.879212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f0f6a70fa64ba4941d22800b21e32b', 'request_id': 'req-2b1c1d02-b874-41b2-8928-af847982498f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:15.932527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:15.939341 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3321/6630] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:15 2022] POST /identity/v3/roles => generated 246 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:15.941030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:15.999838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c46ff2-970c-4dae-8421-ce38f8df9918 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:16.031808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] The token cache is being invalidate because project 52f0f6a70fa64ba4941d22800b21e32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:16.032711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:16.036091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:16.050078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3310/6631] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:15 2022] DELETE /identity/v3/projects/52f0f6a70fa64ba4941d22800b21e32b => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:16.054375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:16.056029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:16.082698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:16.236558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:16.237600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:16.238105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:16.238597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:16.239923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:16.243879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:16.408663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1d02-b874-41b2-8928-af847982498f tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:16.431766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:16.433493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:16.434557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:16.436956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:16.438993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:16.445036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:16.494966 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3322/6632] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:15 2022] POST /identity/v3/projects => generated 363 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:16.504316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:16.514977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:16.743748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3311/6633] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:16 2022] POST /identity/v3/projects => generated 375 bytes in 698 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:16.754411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:16.772071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:16.963571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e01d-0d1f-4208-9b5a-37fccda61c60 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:17.158871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:17.221743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d907f-ec56-4b44-8644-3a6417220c7f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:17.231807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:17.252278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:17.254981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:17.256426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:17.257184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:17.260980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=212e28d8157d4752be34b5c4135ff1bf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:17.267005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:17.282778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:17.284175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:17.284424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:17.284833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/5f26a152f857465fbaa0d771fa7dd692/users/f961d2d37f774d00b13b3c1787810b8e/roles/f9a7d84a175041b49e26e04db5acb8e2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:17.356434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f26a152f857465fbaa0d771fa7dd692, user_id=f961d2d37f774d00b13b3c1787810b8e, role_id=f9a7d84a175041b49e26e04db5acb8e2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:17.357968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:17.361637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:17.368108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:17.491105 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3323/6634] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:16 2022] PUT /identity/v3/projects/5f26a152f857465fbaa0d771fa7dd692/users/f961d2d37f774d00b13b3c1787810b8e/roles/f9a7d84a175041b49e26e04db5acb8e2 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:17.492533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:17.502096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:17.570841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:17.576808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:17.596780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3312/6635] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:16 2022] PATCH /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf => generated 277 bytes in 843 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:17.599354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:17.611825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:17.820922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262adb6d-a12d-4c17-a61d-385770322684 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:17.829229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f576-e2f4-418a-b6f8-c62fab10364f tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:17.856822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:17.867448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:17.867448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:17.867448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:17.869984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:17.890223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:18.072107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:18.100676 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3324/6636] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:17 2022] POST /identity/v3/projects => generated 364 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:18.102549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:18.112245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:18.142019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:18.143228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:18.143779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:18.144742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:18.167835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:18.174731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:18.203665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:18.398319 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3313/6637] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:17 2022] POST /identity/v3/users => generated 288 bytes in 804 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:18.401616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:18.426110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:18.442134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f72b-3dcb-4668-b71a-6bcf2f28167e tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:18.458087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:18.458087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:18.466275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:18.466275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/5f26a152f857465fbaa0d771fa7dd692/users/f961d2d37f774d00b13b3c1787810b8e/roles/ba12aa9cbd0b41589bfe6173a0b57962` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:18.474419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f26a152f857465fbaa0d771fa7dd692, user_id=f961d2d37f774d00b13b3c1787810b8e, role_id=ba12aa9cbd0b41589bfe6173a0b57962)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:18.483057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:18.669779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0f7f9-186a-4901-a6de-ebd11c4b67be admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:18.675697 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3325/6638] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:18 2022] PUT /identity/v3/projects/5f26a152f857465fbaa0d771fa7dd692/users/f961d2d37f774d00b13b3c1787810b8e/roles/ba12aa9cbd0b41589bfe6173a0b57962 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:18.678704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:18.685228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:19.016578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:19.018189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:19.019287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:19.021942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/domains/212e28d8157d4752be34b5c4135ff1bf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:19.023467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c4-5fe3-4b3c-85ce-6bd9219b5326 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:19.039879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:19.043291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:19.044030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:19.044776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:19.056846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:19.062162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:19.094224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=212e28d8157d4752be34b5c4135ff1bf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:19.097663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:19.187587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.210403 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3326/6639] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:18 2022] POST /identity/v3/roles => generated 240 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:19.211019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.212251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:19.218506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:19.405955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:19.463833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.464546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64919b3-dcea-4445-af71-ae162c88a646 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:19.501456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.513977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:19.520755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.631853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:19.634205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:19.634685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:19.635320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] PATH_INFO: `/v3/users/da0560ce4b7a4b3b8a0228c33a0f5ac9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:19.638068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0560ce4b7a4b3b8a0228c33a0f5ac9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:19.642591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:19.863963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] The token cache is being invalidate because project 212e28d8157d4752be34b5c4135ff1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:19.868581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.873092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.910734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.926526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.928967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '212e28d8157d4752be34b5c4135ff1bf', 'request_id': 'req-209373cc-88e7-4085-82dd-5c4e335eb11b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:19.964480 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3314/6640] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 4 21:00:18 2022] DELETE /identity/v3/domains/212e28d8157d4752be34b5c4135ff1bf => generated 0 bytes in 1565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:19.966757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:19.971658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:20.009643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209373cc-88e7-4085-82dd-5c4e335eb11b tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:20.019815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:20.023229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:20.023576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:20.024064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:20.025478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:20.029406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:20.074479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3315/6641] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:19 2022] GET /identity/v3/roles => generated 2800 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:20.076907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:20.080692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:20.089393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0560ce4b7a4b3b8a0228c33a0f5ac9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:20.090970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0560ce4b7a4b3b8a0228c33a0f5ac9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:20.232191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0560ce4b7a4b3b8a0228c33a0f5ac9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:20.292944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0560ce4b7a4b3b8a0228c33a0f5ac9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:20.344814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0560ce4b7a4b3b8a0228c33a0f5ac9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:20.396998 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3327/6642] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:19 2022] DELETE /identity/v3/users/da0560ce4b7a4b3b8a0228c33a0f5ac9 => generated 0 bytes in 1181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:20.399784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:20.402522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:20.420812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee089c-cb42-4449-8d5a-f5ea3a6f6947 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:20.668799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846dcc-f3cd-462a-ae08-a703ff0ec94d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:20.697018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:20.701420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:20.702519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:20.703062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/c4063a75722947b19617383d5035fea3/users/6bd474a9a4ab45489ba012f153a7596b/roles/7714e8d71e1b47169cb71c44d3d9c9ae` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:20.720120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:20.720931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:20.721565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:20.722218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:20.725378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:20.729877 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 21:00:20.729877 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 21:00:20.729877 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 21:00:20.745938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:20.784195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4063a75722947b19617383d5035fea3, user_id=6bd474a9a4ab45489ba012f153a7596b, role_id=7714e8d71e1b47169cb71c44d3d9c9ae)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:20.791695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:20.929266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:20.945705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3316/6643] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:20 2022] GET /identity/v3/users => generated 9184 bytes in 870 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:20.947516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:20.949952 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3328/6644] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:20 2022] PUT /identity/v3/projects/c4063a75722947b19617383d5035fea3/users/6bd474a9a4ab45489ba012f153a7596b/roles/7714e8d71e1b47169cb71c44d3d9c9ae => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:20.954675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:20.957345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:20.959939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:21.216353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b49ef-5540-4fea-b0fc-033384c0192a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:21.237369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa095e-245b-42f7-b8e8-4e789e8e0ce2 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:21.238917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:21.265568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:21.269506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:21.270619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:21.272266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:21.279205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8faedbf6a3f34c349b9de33e7848b6ea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:21.286129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:21.489871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:21.491833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:21.496524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:21.498933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] PATH_INFO: `/v3/users/72c5bb1c1f1e40549f50045f0b001aad` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:21.510549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c5bb1c1f1e40549f50045f0b001aad)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:21.517641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:21.518562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role 8faedbf6a3f34c349b9de33e7848b6ea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:21.519176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:21.520437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:21.528782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3329/6645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:20 2022] DELETE /identity/v3/roles/8faedbf6a3f34c349b9de33e7848b6ea => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:21.533261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:21.541390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:21.736031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c2d1-ef9a-4441-b363-4f7e33374611 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:21.747878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:21.749115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:21.749735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:21.750493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:21.752032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:21.755374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c34c74-34cb-4775-99c6-f11e6ab4d12a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:21.820411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3330/6646] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:21 2022] GET /identity/v3/roles => generated 2575 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:21.823732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b71b-4354-4878-83f4-909b3bc4b853 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:21.824656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b71b-4354-4878-83f4-909b3bc4b853 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:21.825705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272b71b-4354-4878-83f4-909b3bc4b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:21.891266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5272b71b-4354-4878-83f4-909b3bc4b853 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:21.895562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5272b71b-4354-4878-83f4-909b3bc4b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:21.931900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3331/6647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:21.934754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:21.937707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:21.938377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:21.948591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c5bb1c1f1e40549f50045f0b001aad'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:22.134780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c5bb1c1f1e40549f50045f0b001aad'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:22.176996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] MFA Rules not processed for user `f961d2d37f774d00b13b3c1787810b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:22.199588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c5bb1c1f1e40549f50045f0b001aad'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:22.220421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:22.293564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c5bb1c1f1e40549f50045f0b001aad'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:22.298225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c5bb1c1f1e40549f50045f0b001aad'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:22.338372 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3317/6648] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:20 2022] DELETE /identity/v3/users/72c5bb1c1f1e40549f50045f0b001aad => generated 0 bytes in 1392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:22.359488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:22.367844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:22.496037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:22.774972 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3332/6649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 842 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:22.780001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:22.787639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:22.840622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029e9e5-0959-444e-9deb-90ffb5569cea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:22.877334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:22.890688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:22.890688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:22.890688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/8fc400f479484addbf01c63c56be3f2d/users/6bd474a9a4ab45489ba012f153a7596b/roles/7714e8d71e1b47169cb71c44d3d9c9ae` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:22.903294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8fc400f479484addbf01c63c56be3f2d, user_id=6bd474a9a4ab45489ba012f153a7596b, role_id=7714e8d71e1b47169cb71c44d3d9c9ae)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:22.922330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:23.063300 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3318/6650] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:22 2022] PUT /identity/v3/projects/8fc400f479484addbf01c63c56be3f2d/users/6bd474a9a4ab45489ba012f153a7596b/roles/7714e8d71e1b47169cb71c44d3d9c9ae => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:23.063300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:23.076773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:23.217671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:23.241995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edae14d-2da5-4e43-9562-0faa5e72d695 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:23.464128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425489e-4dce-4ace-9889-b053b5d67eb0 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:23.491335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:23.510764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:23.511746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:23.512298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:23.512785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] PATH_INFO: `/v3/projects/ab88ca8a33714534ac6f4e911c48e88a/users/7741782f73fd49d29b3d4ba797568d7c/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:23.513489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:23.514001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:23.517111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/be9e416819a04e0eb9fbee6414d5a1e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:23.528921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=be9e416819a04e0eb9fbee6414d5a1e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:23.532357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:23.637845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab88ca8a33714534ac6f4e911c48e88a, user_id=7741782f73fd49d29b3d4ba797568d7c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:23.644271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a75e3-8abe-4adc-b4cc-d6ee799a713a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:23.804477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role be9e416819a04e0eb9fbee6414d5a1e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:23.805331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:23.808275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:23.813033 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3333/6651] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:22 2022] DELETE /identity/v3/roles/be9e416819a04e0eb9fbee6414d5a1e9 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:23.814861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:23.825493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:23.844218 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3319/6652] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:23 2022] PUT /identity/v3/projects/ab88ca8a33714534ac6f4e911c48e88a/users/7741782f73fd49d29b3d4ba797568d7c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:23.851717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd8c-b567-4e04-90f2-c34d66e2a887 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:23.855911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd8c-b567-4e04-90f2-c34d66e2a887 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:23.862789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd8c-b567-4e04-90f2-c34d66e2a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:23.985686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3c41bd8c-b567-4e04-90f2-c34d66e2a887 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:23.991976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3c41bd8c-b567-4e04-90f2-c34d66e2a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.055579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:24.085511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6675df-b429-4677-b072-a69ae744a983 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:24.097483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:24.098646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:24.108562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:24.108562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:24.115568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.280050 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3320/6653] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:24.283226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4957-40ac-4217-a485-1a2c1a3c3e76 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:24.283937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4957-40ac-4217-a485-1a2c1a3c3e76 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:24.284587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4957-40ac-4217-a485-1a2c1a3c3e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:24.329294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8d0b4957-40ac-4217-a485-1a2c1a3c3e76 None None] MFA Rules not processed for user `f961d2d37f774d00b13b3c1787810b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:24.335059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d0b4957-40ac-4217-a485-1a2c1a3c3e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.387225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:24.393498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579dad-5844-4115-bb54-e1d1371c04fb service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:24.437240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3334/6654] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:24.441645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:24.442118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:24.442594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:24.557216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] MFA Rules not processed for user `6bd474a9a4ab45489ba012f153a7596b`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:24.565987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.588278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3335/6655] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:24 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 21:00:24.588278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:24.590171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.613467 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3321/6656] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:24.617344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:24.617847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:24.618448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:24.733212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] MFA Rules not processed for user `7741782f73fd49d29b3d4ba797568d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:24.739879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:24.973839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:25.010976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9f7c-1770-459f-8ba1-1b6312414c45 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:25.039786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c8347d33f2416eb915fac17da5a403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5afeead2f2774e36a4fcb67e8b55c630', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:25.042289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:25.044531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:25.045155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] PATH_INFO: `/v3/roles/bd9c84e113f749ffb66cd3390137e5ee` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:25.054969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bd9c84e113f749ffb66cd3390137e5ee)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:25.061640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:25.156907 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3322/6657] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:25.173302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:25.202364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b52e4-bf30-4f57-9c15-ae5e98d61814 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:25.213082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:25.216053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:25.216555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:25.217058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:25.240965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:25.244054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa6b0c-82d2-4e30-b186-3de06e288d95 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:25.268257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3323/6658] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:25.272201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:25.272460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:25.274277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:25.304161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] MFA Rules not processed for user `6bd474a9a4ab45489ba012f153a7596b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:25.308813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:25.344019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invalidating the token cache because role bd9c84e113f749ffb66cd3390137e5ee has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:25.344539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:25.346073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:25.352120 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3336/6659] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:24 2022] DELETE /identity/v3/roles/bd9c84e113f749ffb66cd3390137e5ee => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:25.353987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:25.357079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:25.562499 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3324/6660] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 04 21:00:25.564285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:25.567006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:25.631617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:25.671646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f6ee-ab8b-4963-81d6-b38937e688a4 tempest-RolesV3TestJSON-2456718 tempest-RolesV3TestJSON-2456718-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:25.707585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f961d2d37f774d00b13b3c1787810b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f26a152f857465fbaa0d771fa7dd692', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-441832506', 'tempest-DelegatedRole-1647496788'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:25.708763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:25.709280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:25.710047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:25.711667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] RBAC: Authorizing `identity:create_trust()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:25.713644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:25.902095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b5b-0ae8-4b21-a307-30bd60a59c57 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 04 21:00:26.129401 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 04 21:00:26.132033 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:26.134530 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3337/6661] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 21:00:25 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 782 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:00:26.139329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:26.146084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:26.165167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:26.166277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:26.166910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:26.167593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:26.183957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:26.382290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:26.489914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:26.494597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:26.495610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ad925-b90f-4139-8ff4-f300ae8f9c77 tempest-TrustsV3TestJSON-1815523913 tempest-user-1728889643] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:26.515361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:26.516630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:26.517107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:26.517736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] PATH_INFO: `/v3/users/6a3bc25254ae4b9c8901f75b0dc6ec74` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:26.519967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3bc25254ae4b9c8901f75b0dc6ec74)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:26.524469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:26.544730 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3325/6662] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 981 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:26.546063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:26.553102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:26.848732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f75e9-36df-4756-8220-4f9413d561ed service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:26.858935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:26.860668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:26.861168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:26.861988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:26.865670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:26.955714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3bc25254ae4b9c8901f75b0dc6ec74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:26.957644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3bc25254ae4b9c8901f75b0dc6ec74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:27.069241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3bc25254ae4b9c8901f75b0dc6ec74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:27.123020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3bc25254ae4b9c8901f75b0dc6ec74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:27.145563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:27.152918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3bc25254ae4b9c8901f75b0dc6ec74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:27.159372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:27.180634 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3338/6663] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:26 2022] DELETE /identity/v3/users/6a3bc25254ae4b9c8901f75b0dc6ec74 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:27.182407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:27.193821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:27.332165 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3326/6664] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 4 21:00:26 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:27.332165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:27.336954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:27.342378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:27.470538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42c5dc-1b7d-46d1-9c10-fc69449359ce tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:27.561988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227f1e-bca4-4099-b1b1-34485798f13c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:27.576647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:27.578095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:27.578759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:27.579472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/ba12aa9cbd0b41589bfe6173a0b57962` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:27.583561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba12aa9cbd0b41589bfe6173a0b57962)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:27.591702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:27.755998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:27.757476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:27.757978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:27.758476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] PATH_INFO: `/v3/projects/6c1d2c9709a94cf691cb05145eeb8e23` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:27.762046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1d2c9709a94cf691cb05145eeb8e23)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:27.768304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:27.913883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:28.077312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1d2c9709a94cf691cb05145eeb8e23', 'request_id': 'req-7b0e9732-addf-4fe9-b92c-fcd70072c554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.108384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role ba12aa9cbd0b41589bfe6173a0b57962 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:28.108668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1d2c9709a94cf691cb05145eeb8e23', 'request_id': 'req-7b0e9732-addf-4fe9-b92c-fcd70072c554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.109041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.112252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.125477 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3339/6665] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:27 2022] DELETE /identity/v3/roles/ba12aa9cbd0b41589bfe6173a0b57962 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:28.127528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:28.133245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:28.140827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1d2c9709a94cf691cb05145eeb8e23', 'request_id': 'req-7b0e9732-addf-4fe9-b92c-fcd70072c554'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.311613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] The token cache is being invalidate because project 6c1d2c9709a94cf691cb05145eeb8e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:28.312404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.315005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b0e9732-addf-4fe9-b92c-fcd70072c554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.340967 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3327/6666] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:27 2022] DELETE /identity/v3/projects/6c1d2c9709a94cf691cb05145eeb8e23 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:28.345737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17373-b3be-4cbf-a322-6d43dc03dfaf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:28.347799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17373-b3be-4cbf-a322-6d43dc03dfaf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:28.353392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17373-b3be-4cbf-a322-6d43dc03dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:28.486410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05bbf-2760-4497-8d22-daa03e326b2d tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:28.493133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9ed17373-b3be-4cbf-a322-6d43dc03dfaf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:28.501933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ed17373-b3be-4cbf-a322-6d43dc03dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:28.506506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:28.507960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:28.508471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:28.508963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] PATH_INFO: `/v3/projects/96afd63f40424915a4daa8d6e831fd90` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:28.511745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96afd63f40424915a4daa8d6e831fd90)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:28.517529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:28.551997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3328/6667] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:28.555887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:28.556727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:28.557231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:28.584341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:28.635451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] MFA Rules not processed for user `6bd474a9a4ab45489ba012f153a7596b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:28.640407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:28.749753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96afd63f40424915a4daa8d6e831fd90', 'request_id': 'req-21ab81cb-ebb7-4f17-898b-205f0177bdf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.863675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3329/6668] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 04 21:00:28.867312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:28.871811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:28.892451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96afd63f40424915a4daa8d6e831fd90', 'request_id': 'req-21ab81cb-ebb7-4f17-898b-205f0177bdf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.922038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96afd63f40424915a4daa8d6e831fd90', 'request_id': 'req-21ab81cb-ebb7-4f17-898b-205f0177bdf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:28.994345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] The token cache is being invalidate because project 96afd63f40424915a4daa8d6e831fd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:28.995059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:29.000278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-21ab81cb-ebb7-4f17-898b-205f0177bdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:29.005565 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3340/6669] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:28 2022] DELETE /identity/v3/projects/96afd63f40424915a4daa8d6e831fd90 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:29.008506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:29.009905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:29.010361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:29.061494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:29.063828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:29.138197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:29.144986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d4fa3-7044-4763-9fb3-cfce72ff3608 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:29.324364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:29.333008 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3341/6670] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:29.335617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:29.339240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:29.353498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:29.356513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:29.357074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:29.357643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/f9a7d84a175041b49e26e04db5acb8e2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:29.366827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f9a7d84a175041b49e26e04db5acb8e2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:29.372185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:29.534651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a13fa-5835-464e-acbe-71a079f27342 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:29.544373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:29.545803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:29.547166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:29.547166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:29.554836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:29.577639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:29.581058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:29.606174 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3342/6671] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:29.609495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:29.613691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:29.840177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef2a8-c058-4d01-9224-594730896cf5 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:29.849937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:29.850263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:29.850759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:29.851311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/roles/7714e8d71e1b47169cb71c44d3d9c9ae` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:29.854478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7714e8d71e1b47169cb71c44d3d9c9ae)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:29.858980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:29.879897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role f9a7d84a175041b49e26e04db5acb8e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:29.881499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:29.882443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:29.904386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3330/6672] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:28 2022] DELETE /identity/v3/roles/f9a7d84a175041b49e26e04db5acb8e2 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:29.910530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:29.919716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:30.182491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invalidating the token cache because role 7714e8d71e1b47169cb71c44d3d9c9ae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:30.182856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:30.184123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dbd97ea5-be4b-44da-8f33-315f85775e83 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:30.194084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3343/6673] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:29 2022] DELETE /identity/v3/roles/7714e8d71e1b47169cb71c44d3d9c9ae => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:30.196888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:30.197175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:30.197683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:30.238764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfefff-6c33-4d69-94e3-1973b3773032 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:30.258278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:30.260957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:30.334264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:30.477896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:30.478920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:30.480510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:30.481077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] PATH_INFO: `/v3/users/86fb2f56c07b4985a10338ec5ca600a2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:30.484191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fb2f56c07b4985a10338ec5ca600a2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:30.500091 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3344/6674] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:30.501325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:30.502609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:30.506119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:30.791822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45238912-1b1f-4558-9dfa-481967c05a3d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:30.805998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:30.808728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:30.809813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:30.810560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/f961d2d37f774d00b13b3c1787810b8e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:30.814134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f961d2d37f774d00b13b3c1787810b8e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:30.820566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:30.994319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fb2f56c07b4985a10338ec5ca600a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.086841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f961d2d37f774d00b13b3c1787810b8e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.086841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f961d2d37f774d00b13b3c1787810b8e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.110817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fb2f56c07b4985a10338ec5ca600a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.136124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fb2f56c07b4985a10338ec5ca600a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.154050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:31.172482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fb2f56c07b4985a10338ec5ca600a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.174266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fb2f56c07b4985a10338ec5ca600a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.186513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3331/6675] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:29 2022] DELETE /identity/v3/users/86fb2f56c07b4985a10338ec5ca600a2 => generated 0 bytes in 1281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:31.192430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:31.195635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:31.289698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f961d2d37f774d00b13b3c1787810b8e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.343832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f961d2d37f774d00b13b3c1787810b8e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.371812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f961d2d37f774d00b13b3c1787810b8e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.404238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3345/6676] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:30 2022] DELETE /identity/v3/users/f961d2d37f774d00b13b3c1787810b8e => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:31.405526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:31.412608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:31.431689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab32d-5ec2-455c-a7ba-0d3f2f7fbd5b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:31.650808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:31.653238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:31.656394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:31.659419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:31.659665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/8fc400f479484addbf01c63c56be3f2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:31.665060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8fc400f479484addbf01c63c56be3f2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:31.672029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:31.739562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bf3ca-b966-4cf1-b0f4-598780fef7d9 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:31.772716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:31.776007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:31.776007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:31.776007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:31.777557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:31.778099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:31.781568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:31.823416 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3346/6677] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:31.823416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:31.833360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:31.865956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34990ed-a81a-4e4c-8176-fa0eca36fb97 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:31.882068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:31.899482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:31.902979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:31.922188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] PATH_INFO: `/v3/projects/bd170b1b29e349dda205dcbd8e5c1854` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:31.931680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd170b1b29e349dda205dcbd8e5c1854)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:31.937746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:31.976131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc400f479484addbf01c63c56be3f2d', 'request_id': 'req-f04c03da-cd5e-4133-af98-a1708b203372'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:31.999296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc400f479484addbf01c63c56be3f2d', 'request_id': 'req-f04c03da-cd5e-4133-af98-a1708b203372'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.018950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc400f479484addbf01c63c56be3f2d', 'request_id': 'req-f04c03da-cd5e-4133-af98-a1708b203372'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.207885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project 8fc400f479484addbf01c63c56be3f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:32.208344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.209670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.212839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3332/6678] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:31 2022] DELETE /identity/v3/projects/8fc400f479484addbf01c63c56be3f2d => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:32.214564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:32.217881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:32.249790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd170b1b29e349dda205dcbd8e5c1854', 'request_id': 'req-95239f46-4600-467b-bc14-7febf8c9bd3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.337290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:32.405699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c03da-cd5e-4133-af98-a1708b203372 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:32.413098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd170b1b29e349dda205dcbd8e5c1854', 'request_id': 'req-95239f46-4600-467b-bc14-7febf8c9bd3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.444526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd170b1b29e349dda205dcbd8e5c1854', 'request_id': 'req-95239f46-4600-467b-bc14-7febf8c9bd3b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.493813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] The token cache is being invalidate because project bd170b1b29e349dda205dcbd8e5c1854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:32.498581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.498581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:32.498581 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3347/6679] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:31 2022] DELETE /identity/v3/projects/bd170b1b29e349dda205dcbd8e5c1854 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:32.500326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:32.503274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:32.659027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:32.661312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:32.662374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:32.663315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/5f26a152f857465fbaa0d771fa7dd692` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:32.666423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f26a152f857465fbaa0d771fa7dd692)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:32.671495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:32.712479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239f46-4600-467b-bc14-7febf8c9bd3b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:32.723937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:32.725322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:32.726152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:32.726795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:32.728954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:32.731545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:32.903072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3348/6680] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:32.904442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:32.909528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:33.038614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f26a152f857465fbaa0d771fa7dd692', 'request_id': 'req-4e347673-02ce-4234-a6bc-e2159142fd15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.074489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f26a152f857465fbaa0d771fa7dd692', 'request_id': 'req-4e347673-02ce-4234-a6bc-e2159142fd15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.120584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f26a152f857465fbaa0d771fa7dd692', 'request_id': 'req-4e347673-02ce-4234-a6bc-e2159142fd15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.129918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:33.187111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da9e0-d00b-4bc6-baa4-f8705ad97d93 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:33.202358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:33.203051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:33.203616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:33.204105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] PATH_INFO: `/v3/projects/978ff0301b2d496584a4a4a86233df46` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:33.212607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=978ff0301b2d496584a4a4a86233df46)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:33.216523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:33.270831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project 5f26a152f857465fbaa0d771fa7dd692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:33.274948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.278984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.285645 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3333/6681] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:32 2022] DELETE /identity/v3/projects/5f26a152f857465fbaa0d771fa7dd692 => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:33.287527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:33.294556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:33.551189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978ff0301b2d496584a4a4a86233df46', 'request_id': 'req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.608212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347673-02ce-4234-a6bc-e2159142fd15 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:33.629516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:33.657440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978ff0301b2d496584a4a4a86233df46', 'request_id': 'req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.695979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978ff0301b2d496584a4a4a86233df46', 'request_id': 'req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.786562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] The token cache is being invalidate because project 978ff0301b2d496584a4a4a86233df46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:33.790896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.796519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:33.830482 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3349/6682] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:32 2022] DELETE /identity/v3/projects/978ff0301b2d496584a4a4a86233df46 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:33.830482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:33.837672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:34.039875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:34.041153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:34.041644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:34.042137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/8fc400f479484addbf01c63c56be3f2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:34.076092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8fc400f479484addbf01c63c56be3f2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:34.089022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Could not find project: 8fc400f479484addbf01c63c56be3f2d.: keystone.exception.ProjectNotFound: Could not find project: 8fc400f479484addbf01c63c56be3f2d. Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 04 21:00:34.148873 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8fc400f479484addbf01c63c56be3f2d. Oct 04 21:00:34.151005 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:00:34.162979 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3334/6683] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:33 2022] DELETE /identity/v3/projects/8fc400f479484addbf01c63c56be3f2d => generated 113 bytes in 876 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:34.165275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:34.169378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:34.203192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064e3c-9a63-47e3-b0e8-25fba0e14a8f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:34.231077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43756a-14ef-4dfd-8dc0-5ca6f6dda801 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:34.232347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:34.233651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:34.238532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:34.239251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] PATH_INFO: `/v3/users/77c8347d33f2416eb915fac17da5a403` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:34.245708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c8347d33f2416eb915fac17da5a403)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:34.254325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:34.254657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:34.255410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:34.256763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:34.257285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:34.264300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:34.276423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:34.495997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3335/6684] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:34 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:34.498237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:34.528470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:34.702173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c8347d33f2416eb915fac17da5a403'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:34.711967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c8347d33f2416eb915fac17da5a403'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:34.875681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c8347d33f2416eb915fac17da5a403'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:34.930386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c8347d33f2416eb915fac17da5a403'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:34.973396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-276670be-94d1-4b3e-9229-34bedf7882a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c8347d33f2416eb915fac17da5a403'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:34.979850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:34.998953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3350/6685] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:33 2022] DELETE /identity/v3/users/77c8347d33f2416eb915fac17da5a403 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:35.002094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:35.002592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:35.003083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:35.055742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d305f-4faa-4c1a-af39-1e80b027526d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:35.111015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:35.119529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:35.429668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:35.446706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:35.450095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:35.452576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:35.457439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:35.470871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:35.486560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3351/6686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:35.488488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:35.494286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:35.714749 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3336/6687] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 21:00:34 2022] POST /identity/v3/projects => generated 329 bytes in 1218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:35.716633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:35.738763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:35.871277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:35.915656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf07f-a17e-467c-b85c-c75744bb10d8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:36.166331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb2c5-431d-41ff-bafe-ace895aad23e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:36.176838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:36.181113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:36.185096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:36.187810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/projects/c4063a75722947b19617383d5035fea3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:36.195721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4063a75722947b19617383d5035fea3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:36.196830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:36.200248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:36.200727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:36.201213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:36.202533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:36.205274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:36.207863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366a563-f5bc-4cb3-ac9a-11edf550ddf8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:36.245227 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3337/6688] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:36.249207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:36.250163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:36.251963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:36.327990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:36.333358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:36.355654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3338/6689] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:36.357472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:36.363443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:36.503274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:36.513851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4063a75722947b19617383d5035fea3', 'request_id': 'req-6067e080-05c2-4a12-a931-5079c7b59f18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:36.623397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4063a75722947b19617383d5035fea3', 'request_id': 'req-6067e080-05c2-4a12-a931-5079c7b59f18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:36.649422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4063a75722947b19617383d5035fea3', 'request_id': 'req-6067e080-05c2-4a12-a931-5079c7b59f18'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:36.703479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] The token cache is being invalidate because project c4063a75722947b19617383d5035fea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:36.704000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:36.706583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:36.711095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3352/6690] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:35 2022] DELETE /identity/v3/projects/c4063a75722947b19617383d5035fea3 => generated 0 bytes in 1224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:36.712808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:36.728550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:36.783997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08e47f-d372-4e02-91db-fd280f1e93b8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:37.091531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067e080-05c2-4a12-a931-5079c7b59f18 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:37.116850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:37.117978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:37.118490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:37.118979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:37.120832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:37.124724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:37.169126 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3353/6691] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:37.171193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:37.189974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:37.189974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:37.190840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:37.191685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:37.191685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:37.191685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:37.197168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:37.235967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d803d-5711-4682-8019-bd9387811045 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:37.263964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:37.265510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:37.268040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:37.268040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:37.268570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:37.269408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:37.274120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:37.338701 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3354/6692] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:37.340825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:37.344212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:37.410118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3339/6693] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:36 2022] POST /identity/v3/users => generated 416 bytes in 1053 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:37.412341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:37.423581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:37.500780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9951f99-6226-4dbb-8b58-05eff0c560fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:37.526845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:37.526845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:37.526845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:37.526845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] PATH_INFO: `/v3/projects/5afeead2f2774e36a4fcb67e8b55c630` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:37.530208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afeead2f2774e36a4fcb67e8b55c630)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:37.534525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:37.686879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812dc9-9618-4bcd-8ec4-88a55f5dfa9e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:37.712174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:37.714036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:37.714772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:37.715478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/users/6bd474a9a4ab45489ba012f153a7596b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:37.718155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6bd474a9a4ab45489ba012f153a7596b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:37.730667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:37.824013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:37.857447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afeead2f2774e36a4fcb67e8b55c630', 'request_id': 'req-13125971-d777-473a-94c4-25bcd9fe03fc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:37.878030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afeead2f2774e36a4fcb67e8b55c630', 'request_id': 'req-13125971-d777-473a-94c4-25bcd9fe03fc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:37.897023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afeead2f2774e36a4fcb67e8b55c630', 'request_id': 'req-13125971-d777-473a-94c4-25bcd9fe03fc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.164710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] The token cache is being invalidate because project 5afeead2f2774e36a4fcb67e8b55c630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:38.168880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.173258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.194156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3340/6694] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:37 2022] DELETE /identity/v3/projects/5afeead2f2774e36a4fcb67e8b55c630 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:38.211225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:38.220715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:38.229014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd474a9a4ab45489ba012f153a7596b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.230339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd474a9a4ab45489ba012f153a7596b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.377146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd474a9a4ab45489ba012f153a7596b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.397629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:38.429587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd474a9a4ab45489ba012f153a7596b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.470466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd474a9a4ab45489ba012f153a7596b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:38.508032 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3355/6695] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:37 2022] DELETE /identity/v3/users/6bd474a9a4ab45489ba012f153a7596b => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:38.510436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:38.520761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:38.617535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13125971-d777-473a-94c4-25bcd9fe03fc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:38.809337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a86e-1289-454a-9688-71cbf581092d tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:38.840190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:38.841992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:38.843219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:38.844091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:38.845711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:38.850541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:38.883674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:38.884951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:38.885461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:38.885956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] PATH_INFO: `/v3/projects/f9de9ddb18854733af8b5c5daf5b8681/users/e2cf0edf8b3d4b58bcd78077675d4886/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:38.961544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9de9ddb18854733af8b5c5daf5b8681, user_id=e2cf0edf8b3d4b58bcd78077675d4886, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:38.985807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e1b9-ff3e-461f-9d03-cd674150e502 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:39.034618 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3356/6696] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:38 2022] POST /identity/v3/projects => generated 387 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:39.034618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:39.038431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:39.129819 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3341/6697] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:38 2022] PUT /identity/v3/projects/f9de9ddb18854733af8b5c5daf5b8681/users/e2cf0edf8b3d4b58bcd78077675d4886/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:39.151755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:39.152240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:39.152723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:39.254799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:39.265564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:39.366093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3555b5-3134-4891-948e-9a7d3a141032 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:39.467229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:39.499392 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3342/6698] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:39.501467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:39.504195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:39.646727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:39.648379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:39.650745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:39.665991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:39.683912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:39.689680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:39.757709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1093-a463-4863-a738-f6822b2e965a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:39.772661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:39.775288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:39.776590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:39.777119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:39.801213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 21:00:39.840713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3357/6699] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:39 2022] POST /identity/v3/roles => generated 244 bytes in 809 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:39.845119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f0315cc5-643e-42b2-bf00-8aef8c5097c7 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Could not find domain: 2d8d7f0eda254a0a856c9e2a690dd19d.: keystone.exception.DomainNotFound: Could not find domain: 2d8d7f0eda254a0a856c9e2a690dd19d. Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2d8d7f0eda254a0a856c9e2a690dd19d. Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:39.847051 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:39.855730 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application with Lock( Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2d8d7f0eda254a0a856c9e2a690dd19d. Oct 04 21:00:39.858509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:00:39.861345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3343/6700] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:39 2022] PATCH /identity/v3/domains/2d8d7f0eda254a0a856c9e2a690dd19d => generated 112 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:39.861345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:39.861345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:39.861345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:39.877857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:39.902863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa607d-c11c-4706-afbc-4a6d6f04f9cf tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:39.942339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:39.944164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:39.944674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:39.945387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:39.954179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:39.975894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cc454-af8d-4820-96ec-ce9ce416c930 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:40.126464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] MFA Rules not processed for user `e2cf0edf8b3d4b58bcd78077675d4886`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:40.126464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:40.287066 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3358/6701] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:39 2022] POST /identity/v3/users => generated 294 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:40.298549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:40.299047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:40.303510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:40.347797 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3344/6702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:40.350334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.400849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcdc71-173a-4e59-b3ad-2a0fa875f595 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:40.405101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:40.410260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:40.411007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:40.412990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:40.413676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:40.414306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:40.415993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:40.420075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:40.442190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3359/6703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:40.444223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.467503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb1c36-1c9c-4198-b07a-2567d621a8ca None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:40.477718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:40.478965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:40.479566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:40.480093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:40.499507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Could not find domain: 3d87f3010fd54f4a86cc236c4e2405cf.: keystone.exception.DomainNotFound: Could not find domain: 3d87f3010fd54f4a86cc236c4e2405cf. Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3d87f3010fd54f4a86cc236c4e2405cf. Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:40.510912 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:40.513002 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3d87f3010fd54f4a86cc236c4e2405cf. Oct 04 21:00:40.514701 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:40.518630 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3360/6704] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:40 2022] PATCH /identity/v3/domains/3d87f3010fd54f4a86cc236c4e2405cf => generated 112 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:40.520372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.566916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4842d71-e20c-46d9-b0e1-3cb1f4e17c1b tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:40.577768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:40.579056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:40.579597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:40.580161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:40.581905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:40.586123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:40.605169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3345/6705] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:40 2022] POST /identity/v3/roles => generated 247 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:40.619584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.619584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:40.648158 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3361/6706] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:40 2022] GET /identity/v3/roles => generated 1893 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:40.652471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.715554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b613-e1ce-4c4f-8880-2160d5631f3d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:40.755932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:40.757606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:40.762832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:40.765530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:40.772516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:40.776065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:40.805589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:40.910146 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3362/6707] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:40.910146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:40.988353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36683548-3e0b-4139-9609-4fe5d381746c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:40.999966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e09b9-7b58-4f7f-b6ae-4edce4a52ac5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.000969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.003314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.004262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.004996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/23e29e71d547485caabffb7bd158433b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.010457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.011927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.012535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.013132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.024418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 21:00:41.037455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Could not find domain: 23e29e71d547485caabffb7bd158433b.: keystone.exception.DomainNotFound: Could not find domain: 23e29e71d547485caabffb7bd158433b. Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 23e29e71d547485caabffb7bd158433b. Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:41.041657 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:41.043923 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 23e29e71d547485caabffb7bd158433b. Oct 04 21:00:41.046068 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.051984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:41.059640 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3363/6708] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:40 2022] PATCH /identity/v3/domains/23e29e71d547485caabffb7bd158433b => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:41.066617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:41.100078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87d61e-9aa0-428c-9f93-36b70904239c tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.136900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.138407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3346/6709] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:41.149180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.150556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.152468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/887696004b394ed89f51cae269e01512/users/5638e5732f6b4d5b84418b7c7906cf0d/roles/12309f660c6f496cbe04c1485cb1239d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.163383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:41.218968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=887696004b394ed89f51cae269e01512, user_id=5638e5732f6b4d5b84418b7c7906cf0d, role_id=12309f660c6f496cbe04c1485cb1239d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:41.234580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:41.243245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055ba7c-c0e6-4916-a73a-1d823103101a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.261058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.267855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.267855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.267855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.267855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:41.267855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:41.298658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3347/6710] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:41 2022] GET /identity/v3/roles => generated 1893 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:41.307536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:41.328884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:41.350178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef915-6861-4eec-ac17-2124f3d28553 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.372127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.373878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.374968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.375758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.377834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:41.384581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:41.389003 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3364/6711] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:41 2022] PUT /identity/v3/projects/887696004b394ed89f51cae269e01512/users/5638e5732f6b4d5b84418b7c7906cf0d/roles/12309f660c6f496cbe04c1485cb1239d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:41.397556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:41.588148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3348/6712] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:41 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:41.589791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:41.684417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce627-783f-49c4-9c79-8b313ce51246 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.899589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c8be-40e0-4039-9fbe-69f5c153f8ba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:41.911615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb3eba82f04487689cae784b5bd92c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fada00d6c093462d9c08c33cd52626b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.919050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.922336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.924215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] PATH_INFO: `/v3/domains/8cbdff4388a24d5daf19bbe5519f8390` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.934471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:41.941024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:41.941024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:41.941608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] PATH_INFO: `/v3/projects/9414c27e5e724ab4956a3499d081bdca/users/8b73e1c41f024b519fa29f65abe9b6a8/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:41.960057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Could not find domain: 8cbdff4388a24d5daf19bbe5519f8390.: keystone.exception.DomainNotFound: Could not find domain: 8cbdff4388a24d5daf19bbe5519f8390. Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8cbdff4388a24d5daf19bbe5519f8390. Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:41.991618 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:41.993994 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8cbdff4388a24d5daf19bbe5519f8390. Oct 04 21:00:41.996184 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:41.999204 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3365/6713] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 4 21:00:41 2022] PATCH /identity/v3/domains/8cbdff4388a24d5daf19bbe5519f8390 => generated 112 bytes in 606 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:42.016721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:42.029541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9414c27e5e724ab4956a3499d081bdca, user_id=8b73e1c41f024b519fa29f65abe9b6a8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:42.059699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:42.187961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:42.269973 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3349/6714] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:41 2022] PUT /identity/v3/projects/9414c27e5e724ab4956a3499d081bdca/users/8b73e1c41f024b519fa29f65abe9b6a8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:42.269973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:42.481764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045e8d-bded-481a-814a-9ca5d179adb3 tempest-TokensV3TestJSON-1959598325 tempest-TokensV3TestJSON-1959598325-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:42.589911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ed29-96ad-4477-b49d-9253e4933218 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:42.649578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:42.649578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:42.649578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:42.650136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:42.655998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:42.665608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:42.847236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3350/6715] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:42 2022] POST /identity/v3/users => generated 290 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:42.851388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:42.860174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:42.923242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:42.941585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:42.941585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:42.941585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/887696004b394ed89f51cae269e01512/users/5638e5732f6b4d5b84418b7c7906cf0d/roles/85c82ee355044422b3bda80cc88739cb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:42.941985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14972d3f-1fb9-43b7-8284-88ec05b6c00a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:42.956135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:42.957016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:42.957514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:42.959330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] PATH_INFO: `/v3/users/d8387fc633ae44b6a7799430fb730045` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:42.961853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=887696004b394ed89f51cae269e01512, user_id=5638e5732f6b4d5b84418b7c7906cf0d, role_id=85c82ee355044422b3bda80cc88739cb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:42.962079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8387fc633ae44b6a7799430fb730045)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:42.971419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:42.979503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:43.145123 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3366/6716] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:41 2022] PUT /identity/v3/projects/887696004b394ed89f51cae269e01512/users/5638e5732f6b4d5b84418b7c7906cf0d/roles/85c82ee355044422b3bda80cc88739cb => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:43.155342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:43.163923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:43.431389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8387fc633ae44b6a7799430fb730045'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.450005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:43.502402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c926c8-7ada-44ab-b2fa-d475b29a1609 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:43.515551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:43.517329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:43.518418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:43.518907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] PATH_INFO: `/v3/users/7741782f73fd49d29b3d4ba797568d7c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:43.522416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7741782f73fd49d29b3d4ba797568d7c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:43.527545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:43.622012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8387fc633ae44b6a7799430fb730045'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.662582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8387fc633ae44b6a7799430fb730045'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.722128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8387fc633ae44b6a7799430fb730045'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.723531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-464de885-f3c4-40e0-9fed-bf4e38f827bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8387fc633ae44b6a7799430fb730045'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.744116 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3351/6717] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:42 2022] DELETE /identity/v3/users/d8387fc633ae44b6a7799430fb730045 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:43.746680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:43.747076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:43.757473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:43.848115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] MFA Rules not processed for user `8b73e1c41f024b519fa29f65abe9b6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:43.850092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:43.947470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7741782f73fd49d29b3d4ba797568d7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:43.949452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7741782f73fd49d29b3d4ba797568d7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:44.109107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7741782f73fd49d29b3d4ba797568d7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:44.149024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:44.174569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7741782f73fd49d29b3d4ba797568d7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:44.182280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3352/6718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:44.184162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:44.189465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:44.210533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7741782f73fd49d29b3d4ba797568d7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:44.245457 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3367/6719] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:43 2022] DELETE /identity/v3/users/7741782f73fd49d29b3d4ba797568d7c => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:44.246625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:44.250816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:44.628336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03a635-3ef4-4c77-87c9-232d67925ead None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:44.715467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6071d2-1577-4570-98b6-b828ba5fd848 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:44.724163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:44.725555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:44.726167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:44.726717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:44.728637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:44.732603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313f213-7df6-40f0-b068-f2db50e531dd tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:44.849948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3368/6720] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:44 2022] GET /identity/v3/users => generated 8044 bytes in 599 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:44.849948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0716f-8c4d-420a-978a-aa5074abd79b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:44.849948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0716f-8c4d-420a-978a-aa5074abd79b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:44.849948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0716f-8c4d-420a-978a-aa5074abd79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:44.902075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-60d0716f-8c4d-420a-978a-aa5074abd79b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:44.906048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-60d0716f-8c4d-420a-978a-aa5074abd79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.019038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:45.020150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:45.020648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:45.021213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:45.023930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:45.027100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66ae22-ecbd-4caf-ab26-b554500388bf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:45.040547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:45.056377 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3353/6721] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:44 2022] GET /identity/v3/roles => generated 1893 bytes in 873 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:45.058255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:45.059055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:45.059822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:45.102777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:45.105382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.156306 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3354/6722] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:45.158017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:45.161618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.292147 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3369/6723] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:45.292971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:45.294193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:45.298458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:45.426189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00c717-e10c-4a34-91ea-0960bb5fe7ee None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:45.441038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:45.442295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:45.442456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:45.442783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:45.455367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] MFA Rules not processed for user `5638e5732f6b4d5b84418b7c7906cf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:45.458050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.464426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.688186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:45.698042 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3370/6724] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:45.719372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:45.725909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.786757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a01e-4de6-4098-87da-f2ef0bf54595 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:45.810232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:45.823843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:45.823843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:45.823843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:45.823843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:45.824676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:45.873218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:45.884255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:45.898976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3371/6725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:45 2022] GET /identity/v3/roles => generated 1893 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:45.898976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:45.910142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:45.952030 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3355/6726] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:45.953767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:45.996723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37dc47-ef2e-4e36-8dc2-a9a665d38219 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:46.008097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebebe04-13bf-41eb-88cd-7b97f4ce434e service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:46.021997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:46.022840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.023157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.023443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.034575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:46.035851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.036427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.036899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.070570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:46.079524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:46.080207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a547-af93-4853-a943-b642995dbac0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:46.082557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:46.113436 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3372/6727] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:46.117725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.118471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.119183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.139924 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3356/6728] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:46.149197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:46.178097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] MFA Rules not processed for user `5638e5732f6b4d5b84418b7c7906cf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:46.183456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:46.188737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319e86-e93d-426a-bd3f-8d77ed5c5a2a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:46.206052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3373/6729] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:46.212164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:46.213374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.213577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:46.213868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.214433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] PATH_INFO: `/v3/projects/9f4c2a4b78904db3b58d6625906a7451/users/a01a712b0ad54ed3887f06fa94dff872/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.249470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b52f2f-6cea-4698-b74e-e05cf7946b79 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:46.266263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:46.273258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.274526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.277467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4c2a4b78904db3b58d6625906a7451, user_id=a01a712b0ad54ed3887f06fa94dff872, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:46.282689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3497f-cf30-43c6-9f86-9f993ca7a64b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:46.290005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.292394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:create_trust()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:46.297015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:46.475990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3357/6730] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:46 2022] PUT /identity/v3/projects/9f4c2a4b78904db3b58d6625906a7451/users/a01a712b0ad54ed3887f06fa94dff872/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:46.501031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:46.502085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:46.503937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:46.691701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] MFA Rules not processed for user `a01a712b0ad54ed3887f06fa94dff872`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:46.694908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:46.749201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3374/6731] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 21:00:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:46.751969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:46.794068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5f340-069c-4e2a-8f5f-ab56a381d0d1 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.059127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.059548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:47.060460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.062110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.062614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.071376 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3358/6732] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:00:47.078411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:get_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.079924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.082052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.101022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9082a0-6ee6-426a-9f6d-bbba50f7e6c2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.103808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3375/6733] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:00:46 2022] GET /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed => generated 834 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:47.110484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a712b0ad54ed3887f06fa94dff872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f4c2a4b78904db3b58d6625906a7451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.112044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.112831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.113550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] PATH_INFO: `/v3/domains/default` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.115805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.126784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.131611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.137610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1d99-1118-4340-8641-1c8c19c95394 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.139242 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3359/6734] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 4 21:00:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:47.146008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.149662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.151471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.152532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.153545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.172229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.180432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.223544 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3376/6735] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 21:00:47 2022] GET /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles => generated 371 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:47.231611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.266693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af582fb-7514-4b63-96a6-d72a62079a5f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.280016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.281814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.282617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.283126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/12309f660c6f496cbe04c1485cb1239d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.329832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed, role_id=12309f660c6f496cbe04c1485cb1239d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.344905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.393764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3377/6736] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 21:00:47 2022] GET /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/12309f660c6f496cbe04c1485cb1239d => generated 244 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:47.395756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.451413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e3c23-c823-42ca-b48e-aad05e700f7f tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.476375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955cea7-080b-4e71-94a7-da770a8f9d5e tempest-DefaultDomainTestJSON-1172519934 tempest-DefaultDomainTestJSON-1172519934-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.480824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.482072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.482552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.483060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/12309f660c6f496cbe04c1485cb1239d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.495941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.497778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.498747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.499687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] PATH_INFO: `/v3/users/a01a712b0ad54ed3887f06fa94dff872` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.503847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01a712b0ad54ed3887f06fa94dff872)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.510500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.524464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed, role_id=12309f660c6f496cbe04c1485cb1239d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.527429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.556824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:47.571200 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3378/6737] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 21:00:47 2022] HEAD /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/12309f660c6f496cbe04c1485cb1239d => generated 0 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 04 21:00:47.578007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.622336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99641-f743-414e-a2b9-b4710a11088e tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.643435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.644699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.645201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.645703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/85c82ee355044422b3bda80cc88739cb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.660448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed, role_id=85c82ee355044422b3bda80cc88739cb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.665469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Could not find role: 85c82ee355044422b3bda80cc88739cb.: keystone.exception.RoleNotFound: Could not find role: 85c82ee355044422b3bda80cc88739cb. Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:00:47.708181 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 85c82ee355044422b3bda80cc88739cb. Oct 04 21:00:47.711280 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:47.718144 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3379/6738] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 21:00:47 2022] GET /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/85c82ee355044422b3bda80cc88739cb => generated 110 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 04 21:00:47.727371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.765911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50670df-a432-42f0-9f13-4a5f16e3edc3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.783604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.785002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `HEAD` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.785512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.786072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/85c82ee355044422b3bda80cc88739cb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.802667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed, role_id=85c82ee355044422b3bda80cc88739cb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.805939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Could not find role: 85c82ee355044422b3bda80cc88739cb.: keystone.exception.RoleNotFound: Could not find role: 85c82ee355044422b3bda80cc88739cb. Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:00:47.843446 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 85c82ee355044422b3bda80cc88739cb. Oct 04 21:00:47.845088 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:47.848269 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3380/6739] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 21:00:47 2022] HEAD /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed/roles/85c82ee355044422b3bda80cc88739cb => generated 0 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:00:47.855118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:47.906014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01a712b0ad54ed3887f06fa94dff872'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:47.911660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190ce8-a964-42e2-8821-02475da1a4b3 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:47.941476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:47.947668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:47.947668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:47.947668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:47.977044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorizing `identity:delete_trust(trust_id=8acaedc5b4cf42c2a478863e983ca6ed)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:47.981297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:48.011999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01a712b0ad54ed3887f06fa94dff872'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.046120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01a712b0ad54ed3887f06fa94dff872'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.095192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01a712b0ad54ed3887f06fa94dff872'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.102142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-137f6f5a-04c6-445f-a791-aa6016f830a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01a712b0ad54ed3887f06fa94dff872'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.129152 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3360/6740] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:47 2022] DELETE /identity/v3/users/a01a712b0ad54ed3887f06fa94dff872 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:48.133437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:48.134110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:48.135783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:48.143239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8acaedc5b4cf42c2a478863e983ca6ed', 'request_id': 'req-e945b7b6-d910-4b39-bd8b-ed78321ee03c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.146634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8acaedc5b4cf42c2a478863e983ca6ed', 'request_id': 'req-e945b7b6-d910-4b39-bd8b-ed78321ee03c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.149170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8acaedc5b4cf42c2a478863e983ca6ed', 'request_id': 'req-e945b7b6-d910-4b39-bd8b-ed78321ee03c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:48.189880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:48.192985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:48.280334 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3381/6741] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:00:47 2022] DELETE /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:00:48.287710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:48.296378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:48.338017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b7b6-d910-4b39-bd8b-ed78321ee03c tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:48.378621 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3361/6742] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:48.433530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:48.437051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:48.498349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:48.562481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5638e5732f6b4d5b84418b7c7906cf0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '887696004b394ed89f51cae269e01512', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1117994095', 'tempest-DelegatedRole-1073575433'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:48.565114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:48.565743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:48.566296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] PATH_INFO: `/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Could not find trust: 8acaedc5b4cf42c2a478863e983ca6ed.: keystone.exception.TrustNotFound: Could not find trust: 8acaedc5b4cf42c2a478863e983ca6ed. Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 04 21:00:48.652616 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8acaedc5b4cf42c2a478863e983ca6ed. Oct 04 21:00:48.654463 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:00:48.664043 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3382/6743] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:00:48 2022] GET /identity/v3/OS-TRUST/trusts/8acaedc5b4cf42c2a478863e983ca6ed => generated 111 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 04 21:00:48.665812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:48.672337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:48.743224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006fbc5-30a3-4cfb-a9bc-e8c9f67d21f2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:48.759200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:48.764544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:48.765071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:48.765619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:48.815697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:48.819363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:48.850223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3362/6744] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:48.926451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:48.936432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:49.033660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d85cad-d824-4eda-8837-4b511f5bc07d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:49.058532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:49.059550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:49.060169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:49.060778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] PATH_INFO: `/v3/projects/ab88ca8a33714534ac6f4e911c48e88a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:49.062154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dfa89-c350-46c7-b26a-4eba6c07baa8 tempest-TrustsV3TestJSON-1871451729 tempest-user-1109612722] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:49.066663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab88ca8a33714534ac6f4e911c48e88a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:49.072718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:49.077610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:49.077857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:49.078016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:49.078016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/85c82ee355044422b3bda80cc88739cb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:49.079045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=85c82ee355044422b3bda80cc88739cb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:49.081459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:49.406452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:49.439081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab88ca8a33714534ac6f4e911c48e88a', 'request_id': 'req-89b341e8-d8ba-4e6d-9239-8ce98633180e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.464427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab88ca8a33714534ac6f4e911c48e88a', 'request_id': 'req-89b341e8-d8ba-4e6d-9239-8ce98633180e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.483184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab88ca8a33714534ac6f4e911c48e88a', 'request_id': 'req-89b341e8-d8ba-4e6d-9239-8ce98633180e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.581175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 85c82ee355044422b3bda80cc88739cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:49.581912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.585814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.597254 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3383/6745] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:48 2022] DELETE /identity/v3/roles/85c82ee355044422b3bda80cc88739cb => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:49.605760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:49.607275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] The token cache is being invalidate because project ab88ca8a33714534ac6f4e911c48e88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:49.607779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.617612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:49.620056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89b341e8-d8ba-4e6d-9239-8ce98633180e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:49.629721 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3363/6746] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:48 2022] DELETE /identity/v3/projects/ab88ca8a33714534ac6f4e911c48e88a => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:00:49.632387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:49.632853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:49.633492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:49.744033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:49.758623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:49.940176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fa50e-b67a-4f5c-8508-89e02916a115 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:49.969841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:49.971039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:49.971690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:49.972199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/12309f660c6f496cbe04c1485cb1239d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:49.976301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12309f660c6f496cbe04c1485cb1239d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:49.978974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:50.039252 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3364/6747] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:50.048053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:50.056338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:50.087453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03fb0-3ebc-4020-a644-41a8d8dfea8f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:50.098009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:50.099253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:50.100576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:50.101921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] PATH_INFO: `/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:50.104966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6e751fcaaf430d964cd0eb9399aab6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:50.109738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:50.485210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 12309f660c6f496cbe04c1485cb1239d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:50.487373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.489124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c3affd8-1a47-4103-bc7f-7ebb9b22f090 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.500337 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3384/6748] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:49 2022] DELETE /identity/v3/roles/12309f660c6f496cbe04c1485cb1239d => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:50.503179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:50.503998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:50.504553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:50.511866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:50.552285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6e751fcaaf430d964cd0eb9399aab6', 'request_id': 'req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.552605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:50.554723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:50.572848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6e751fcaaf430d964cd0eb9399aab6', 'request_id': 'req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.603084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6e751fcaaf430d964cd0eb9399aab6', 'request_id': 'req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.733946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3385/6749] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:50.736400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:50.741959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:50.941732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] The token cache is being invalidate because project 9e6e751fcaaf430d964cd0eb9399aab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:50.946837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.948454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:50.956976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3365/6750] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:50 2022] DELETE /identity/v3/projects/9e6e751fcaaf430d964cd0eb9399aab6 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:50.960348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:50.969441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:51.010824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e9038-0220-49c1-a1c6-66fb4b264451 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:51.034729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:51.040423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:51.042334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:51.043179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/5638e5732f6b4d5b84418b7c7906cf0d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:51.047416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5638e5732f6b4d5b84418b7c7906cf0d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:51.056570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:51.062617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:51.272058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff0c7-e0cf-4ed6-a37e-e626e53bac74 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:51.288978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:51.290509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:51.291098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:51.291911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:51.293318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:51.293971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:51.297704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:51.337590 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3366/6751] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:51.339701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:51.343272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:51.387183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f814f-2713-4971-91ce-76e0fce18032 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:51.388273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5638e5732f6b4d5b84418b7c7906cf0d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:51.389948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5638e5732f6b4d5b84418b7c7906cf0d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:51.411713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:51.413272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:51.413867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:51.414449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] PATH_INFO: `/v3/users/5bb3eba82f04487689cae784b5bd92c7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:51.417242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb3eba82f04487689cae784b5bd92c7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:51.423336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:51.555357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5638e5732f6b4d5b84418b7c7906cf0d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:51.587111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5638e5732f6b4d5b84418b7c7906cf0d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:51.615694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5638e5732f6b4d5b84418b7c7906cf0d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:51.634517 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3386/6752] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:50 2022] DELETE /identity/v3/users/5638e5732f6b4d5b84418b7c7906cf0d => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:51.634517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:51.634517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:51.840378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dd747-2a04-43de-82a3-bee17be88f82 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:51.850808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:51.854480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:51.854480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:51.854480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] PATH_INFO: `/v3/projects/9f4c2a4b78904db3b58d6625906a7451` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:51.856273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4c2a4b78904db3b58d6625906a7451)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:51.860238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:51.941113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb3eba82f04487689cae784b5bd92c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.035522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb3eba82f04487689cae784b5bd92c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.072593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb3eba82f04487689cae784b5bd92c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.095088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4c2a4b78904db3b58d6625906a7451', 'request_id': 'req-cae6f903-db76-4a34-8611-2ec44fe90bc9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.108945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb3eba82f04487689cae784b5bd92c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.112012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb3eba82f04487689cae784b5bd92c7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.129156 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3367/6753] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:51 2022] DELETE /identity/v3/users/5bb3eba82f04487689cae784b5bd92c7 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:52.138121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:52.138121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:52.218034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4c2a4b78904db3b58d6625906a7451', 'request_id': 'req-cae6f903-db76-4a34-8611-2ec44fe90bc9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.238612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4c2a4b78904db3b58d6625906a7451', 'request_id': 'req-cae6f903-db76-4a34-8611-2ec44fe90bc9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.281484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] The token cache is being invalidate because project 9f4c2a4b78904db3b58d6625906a7451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:52.282001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.283310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:52.296723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3387/6754] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:51 2022] DELETE /identity/v3/projects/9f4c2a4b78904db3b58d6625906a7451 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:52.296723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:52.300207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:52.331395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325835d-c149-46ea-9097-f4b73d50e492 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:52.367169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:52.369179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:52.369179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:52.370656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:52.372471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:52.378495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cebb7-1885-4cd0-9950-5b139e7b1453 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:52.487571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f903-db76-4a34-8611-2ec44fe90bc9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:52.564205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:52.582493 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3368/6755] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:52 2022] POST /identity/v3/projects => generated 371 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:52.607339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:52.607339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:52.607339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:52.701316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:52.754831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:52.768083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:52.847186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:52.848400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:52.850291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:52.851100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/887696004b394ed89f51cae269e01512` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:52.854820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=887696004b394ed89f51cae269e01512)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:52.865618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.035026 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3369/6756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:53.036196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.039514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:53.068001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ad6ba-14ed-4f64-af9b-47cce10b2eb0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:53.080388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:53.081897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.082400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.083227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.085058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:53.089784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b75-d7f2-4375-8b60-983c0e81b9ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.325316 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3370/6757] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:53 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:53.326458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887696004b394ed89f51cae269e01512', 'request_id': 'req-a9ab6152-3293-4779-86e4-74de46bf472e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:53.327827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.332049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.332730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.399673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:53.405528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:53.625278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3371/6758] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:53.627302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.652449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61a62-7158-4ac5-ac7d-e85cfd56f83e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:53.666616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:53.673148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.673148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.673148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.673148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:53.680336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.699345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887696004b394ed89f51cae269e01512', 'request_id': 'req-a9ab6152-3293-4779-86e4-74de46bf472e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:53.712993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887696004b394ed89f51cae269e01512', 'request_id': 'req-a9ab6152-3293-4779-86e4-74de46bf472e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:53.752655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3372/6759] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:53.767987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.791824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project 887696004b394ed89f51cae269e01512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:53.792209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:53.793469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:53.801794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f02096-939d-44b5-8de7-936dbf23df50 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:53.803302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3388/6760] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:52 2022] DELETE /identity/v3/projects/887696004b394ed89f51cae269e01512 => generated 0 bytes in 1515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:53.804534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.813236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:53.819366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:53.820956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.821670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.822407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.823657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:00:53.824336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:53.827843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.842887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6152-3293-4779-86e4-74de46bf472e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:53.857244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea811-e540-4738-855d-70790dc007af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:53.859125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea811-e540-4738-855d-70790dc007af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.859789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea811-e540-4738-855d-70790dc007af admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.860377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea811-e540-4738-855d-70790dc007af admin admin] PATH_INFO: `/v3/projects/fada00d6c093462d9c08c33cd52626b4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.864467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ea811-e540-4738-855d-70790dc007af admin admin] RBAC: Authorizing `identity:delete_project(project_id=fada00d6c093462d9c08c33cd52626b4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:53.873101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ea811-e540-4738-855d-70790dc007af admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.887839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3373/6761] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:00:53.890337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.898096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:53.921374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937c776-3dcd-4522-b94c-dd3a0199f064 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:53.930044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:53.931038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:53.932355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:53.932355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:53.933177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:53.936936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:53.958101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3374/6762] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:53.960020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:53.963096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:54.149077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fada00d6c093462d9c08c33cd52626b4', 'request_id': 'req-186ea811-e540-4738-855d-70790dc007af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:54.234175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a73f8-dd31-4a55-87f2-c44e9c1a783b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:54.247309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fada00d6c093462d9c08c33cd52626b4', 'request_id': 'req-186ea811-e540-4738-855d-70790dc007af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:54.271074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fada00d6c093462d9c08c33cd52626b4', 'request_id': 'req-186ea811-e540-4738-855d-70790dc007af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:54.324236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] The token cache is being invalidate because project fada00d6c093462d9c08c33cd52626b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:00:54.325284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:54.326555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:54.331916 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3389/6763] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:53 2022] DELETE /identity/v3/projects/fada00d6c093462d9c08c33cd52626b4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:54.333470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:54.344049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:54.483843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:54.490530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:54.491311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:54.491876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:54.494962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:54.507338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:54.583171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:54.608708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:54.739675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3375/6764] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 4 21:00:53 2022] POST /identity/v3/projects => generated 327 bytes in 781 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:54.741217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:54.758712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:54.765174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea811-e540-4738-855d-70790dc007af admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:55.073154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0586d12-c150-4b46-a844-e6f3f4310876 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:55.103222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:55.104267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:55.104777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:55.107531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:55.107746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:55.108539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:55.111703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:55.112285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:55.112859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] PATH_INFO: `/v3/projects/e9ad129f27e84d8389d5367ef542a543/users/03b5d69641cb42928edf54c3b919732e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:55.115881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:55.199720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ad129f27e84d8389d5367ef542a543, user_id=03b5d69641cb42928edf54c3b919732e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:55.224667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:55.312926 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3390/6765] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:00:54 2022] POST /identity/v3/projects => generated 377 bytes in 980 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:55.328678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:55.334036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:55.354103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3376/6766] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:54 2022] PUT /identity/v3/projects/e9ad129f27e84d8389d5367ef542a543/users/03b5d69641cb42928edf54c3b919732e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:55.357357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:55.368760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:55.490209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:55.674995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6080de-e90e-492d-890b-f63caa8c49f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:55.690024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f4e1-54ea-4b3b-9d12-96a0bb012dbe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:55.704298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:55.705981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:55.706821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:55.707751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:55.710022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:55.714699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:55.935621 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3377/6767] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:55 2022] POST /identity/v3/users => generated 413 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:55.940185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:56.013367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:56.014456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:56.014856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:56.015383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] PATH_INFO: `/v3/users/66be740f793641daa240fb18364ea410` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:56.019048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66be740f793641daa240fb18364ea410)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:56.023589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:56.209584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a683-5311-47d2-9271-6f5c0c94869a tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:56.254207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:56.266707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:56.280228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:56.280927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:56.282186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:56.289151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc246dbd-bcac-401b-9df5-9d349702ed08 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:56.378988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:56.386392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:56.500754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3378/6768] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:00:55 2022] POST /identity/v3/users => generated 289 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:56.507505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:56.508151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:56.508645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:56.525358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:56.593470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:56.641482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] MFA Rules not processed for user `03b5d69641cb42928edf54c3b919732e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:56.644393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:56.651722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66be740f793641daa240fb18364ea410'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:56.707894 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3391/6769] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:55 2022] DELETE /identity/v3/users/66be740f793641daa240fb18364ea410 => generated 0 bytes in 1383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:56.717197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:56.735849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:56.745564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:56.986859 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3379/6770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:56.986859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:57.027223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:57.112160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20675-b560-41f6-83ab-037f4aa9418a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:57.117195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935fd7-ad97-422d-b617-c300d2064b48 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:57.136638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:57.137373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:57.140829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:57.143851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:57.154377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:57.157892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:57.250834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:57.296841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3392/6771] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:56 2022] POST /identity/v3/roles => generated 244 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:57.299023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:57.305015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:57.371064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:57.372805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:57.373672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:57.374638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:57.376832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:57.381614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:57.415603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:57.426543 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3380/6772] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:56 2022] GET /identity/v3/roles => generated 1655 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:57.428553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:57.476482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09233d-6cf7-4138-89a0-58fe8154d666 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:57.531812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:57.534741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:57.535439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:57.536439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:57.538412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:57.542087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:57.607695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b8907-b873-45b2-b349-8e5758f17f09 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:57.628668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:57.631504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:57.635403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:57.635403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:57.759466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3381/6773] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 4 21:00:57 2022] POST /identity/v3/roles => generated 247 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:00:57.763379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:57.870993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ff61-3f8c-43ea-a81d-c5a6f2bae73b tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:57.884552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:57.901977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:57.904379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:57.904947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:57.916714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:57.918171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:57.958165 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3382/6774] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:57 2022] GET /identity/v3/roles => generated 1893 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:00:57.958165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:58.000657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:58.015825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:58.028667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba2212-34b6-4ea6-8de6-7a58c9d3e12a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:58.054838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:58.056584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:58.057403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:58.060182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/f90383073e2341b0a715c2f581df793b/users/71af316a5fa14538affe8cb5ed70b2f3/roles/596eab1021344796b3106790861f7487` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:58.062293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3393/6775] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:00:58.082234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:58.125156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f90383073e2341b0a715c2f581df793b, user_id=71af316a5fa14538affe8cb5ed70b2f3, role_id=596eab1021344796b3106790861f7487)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:58.141049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0798fd4-990b-470b-9118-3c627d07202e service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:58.141889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:58.160426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:58.162426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:58.162426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:58.162426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] PATH_INFO: `/v3/projects/e374235b0aa04257b4a95733728540f3/users/3dd22200c78348c1816f705533d605bd/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:58.199921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e374235b0aa04257b4a95733728540f3, user_id=3dd22200c78348c1816f705533d605bd, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:58.207360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:58.266690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3383/6776] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:57 2022] PUT /identity/v3/projects/f90383073e2341b0a715c2f581df793b/users/71af316a5fa14538affe8cb5ed70b2f3/roles/596eab1021344796b3106790861f7487 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:58.266690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:58.269568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:58.387440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3394/6777] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:58 2022] PUT /identity/v3/projects/e374235b0aa04257b4a95733728540f3/users/3dd22200c78348c1816f705533d605bd/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:58.391255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:58.514849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13f1-ee69-46a4-a84f-aa755425ada5 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:58.725952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786531-1ce0-42d3-acdf-2404c1010bda admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:58.748947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:58.749703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:58.750068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:58.750425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/f90383073e2341b0a715c2f581df793b/users/71af316a5fa14538affe8cb5ed70b2f3/roles/fbfd3e87f4e6417c9f784a6c7d656264` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:58.758815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f90383073e2341b0a715c2f581df793b, user_id=71af316a5fa14538affe8cb5ed70b2f3, role_id=fbfd3e87f4e6417c9f784a6c7d656264)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:58.773339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b337c-cc37-441f-bece-a0f41097c9fc tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:58.795094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:58.800483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:58.800483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:58.800483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] PATH_INFO: `/v3/users/03b5d69641cb42928edf54c3b919732e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:58.801342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b5d69641cb42928edf54c3b919732e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:58.806020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:00:58.970762 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3395/6778] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:00:58 2022] PUT /identity/v3/projects/f90383073e2341b0a715c2f581df793b/users/71af316a5fa14538affe8cb5ed70b2f3/roles/fbfd3e87f4e6417c9f784a6c7d656264 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:58.974128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:58.975802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:58.976905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:59.024500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:59.105711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] MFA Rules not processed for user `3dd22200c78348c1816f705533d605bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:00:59.108757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:59.273345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b5d69641cb42928edf54c3b919732e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:59.321692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:59.430207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b5d69641cb42928edf54c3b919732e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:59.472225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b5d69641cb42928edf54c3b919732e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:59.508667 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3396/6779] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:00:59.510338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:59.517300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:59.531642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b5d69641cb42928edf54c3b919732e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:59.536091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b5d69641cb42928edf54c3b919732e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:00:59.562993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3384/6780] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:00:58 2022] DELETE /identity/v3/users/03b5d69641cb42928edf54c3b919732e => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:00:59.564745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:00:59.567951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:00:59.892803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff508-c0b5-444f-a319-86f62acb45e4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:59.966426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e83e2-20f8-4fc8-85bf-f75e1c0eb89e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:00:59.976637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:00:59.978026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:00:59.978668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:00:59.979327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:00:59.981169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:00:59.985650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:00.058665 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3385/6781] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:00:59 2022] GET /identity/v3/users => generated 7482 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:00.060542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:00.064014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:00.224156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:00.225263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:00.225771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:00.235709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] PATH_INFO: `/v3/projects/8df610a8884f449b9d4723d97957a2a6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:00.238899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df610a8884f449b9d4723d97957a2a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:00.245323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:00.282745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6154fe7-848d-47f7-882b-dbec389df07e tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:00.304781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:00.306024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:00.306529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:00.307038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:00.308400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:00.326145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810649-e5aa-43cb-935d-bb7041662277 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:00.520039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df610a8884f449b9d4723d97957a2a6', 'request_id': 'req-ff8319b6-21e8-4510-af6d-c357d2c98265'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:00.548684 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3386/6782] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:00 2022] POST /identity/v3/projects => generated 375 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:00.551760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:00.553145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:00.554015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:00.600410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:00.605761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:00.656482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:00.666785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df610a8884f449b9d4723d97957a2a6', 'request_id': 'req-ff8319b6-21e8-4510-af6d-c357d2c98265'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:00.698598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df610a8884f449b9d4723d97957a2a6', 'request_id': 'req-ff8319b6-21e8-4510-af6d-c357d2c98265'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:00.748172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] The token cache is being invalidate because project 8df610a8884f449b9d4723d97957a2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:00.748172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:00.757257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ff8319b6-21e8-4510-af6d-c357d2c98265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:00.761343 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3397/6783] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:00:59 2022] DELETE /identity/v3/projects/8df610a8884f449b9d4723d97957a2a6 => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:00.770660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fa1f-5d97-4e82-b374-d2d40865917f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:00.773746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fa1f-5d97-4e82-b374-d2d40865917f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:00.773746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fa1f-5d97-4e82-b374-d2d40865917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:00.838103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:00.895498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3387/6784] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:00.898354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:00.901707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:00.913083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4f13fa1f-5d97-4e82-b374-d2d40865917f None None] MFA Rules not processed for user `71af316a5fa14538affe8cb5ed70b2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:00.916544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f13fa1f-5d97-4e82-b374-d2d40865917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:00.942419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6efb-91b2-4861-a8ba-bbb34e25135c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:00.955442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:00.957355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:00.959341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:00.960178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:00.962481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:00.967671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fcb87-d779-4bc2-ac79-79f4e47da6b9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:01.084376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3398/6785] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:01.087088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.087538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.088090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.137919 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3388/6786] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:00 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:01.143588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.145578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:01.148849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:01.159652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.160552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.191466 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3399/6787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:01.201959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.204848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:01.285430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] MFA Rules not processed for user `71af316a5fa14538affe8cb5ed70b2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:01.296073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:01.329718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3389/6788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:01.334624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.376775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54d2ff-4f4c-405b-b02c-b43154ece0a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:01.399848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:01.400968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.401469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.401973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.403114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:01.406129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a58a-c68a-467c-9854-6fcc51d1a9f0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:01.452722 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3390/6789] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:01 2022] GET /identity/v3/roles => generated 1893 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:01.460645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae356b-8314-4cba-bffe-46ca8cc7f284 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:01.469729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.470109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:01.470298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.470775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.471048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.472158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.473068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.499723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:01.508514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:01.541675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:01.543584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:01.546024 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3400/6790] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:01.547872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.575239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316fbde-307d-4bdb-a1ce-8ce931e6ad41 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:01.579443 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3391/6791] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:01.581120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.592484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:01.593641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.594139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.595170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.596711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:create_trust()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:01.599061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:01.612046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acd00c-b961-4bed-a627-8f65e73c3e70 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:01.631513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:01.632886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:01.633403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:01.633853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] PATH_INFO: `/v3/projects/d707b239f54e4f1192cd13ffdb6ee144/users/cd3e6d09ab29406eb6918ad57c5385ec/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:01.697884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d707b239f54e4f1192cd13ffdb6ee144, user_id=cd3e6d09ab29406eb6918ad57c5385ec, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:01.711780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:01.838410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3392/6792] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:01 2022] PUT /identity/v3/projects/d707b239f54e4f1192cd13ffdb6ee144/users/cd3e6d09ab29406eb6918ad57c5385ec/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:01.841815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.941012 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3401/6793] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 4 21:01:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:01.942668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:01.986696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5c3ee-0754-4a10-8b33-db87f33b93e5 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.066101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:02.093400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7b2e-2cf0-4a75-89c3-ea4460ede2d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.105049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.108712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.109541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.110212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.113037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:02.113655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.117707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.179463 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3393/6794] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:02.181853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:02.237611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.239012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.239841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.240419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.241841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.245180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.281898 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3402/6795] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:01 2022] GET /identity/v3/roles => generated 1893 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:02.281898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:02.302949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77befd-3a0a-4ed9-9897-3299387a195c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.314566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.315781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.316466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.317120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.319181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.324227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.355623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:02.364737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f9d8b-65dd-4d2b-ad69-e0a7101228d9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.375815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.378003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.378725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.379420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.393137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:get_trust(trust_id=e731006c7736475090963df6818c92de)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.399196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.417513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3394/6796] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:01:02 2022] GET /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de => generated 835 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:02.417513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:02.450664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510104-ce54-4218-8a1a-45157c9abcd9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.463948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.473504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.473504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.473504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] PATH_INFO: `/v3/projects/d707b239f54e4f1192cd13ffdb6ee144/users/cd3e6d09ab29406eb6918ad57c5385ec/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.473504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d707b239f54e4f1192cd13ffdb6ee144, user_id=cd3e6d09ab29406eb6918ad57c5385ec, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.477607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.506508 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3403/6797] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:02 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:02.508653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:02.519405 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3395/6798] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:02 2022] PUT /identity/v3/projects/d707b239f54e4f1192cd13ffdb6ee144/users/cd3e6d09ab29406eb6918ad57c5385ec/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:02.519405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:02.691442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8cdd-ae10-45a3-b35e-320935cb77cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.700380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.702447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.703173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.704755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.717550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c5ea1-28c6-44e1-9ce3-7ff8005840ac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:02.720791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e731006c7736475090963df6818c92de)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.725680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e68723-b65e-47e0-9e1c-95352914ef75 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:02.754796 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3404/6799] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 4 21:01:02 2022] GET /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles => generated 371 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:02.758005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.758943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.759742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.842996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] MFA Rules not processed for user `cd3e6d09ab29406eb6918ad57c5385ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:02.846227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:02.879975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:02.880283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:02.880989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:02.884728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:02.884728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:02.888581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.043304 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3405/6800] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:03.045440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.063421 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3396/6801] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:02 2022] POST /identity/v3/users => generated 285 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:03.065174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.076465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b744de-b9dd-4b74-a5f3-db38908518d8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.088906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.088906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.088906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.089733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/596eab1021344796b3106790861f7487` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.103726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096370-707f-487d-8bc6-8d38ef041100 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.105702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e731006c7736475090963df6818c92de, role_id=596eab1021344796b3106790861f7487)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.110447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.115943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.117064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:03.117981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.118502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.119073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.120781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.125867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.136219 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3406/6802] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/596eab1021344796b3106790861f7487 => generated 244 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:03.138618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.152508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3397/6803] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/roles => generated 1893 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:03.155747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.195564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb90b5-04a7-4edc-b5dc-be9759766233 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.211936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.213073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.214100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.214867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/596eab1021344796b3106790861f7487` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.234008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e731006c7736475090963df6818c92de, role_id=596eab1021344796b3106790861f7487)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.238094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.270299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3398/6804] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 21:01:03 2022] HEAD /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/596eab1021344796b3106790861f7487 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 04 21:01:03.270299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.305306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37c78-8fa2-4237-91a6-33bcb1a408f1 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.328097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.328711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.331324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.332107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.335357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.335777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8183fd-7c3e-446b-b374-18ebf0831d7a tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.340426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.345339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.346694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.347491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.347990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.372766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.376162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.390239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3399/6805] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/roles => generated 1893 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:03.391856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.406227 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3407/6806] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:03.408772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.413399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da48b4-2bcb-4091-a68e-0a5a0aa61e39 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.421834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.423306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.423306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.423617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/fbfd3e87f4e6417c9f784a6c7d656264` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.432304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811ab9-d0ef-4ebc-8ed9-d3edfcc00930 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.436510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e731006c7736475090963df6818c92de, role_id=fbfd3e87f4e6417c9f784a6c7d656264)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.440583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.444803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.445380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.446520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.448112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] PATH_INFO: `/v3/projects/0ece750da596456dbaa139c4937faabe/users/9e2e3ecc00374307a38b6f42ad77f0ba/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Could not find role: fbfd3e87f4e6417c9f784a6c7d656264.: keystone.exception.RoleNotFound: Could not find role: fbfd3e87f4e6417c9f784a6c7d656264. Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:01:03.466798 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fbfd3e87f4e6417c9f784a6c7d656264. Oct 04 21:01:03.468815 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:01:03.469504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3400/6807] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/fbfd3e87f4e6417c9f784a6c7d656264 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:01:03.475329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.494266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ece750da596456dbaa139c4937faabe, user_id=9e2e3ecc00374307a38b6f42ad77f0ba, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.499306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbde69-b464-4ffc-a08f-35c5baf12ba9 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.504272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a21bf-d4c3-4873-ba32-2780b75a8c03 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.513189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.516482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `HEAD` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.517117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.517802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/fbfd3e87f4e6417c9f784a6c7d656264` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.542119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e731006c7736475090963df6818c92de, role_id=fbfd3e87f4e6417c9f784a6c7d656264)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.546411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.549744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Could not find role: fbfd3e87f4e6417c9f784a6c7d656264.: keystone.exception.RoleNotFound: Could not find role: fbfd3e87f4e6417c9f784a6c7d656264. Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 21:01:03.573159 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fbfd3e87f4e6417c9f784a6c7d656264. Oct 04 21:01:03.575449 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:01:03.579192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3401/6808] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 4 21:01:03 2022] HEAD /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de/roles/fbfd3e87f4e6417c9f784a6c7d656264 => generated 0 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:01:03.587294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.622250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4700-5263-4d8f-a59e-0c8d64846167 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:03.633014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:03.654877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.657807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.659864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.665876 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3408/6809] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:03 2022] PUT /identity/v3/projects/0ece750da596456dbaa139c4937faabe/users/9e2e3ecc00374307a38b6f42ad77f0ba/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:03.683441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorizing `identity:delete_trust(trust_id=e731006c7736475090963df6818c92de)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:03.694075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:03.694075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:03.694075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:03.699003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:03.812219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] MFA Rules not processed for user `9e2e3ecc00374307a38b6f42ad77f0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:03.814827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:03.845774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e731006c7736475090963df6818c92de', 'request_id': 'req-26399f21-67b5-4ca5-942a-20b0a6560c7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:03.847056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e731006c7736475090963df6818c92de', 'request_id': 'req-26399f21-67b5-4ca5-942a-20b0a6560c7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:03.848772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e731006c7736475090963df6818c92de', 'request_id': 'req-26399f21-67b5-4ca5-942a-20b0a6560c7f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:03.971124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3402/6810] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 4 21:01:03 2022] DELETE /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:01:03.980541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:03.989887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:04.035733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26399f21-67b5-4ca5-942a-20b0a6560c7f tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.089918 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3409/6811] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:04.095630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.165265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020034a-a32d-463e-a67c-aa542b987d3b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.187101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2e3ecc00374307a38b6f42ad77f0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ece750da596456dbaa139c4937faabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.188320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.188834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.194906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.210785 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3410/6812] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 4 21:01:04 2022] GET /identity/v3 => generated 255 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:04.211488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.256225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37b66a-4216-44ed-96a3-bbe5b60d1ba7 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.275781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2e3ecc00374307a38b6f42ad77f0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ece750da596456dbaa139c4937faabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.281051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.283099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71af316a5fa14538affe8cb5ed70b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f90383073e2341b0a715c2f581df793b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781675919', 'tempest-DelegatedRole-1307763186'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.284296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.284862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.287532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.289995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.296676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] PATH_INFO: `/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.297090 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3411/6813] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 4 21:01:04 2022] GET /identity/v3 => generated 255 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:04.299201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Could not find trust: e731006c7736475090963df6818c92de.: keystone.exception.TrustNotFound: Could not find trust: e731006c7736475090963df6818c92de. Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 04 21:01:04.337405 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e731006c7736475090963df6818c92de. Oct 04 21:01:04.338992 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:01:04.344477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3403/6814] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 4 21:01:03 2022] GET /identity/v3/OS-TRUST/trusts/e731006c7736475090963df6818c92de => generated 111 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:01:04.345366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1220c51-378e-489a-8853-a8d180bd6e61 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.352821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.356914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:04.369138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455c95-7b09-4ca6-ac17-63ea22b6d841 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e2e3ecc00374307a38b6f42ad77f0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ece750da596456dbaa139c4937faabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.372662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455c95-7b09-4ca6-ac17-63ea22b6d841 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.372662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455c95-7b09-4ca6-ac17-63ea22b6d841 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.372662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455c95-7b09-4ca6-ac17-63ea22b6d841 tempest-TestApiDiscovery-1919223868 tempest-TestApiDiscovery-1919223868-project] PATH_INFO: `/v3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.383189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3412/6815] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 4 21:01:04 2022] GET /identity/v3 => generated 255 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:04.385855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0547-f5a0-4518-89b4-a100115dd8ee None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.390677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0547-f5a0-4518-89b4-a100115dd8ee None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.391280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0547-f5a0-4518-89b4-a100115dd8ee None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.402757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3413/6816] 10.222.0.78 () {56 vars in 895 bytes} [Tue Oct 4 21:01:04 2022] GET /identity/ => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 21:01:04.404229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.404801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.405540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.414955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3414/6817] 10.222.0.78 () {56 vars in 895 bytes} [Tue Oct 4 21:01:04 2022] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 21:01:04.418791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.426513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:04.566986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:04.633650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0416bf-3f7f-45fd-b139-7aeca78405b0 tempest-TrustsV3TestJSON-15254805 tempest-user-371448620] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.650049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d25cf-6440-4881-ba36-361ae5a676ad None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:04.666460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.671951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.673035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.674027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/fbfd3e87f4e6417c9f784a6c7d656264` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.681912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbfd3e87f4e6417c9f784a6c7d656264)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:04.687015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:04.698061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:04.703252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:04.704237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:04.704935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] PATH_INFO: `/v3/users/9e2e3ecc00374307a38b6f42ad77f0ba` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:04.707765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2e3ecc00374307a38b6f42ad77f0ba)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:04.713004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:04.985005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role fbfd3e87f4e6417c9f784a6c7d656264 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:04.985536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:04.987086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:04.992773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3404/6818] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:04 2022] DELETE /identity/v3/roles/fbfd3e87f4e6417c9f784a6c7d656264 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:04.994632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:04.997320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:05.054687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2e3ecc00374307a38b6f42ad77f0ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.058233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2e3ecc00374307a38b6f42ad77f0ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.103767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:05.193885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2e3ecc00374307a38b6f42ad77f0ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.244668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2e3ecc00374307a38b6f42ad77f0ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.254278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ce4d-7bdd-4eb5-98e4-143151485f95 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:05.277275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:05.278941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:05.278941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:05.280069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] PATH_INFO: `/v3/projects/e9ad129f27e84d8389d5367ef542a543` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:05.284870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ad129f27e84d8389d5367ef542a543)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:05.292600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2e3ecc00374307a38b6f42ad77f0ba'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.296843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:05.341803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3415/6819] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:04 2022] DELETE /identity/v3/users/9e2e3ecc00374307a38b6f42ad77f0ba => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:05.343781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:05.348617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:05.585703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ad129f27e84d8389d5367ef542a543', 'request_id': 'req-4ae1aff3-5525-4184-bc58-c4b373484ef6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.610701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ad129f27e84d8389d5367ef542a543', 'request_id': 'req-4ae1aff3-5525-4184-bc58-c4b373484ef6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.622084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c08b85-0d3c-47d6-8078-7c90ffca849a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:05.634382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ad129f27e84d8389d5367ef542a543', 'request_id': 'req-4ae1aff3-5525-4184-bc58-c4b373484ef6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.796469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] The token cache is being invalidate because project e9ad129f27e84d8389d5367ef542a543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:05.797427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.803598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4ae1aff3-5525-4184-bc58-c4b373484ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:05.811178 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3405/6820] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:04 2022] DELETE /identity/v3/projects/e9ad129f27e84d8389d5367ef542a543 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:05.814682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3442-db19-41ed-bf82-f5df7f8661fb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:05.815630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3442-db19-41ed-bf82-f5df7f8661fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:05.817404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3442-db19-41ed-bf82-f5df7f8661fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:05.836291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:05.837404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:05.838136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:05.838821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/roles/596eab1021344796b3106790861f7487` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:05.841938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_role(role_id=596eab1021344796b3106790861f7487)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:05.845877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:05.885363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4cfa3442-db19-41ed-bf82-f5df7f8661fb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:05.887718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4cfa3442-db19-41ed-bf82-f5df7f8661fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.001569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:06.012827 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3406/6821] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:06.016025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:06.017834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:06.034390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:06.101230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:06.104481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.135741 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3407/6822] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:06.138144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:06.141091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.169454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invalidating the token cache because role 596eab1021344796b3106790861f7487 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:06.170287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:06.173056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4a4a56f7-e438-490e-a82d-b20e68483b52 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:06.189204 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3416/6823] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:05 2022] DELETE /identity/v3/roles/596eab1021344796b3106790861f7487 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:06.195567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:06.196262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:06.196877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:06.253312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:06.256646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.377035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b768-2630-4d6b-bd83-592db22e0353 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:06.444036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:06.497299 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3417/6824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:06.499377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:06.502688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.701170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:06.702252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:06.702677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:06.703125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:06.711603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:06.775505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922b46-426a-4378-962f-7e3dd3663dd5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:06.786606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:06.788711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:06.790918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:06.791663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:06.792788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/users/71af316a5fa14538affe8cb5ed70b2f3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:06.800701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:06.800878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_user(user_id=71af316a5fa14538affe8cb5ed70b2f3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:06.812849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:06.868655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3408/6825] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:06.871348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:06.915392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352726e-4713-4876-9d30-089a7a32c491 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:06.937425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:06.938803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:06.940741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:06.948969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:06.951571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:06.952259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:06.956565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:07.020162 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3409/6826] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:07.028417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:07.064736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a8216-f0b3-4b95-9994-948fa0a003e1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:07.080852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71af316a5fa14538affe8cb5ed70b2f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:07.085087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71af316a5fa14538affe8cb5ed70b2f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:07.113125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:07.114281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:07.114835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:07.119831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:07.131070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:07.131070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:07.206758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71af316a5fa14538affe8cb5ed70b2f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:07.257325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71af316a5fa14538affe8cb5ed70b2f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:07.281676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71af316a5fa14538affe8cb5ed70b2f3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:07.310179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3418/6827] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:06 2022] DELETE /identity/v3/users/71af316a5fa14538affe8cb5ed70b2f3 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:07.318755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:07.343003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:07.401868 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3410/6828] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:07 2022] POST /identity/v3/projects => generated 391 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:01:07.408644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:07.412206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:07.756736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa427-ba19-4e42-9461-bc83b7a47c4d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:07.772390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:07.774532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:07.776100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:07.776602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:07.781869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:07.790196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884351c-633a-47af-83f7-89197431d0e6 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:07.790450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:07.981778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3411/6829] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:07 2022] POST /identity/v3/users => generated 296 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:07.992418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:08.043878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221536cf-f733-44ae-99c4-92ef6ec0279c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:08.047307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:08.068325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:08.072425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:08.073927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660909b1faf74d35bdf949e9aeafbe6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53abb09a4275438aa28bca0ada5565df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:08.076933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:08.076933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:08.077304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:08.077304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:08.077304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] PATH_INFO: `/v3/projects/f90383073e2341b0a715c2f581df793b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:08.080142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f90383073e2341b0a715c2f581df793b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:08.080833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:08.084014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:08.085375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:08.120018 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3412/6830] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:08.128566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:08.169061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd6c49-3699-437c-bb4b-6f43d7e38039 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:08.183286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:08.185373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:08.185991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:08.186726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:08.189271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:08.193873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:08.229028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3413/6831] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:08.236015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:08.261293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8e14f-bbf9-4e0c-bd70-4f2c40547840 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:08.275573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:08.278211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:08.279060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:08.279965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] PATH_INFO: `/v3/projects/98ce5f7990b74f0f956eeabc4adb3c44/users/3352fd9f96b844dfb63870cfff7b0718/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:08.328560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ce5f7990b74f0f956eeabc4adb3c44, user_id=3352fd9f96b844dfb63870cfff7b0718, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:08.337583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5673dd-5cff-4d4b-9a64-327529e56dcd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:08.787051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90383073e2341b0a715c2f581df793b', 'request_id': 'req-28a74114-47a7-4751-a2f4-80bf25a6df61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:08.854285 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3414/6832] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:08 2022] PUT /identity/v3/projects/98ce5f7990b74f0f956eeabc4adb3c44/users/3352fd9f96b844dfb63870cfff7b0718/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:08.865434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:08.866652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:08.867708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:08.982813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] MFA Rules not processed for user `3352fd9f96b844dfb63870cfff7b0718`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:08.986439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:09.023187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:09.095562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90383073e2341b0a715c2f581df793b', 'request_id': 'req-28a74114-47a7-4751-a2f4-80bf25a6df61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:09.116185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90383073e2341b0a715c2f581df793b', 'request_id': 'req-28a74114-47a7-4751-a2f4-80bf25a6df61'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:09.168822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] The token cache is being invalidate because project f90383073e2341b0a715c2f581df793b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:09.171184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:09.172596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:09.186702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3419/6833] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:07 2022] DELETE /identity/v3/projects/f90383073e2341b0a715c2f581df793b => generated 0 bytes in 1871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:01:09.197694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:09.200316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:09.309608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3415/6834] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:09.364306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:09.367914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:09.556308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a74114-47a7-4751-a2f4-80bf25a6df61 tempest-TrustsV3TestJSON-1846196238 tempest-TrustsV3TestJSON-1846196238-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:09.656534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02dd6e-d2af-405f-98af-c9f8ad1a0cdc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:09.675476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:09.677176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:09.680423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:09.681651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:09.727595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:09.730796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:09.781822 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3416/6835] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:09.864613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:09.866780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:09.867157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:09.867989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] PATH_INFO: `/v3/users/81bf1d833f5140b78ff59dfae42ff054` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:09.870946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bf1d833f5140b78ff59dfae42ff054)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:09.891496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:10.240043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:10.246029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:10.300149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb347-6823-48bc-b267-5cf1f11206de service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:10.316863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:10.322243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:10.322243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:10.323159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] PATH_INFO: `/v3/projects/0ece750da596456dbaa139c4937faabe` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:10.326115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ece750da596456dbaa139c4937faabe)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:10.335418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:10.336135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bf1d833f5140b78ff59dfae42ff054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.337872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bf1d833f5140b78ff59dfae42ff054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.382238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:10.502059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bf1d833f5140b78ff59dfae42ff054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.564835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bf1d833f5140b78ff59dfae42ff054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.581098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-740afdcc-a701-4692-a1a1-652a68c04be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bf1d833f5140b78ff59dfae42ff054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.602233 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3420/6836] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:09 2022] DELETE /identity/v3/users/81bf1d833f5140b78ff59dfae42ff054 => generated 0 bytes in 1406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:10.610948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef337-b1c1-4b28-a0cf-c08b8b58f528 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:10.616327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef337-b1c1-4b28-a0cf-c08b8b58f528 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:10.617041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef337-b1c1-4b28-a0cf-c08b8b58f528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:10.691854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-47bef337-b1c1-4b28-a0cf-c08b8b58f528 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:10.692490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ece750da596456dbaa139c4937faabe', 'request_id': 'req-0fb82b09-1af0-4321-bb74-48bff6d659cc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.697896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-47bef337-b1c1-4b28-a0cf-c08b8b58f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:10.730954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ece750da596456dbaa139c4937faabe', 'request_id': 'req-0fb82b09-1af0-4321-bb74-48bff6d659cc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.765560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ece750da596456dbaa139c4937faabe', 'request_id': 'req-0fb82b09-1af0-4321-bb74-48bff6d659cc'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.887619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] The token cache is being invalidate because project 0ece750da596456dbaa139c4937faabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:10.892729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.898129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0fb82b09-1af0-4321-bb74-48bff6d659cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:10.923749 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3417/6837] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:10 2022] DELETE /identity/v3/projects/0ece750da596456dbaa139c4937faabe => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:10.935363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:10.936476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:10.937258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:10.992362 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3421/6838] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:11.019711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:11.024247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:11.046338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3418/6839] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:11.061932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:11.062267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:11.062847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:11.081449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:11.085223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:11.147872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:11.153479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:11.223069 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3422/6840] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:11.233054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:11.234999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:11.254114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7c50-60ac-4de2-ac4b-6b540f26947e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:11.264469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:11.265136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:11.265612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:11.266155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:11.267508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:11.268042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:11.272709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:11.326153 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3423/6841] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:11.330050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:11.361982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691cff-833f-4896-b937-401ef03b62c1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:11.363335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f0e74-456e-4239-b1a8-0e84dda92c2a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:11.377116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:11.379780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:11.379780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:11.383561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:11.383705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:11.385316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:11.386088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:11.388137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:11.389788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:11.397088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:11.409751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:11.413940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:11.444754 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3419/6842] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:11.627198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3424/6843] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:11 2022] POST /identity/v3/projects => generated 371 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:11.629398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:11.658046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05715d-8f8c-4e55-b8ac-c020fe65543a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:11.822261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:11.824155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:11.824741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:11.825172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:11.826416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:11.831209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:12.035112 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3420/6844] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:11 2022] POST /identity/v3/users => generated 286 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:01:12.042782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:12.101625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf5f1b-c6ac-4f9f-8584-4b6635800ce5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:12.139640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:12.142525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:12.143093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:12.144900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:12.146309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:12.157241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:12.192161 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3425/6845] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:12.194096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:12.217266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec98c1e-58bb-4a11-baaf-a5f6b5686460 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:12.230429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:12.231920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:12.232531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:12.233139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:12.234394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:12.239873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356c8b-c90a-4b13-9fdb-654f03467047 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:12.271388 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3421/6846] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:12.278995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:12.317241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323fda-1cac-42e3-807a-4b70ee528797 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:12.330396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:12.333187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:12.333977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:12.334558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] PATH_INFO: `/v3/projects/53cd747214c14a17b72167200febe75f/users/96de5867e85b4a0794a269d77089c7a2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:12.390467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cd747214c14a17b72167200febe75f, user_id=96de5867e85b4a0794a269d77089c7a2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:12.399400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:12.560216 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3426/6847] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:12 2022] PUT /identity/v3/projects/53cd747214c14a17b72167200febe75f/users/96de5867e85b4a0794a269d77089c7a2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:12.565013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:12.566759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:12.568606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:12.697817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] MFA Rules not processed for user `96de5867e85b4a0794a269d77089c7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:12.704156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:12.962088 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3422/6848] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:12.969326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:12.993302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a85799-93cf-4dec-8dc9-e6fe9d913bf1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:13.002601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:13.004188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:13.004683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:13.005138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:13.006364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:13.009491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:13.202167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3427/6849] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 4 21:01:12 2022] POST /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:13.215877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:13.248626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0004e-ccac-4cf2-97f3-5cbb98b83063 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:13.279853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:13.281304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:13.281782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:13.282384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/5d5ca957f3f94af5bf6e120c9f6ceaf5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:13.293074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=5d5ca957f3f94af5bf6e120c9f6ceaf5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:13.294547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:13.431750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:13.473711 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3423/6850] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 4 21:01:13 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/5d5ca957f3f94af5bf6e120c9f6ceaf5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:13.481888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:13.504981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c163a-58fc-4a4d-a244-ebbb9be07a6f tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:13.521237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:13.523702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:13.525092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:13.526884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:13.528351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:13.535182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:13.728927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3428/6851] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 4 21:01:13 2022] POST /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:13.757651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:13.757651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fd39b-7bd9-4f70-be88-1ff54cb8dc9b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:13.765143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:13.767952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:13.768738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:13.771487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/cb02ad0f92514159acef28e104de8339` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:13.775948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=cb02ad0f92514159acef28e104de8339)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:13.779238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:13.931062 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3424/6852] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 4 21:01:13 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/cb02ad0f92514159acef28e104de8339 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:13.938615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:13.969000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaecb5-67cf-40a3-8949-2e5659709fa3 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:13.990991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:13.992714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:13.993627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:13.994570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/cb02ad0f92514159acef28e104de8339` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Could not find credential: 00f6f822e31a215477add5439112b7e8ed2b451902fb46443a187acae677cedb.: keystone.exception.CredentialNotFound: Could not find credential: 00f6f822e31a215477add5439112b7e8ed2b451902fb46443a187acae677cedb. Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 04 21:01:14.054411 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application with Lock( Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 21:01:14.056328 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._enter() Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.creator() Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application created_value = creator( Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 00f6f822e31a215477add5439112b7e8ed2b451902fb46443a187acae677cedb. Oct 04 21:01:14.057370 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:01:14.069089 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3429/6853] 10.222.0.78 () {58 vars in 1377 bytes} [Tue Oct 4 21:01:13 2022] GET /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/cb02ad0f92514159acef28e104de8339 => generated 148 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 04 21:01:14.069341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.083759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:14.092560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceab3ca-1342-4500-84b3-d1001368f02b tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.101012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:14.102706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:14.103262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:14.103675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.104867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:14.108124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:14.287605 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3425/6854] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 4 21:01:14 2022] POST /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:14.294573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.310996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.319096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:14.326209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fdc8-a12c-48ec-bd0f-db8fed68ea6c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.349196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:14.375307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:14.376387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:14.389222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.390479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:14.393834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:14.507516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3430/6855] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 4 21:01:14 2022] POST /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:14.514253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.553621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972048c-2508-4d0e-8920-330fe713fb18 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.560901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729f8e2-b4cd-4452-b45e-96362e2f4cc2 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.564703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:14.565888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:14.566469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:14.566973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] PATH_INFO: `/v3/projects/858ebfaaa6594e938e79b39bf10898b1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.573284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:14.575388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:14.576237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:14.580639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] RBAC: Authorizing `identity:delete_project(project_id=858ebfaaa6594e938e79b39bf10898b1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:14.586000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:14.594993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.600455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:14.612266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:14.657540 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3431/6856] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 4 21:01:14 2022] GET /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 865 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:01:14.666464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.696880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24c2f-d0d1-49e9-bd25-15f2e02429ff tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.707380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:14.709098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:14.709745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:14.710379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/9a1faa91eb724ed8ba2a7352b6b8395d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:14.719947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=9a1faa91eb724ed8ba2a7352b6b8395d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:14.723651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:14.891650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3432/6857] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 4 21:01:14 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/9a1faa91eb724ed8ba2a7352b6b8395d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:14.900477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:14.909335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858ebfaaa6594e938e79b39bf10898b1', 'request_id': 'req-dd46098e-f09a-4101-9fa0-647f1669283e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:14.921084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0cd0b-39ee-4238-b2ba-5b04f284f5a1 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:14.924839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858ebfaaa6594e938e79b39bf10898b1', 'request_id': 'req-dd46098e-f09a-4101-9fa0-647f1669283e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:14.942107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858ebfaaa6594e938e79b39bf10898b1', 'request_id': 'req-dd46098e-f09a-4101-9fa0-647f1669283e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:15.082369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:15.085608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:15.086125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:15.086657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/510e17ec8c9c4b35a9bcb2b01eb56359` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:15.094030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=510e17ec8c9c4b35a9bcb2b01eb56359)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:15.104750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:15.124204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] The token cache is being invalidate because project 858ebfaaa6594e938e79b39bf10898b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:15.125289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:15.128234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:15.134168 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3426/6858] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:14 2022] DELETE /identity/v3/projects/858ebfaaa6594e938e79b39bf10898b1 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:15.140694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:15.144245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:15.284960 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3433/6859] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 4 21:01:14 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/510e17ec8c9c4b35a9bcb2b01eb56359 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:15.294730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:15.300005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:15.467610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c175-cf26-45b3-8e75-a3414a61108d tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:15.467610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:15.467610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:15.468197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:15.468197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:15.472037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:15.482525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:15.546232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46098e-f09a-4101-9fa0-647f1669283e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:15.560172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:15.561606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:15.562106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:15.562607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] PATH_INFO: `/v3/users/660909b1faf74d35bdf949e9aeafbe6a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:15.564358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660909b1faf74d35bdf949e9aeafbe6a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:15.569601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:15.619003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:15.640985 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3434/6860] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 4 21:01:15 2022] POST /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2 => generated 367 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:15.648238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:15.692813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:15.697987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0a28-3046-4a34-a551-9f13d86f8c09 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:15.708350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:15.714150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:15.715245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:15.716033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/756a6b6753d245859c8d23f8b21c0339` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:15.720619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=756a6b6753d245859c8d23f8b21c0339)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:15.722596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:15.735193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3435/6861] 10.222.0.78 () {58 vars in 1377 bytes} [Tue Oct 4 21:01:15 2022] GET /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/756a6b6753d245859c8d23f8b21c0339 => generated 367 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:15.737429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:15.776440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f296-5aff-4707-9c59-b0165d7adf49 tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:15.785801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96de5867e85b4a0794a269d77089c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cd747214c14a17b72167200febe75f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:15.788155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:15.789001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:15.790044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/756a6b6753d245859c8d23f8b21c0339` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:15.794735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=96de5867e85b4a0794a269d77089c7a2, credential_id=756a6b6753d245859c8d23f8b21c0339)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:15.808164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:15.990295 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3436/6862] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 4 21:01:15 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2/credentials/OS-EC2/756a6b6753d245859c8d23f8b21c0339 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:15.992295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:15.998928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:16.003926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660909b1faf74d35bdf949e9aeafbe6a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.038796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699acf-85d8-4c7a-a599-c01b9f48959c tempest-EC2CredentialsTest-206298343 tempest-EC2CredentialsTest-206298343-project] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:16.049402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:16.050958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:16.051663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:16.052287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] PATH_INFO: `/v3/users/96de5867e85b4a0794a269d77089c7a2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:16.054863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96de5867e85b4a0794a269d77089c7a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:16.061561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:16.161231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660909b1faf74d35bdf949e9aeafbe6a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.180161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660909b1faf74d35bdf949e9aeafbe6a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.225341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660909b1faf74d35bdf949e9aeafbe6a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.227454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07fbfb4d-9edc-48dc-a333-85af9f357220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660909b1faf74d35bdf949e9aeafbe6a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.254260 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3427/6863] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:15 2022] DELETE /identity/v3/users/660909b1faf74d35bdf949e9aeafbe6a => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:16.566427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96de5867e85b4a0794a269d77089c7a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.566427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96de5867e85b4a0794a269d77089c7a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.692912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96de5867e85b4a0794a269d77089c7a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.755736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96de5867e85b4a0794a269d77089c7a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.787030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96de5867e85b4a0794a269d77089c7a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:16.807171 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3437/6864] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:15 2022] DELETE /identity/v3/users/96de5867e85b4a0794a269d77089c7a2 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:16.814885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:16.815923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:16.816653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:16.892056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:16.894749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:17.055102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3428/6865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:17.130605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:17.137205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:17.539198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511effe2-dfb5-43cd-a3ec-a125b8582360 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:17.552709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:17.555328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:17.556057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:17.556729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:17.581331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:17.584262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3b58-bacb-4439-87b6-336fcb51fbfe service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:17.620955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3438/6866] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:20.802706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:20.812194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:20.850569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bcd3-f8a8-4d84-9237-2f524144610b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:20.860267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:20.861558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:20.862418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:20.863106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] PATH_INFO: `/v3/projects/53abb09a4275438aa28bca0ada5565df` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:20.866161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53abb09a4275438aa28bca0ada5565df)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:20.869970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:21.130440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53abb09a4275438aa28bca0ada5565df', 'request_id': 'req-ae2ac044-39f9-438e-adbd-f86c518bc640'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:21.149118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53abb09a4275438aa28bca0ada5565df', 'request_id': 'req-ae2ac044-39f9-438e-adbd-f86c518bc640'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:21.166800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53abb09a4275438aa28bca0ada5565df', 'request_id': 'req-ae2ac044-39f9-438e-adbd-f86c518bc640'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:21.373810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] The token cache is being invalidate because project 53abb09a4275438aa28bca0ada5565df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:21.381773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:21.384763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:21.400119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3429/6867] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:20 2022] DELETE /identity/v3/projects/53abb09a4275438aa28bca0ada5565df => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:21.405303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:21.405303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:21.407861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb57fb-8e6b-4878-a830-d429a7e415cf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:21.408502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb57fb-8e6b-4878-a830-d429a7e415cf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:21.410620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb57fb-8e6b-4878-a830-d429a7e415cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:21.493483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:21.531748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ddb57fb-8e6b-4878-a830-d429a7e415cf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:21.534640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ddb57fb-8e6b-4878-a830-d429a7e415cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:21.664452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac044-39f9-438e-adbd-f86c518bc640 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:21.685136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:21.688438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:21.688438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:21.688732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] PATH_INFO: `/v3/projects/53cd747214c14a17b72167200febe75f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:21.697501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cd747214c14a17b72167200febe75f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:21.701336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:21.736745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:21.797888 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3439/6868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:21.811569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:21.812470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:21.813453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:21.877074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:21.894024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:21.925617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3440/6869] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:01:21.933491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:21.966789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c683e0-192b-4ce0-ad47-6ab856ec4172 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:21.994698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:21.996543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:21.997129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:21.997647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:21.998964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:22.004408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:22.020230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:22.071898 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3441/6870] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:01:22.073702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:22.119412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e410-baef-4db4-8459-a6e4bcf23879 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:22.144159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cd747214c14a17b72167200febe75f', 'request_id': 'req-43e82058-75fc-4316-a344-1fd45b6964d3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:22.175097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cd747214c14a17b72167200febe75f', 'request_id': 'req-43e82058-75fc-4316-a344-1fd45b6964d3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:22.210825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cd747214c14a17b72167200febe75f', 'request_id': 'req-43e82058-75fc-4316-a344-1fd45b6964d3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:22.374924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] The token cache is being invalidate because project 53cd747214c14a17b72167200febe75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:22.379213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:22.382107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:22.382810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-43e82058-75fc-4316-a344-1fd45b6964d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:22.389363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.390501 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3430/6871] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:21 2022] DELETE /identity/v3/projects/53cd747214c14a17b72167200febe75f => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:22.391263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.392645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.400996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6581b1-25cd-485c-8dd2-cd3187eab83a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.401526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6581b1-25cd-485c-8dd2-cd3187eab83a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.406093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6581b1-25cd-485c-8dd2-cd3187eab83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.410338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:22.414974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:22.487544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cb6581b1-25cd-485c-8dd2-cd3187eab83a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:22.489663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cb6581b1-25cd-485c-8dd2-cd3187eab83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:22.539508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3431/6872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:22.542796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.543609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.544277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.589832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:22.593786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:22.619589 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3432/6873] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:22.621733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:22.643383 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3442/6874] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:22.645389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:22.660382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744194e7-5353-4ae4-9517-6a6cbcff223a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:22.660752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:22.837959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:22.839682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.842107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.844687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.846769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:22.847801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:22.848089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ceef9-c7e8-4179-8b7d-d0b266e4c60a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:22.852202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:22.857911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:22.859448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.860236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.860964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.862450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:22.866547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:22.907386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3433/6875] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:22.912900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:22.938265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79249-7415-4363-82b4-cb0077066838 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:22.981451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:22.985471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:22.986382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:22.987092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:22.988996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:22.996640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:23.006377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3443/6876] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:22 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:23.012473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.046306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706a5f-7d66-4a07-8a2e-908826c5bc04 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.068849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.074120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.075839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.076820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.083563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:23.089698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:23.134601 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3444/6877] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:01:23.137183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.170387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51992b-eeda-41a8-bd3d-0ce2d260b669 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.188831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.190555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.191832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.192446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.196736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:23.202103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:23.220582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3434/6878] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:22 2022] POST /identity/v3/projects => generated 379 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:23.227976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.263962 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3445/6879] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:23.278032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.280224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:23.331270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b116e-8329-4edb-8806-08b30da5bce4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.416355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:23.479588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0046d0-26bb-4070-a90b-c80e496baf59 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.497608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.498706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.499227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.499794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.501111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:23.506333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:23.575606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.577584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.578393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.579311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] PATH_INFO: `/v3/projects/81c32c498e924f98adcff057b368dc50/users/707f72f65fb94accbdc0f9b3ac128f0f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.638187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c32c498e924f98adcff057b368dc50, user_id=707f72f65fb94accbdc0f9b3ac128f0f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:23.644683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:23.735940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3435/6880] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:23 2022] POST /identity/v3/users => generated 290 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:23.743090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.760707 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3446/6881] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:23 2022] PUT /identity/v3/projects/81c32c498e924f98adcff057b368dc50/users/707f72f65fb94accbdc0f9b3ac128f0f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:23.762271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:23.773831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:23.794925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd059c6-6c21-452d-89a6-fde2b88e7e00 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.972321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc065714-75db-44b5-a9c8-4099791d0791 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:23.985107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.987087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.988559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.989646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.991839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:23.992752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:23.994033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:23.994551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:23.995063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] PATH_INFO: `/v3/users/46dc089447bc4483aa36a607473a1c04` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:23.997145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad825-73d1-4f3a-9321-9248fc7337f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:24.004404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dc089447bc4483aa36a607473a1c04)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:24.017844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:24.029664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3436/6882] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:01:24.034477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:24.035467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:24.036295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:24.106351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] MFA Rules not processed for user `707f72f65fb94accbdc0f9b3ac128f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:24.108845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:24.351530 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3437/6883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:24.414806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:24.414806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51513b0-f58d-41e7-a536-68e6de3b52bd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:24.414806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:24.416682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:24.416830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:24.417492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:24.420313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:24.426820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:24.490058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3438/6884] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:24.491851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:24.503041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:24.564149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:24.708630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dc089447bc4483aa36a607473a1c04'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:24.719019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dc089447bc4483aa36a607473a1c04'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:24.799386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75b48-88de-4761-8584-c040b127b085 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:24.823266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:24.824407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:24.824790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:24.825259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:24.841512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dc089447bc4483aa36a607473a1c04'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:24.869491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:24.875499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:24.892708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dc089447bc4483aa36a607473a1c04'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:24.898503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3439/6885] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:24.900035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:24.921199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e9890a25-dee4-4862-94e5-d146e795d489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dc089447bc4483aa36a607473a1c04'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:24.937746 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3447/6886] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:23 2022] DELETE /identity/v3/users/46dc089447bc4483aa36a607473a1c04 => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:24.944615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:24.945553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:24.946486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:24.962903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074289-88ca-4ca4-807e-cf3417bc1c66 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:24.989032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:24.992803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:25.076491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:25.195499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:25.196711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:25.197427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:25.197900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] PATH_INFO: `/v3/projects/9a31e1fcdb32463cb48e66ff89326aa8/users/6ee66cd8749d4c95bde8ae4d20dffd33/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:25.269353 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3448/6887] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:01:25.302481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a31e1fcdb32463cb48e66ff89326aa8, user_id=6ee66cd8749d4c95bde8ae4d20dffd33, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:25.360422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33878e-64f0-4c1e-8d77-669372fff29e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:25.388232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:25.392839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:25.543997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3440/6888] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:24 2022] PUT /identity/v3/projects/9a31e1fcdb32463cb48e66ff89326aa8/users/6ee66cd8749d4c95bde8ae4d20dffd33/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:25.569987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610231-d21d-4c2d-8e1d-93c6ffa40cc9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:25.569987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610231-d21d-4c2d-8e1d-93c6ffa40cc9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:25.569987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610231-d21d-4c2d-8e1d-93c6ffa40cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:25.674150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-12610231-d21d-4c2d-8e1d-93c6ffa40cc9 None None] MFA Rules not processed for user `6ee66cd8749d4c95bde8ae4d20dffd33`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:25.677101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-12610231-d21d-4c2d-8e1d-93c6ffa40cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:25.692481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbf5d5-9514-4a74-a869-524b2fe72cad None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:25.941584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:25.944951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:25.945606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:25.946114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:25.957949 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3441/6889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:25.961081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:25.961670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:25.962272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:26.044892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:26.047783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:26.072867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:26.147405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:26.150967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:26.179651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3449/6890] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:01:26.182108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:26.187928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:26.244513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3442/6891] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:26.315983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:26.374205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e645b7-2ea2-4c41-8259-62129531aa48 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:26.383084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:26.384366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:26.384840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:26.385349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:26.406752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:26.408711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:26.424447 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3450/6892] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:26.480955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:26.483639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:26.859486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5085f-55b1-4081-9f1c-454e58bf48c4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:26.870110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:26.873208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:26.873773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:26.874284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:26.896615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:26.901065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:26.946719 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3443/6893] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:27.584720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:27.586843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:27.646140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:27.654028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:27.699260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809c50-00e2-4530-8470-3683e53f2ab1 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:27.718544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:27.719655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:27.720547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:27.721395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] PATH_INFO: `/v3/users/6ee66cd8749d4c95bde8ae4d20dffd33` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:27.726194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee66cd8749d4c95bde8ae4d20dffd33)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:27.736531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:27.742286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbb17-3edc-4c6b-939c-728a0308bcfb service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:27.768784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:27.775675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:27.775675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:27.777746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] PATH_INFO: `/v3/users/e2cf0edf8b3d4b58bcd78077675d4886` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:27.786112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cf0edf8b3d4b58bcd78077675d4886)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:27.800021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:28.224858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee66cd8749d4c95bde8ae4d20dffd33'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.230419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee66cd8749d4c95bde8ae4d20dffd33'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.285874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cf0edf8b3d4b58bcd78077675d4886'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.389343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee66cd8749d4c95bde8ae4d20dffd33'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.456454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee66cd8749d4c95bde8ae4d20dffd33'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.486943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cf0edf8b3d4b58bcd78077675d4886'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.495862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee66cd8749d4c95bde8ae4d20dffd33'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.519331 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3451/6894] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:27 2022] DELETE /identity/v3/users/6ee66cd8749d4c95bde8ae4d20dffd33 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:28.519331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:28.523096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:28.531478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cf0edf8b3d4b58bcd78077675d4886'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.580060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cf0edf8b3d4b58bcd78077675d4886'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.581716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a562e0be-0ac6-4d64-96ec-f878b047b9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cf0edf8b3d4b58bcd78077675d4886'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:28.587026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:28.610016 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3444/6895] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:27 2022] DELETE /identity/v3/users/e2cf0edf8b3d4b58bcd78077675d4886 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:28.612723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb410-6c76-49dc-a91d-3b655d05bf4a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:28.613252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb410-6c76-49dc-a91d-3b655d05bf4a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:28.613770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb410-6c76-49dc-a91d-3b655d05bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:28.664828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-74ceb410-6c76-49dc-a91d-3b655d05bf4a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:28.667677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74ceb410-6c76-49dc-a91d-3b655d05bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:28.838990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc7a8-62d8-4108-ae18-3dbf89a2f15f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:28.963816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3445/6896] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:28.971742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dcca-1497-4cff-9b17-f74b477525c5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:28.974714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dcca-1497-4cff-9b17-f74b477525c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:28.977689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dcca-1497-4cff-9b17-f74b477525c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:29.079517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-97c0dcca-1497-4cff-9b17-f74b477525c5 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:29.088268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-97c0dcca-1497-4cff-9b17-f74b477525c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:29.171690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:29.194147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:29.195757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:29.196332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:29.197186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] PATH_INFO: `/v3/projects/6f835a04a6144c6498f0ac2e720dd347` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:29.199890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f835a04a6144c6498f0ac2e720dd347)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:29.215046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:29.337966 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3446/6897] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:29.349384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:29.350647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:29.350647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:29.429713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:29.434968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:29.469724 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3447/6898] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:29.469724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:29.481017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:29.549090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f835a04a6144c6498f0ac2e720dd347', 'request_id': 'req-65e8e515-cd5b-477b-81d6-e7a7f445a163'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:29.711621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a0e4f-0d08-4361-bad1-fe4bd138c6b7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:29.831954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f835a04a6144c6498f0ac2e720dd347', 'request_id': 'req-65e8e515-cd5b-477b-81d6-e7a7f445a163'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:29.835406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:29.836592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:29.837037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:29.837508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:29.850530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:29.855712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f835a04a6144c6498f0ac2e720dd347', 'request_id': 'req-65e8e515-cd5b-477b-81d6-e7a7f445a163'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:29.896641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] The token cache is being invalidate because project 6f835a04a6144c6498f0ac2e720dd347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:29.897264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:29.900606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:29.906936 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3452/6899] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:28 2022] DELETE /identity/v3/projects/6f835a04a6144c6498f0ac2e720dd347 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:29.909355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:29.914424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.058277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:30.065466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:30.125340 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3448/6900] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:30.127540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:30.137967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.197782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ad75b-a679-4ba2-928d-4ad29987f67d service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:30.229982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:30.231293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.231957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.232250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.241259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.302280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:30.305922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655b521-3a8c-4582-bc7a-c90711a4a296 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:30.323577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e515-cd5b-477b-81d6-e7a7f445a163 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:30.336321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:30.337636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.338376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.338905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.342788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.359317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3449/6901] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:30.364767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97215c0-7ca6-49dc-a272-04703ce7f0f8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.365313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97215c0-7ca6-49dc-a272-04703ce7f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.368342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97215c0-7ca6-49dc-a272-04703ce7f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.433070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d97215c0-7ca6-49dc-a272-04703ce7f0f8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:30.435561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d97215c0-7ca6-49dc-a272-04703ce7f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.470560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3450/6902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:30.470560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.470560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.470560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.517635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:30.521133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:30.543763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3451/6903] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:30.551267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:30.573831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f145b4-8c3c-42e8-938a-73e911d6def7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:30.592362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:30.594241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.595113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.595966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.597594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:30.598457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:30.603045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:30.647097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:30.652136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:30.657822 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3452/6904] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:01:30.669409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:30.683502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3453/6905] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:30.729966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c00ee-354b-4581-ac1b-d97e76ec24a5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:30.755047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:30.756858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:30.757431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:30.757989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:30.759380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:30.763424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:31.006251 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3453/6906] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:30 2022] POST /identity/v3/projects => generated 369 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:31.015081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:31.038517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e2994-8471-4fac-9e39-3cf0cbd27b79 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:31.104777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:31.250929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:31.252419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:31.258708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:31.258708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:31.258708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:31.261786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:31.465157 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3454/6907] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:31 2022] POST /identity/v3/users => generated 285 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:31.470632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:31.519381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ea60-3c34-46cd-9b7b-6f7e2c642bf8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:31.543238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:31.544628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:31.547932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:31.547932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:31.548758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:31.553681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:31.658896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:31.669019 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3454/6908] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:31.701280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb4e6-c1bf-4292-91a2-b70b517b812f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:31.714419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:31.728658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:31.729279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:31.729832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:31.735000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:31.749813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:31.797266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3455/6909] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:31.806718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:32.041481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11647e-e59c-4ecf-b4ca-9255f04e9359 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:32.084773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:32.087967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:32.088934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:32.092657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] PATH_INFO: `/v3/projects/ca7f2bba3c69407a8ea0d332797a7f98/users/b4449b4b4db04ed1a91efcbedd26f093/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:32.165692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7f2bba3c69407a8ea0d332797a7f98, user_id=b4449b4b4db04ed1a91efcbedd26f093, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:32.181995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44589c-483b-4359-93f8-57510140e853 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:32.309285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:32.314066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:32.408348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e30fc-ab9c-4931-af54-dc55d3f86a51 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:32.443350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:32.451684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:32.452617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:32.453366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] PATH_INFO: `/v3/projects/f9de9ddb18854733af8b5c5daf5b8681` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:32.456825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9de9ddb18854733af8b5c5daf5b8681)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:32.468814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:32.527610 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3455/6910] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:31 2022] PUT /identity/v3/projects/ca7f2bba3c69407a8ea0d332797a7f98/users/b4449b4b4db04ed1a91efcbedd26f093/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:32.535577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:32.536518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:32.537961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:32.653351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] MFA Rules not processed for user `b4449b4b4db04ed1a91efcbedd26f093`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:32.656839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:32.876013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9de9ddb18854733af8b5c5daf5b8681', 'request_id': 'req-79991d3c-c756-476d-9dd8-f1d0c17c75b7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:32.904550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:32.933647 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3456/6911] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:32.935398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:32.945122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:33.009427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9de9ddb18854733af8b5c5daf5b8681', 'request_id': 'req-79991d3c-c756-476d-9dd8-f1d0c17c75b7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.049410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9de9ddb18854733af8b5c5daf5b8681', 'request_id': 'req-79991d3c-c756-476d-9dd8-f1d0c17c75b7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.099447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] The token cache is being invalidate because project f9de9ddb18854733af8b5c5daf5b8681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:33.100078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.103630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.106483 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3456/6912] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:32 2022] DELETE /identity/v3/projects/f9de9ddb18854733af8b5c5daf5b8681 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:01:33.108052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:33.110767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:33.159340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af90ff-527b-4daf-ad64-3c1028630650 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:33.330304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991d3c-c756-476d-9dd8-f1d0c17c75b7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:33.340734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:33.342418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:33.343082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:33.343510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:33.347890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:33.407411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:33.408627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:33.412651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:33.412651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] PATH_INFO: `/v3/projects/9a31e1fcdb32463cb48e66ff89326aa8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:33.421351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a31e1fcdb32463cb48e66ff89326aa8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:33.426731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:33.643896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:33.703914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:33.707702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65baee-719d-4386-8eaf-ef24dc2b8111 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:33.727683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a31e1fcdb32463cb48e66ff89326aa8', 'request_id': 'req-27f697c6-8384-4b9d-93e6-0999a6b9393b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.758015 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3457/6913] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:33.768729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd48207-2596-4c9f-9c38-fffdea9da492 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:33.769510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd48207-2596-4c9f-9c38-fffdea9da492 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:33.770239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd48207-2596-4c9f-9c38-fffdea9da492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:33.772796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a31e1fcdb32463cb48e66ff89326aa8', 'request_id': 'req-27f697c6-8384-4b9d-93e6-0999a6b9393b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.817548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a31e1fcdb32463cb48e66ff89326aa8', 'request_id': 'req-27f697c6-8384-4b9d-93e6-0999a6b9393b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:33.874964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1fd48207-2596-4c9f-9c38-fffdea9da492 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:33.884910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1fd48207-2596-4c9f-9c38-fffdea9da492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:34.014532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] The token cache is being invalidate because project 9a31e1fcdb32463cb48e66ff89326aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:34.019572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:34.021992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27f697c6-8384-4b9d-93e6-0999a6b9393b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:34.026881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3457/6914] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:32 2022] DELETE /identity/v3/projects/9a31e1fcdb32463cb48e66ff89326aa8 => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:34.037226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:34.044265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:34.050488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:34.153143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:34.174290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:34.188643 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3458/6915] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:34.197812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def0fa-6749-4ac3-a950-fd3a0ed6e8a1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:34.198342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def0fa-6749-4ac3-a950-fd3a0ed6e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:34.198893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def0fa-6749-4ac3-a950-fd3a0ed6e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:34.313087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b5def0fa-6749-4ac3-a950-fd3a0ed6e8a1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:34.315446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b5def0fa-6749-4ac3-a950-fd3a0ed6e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:34.361320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:34.523361 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3458/6916] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:34.536699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:34.539748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:34.687551 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3459/6917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:34.695520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:34.696431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:34.697340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:34.769674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:34.772405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:34.822160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3460/6918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:34.824232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:34.832663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:35.039479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf209e16-af27-47cc-956d-bee0de652a67 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.081460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.086856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.091352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.093815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.196888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.202906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4531767-d7e3-4f58-b4a5-e72c8101f06b service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:35.215993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08573-dcf4-4884-b95e-db25f9b498d2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.242369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e6d09ab29406eb6918ad57c5385ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707b239f54e4f1192cd13ffdb6ee144', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.245025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.245520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.245670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.249445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:35.249922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.259317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:35.269646 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3459/6919] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:35.269646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.296862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.297436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.351794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3461/6920] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:35.353275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:35.424333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:35.435905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:35.457577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d981c-5491-4ae3-9b76-457b6315b7b2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.502304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.504238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.504238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.504678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.506851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:35.510978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.530734 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3460/6921] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:35.532165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:35.554266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:35.608742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9dcd-00fc-4ef0-85c3-7b8a9f2d6b8a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.649704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e6d09ab29406eb6918ad57c5385ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707b239f54e4f1192cd13ffdb6ee144', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.649704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.649704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.650475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.654371 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3462/6922] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:35.656603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:35.664586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.675399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:35.699927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:35.715633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fa2f1-b6a0-48ac-959f-9b6c560f6f8f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.737084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.739494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.740434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.741208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.743822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:35.744981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.752961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:35.862624 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3463/6923] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:35.865855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:35.934666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb2d2-f2b8-4ec2-a305-f109f1a4f9e3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:35.953258 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3461/6924] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:35 2022] POST /identity/v3/projects => generated 349 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:35.953258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:35.960309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:35.965182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:35.970216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:35.970894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:35.972243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:35.979305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:36.266770 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3464/6925] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:35 2022] POST /identity/v3/projects => generated 357 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:36.274044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:36.424061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125cc9-45a8-4ca9-a8ad-ddba83f55da2 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:36.716361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:36.716804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392705-3132-4411-9ade-5ca66ea39729 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:36.743196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e6d09ab29406eb6918ad57c5385ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707b239f54e4f1192cd13ffdb6ee144', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:36.744564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:36.745068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:36.745550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:36.747062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:36.747588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:36.750825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:36.783599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3465/6926] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:36.783599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:36.821607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:36.822911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:36.823266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:36.823700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:36.829699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:36.847630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4e109-b25c-4cc4-add1-4248c6a355e2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:37.090953 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3462/6927] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:35 2022] POST /identity/v3/projects => generated 391 bytes in 1141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:37.097700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:37.098280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:37.098779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:37.106776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3e7a3-d048-4155-93e5-2bfaa262de44 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:37.218167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:37.220530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:37.393017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:37.394162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:37.394665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:37.395205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:37.396973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:37.411416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:37.532884 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3463/6928] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:37.540385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:37.593783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff56c3-fbe9-41ed-83bd-705b531c7479 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:37.613056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:37.614609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:37.617615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:37.617870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:37.618871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:37.624262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:37.635351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:37.639814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3466/6929] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:36 2022] POST /identity/v3/users => generated 279 bytes in 860 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:37.641477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:37.819923 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3464/6930] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:37 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:37.822153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:37.884237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba422dd-412e-448d-9d1b-b935d8dab423 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:37.939815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:37.941010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:37.941628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:37.942336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:37.944222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:37.948202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.004366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254a05e-dfbb-4a52-a911-8f21c5547542 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.009875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3465/6931] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:38.011226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:38.034332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.035484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.035948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.036407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.057607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444be8c-6f36-4218-90ba-fb3e796bed4d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.069796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.079810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.082627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.083763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.084515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.085377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.090940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.094693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.139657 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3467/6932] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:38.141963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:38.153826 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3466/6933] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:38.160692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:38.202600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa291b3-fc93-4a15-b1f4-051a6bc25142 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.207937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703f309-13e0-4700-9f52-20d5e6d5dae8 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.226031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.227181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.227711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.228351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.229565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.238834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.249339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.254299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.257752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.258614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.263174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.269392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.295207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3467/6934] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:01:38.302579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:38.326655 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3468/6935] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:38.337222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:38.352193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b643-1440-41bb-a9a1-6d7ad36d5c4b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.373059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.374993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.376464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.377338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] PATH_INFO: `/v3/projects/08f99ad15fe84fa2b388cd850f27c012/users/5a000cac2d734931927f4a55cc0a4d7f/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.388839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd01b2-e275-4f92-96a1-154b778d26f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:38.420847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:38.420847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.424029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.424614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] PATH_INFO: `/v3/projects/1befee7230d44241b69bd63aca2ceeca/users/878a0e020dc445e089c0b56b21a57b3a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.445330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f99ad15fe84fa2b388cd850f27c012, user_id=5a000cac2d734931927f4a55cc0a4d7f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.457831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0d738-5d46-43e5-ae55-fb65ad61a323 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.506325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1befee7230d44241b69bd63aca2ceeca, user_id=878a0e020dc445e089c0b56b21a57b3a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:38.516929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429767f-afdd-4fab-9544-422fa9c1fbe4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:38.600393 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3468/6936] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:38 2022] PUT /identity/v3/projects/08f99ad15fe84fa2b388cd850f27c012/users/5a000cac2d734931927f4a55cc0a4d7f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:38.611093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.611995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.612615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.704770 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3469/6937] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:38 2022] PUT /identity/v3/projects/1befee7230d44241b69bd63aca2ceeca/users/878a0e020dc445e089c0b56b21a57b3a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:38.731482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:38.732320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:38.738380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:38.762041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] MFA Rules not processed for user `5a000cac2d734931927f4a55cc0a4d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:38.765033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:38.879405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] MFA Rules not processed for user `878a0e020dc445e089c0b56b21a57b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:38.885793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:38.996067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:39.134481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3469/6938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:01:39.142651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:39.209924 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3470/6939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:39.218669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:39.374980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:39.421360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351fea-dab1-43f2-bcfe-88c879606c45 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:39.435755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:39.437999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:39.441404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:39.441404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:39.442698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:39.448263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:39.509225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98101-dec6-4043-a61d-7179a4c4154e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:39.516322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:39.517125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:39.517618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:39.518030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:39.519076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:39.524327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:39.639267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3471/6940] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:39 2022] POST /identity/v3/projects => generated 357 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:39.645499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:39.796442 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3470/6941] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:39 2022] POST /identity/v3/projects => generated 391 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:39.804462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:39.866118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8345-82a5-484f-822a-aec8937d2d75 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:40.145207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46dd5-c33d-4865-8127-186ad77007f7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:40.150121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:40.151693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.153333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.154185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.155660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:40.156543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:40.157976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.158792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.159707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.161113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec824b0-f35b-43db-910d-e81be4d777f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:40.161352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:40.165253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:40.336266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3472/6942] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:39 2022] POST /identity/v3/users => generated 285 bytes in 692 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:01:40.345616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.346435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.348804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3471/6943] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:39 2022] POST /identity/v3/users => generated 302 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:40.351188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:40.351972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.455128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:40.458476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:40.660339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30900f6f-f8e9-42fb-b072-8d194f244646 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:40.675325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e6d09ab29406eb6918ad57c5385ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd707b239f54e4f1192cd13ffdb6ee144', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:40.678637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.678637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.678637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] PATH_INFO: `/v3/projects/b37982dc23a3464ebd21645fe64210af` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.682124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b37982dc23a3464ebd21645fe64210af)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:40.688736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:40.694196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:40.775452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3473/6944] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:40.784036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:40.812754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3dde2-2008-4ab3-abec-3518d62eaa78 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:40.831624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:40.832801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.833488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.834250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.836619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:40.842034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:40.865537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:40.887074 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3474/6945] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:40.888800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:40.930114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2a4ed-83c9-4973-866b-7c266569548f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:40.956324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:40.956324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:40.956324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:40.959287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:40.962439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:40.966596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:40.995539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3475/6946] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:41.000375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:41.023935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6542-48e0-4eb3-8a1c-a62154aca221 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:41.038980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:41.040783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:41.042626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:41.042836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] PATH_INFO: `/v3/projects/63daeda625fe4ea68c6696cddcdef2d2/users/79c273e585a648fd89ad6da0b7fb400f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:41.093781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63daeda625fe4ea68c6696cddcdef2d2, user_id=79c273e585a648fd89ad6da0b7fb400f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:41.101903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:41.274405 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3476/6947] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:40 2022] PUT /identity/v3/projects/63daeda625fe4ea68c6696cddcdef2d2/users/79c273e585a648fd89ad6da0b7fb400f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:41.285117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:41.343483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37982dc23a3464ebd21645fe64210af', 'request_id': 'req-b5a72bbd-1cdd-4066-8809-6345435e5421'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:41.364118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37982dc23a3464ebd21645fe64210af', 'request_id': 'req-b5a72bbd-1cdd-4066-8809-6345435e5421'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:41.398133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37982dc23a3464ebd21645fe64210af', 'request_id': 'req-b5a72bbd-1cdd-4066-8809-6345435e5421'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:41.534842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] The token cache is being invalidate because project b37982dc23a3464ebd21645fe64210af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:41.535438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:41.536359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e8e0-90c9-4ab4-a74d-e47c699544b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:41.540005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:41.546384 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3472/6948] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:40 2022] DELETE /identity/v3/projects/b37982dc23a3464ebd21645fe64210af => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:41.555481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:41.562071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:41.563113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:41.564947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:41.565398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:41.568734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:41.576749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:41.954429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72bbd-1cdd-4066-8809-6345435e5421 tempest-RoutersIpV6AdminTest-381076338 tempest-RoutersIpV6AdminTest-381076338-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:41.973230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:41.979410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:42.013071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3477/6949] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:42.016190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:42.019817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:42.223009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:42.223009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:42.227805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:42.228407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] PATH_INFO: `/v3/projects/0b74fdefe17748aeb69be52d4337526c/users/bf3f7e6202b740939e2facd56e11504b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:42.329687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b74fdefe17748aeb69be52d4337526c, user_id=bf3f7e6202b740939e2facd56e11504b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:42.341527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c096b-9652-474e-b380-d7dd06feecda service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:42.344164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:42.367836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:42.374604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:42.375128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:42.375690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:42.376679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:42.385670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:42.426287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3478/6950] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:42.428495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:42.433676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:42.456143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:42.471474 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3473/6951] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:41 2022] PUT /identity/v3/projects/0b74fdefe17748aeb69be52d4337526c/users/bf3f7e6202b740939e2facd56e11504b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:42.473301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:42.583461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:42.654633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a52a-3abc-40ba-9d85-35f691987862 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:42.709749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad52f-7794-49b4-bc79-1189246ee766 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:42.723799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:42.726172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:42.726627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:42.727834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] PATH_INFO: `/v3/projects/63daeda625fe4ea68c6696cddcdef2d2/users/79c273e585a648fd89ad6da0b7fb400f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:42.733281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63daeda625fe4ea68c6696cddcdef2d2, user_id=79c273e585a648fd89ad6da0b7fb400f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:42.741706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:42.783322 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3474/6952] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:42 2022] PUT /identity/v3/projects/63daeda625fe4ea68c6696cddcdef2d2/users/79c273e585a648fd89ad6da0b7fb400f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:42.783322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:42.863718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:42.865820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:42.866310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:42.870597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:42.891894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:43.058432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8afd5-d2c1-45b7-9b7c-819e5a349bbc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:43.095406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:43.099786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:43.103538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:43.111412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:43.111660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:43.111660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:43.112041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3293-5452-4880-9152-a61ac142afda service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:43.112221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb19cd-d88d-4374-89d5-2d489e38a015 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:43.150772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3479/6953] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:43.153286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:43.155379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:43.161211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:43.167311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3475/6954] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:43.170858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:43.171869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:43.172705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:43.222421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:43.225956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:43.239080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] MFA Rules not processed for user `79c273e585a648fd89ad6da0b7fb400f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:43.241398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:43.531634 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3476/6955] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:43.533103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:43.559589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:43.562762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c816-efdf-49f1-8f4f-ac7083532890 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:43.575742 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3480/6956] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:43.581611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:43.584703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:43.586527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:43.608373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:43.615190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:43.621875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] PATH_INFO: `/v3/projects/0b74fdefe17748aeb69be52d4337526c/users/bf3f7e6202b740939e2facd56e11504b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:43.633928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b74fdefe17748aeb69be52d4337526c, user_id=bf3f7e6202b740939e2facd56e11504b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:43.658175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:43.761077 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3477/6957] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:43 2022] PUT /identity/v3/projects/0b74fdefe17748aeb69be52d4337526c/users/bf3f7e6202b740939e2facd56e11504b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:43.764067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:43.773105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:43.929248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:43.987987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217b6e-14f7-4453-8417-74f9c4e76dc1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:43.996654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca09f2-771e-4a28-a799-a43a63638c67 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:44.004091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:44.005446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:44.005948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:44.006419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:44.178717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:44.181152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:44.181152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:44.181152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:44.332079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:44.335654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f7b5f-2341-4915-a253-a3b6147dd928 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:44.363518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:44.365757 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3478/6958] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:44.368122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:44.368384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:44.370384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:44.370384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:44.394395 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3481/6959] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:44.462073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] MFA Rules not processed for user `bf3f7e6202b740939e2facd56e11504b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:44.464559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:44.782862 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3479/6960] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:44.838851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:44.928387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:44.994168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3f6aa-7c4f-41ec-96dc-4245c7602eb3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:45.015339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:45.017611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:45.018294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:45.019078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:45.023799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:45.046064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:45.085290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f6247-96c2-4748-a1b2-74b7d161ebca service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:45.094025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:45.095604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:45.096421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:45.097155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:45.101829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:45.220943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:45.227489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:45.254555 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3480/6961] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:45.304285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:45.307475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8b99a-44f8-43fb-bdbf-712643cf3789 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:45.343295 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3482/6962] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:45.542791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:45.551681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:45.611434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:45.728971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae67dae-bf2d-4b9f-bb0a-de09447910dc service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:45.738640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:45.744626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:45.744626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:45.744626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] PATH_INFO: `/v3/users/707f72f65fb94accbdc0f9b3ac128f0f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:45.744626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707f72f65fb94accbdc0f9b3ac128f0f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:45.747953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:46.378218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707f72f65fb94accbdc0f9b3ac128f0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:46.549546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707f72f65fb94accbdc0f9b3ac128f0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:46.573365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707f72f65fb94accbdc0f9b3ac128f0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:46.612751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707f72f65fb94accbdc0f9b3ac128f0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:46.614478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707f72f65fb94accbdc0f9b3ac128f0f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:46.656975 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3481/6963] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:45 2022] DELETE /identity/v3/users/707f72f65fb94accbdc0f9b3ac128f0f => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:46.660192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:46.661154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:46.661307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:46.749532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:46.752607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:46.987783 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3483/6964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:47.011863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:47.017067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:47.221814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8534-bf5e-4227-8ea4-bfd22f4e4961 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:47.229795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:47.231164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:47.232439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:47.233028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:47.276278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:47.298088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1d7dc-615c-4ffa-a796-4d7aaef4b69f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:47.339545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3482/6965] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:50.232406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:50.236361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:50.330477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9abe2-98e5-4a11-8d47-4f0cfc3e466e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:50.374211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:50.376509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:50.376509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:50.376509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] PATH_INFO: `/v3/projects/81c32c498e924f98adcff057b368dc50` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:50.390815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c32c498e924f98adcff057b368dc50)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:50.408359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:50.936607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c32c498e924f98adcff057b368dc50', 'request_id': 'req-84de7c5a-3dc3-4390-a09c-67b126e1948c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:51.111232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c32c498e924f98adcff057b368dc50', 'request_id': 'req-84de7c5a-3dc3-4390-a09c-67b126e1948c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:51.135313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c32c498e924f98adcff057b368dc50', 'request_id': 'req-84de7c5a-3dc3-4390-a09c-67b126e1948c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:51.200323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] The token cache is being invalidate because project 81c32c498e924f98adcff057b368dc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:51.200838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:51.204644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-84de7c5a-3dc3-4390-a09c-67b126e1948c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:51.214247 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3484/6966] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:50 2022] DELETE /identity/v3/projects/81c32c498e924f98adcff057b368dc50 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:51.222337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:51.224893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:51.225798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:51.402845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:51.413220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:51.515591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:51.655738 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3483/6967] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:51.877033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:51.877033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:51.877033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:51.895419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:51.898186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:51.916327 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3485/6968] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:51.922045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:51.941369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a61e-cd80-467c-9e22-e976621766ec None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:51.980052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:51.982073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:51.982481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:51.983176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:51.984887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:51.985771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:51.996167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:52.058726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:52.093010 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3484/6969] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:01:52.107350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d96c-7ffa-4635-8370-9c1dc9317ee2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:52.131004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:52.131004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:52.131344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:52.131767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:52.133956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:52.152969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:52.224577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:52.424399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3486/6970] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:52 2022] POST /identity/v3/projects => generated 371 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:52.427035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:52.472571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64529e8-e95a-497e-b6d1-3542bdd30873 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:52.627470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:52.628477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:52.628970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:52.631400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:52.631660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:52.635329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:52.862892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3485/6971] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:52 2022] POST /identity/v3/users => generated 286 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:52.869329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:52.931582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf6022-05ce-4b81-a647-e3afe7c948fe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:52.976683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:52.977851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:52.978313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:52.978812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:52.980142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:52.990615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:53.019264 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3487/6972] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:53.032179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:53.055206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3e389-6b64-4cf3-acc9-1cfbab605b16 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:53.068110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:53.080440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:53.080440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:53.080440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:53.080440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:53.080440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:53.107301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3486/6973] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:01:53.110449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:53.135936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164da42-9148-4bd7-b361-750d3f18a5a3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:53.147768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:53.149365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:53.149901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:53.150348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] PATH_INFO: `/v3/projects/51d74f68f27244308dd89aa722cf5f3a/users/c4c62359e5dd45aa9ebe73891ae5fcf0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:53.204596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d74f68f27244308dd89aa722cf5f3a, user_id=c4c62359e5dd45aa9ebe73891ae5fcf0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:53.218475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ffa47-bc4f-4070-a977-ebefb7f835c4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:53.301184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:53.304437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:53.482346 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3488/6974] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:01:53 2022] PUT /identity/v3/projects/51d74f68f27244308dd89aa722cf5f3a/users/c4c62359e5dd45aa9ebe73891ae5fcf0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:53.499287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:53.508743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:53.508743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:53.643449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c222-9bf1-45f8-ba15-820b2c67baac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:53.656996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] MFA Rules not processed for user `c4c62359e5dd45aa9ebe73891ae5fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:53.662442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:53.925225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:53.998133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:54.001325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:54.001325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:54.001325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:54.019528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:54.040648 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3489/6975] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:54.055049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:54.055049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:54.126738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:54.134924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:54.193970 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3487/6976] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:54.195600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:54.206159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:54.383812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23ff3-7a69-4414-b3e1-2b92c1c196c8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:54.413725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:54.414927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:54.415507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:54.416025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] PATH_INFO: `/v3/users/8b73e1c41f024b519fa29f65abe9b6a8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:54.434596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b73e1c41f024b519fa29f65abe9b6a8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:54.443093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:54.632671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74890d-6c1a-441e-9dfd-2ad7e1ecf970 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:54.647807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:54.649365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:54.650066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:54.651014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] PATH_INFO: `/v3/users/56e65852d5724eb2a27b7d436b22742c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:54.653947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e65852d5724eb2a27b7d436b22742c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:54.660520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:54.912068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b73e1c41f024b519fa29f65abe9b6a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:54.913420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b73e1c41f024b519fa29f65abe9b6a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:54.944976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:55.083079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b73e1c41f024b519fa29f65abe9b6a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.132811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e65852d5724eb2a27b7d436b22742c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.136908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b73e1c41f024b519fa29f65abe9b6a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.159450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b73e1c41f024b519fa29f65abe9b6a8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.174615 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3490/6977] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:54 2022] DELETE /identity/v3/users/8b73e1c41f024b519fa29f65abe9b6a8 => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:55.176619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:55.180135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:55.272895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e65852d5724eb2a27b7d436b22742c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.298430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e65852d5724eb2a27b7d436b22742c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.356326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e65852d5724eb2a27b7d436b22742c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.357576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-801ebf1d-ad5b-49c4-bc2d-4332a9c6fb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e65852d5724eb2a27b7d436b22742c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:55.388531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3488/6978] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:54 2022] DELETE /identity/v3/users/56e65852d5724eb2a27b7d436b22742c => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:55.391295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db75be-f4d6-4eda-b5c9-5d8226f93708 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:55.391818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db75be-f4d6-4eda-b5c9-5d8226f93708 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:55.392287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db75be-f4d6-4eda-b5c9-5d8226f93708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:55.471049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f0db75be-f4d6-4eda-b5c9-5d8226f93708 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:55.473286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f0db75be-f4d6-4eda-b5c9-5d8226f93708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:55.545128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709bf47-f6fd-4f71-bc0f-8b21800a5d47 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:55.691661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:55.736036 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3489/6979] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:55.736036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:55.736036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:55.736036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:55.843548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:55.861948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:55.891283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:55.892266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:55.892703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:55.893246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:55.902514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:55.925406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3490/6980] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:55.928124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:55.948827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:56.214580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:56.217751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:56.251420 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3491/6981] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 1076 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:56.254440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:56.259471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11672f08-f8db-46e5-8921-88c43bb41065 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:56.275883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:56.277076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:56.277752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:56.278083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:56.311070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:56.313906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:56.316521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116928-0971-45a5-9c9e-8ee4e4378afc service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:56.337856 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3491/6982] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:56.340491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:56.342470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:56.343345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:56.344250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:56.397181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:56.400142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:56.476969 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3492/6983] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:56.533873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:56.537547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:56.616736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f1b26-5732-4152-8df3-7a9a7b7b30b8 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:56.635490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:56.637518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:56.637518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:56.638011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] PATH_INFO: `/v3/users/c4c62359e5dd45aa9ebe73891ae5fcf0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:56.647175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c62359e5dd45aa9ebe73891ae5fcf0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:56.656896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:57.180253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c62359e5dd45aa9ebe73891ae5fcf0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:57.299394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c62359e5dd45aa9ebe73891ae5fcf0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:57.326080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c62359e5dd45aa9ebe73891ae5fcf0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:57.401483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:57.406053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:57.418085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c62359e5dd45aa9ebe73891ae5fcf0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:57.419525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-39e80c25-860a-47f4-9cb6-f7bc0b0714d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c62359e5dd45aa9ebe73891ae5fcf0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:57.434561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3492/6984] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:01:56 2022] DELETE /identity/v3/users/c4c62359e5dd45aa9ebe73891ae5fcf0 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:57.443071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:57.443808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:57.444606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:57.503401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:57.505915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:57.511975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccfc7d-0cf1-44fc-af69-74edd59093d6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:57.615317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:57.785896 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3493/6985] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:01:57.810830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:57.814269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:57.855078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:57.918618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:57.920888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:57.921480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:57.921972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] PATH_INFO: `/v3/projects/b0c85d506fb94c18954be47609cba122` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:57.929779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c85d506fb94c18954be47609cba122)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:57.938142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:58.096780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd739-83a7-43b9-adf4-78e8e4abeb56 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:58.119598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:58.121149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:58.123512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:58.127119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:58.172137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:58.183639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:58.242617 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3494/6986] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:01:58.245590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:58.252269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:58.313790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3775-d229-4a54-a5ff-4bb673543552 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:58.314736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c85d506fb94c18954be47609cba122', 'request_id': 'req-68e5b0b9-6904-454e-a7e6-776d23cf0412'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:58.443231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c85d506fb94c18954be47609cba122', 'request_id': 'req-68e5b0b9-6904-454e-a7e6-776d23cf0412'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:58.479278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c85d506fb94c18954be47609cba122', 'request_id': 'req-68e5b0b9-6904-454e-a7e6-776d23cf0412'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:58.545024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] The token cache is being invalidate because project b0c85d506fb94c18954be47609cba122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:58.545024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:58.546007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-68e5b0b9-6904-454e-a7e6-776d23cf0412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:58.550523 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3493/6987] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:57 2022] DELETE /identity/v3/projects/b0c85d506fb94c18954be47609cba122 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:58.564279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771757f-faab-4b9d-b744-1bf617431a4f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:58.566749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771757f-faab-4b9d-b744-1bf617431a4f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:58.567190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771757f-faab-4b9d-b744-1bf617431a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:58.685641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:58.687264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:58.687880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:58.688474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] PATH_INFO: `/v3/projects/9414c27e5e724ab4956a3499d081bdca` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:58.699440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9414c27e5e724ab4956a3499d081bdca)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:58.708438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:58.712953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8771757f-faab-4b9d-b744-1bf617431a4f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:58.717117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8771757f-faab-4b9d-b744-1bf617431a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:58.736166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3494/6988] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:58.753799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:58.755166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:58.756689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:58.835487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:58.844735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:58.906470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3495/6989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:01:58.913905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:58.960792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cffa9-0a60-4bde-ae25-1a6132dc80ff None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:59.037739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:59.041864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:59.042822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:59.045303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:59.049315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:01:59.049875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:59.061228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:59.085231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9414c27e5e724ab4956a3499d081bdca', 'request_id': 'req-2c71552f-89da-4a7f-bef3-0cdb7310dca8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:59.113946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3496/6990] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:01:59.118483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:59.122902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9414c27e5e724ab4956a3499d081bdca', 'request_id': 'req-2c71552f-89da-4a7f-bef3-0cdb7310dca8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:59.153196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9414c27e5e724ab4956a3499d081bdca', 'request_id': 'req-2c71552f-89da-4a7f-bef3-0cdb7310dca8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:59.175758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d58a-f268-4883-b14f-12a077f7c2ee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:01:59.502585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:01:59.504043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:59.504504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:59.506111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:59.507461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:01:59.511415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:01:59.575125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] The token cache is being invalidate because project 9414c27e5e724ab4956a3499d081bdca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:01:59.576057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:59.580655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c71552f-89da-4a7f-bef3-0cdb7310dca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:01:59.596212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3495/6991] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:01:58 2022] DELETE /identity/v3/projects/9414c27e5e724ab4956a3499d081bdca => generated 0 bytes in 1353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:01:59.604559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd88e-d0cd-41d3-b3b5-ac5783af757f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:01:59.605934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd88e-d0cd-41d3-b3b5-ac5783af757f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:01:59.606904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd88e-d0cd-41d3-b3b5-ac5783af757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:01:59.681139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:59.694246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6f5bd88e-d0cd-41d3-b3b5-ac5783af757f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:01:59.700183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f5bd88e-d0cd-41d3-b3b5-ac5783af757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:59.712036 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3497/6992] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:01:59 2022] POST /identity/v3/projects => generated 361 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:01:59.718514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:01:59.726528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:01:59.923581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:59.994364 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3496/6993] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:00.010413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:00.013636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:00.014320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:00.061706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:00.064053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:00.088583 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3497/6994] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:00.091293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:00.152596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949a70-f5f1-47ea-a153-f89438764db8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:00.156712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b0e66-3761-447f-851d-e83edb41ee8c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:00.165898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:00.168077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:00.170485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:00.171007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:00.177238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:00.183048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:00.183347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:00.183497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:00.183497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:00.183497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:00.183497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:00.199620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:00.206945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:00.284069 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3498/6995] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:02:00.289135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:00.351637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e40cc-ead6-47f0-8c00-fc85ea855ee2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:00.414936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:00.422696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:00.423176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:00.425327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:00.435027 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3498/6996] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:01:59 2022] POST /identity/v3/users => generated 281 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:00.437069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:00.441153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:00.457580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:00.503262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4cfd-60e7-4fb9-8980-30078e47b63b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:00.549482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:00.550535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:00.551026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:00.551560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:00.572034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:00.576672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:00.655193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3499/6997] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:00.662120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:00.734412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3864a-e3ed-4107-b66c-7c082179aa48 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:00.742001 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3499/6998] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:00 2022] POST /identity/v3/projects => generated 369 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:00.758392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:01.045539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07946-b72f-4d7c-b046-b509c35c9c3a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:01.059295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:01.064693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.064693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.064693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.064693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:01.077401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:01.102593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:01.107254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.108811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.111431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.116809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:01.124212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:01.203763 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3500/6999] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:01.206019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:01.277227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23ffa0-2546-4247-90ce-711c30f6cf54 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:01.284763 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3500/7000] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:00 2022] POST /identity/v3/users => generated 285 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:01.292642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:01.294416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.314438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.314438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] PATH_INFO: `/v3/projects/38c1b9e029124bf4baadecd5672ec482/users/586bb0dbb658479a908154b21693a735/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.316695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:01.391961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c1b9e029124bf4baadecd5672ec482, user_id=586bb0dbb658479a908154b21693a735, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:01.402496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539ab02-2191-47e7-b614-bd7d7810270f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:01.407806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31049-214e-47e6-b238-0a9641f7e5ed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:01.459738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:01.461172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.461883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.466604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.468428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:01.482444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:01.561391 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3501/7001] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:01.569705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:01.630311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3501/7002] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:01 2022] PUT /identity/v3/projects/38c1b9e029124bf4baadecd5672ec482/users/586bb0dbb658479a908154b21693a735/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:01.666998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.668113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.671844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.672088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b999-067f-49eb-9149-80b3d9ec3f56 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:01.831971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] MFA Rules not processed for user `586bb0dbb658479a908154b21693a735`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:01.843686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:01.859669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:01.862697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:01.863459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:01.864293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:01.865974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:01.869707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:01.909169 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3502/7003] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:01.920569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:01.955386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:02.007897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5841d-f933-4bf1-8b50-25dd62167a64 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:02.024570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:02.026750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:02.027307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:02.028384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] PATH_INFO: `/v3/projects/51d74f68f27244308dd89aa722cf5f3a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:02.042623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d74f68f27244308dd89aa722cf5f3a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:02.050403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:02.064932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:02.110524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:02.268569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3502/7004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 604 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:02.274856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:02.394217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb965b99-cb92-4e3e-af2b-164d24cf4693 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:02.446446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d74f68f27244308dd89aa722cf5f3a', 'request_id': 'req-009e58f1-2ab5-4eae-80bf-6514f31bb353'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:02.493990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d74f68f27244308dd89aa722cf5f3a', 'request_id': 'req-009e58f1-2ab5-4eae-80bf-6514f31bb353'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:02.550552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d74f68f27244308dd89aa722cf5f3a', 'request_id': 'req-009e58f1-2ab5-4eae-80bf-6514f31bb353'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:02.696461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:02.697536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:02.698186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:02.698695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] PATH_INFO: `/v3/projects/07aabd9030f3444e986d02991f96bb44/users/6f9b945a4f00469bb06878d384cf1de3/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:02.746286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] The token cache is being invalidate because project 51d74f68f27244308dd89aa722cf5f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:02.750030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:02.754044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:02.761916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3503/7005] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:01 2022] DELETE /identity/v3/projects/51d74f68f27244308dd89aa722cf5f3a => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:02.773278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:02.777780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:02.785513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aabd9030f3444e986d02991f96bb44, user_id=6f9b945a4f00469bb06878d384cf1de3, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:02.791664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:02.900493 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3503/7006] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:02 2022] PUT /identity/v3/projects/07aabd9030f3444e986d02991f96bb44/users/6f9b945a4f00469bb06878d384cf1de3/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:02.903640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:02.918573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:03.033360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e58f1-2ab5-4eae-80bf-6514f31bb353 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:03.209444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300076-f7c7-4b56-9190-3115d673f56b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:03.220359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:03.222921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:03.223629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:03.224974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:03.229748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:03.246146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:03.247993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:03.248757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:03.249464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:03.253377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:03.524870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:03.527848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:03.533733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:03.537577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672931c3-f326-40e0-a65f-0f4b23a57088 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:03.562207 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3504/7007] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:03.564400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:03.566756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:03.588735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:03.601124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3504/7008] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:03.603740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a39f-7dcb-4696-8f80-4abf3a7dba96 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:03.604360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a39f-7dcb-4696-8f80-4abf3a7dba96 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:03.607602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a39f-7dcb-4696-8f80-4abf3a7dba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:03.688993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ee9a39f-7dcb-4696-8f80-4abf3a7dba96 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:03.697860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ee9a39f-7dcb-4696-8f80-4abf3a7dba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:03.741553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:03.849090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6d97-69c1-4ab7-b261-9954a6586176 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:03.878106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:03.879427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:03.879941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:03.881495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] PATH_INFO: `/v3/users/3352fd9f96b844dfb63870cfff7b0718` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:03.886516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3352fd9f96b844dfb63870cfff7b0718)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:03.890757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:03.991072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3505/7009] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:03.993619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5289-3f10-4206-b00e-9bc229df1a3c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:03.994145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5289-3f10-4206-b00e-9bc229df1a3c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:03.994687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b5289-3f10-4206-b00e-9bc229df1a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:04.055085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-995b5289-3f10-4206-b00e-9bc229df1a3c None None] MFA Rules not processed for user `6f9b945a4f00469bb06878d384cf1de3`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:04.057544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-995b5289-3f10-4206-b00e-9bc229df1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:04.362843 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3506/7010] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:04.365770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:04.368111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:04.368846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:04.472006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3352fd9f96b844dfb63870cfff7b0718'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:04.476366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:04.489283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:04.547794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3507/7011] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:04.547794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:04.617120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3f29d-c0fb-4c71-862f-e0e97f8b4bdc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:04.629602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:04.632259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:04.633605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:04.636156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:04.654902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3352fd9f96b844dfb63870cfff7b0718'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:04.678584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:04.697919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:04.701219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3352fd9f96b844dfb63870cfff7b0718'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:04.774051 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3508/7012] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:04.774353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3352fd9f96b844dfb63870cfff7b0718'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:04.776053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-63fcf417-8d00-4242-8d9d-5160cff33a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3352fd9f96b844dfb63870cfff7b0718'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:04.782567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:04.796043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3505/7013] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:03 2022] DELETE /identity/v3/users/3352fd9f96b844dfb63870cfff7b0718 => generated 0 bytes in 1233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:04.804373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:04.804908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:04.805483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:04.846393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55a916-333e-4953-8684-1bce43e8f3b0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:04.879865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:04.883185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:05.058415 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3506/7014] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:05.081991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:05.082650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:05.082938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:05.083376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:05.085199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:05.085798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:05.090596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:05.133058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3509/7015] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:02:05.144072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:05.149897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:05.179481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caebdef-979e-4a63-8139-1366f98aba57 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:05.189710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:05.191091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:05.191676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:05.192278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:05.201123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:05.205274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:05.425132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:05.425801 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3507/7016] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:05 2022] POST /identity/v3/projects => generated 371 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:05.467441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6bb0-adcb-402a-a840-07b916c61381 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:05.507129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:05.623012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:05.624461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:05.624986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:05.625495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:05.627021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:05.632259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:05.911527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:05.916404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:05.924490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3510/7017] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:05 2022] POST /identity/v3/users => generated 286 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:05.934703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:05.961397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:05.982735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8753a8-16e3-40db-bf64-a3cb991992e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:06.011572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:06.013905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:06.013905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:06.014489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:06.015398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:06.018755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:06.062424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3511/7018] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:06.064979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:06.090310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd6630-8e38-4c21-b47e-aa0c05e1f362 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:06.103438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:06.104945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:06.105747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:06.106176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:06.107719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:06.111255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:06.148977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3512/7019] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:02:06.152237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:06.191663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42540-cfcf-4b24-b323-26f9c5c481f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:06.220871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8946d-d994-4dbd-a195-66c61f7ec4e5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:06.222075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:06.225546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:06.226043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:06.226545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] PATH_INFO: `/v3/projects/8e06a2773f524b409a2acfc334d8abbe/users/bd38028303ba41288608538da071716b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:06.236740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:06.237955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:06.239777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:06.240438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:06.296115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:06.300017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017328fc-b201-4755-9147-8c9aee433455 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:06.307482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e06a2773f524b409a2acfc334d8abbe, user_id=bd38028303ba41288608538da071716b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:06.323511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:06.349136 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3508/7020] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:06.519092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3513/7021] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:06 2022] PUT /identity/v3/projects/8e06a2773f524b409a2acfc334d8abbe/users/bd38028303ba41288608538da071716b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:06.541354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:06.542688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:06.542688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:06.602482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] MFA Rules not processed for user `bd38028303ba41288608538da071716b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:06.604478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:06.817411 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3509/7022] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:06.841132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:06.844442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:07.011782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e244-fe76-43fc-b08b-b7ffe63632dc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:07.020220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:07.021448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:07.021994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:07.022557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:07.054756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:07.057496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc2d9a-5b72-47c4-8860-868d86087b94 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:07.073484 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3514/7023] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:08.138692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:08.141147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:08.401874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d2fc1-f206-4ff5-a1b2-31b773ec97fb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:08.426399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:08.427701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:08.428722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:08.429198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] PATH_INFO: `/v3/projects/98ce5f7990b74f0f956eeabc4adb3c44` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:08.440634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ce5f7990b74f0f956eeabc4adb3c44)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:08.445039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:08.797503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:08.854498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ce5f7990b74f0f956eeabc4adb3c44', 'request_id': 'req-41c1b83f-4cd3-48f1-a402-f3609f7734e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:08.898475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ce5f7990b74f0f956eeabc4adb3c44', 'request_id': 'req-41c1b83f-4cd3-48f1-a402-f3609f7734e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:08.919084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ce5f7990b74f0f956eeabc4adb3c44', 'request_id': 'req-41c1b83f-4cd3-48f1-a402-f3609f7734e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:09.063534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] The token cache is being invalidate because project 98ce5f7990b74f0f956eeabc4adb3c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:09.064221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:09.065717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-41c1b83f-4cd3-48f1-a402-f3609f7734e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:09.071247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3510/7024] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:08 2022] DELETE /identity/v3/projects/98ce5f7990b74f0f956eeabc4adb3c44 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:09.091548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:09.092507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:09.093164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:09.173654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:09.176633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:09.464872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3515/7025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:09.492884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:09.493793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:09.494106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:09.570525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:09.573394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:09.635672 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3511/7026] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:09.644958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:09.664220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:09.700941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9458d-0813-4aab-b9a3-bf6a272aec70 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:09.722168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:09.727572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:09.731699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:09.732458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:09.733981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:09.737738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:09.756965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:09.799950 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3516/7027] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:02:09.810782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:09.873355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fec2b-1da7-49d5-a7b0-0b9996a3efa8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:09.900655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:09.905574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:09.905574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:09.905574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:09.910235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:09.928752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:10.236977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3512/7028] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:09 2022] POST /identity/v3/projects => generated 393 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:10.242967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:10.262037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1b63-b908-4d65-b494-3bab58896705 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:10.728964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:10.733391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:10.734729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:10.734729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:10.739905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:10.760254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:11.003913 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3517/7029] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:10 2022] POST /identity/v3/users => generated 297 bytes in 761 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:11.006618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:11.053228 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a8c5-0b42-4d5c-9a3a-c82157e6e3d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:11.080662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:11.084585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:11.086886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:11.087757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:11.092172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:11.101612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:11.163658 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3513/7030] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:02:11.169705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:11.221824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548417c-b32f-4ea6-822d-b318b295212a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:11.261313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:11.263816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:11.264732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:11.267981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:11.269941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:11.288078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77487a-405e-4abc-b470-b0d4f3e1a3d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:11.344490 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3518/7031] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:11.357805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:11.387580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c077f6-4f02-4966-b797-c316a8c60f7e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:11.416350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:11.418263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:11.424051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:11.424997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] PATH_INFO: `/v3/projects/2f27496d38be44c29c3cd5bc4ae008d8/users/626d1f96e801458eba55b56ff8fb3672/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:11.532649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f27496d38be44c29c3cd5bc4ae008d8, user_id=626d1f96e801458eba55b56ff8fb3672, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:11.549150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:11.759234 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3514/7032] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:11 2022] PUT /identity/v3/projects/2f27496d38be44c29c3cd5bc4ae008d8/users/626d1f96e801458eba55b56ff8fb3672/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:11.785827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:11.785827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:11.785827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:11.948261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] MFA Rules not processed for user `626d1f96e801458eba55b56ff8fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:11.957970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:12.075105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:12.080627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:12.422450 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3519/7033] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:12.434076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:12.571460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e7709-ed5b-4d7d-93c4-4340d61ad8f1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:12.619458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:12.628473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:12.629035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:12.629521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] PATH_INFO: `/v3/users/bd38028303ba41288608538da071716b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:12.639982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd38028303ba41288608538da071716b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:12.658846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:12.711662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b26e-8dde-46b2-9898-6475052ac7c2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:12.738593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:12.739805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:12.740488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:12.741145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:12.742550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:12.749894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:12.806709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:13.034076 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3520/7034] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:12 2022] POST /identity/v3/projects => generated 391 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:13.036612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:13.151573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd38028303ba41288608538da071716b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:13.335800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd38028303ba41288608538da071716b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:13.392350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd38028303ba41288608538da071716b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:13.403017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:13.470505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd38028303ba41288608538da071716b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:13.473052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a752acd-bdc0-44d3-a4c6-f10f1c6a0d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd38028303ba41288608538da071716b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:13.473740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a91b22-8683-40f3-beb4-77d92d14f045 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:13.500504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:13.502404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:13.505349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:13.507367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:13.522193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3515/7035] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:12 2022] DELETE /identity/v3/users/bd38028303ba41288608538da071716b => generated 0 bytes in 1446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:13.523777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:13.530604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:13.531894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:13.534509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:13.536001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:13.637108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:13.651254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:13.867748 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3521/7036] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:13 2022] POST /identity/v3/users => generated 302 bytes in 832 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:13.873732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:13.883757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:13.970078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9b50-82d7-4c65-9bb5-7b8c1467d488 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:14.024852 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3516/7037] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:14.319938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:14.322793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:14.553604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:14.559355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:14.563715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:14.564044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:14.565040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:14.580384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:14.692153 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3522/7038] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 813 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:14.696267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:14.779764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcebd2b-8eaf-4729-9741-efe46f1d8d3a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:14.806656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:14.811750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:14.811750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:14.811750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] PATH_INFO: `/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6/users/224fe404839f47d0b34d816d7c96d223/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:14.819860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055b1d7-0bf9-4afd-a6a2-824953d38680 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:14.849991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:14.857831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:14.859424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:14.869306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:14.880738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b33f33c0e92496ca5f6ca0cb55cafc6, user_id=224fe404839f47d0b34d816d7c96d223, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:14.895173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:14.914259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:14.921033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:14.966859 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3517/7039] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:15.100941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3523/7040] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:14 2022] PUT /identity/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6/users/224fe404839f47d0b34d816d7c96d223/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:15.103547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:15.135124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e16450-a06d-4f7a-a536-cfaa5c433879 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:15.376924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:15.390466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:15.391575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:15.392694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:15.395260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:15.401704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa5894-ba76-4a0f-94ed-f0af4f411b1d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:15.438746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3518/7041] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:15.446824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:15.483093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437e056-551d-4712-90cb-e3eb857dd9f5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:15.522240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:15.523699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:15.524291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:15.524837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] PATH_INFO: `/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6/users/224fe404839f47d0b34d816d7c96d223/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:15.534802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b33f33c0e92496ca5f6ca0cb55cafc6, user_id=224fe404839f47d0b34d816d7c96d223, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:15.540441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:15.579667 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3524/7042] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:15 2022] PUT /identity/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6/users/224fe404839f47d0b34d816d7c96d223/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:15.605463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:15.615654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:15.615654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:15.690600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] MFA Rules not processed for user `224fe404839f47d0b34d816d7c96d223`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:15.692341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:15.723546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:15.973005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3519/7043] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:16.016927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:16.021999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:16.125569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:16.257092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505dd8-3d3e-4f69-b55b-8938c863f549 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:16.269781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:16.271229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:16.272143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:16.273257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:16.278117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:16.468297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:16.473498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af098-4a4e-44fe-89a5-9acbdc8ff1f0 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:16.502907 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3525/7044] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:02:19.284007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:19.286696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:19.659726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799feb-cbb9-4eeb-87a9-656015704868 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:19.695785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:19.697365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:19.697826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:19.698428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] PATH_INFO: `/v3/projects/8e06a2773f524b409a2acfc334d8abbe` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:19.701601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e06a2773f524b409a2acfc334d8abbe)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:19.706755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:20.046606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e06a2773f524b409a2acfc334d8abbe', 'request_id': 'req-49baf0a7-6025-483e-be4a-ad5269171b52'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:20.119595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e06a2773f524b409a2acfc334d8abbe', 'request_id': 'req-49baf0a7-6025-483e-be4a-ad5269171b52'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:20.162766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e06a2773f524b409a2acfc334d8abbe', 'request_id': 'req-49baf0a7-6025-483e-be4a-ad5269171b52'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:20.349707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] The token cache is being invalidate because project 8e06a2773f524b409a2acfc334d8abbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:20.350825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:20.352040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-49baf0a7-6025-483e-be4a-ad5269171b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:20.357409 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3520/7045] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:19 2022] DELETE /identity/v3/projects/8e06a2773f524b409a2acfc334d8abbe => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:20.367544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:20.369161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:20.376220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:20.444411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:20.451093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:20.714397 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3526/7046] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:20.730213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:20.731576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:20.731576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:20.818741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:20.818741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:20.847077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:20.857159 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3521/7047] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:20.884468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae889ec-ded4-4c65-a77a-91843755d0d7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:20.915927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:20.915927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:20.915927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:20.915927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:20.916656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:20.916656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:20.920374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:21.008007 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3527/7048] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:02:21.015835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:21.063374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb04f6-bae1-4ddc-aa86-f26b3a5f8a85 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:21.095253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:21.096811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:21.097556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:21.098288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:21.100062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:21.110122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:21.309936 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3522/7049] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:21 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:21.317317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:21.351747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092daeb-1246-48d9-a935-1d4147b72656 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:21.592592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:21.669341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:21.676191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:21.680565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:21.683982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:21.690602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:21.700085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:21.993645 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3528/7050] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:21 2022] POST /identity/v3/users => generated 293 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:22.002776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:22.038621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4038ec-a3ab-4cd2-838b-010fa8d168cc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:22.058452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:22.065962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:22.065962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:22.065962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:22.070110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:22.073721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:22.089818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:22.131552 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3523/7051] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:22.138871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:22.207032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588f0c-8ad6-475d-97bc-bee3ad45a1e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:22.234536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:22.238680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:22.239243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:22.239680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:22.241530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:22.244321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe6369-90ae-4013-94aa-68e505532fa5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:22.343719 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3529/7052] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:22.350891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:22.387703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8ce3-e98a-48bd-bfa4-d14fb2472f62 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:22.406653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:22.408533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:22.409636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:22.411425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] PATH_INFO: `/v3/projects/d5b04031831a47bb8165bc6090e713ee/users/121a0e5737b84510b68f761b1b228fd1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:22.487363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b04031831a47bb8165bc6090e713ee, user_id=121a0e5737b84510b68f761b1b228fd1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:22.500913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:22.735089 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3524/7053] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:22 2022] PUT /identity/v3/projects/d5b04031831a47bb8165bc6090e713ee/users/121a0e5737b84510b68f761b1b228fd1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:22.762690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881b13-247d-4a48-863c-778403d5483b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:22.763456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881b13-247d-4a48-863c-778403d5483b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:22.763968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881b13-247d-4a48-863c-778403d5483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:22.861184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ca881b13-247d-4a48-863c-778403d5483b None None] MFA Rules not processed for user `121a0e5737b84510b68f761b1b228fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:22.865779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ca881b13-247d-4a48-863c-778403d5483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:23.079050 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3530/7054] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:23.080312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:23.187614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881b13-247d-4a48-863c-778403d5483b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:23.190604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ca881b13-247d-4a48-863c-778403d5483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:23.464983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a473e-2be4-43c6-aeb0-3acada36be26 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:23.486606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:23.487840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:23.488575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:23.489076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:23.495868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:23.509668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:23.516321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881b13-247d-4a48-863c-778403d5483b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:23.545870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:23.551976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:23.552692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:23.553332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] PATH_INFO: `/v3/users/5a000cac2d734931927f4a55cc0a4d7f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:23.558523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a000cac2d734931927f4a55cc0a4d7f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:23.574020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:23.744122 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3525/7055] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:23 2022] POST /identity/v3/projects => generated 383 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:23.746027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:23.983920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a000cac2d734931927f4a55cc0a4d7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:23.991726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a000cac2d734931927f4a55cc0a4d7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:24.024221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf342f8-478e-42d8-a326-ce00611c2a5a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:24.039358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:24.041208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:24.041829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:24.042448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:24.045088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:24.050194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:24.197497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a000cac2d734931927f4a55cc0a4d7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:24.206234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:24.270038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3526/7056] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:23 2022] POST /identity/v3/users => generated 298 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:24.282174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:24.284052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a000cac2d734931927f4a55cc0a4d7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:24.338575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8a2a094b-519a-41bb-95d9-5c43282a933d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a000cac2d734931927f4a55cc0a4d7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:24.373756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1fc0-e2a5-4ce4-897e-6cdc7af8f668 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:24.423644 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3531/7057] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:23 2022] DELETE /identity/v3/users/5a000cac2d734931927f4a55cc0a4d7f => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:02:24.432673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:24.433208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:24.439289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:24.440513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:24.445336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:24.447583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:24.450814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:24.459170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:24.476678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:24.577429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3527/7058] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:24.579191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:24.605786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:24.630119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:24.657729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:24.724823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12d9e2-5e5c-488e-8f76-ca32b6ad02e7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:24.969459 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3532/7059] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:25.001278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:25.006373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:25.036894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:25.044323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:25.044323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:25.044323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] PATH_INFO: `/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0/users/3dc865fe462e474c8eca397ae89f3e64/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:25.113904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09b9c0d050c4bd28053a22fabbc84e0, user_id=3dc865fe462e474c8eca397ae89f3e64, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:25.136614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:25.363632 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3528/7060] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:24 2022] PUT /identity/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0/users/3dc865fe462e474c8eca397ae89f3e64/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:25.366630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbded7f6-f170-4db7-88eb-1c07515aa6ea None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:25.370807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:25.588783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:25.592164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:25.592164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:25.596753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:25.654761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:25.703849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f3f48-1f9f-4348-af51-ba57380755f1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:25.722612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:25.727198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:25.734432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:25.734432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:25.734432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:25.741560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:25.797268 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3529/7061] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:25.803980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:25.877213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7961-beba-422e-a72a-f6627b3fe0a9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:25.910461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:25.912821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:25.916162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:25.919019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] PATH_INFO: `/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0/users/3dc865fe462e474c8eca397ae89f3e64/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:25.934407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09b9c0d050c4bd28053a22fabbc84e0, user_id=3dc865fe462e474c8eca397ae89f3e64, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:25.934883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:25.938738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:25.941921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babe27-cfff-4986-9596-b9c1e2e08d99 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:25.983228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3530/7062] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:25 2022] PUT /identity/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0/users/3dc865fe462e474c8eca397ae89f3e64/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:02:25.983955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3533/7063] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 984 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:26.002502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:26.004997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:26.008260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:26.249982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] MFA Rules not processed for user `3dc865fe462e474c8eca397ae89f3e64`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:26.252805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:26.571303 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3531/7064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:26.744316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:26.744316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:26.779934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83020b6d-39af-4a32-bb20-b63758840418 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:26.958085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:26.966252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:26.967346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:26.968339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:26.973513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:27.172467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:27.175985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:27.196177 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3534/7065] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:27.490369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:27.493780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:27.647229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:27.773971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04620-e348-40fd-9ac2-e2d1cf971dce None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:27.784238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:27.785685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:27.786246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:27.787520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] PATH_INFO: `/v3/projects/08f99ad15fe84fa2b388cd850f27c012` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:27.808306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f99ad15fe84fa2b388cd850f27c012)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:27.820580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:27.907047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:28.176420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f99ad15fe84fa2b388cd850f27c012', 'request_id': 'req-1a14a0da-1f22-4d8a-a801-9f898d8b2220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:28.196670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f99ad15fe84fa2b388cd850f27c012', 'request_id': 'req-1a14a0da-1f22-4d8a-a801-9f898d8b2220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:28.213621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f99ad15fe84fa2b388cd850f27c012', 'request_id': 'req-1a14a0da-1f22-4d8a-a801-9f898d8b2220'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:28.384260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] The token cache is being invalidate because project 08f99ad15fe84fa2b388cd850f27c012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:28.384800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:28.388921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:28.402417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3532/7066] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:27 2022] DELETE /identity/v3/projects/08f99ad15fe84fa2b388cd850f27c012 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:28.406420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:28.457814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470538d-0b3b-4fa9-81e3-1a0aebf8c335 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:28.754142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:28.756502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:28.757015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:28.757539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] PATH_INFO: `/v3/users/bf3f7e6202b740939e2facd56e11504b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:28.764250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3f7e6202b740939e2facd56e11504b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:28.777040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:29.337790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3f7e6202b740939e2facd56e11504b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:29.338948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3f7e6202b740939e2facd56e11504b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:29.554182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3f7e6202b740939e2facd56e11504b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:29.592217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3f7e6202b740939e2facd56e11504b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:29.615953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3f7e6202b740939e2facd56e11504b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:29.631736 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3535/7067] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:28 2022] DELETE /identity/v3/users/bf3f7e6202b740939e2facd56e11504b => generated 0 bytes in 1227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:29.688143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:30.325282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:30.328855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:30.491742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a0da-1f22-4d8a-a801-9f898d8b2220 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:30.662665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:30.664578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:30.665506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:30.666782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:30.670629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:30.776588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:30.897093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:30.900840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32ec0-ab83-4c3c-90e2-0f8fbfde879c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:30.954317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3533/7068] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:32.397192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:32.401759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:32.664883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accf6e-38dc-4145-bde5-310d16910b1e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:32.678496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:32.679596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:32.680058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:32.681209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] PATH_INFO: `/v3/projects/0b74fdefe17748aeb69be52d4337526c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:32.683627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b74fdefe17748aeb69be52d4337526c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:32.688398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:32.964056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b74fdefe17748aeb69be52d4337526c', 'request_id': 'req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:33.102209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b74fdefe17748aeb69be52d4337526c', 'request_id': 'req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:33.134709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b74fdefe17748aeb69be52d4337526c', 'request_id': 'req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:33.192301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] The token cache is being invalidate because project 0b74fdefe17748aeb69be52d4337526c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:33.195946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:33.197804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0fc85f5d-8c0f-4136-9f21-4d8ba8b524d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:33.214095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3536/7069] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:32 2022] DELETE /identity/v3/projects/0b74fdefe17748aeb69be52d4337526c => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:33.217034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:33.217836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:33.218302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:33.291445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:33.296478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:33.628292 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3534/7070] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:33.831706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:33.833272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:33.834909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:33.947511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:33.956308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:34.044369 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3537/7071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:34.053600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:34.093340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938bac-1b8e-4f9a-9246-c26bd90e255b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:34.105026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:34.106144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:34.106881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:34.107503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:34.109029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:34.109517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:34.112982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:34.170886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:34.180065 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3535/7072] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:02:34.206671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5b0e2-f9c9-4134-9da2-27a09b404831 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:34.217215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:34.218779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:34.219621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:34.220157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:34.221416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:34.225522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:34.374183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:34.386757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3538/7073] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:34 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:34.429780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff34d3-2229-4200-a6fa-053235f15944 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:34.787466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:34.794651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:34.794651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:34.794651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:34.796623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:34.808932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:34.972230 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3536/7074] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:34 2022] POST /identity/v3/users => generated 291 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:34.980019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:35.028906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3737-b673-4819-81aa-c59788e58c8d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:35.047343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:35.054292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:35.055310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:35.056189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:35.058282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:35.062787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:35.130590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:35.137642 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3539/7075] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:02:35.175834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f56e6b-2eb1-4241-bc8d-e2a702020b8a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:35.217889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:35.219347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:35.220146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:35.227831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:35.229492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:35.233000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b60068-2483-4e78-9482-609f01486ac8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:35.310404 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3537/7076] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:35.317324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:35.341484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:35.370703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e933fe-2e78-463c-9a8d-34acfe0f3b8a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:35.418508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:35.426974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:35.429527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:35.430177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] PATH_INFO: `/v3/projects/ec1b0b0f9b7d4529945c159db6187b31/users/0907cb7b366c4ca1bbfa529663952c9f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:35.541974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1b0b0f9b7d4529945c159db6187b31, user_id=0907cb7b366c4ca1bbfa529663952c9f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:35.556144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:35.757837 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3540/7077] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:35 2022] PUT /identity/v3/projects/ec1b0b0f9b7d4529945c159db6187b31/users/0907cb7b366c4ca1bbfa529663952c9f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:35.762491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:35.763712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:35.764345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:35.889363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] MFA Rules not processed for user `0907cb7b366c4ca1bbfa529663952c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:35.895811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:36.004718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:36.222460 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3538/7078] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:36.231027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:36.457303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70343fe-3d41-4f57-9f57-5e73a88c4713 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:36.483371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:36.484673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:36.485250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:36.485808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:36.487234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:36.491606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:36.711590 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3541/7079] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:36 2022] POST /identity/v3/projects => generated 381 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:36.714232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:36.769400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6580d-6ba0-463f-bd98-4b6b1510c580 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:37.035848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:37.037916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:37.038730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:37.039499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:37.042092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:37.049409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:37.245634 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3539/7080] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:36 2022] POST /identity/v3/users => generated 291 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:37.252793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:37.275295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c639a-70d9-442c-baf8-a757a15639d6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:37.289910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:37.293854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:37.294735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:37.295498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:37.297417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:37.304025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:37.336543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3542/7081] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:37.343234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:37.376503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38346528-e06f-40fc-beae-0fbe30f2a311 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:37.394331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:37.395528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:37.396293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:37.396851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:37.401202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:37.423571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f4b9a-8b64-48ac-8802-3f658c983e6d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:37.482018 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3540/7082] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:37.487547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:37.539436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e208-0106-471d-8248-f260dfc787d4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:37.565786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:37.570718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:37.573652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:37.574643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] PATH_INFO: `/v3/projects/4e0db5a97f1441379250ee402cb8fece/users/08c4edd2869b47dcbd2c1b987b45b81a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:37.648577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0db5a97f1441379250ee402cb8fece, user_id=08c4edd2869b47dcbd2c1b987b45b81a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:37.663614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:37.859513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3543/7083] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:37 2022] PUT /identity/v3/projects/4e0db5a97f1441379250ee402cb8fece/users/08c4edd2869b47dcbd2c1b987b45b81a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:37.864496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:37.865422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:37.865619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:37.979407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] MFA Rules not processed for user `08c4edd2869b47dcbd2c1b987b45b81a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:37.981363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:38.171321 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3541/7084] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:38.178545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:38.456038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1890-68d1-45a9-820f-6832cde29c64 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:38.466904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:38.468370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:38.468544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:38.469155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:38.471362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:38.475943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:38.744423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3544/7085] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:02:38.752468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:38.792899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aad20a-0f9f-4cce-94eb-cd7bb5788c1d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:38.944674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:39.100029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:39.103369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:39.105450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:39.107586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:39.109777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:39.122396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:39.292674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3542/7086] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:38 2022] POST /identity/v3/users => generated 297 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:39.299927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:39.368809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7fa4-c94d-4a93-8efe-d8d3e0b149aa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:39.398457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:39.401363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:39.406244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:39.407725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:39.410812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:39.415938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:39.490472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3545/7087] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:39.493541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:39.526809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf35c1-7bd2-4ffb-8f8a-bf126bcebc57 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:39.553521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:39.556102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:39.559361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:39.563067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] PATH_INFO: `/v3/projects/87105786ed774112b160fb3d6aeb914f/users/0c8fa9a03a564ed49107a476d239a3c0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:39.639618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87105786ed774112b160fb3d6aeb914f, user_id=0c8fa9a03a564ed49107a476d239a3c0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:39.666430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:39.811195 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3543/7088] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:39 2022] PUT /identity/v3/projects/87105786ed774112b160fb3d6aeb914f/users/0c8fa9a03a564ed49107a476d239a3c0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:39.819097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:39.835079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:39.850782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4201b-b833-4d6d-b557-443535ed63f7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:40.110159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:40.111505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:40.112171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:40.112733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:40.114547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:40.118040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbbd9-5a77-482c-b2cd-1b981dd4754c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:40.164491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:40.166168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3546/7089] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:40.203749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249880b-3b8d-4d40-9fa5-86ef9ea16304 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:40.227484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:40.230923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:40.232482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:40.235634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] PATH_INFO: `/v3/projects/87105786ed774112b160fb3d6aeb914f/users/0c8fa9a03a564ed49107a476d239a3c0/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:40.248640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87105786ed774112b160fb3d6aeb914f, user_id=0c8fa9a03a564ed49107a476d239a3c0, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:40.261590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:40.310371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3544/7090] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:40 2022] PUT /identity/v3/projects/87105786ed774112b160fb3d6aeb914f/users/0c8fa9a03a564ed49107a476d239a3c0/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:40.346413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:40.347158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:40.349215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:40.452718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] MFA Rules not processed for user `0c8fa9a03a564ed49107a476d239a3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:40.456169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:40.745369 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3547/7091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:40.796701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:40.801034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:41.060745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634771a8-90f7-402b-9a06-d8f513c0504c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:41.070923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:41.072902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:41.072902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:41.074104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:41.256125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:41.267364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:41.316388 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3545/7092] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:44.313998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:44.316605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:44.372750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace014e-3cc0-4271-a535-3d87cac796e0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:44.386865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:44.387707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:44.388213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:44.388711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:44.399173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:44.642521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:44.700653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:44.772160 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3548/7093] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:46.605259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:46.610462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:46.823258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:46.917172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35065e-a2b7-4ec5-8412-299d9433bbf0 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:46.927912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:46.929698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:46.930653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:46.931659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] PATH_INFO: `/v3/users/b4449b4b4db04ed1a91efcbedd26f093` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:46.934440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4449b4b4db04ed1a91efcbedd26f093)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:46.939458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:47.514739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:47.518502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:47.557198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4449b4b4db04ed1a91efcbedd26f093'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:47.571221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f06de-9b29-4d36-acde-750a14fc33ed service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:47.623168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:47.624773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:47.625278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:47.626189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] PATH_INFO: `/v3/users/878a0e020dc445e089c0b56b21a57b3a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:47.633521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878a0e020dc445e089c0b56b21a57b3a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:47.642788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:47.726999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:47.730970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4449b4b4db04ed1a91efcbedd26f093'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:47.781993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4449b4b4db04ed1a91efcbedd26f093'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:47.848781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4449b4b4db04ed1a91efcbedd26f093'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:47.851667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5f1a06e2-53f4-4ab4-b6f7-aaa591230195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4449b4b4db04ed1a91efcbedd26f093'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:47.869455 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3546/7094] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:46 2022] DELETE /identity/v3/users/b4449b4b4db04ed1a91efcbedd26f093 => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:47.877332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:47.878536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:47.879731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:47.939614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:47.942576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:48.107509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878a0e020dc445e089c0b56b21a57b3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:48.112631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878a0e020dc445e089c0b56b21a57b3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:48.236424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878a0e020dc445e089c0b56b21a57b3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:48.284513 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3547/7095] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:48.295755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:48.298525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:48.304064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878a0e020dc445e089c0b56b21a57b3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:48.343444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1f1ffcce-456b-434c-ad43-59ae72314091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878a0e020dc445e089c0b56b21a57b3a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:48.376410 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3549/7096] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:47 2022] DELETE /identity/v3/users/878a0e020dc445e089c0b56b21a57b3a => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:48.385968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:48.386519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:48.388863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:48.494596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:48.500286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:48.504270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e960e-bde6-451d-87b2-11cb6aa559e7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:48.556487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:48.828475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:48.830350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:48.831092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:48.831956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:48.843834 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3550/7097] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:48.848783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:48.906662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:48.915015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:48.932494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:48.937484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:48.966654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3548/7098] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:02:49.011909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34790d-19f1-47a2-bb35-b0e54a443244 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:49.020436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:49.021785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:49.022368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:49.023042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:49.051856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:49.055659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cb85-0cba-417c-bde7-8b556234b350 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:49.082041 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3551/7099] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:02:50.051062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:50.054528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:50.092830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5f30e-d009-401a-8ff2-da6be49c4b4b service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:50.108181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:50.110224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:50.110922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:50.111882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] PATH_INFO: `/v3/projects/ca7f2bba3c69407a8ea0d332797a7f98` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:50.116330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7f2bba3c69407a8ea0d332797a7f98)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:50.122126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:50.418162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7f2bba3c69407a8ea0d332797a7f98', 'request_id': 'req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:50.439513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7f2bba3c69407a8ea0d332797a7f98', 'request_id': 'req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:50.460445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7f2bba3c69407a8ea0d332797a7f98', 'request_id': 'req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:50.613382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] The token cache is being invalidate because project ca7f2bba3c69407a8ea0d332797a7f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:50.613843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:50.615455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cc7729fb-79cd-4a77-b2af-c9d3271e9ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:50.622026 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3549/7100] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:50 2022] DELETE /identity/v3/projects/ca7f2bba3c69407a8ea0d332797a7f98 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:50.625762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:50.628449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:50.629026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:50.692117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:50.696891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:50.969855 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3552/7101] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:50.994264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:50.995518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:50.996268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:51.054524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:51.061713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:51.093127 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3550/7102] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:51.100421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:51.137508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19308b3-37e7-4474-a225-851bdb466260 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:51.164413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:51.165243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:51.165647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:51.166830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:51.167899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:51.168348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:51.171900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:51.284508 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3553/7103] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:02:51.293279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:51.337057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1dd15-2306-47aa-a201-a90acf44617c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:51.357941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:51.361377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:51.364347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:51.368537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:51.371587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:51.384063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:51.625496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3551/7104] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:51 2022] POST /identity/v3/projects => generated 405 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:51.632484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:51.678708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85543270-c670-48ca-874c-8d89e8efb3fc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:51.695800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:51.972070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:51.974572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:51.974982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:51.975794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:51.977419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:51.990648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:52.125124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3554/7105] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:51 2022] POST /identity/v3/users => generated 303 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:52.138165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:52.174022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d8b8b-6a5b-4cfd-99af-91441c4ca059 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:52.189368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:52.192120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:52.193275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:52.195701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:52.197566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:52.205042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:52.238774 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3552/7106] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:52.244342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:52.267218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251236-fef9-4a3d-8e54-1ca05e899428 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:52.278281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:52.283974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:52.283974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:52.283974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:52.283974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:52.287991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358004-7578-4f70-a75f-42d16964a169 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:52.321284 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3555/7107] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:02:52.327719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:52.353713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066994f-44f4-4d98-bbfc-43d605871950 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:52.366989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:52.368806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:52.370015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:52.370773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] PATH_INFO: `/v3/projects/1562d48ed80140b0ab30161d95fcf5d6/users/a8e663a672cf4139b6d830c19b1630dd/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:52.433438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1562d48ed80140b0ab30161d95fcf5d6, user_id=a8e663a672cf4139b6d830c19b1630dd, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:52.446031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:52.560638 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3553/7108] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:52 2022] PUT /identity/v3/projects/1562d48ed80140b0ab30161d95fcf5d6/users/a8e663a672cf4139b6d830c19b1630dd/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:52.571348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:52.572926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:52.572926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:52.737763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] MFA Rules not processed for user `a8e663a672cf4139b6d830c19b1630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:52.746914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:53.187467 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3556/7109] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:53.195444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:53.283091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:53.374498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246b09-d657-40fa-8a0f-eea236879c62 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:53.387899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:53.389952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:53.390786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:53.391513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:53.392992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:53.397157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:53.465079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:53.472504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:53.520174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d9cbb-9d49-4ef3-acf0-ead132707a3f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:53.571829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:53.575966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:53.579539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:53.582319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] PATH_INFO: `/v3/projects/1befee7230d44241b69bd63aca2ceeca` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:53.597391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1befee7230d44241b69bd63aca2ceeca)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:53.629399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:53.632467 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3554/7110] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:53 2022] POST /identity/v3/projects => generated 405 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:53.640865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:53.945191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397e5a6-21ed-4868-9eb0-8796a545edde admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:53.961209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1befee7230d44241b69bd63aca2ceeca', 'request_id': 'req-abe98c3b-9826-4c9f-ab58-c164103ceb75'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.048777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1befee7230d44241b69bd63aca2ceeca', 'request_id': 'req-abe98c3b-9826-4c9f-ab58-c164103ceb75'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.069466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1befee7230d44241b69bd63aca2ceeca', 'request_id': 'req-abe98c3b-9826-4c9f-ab58-c164103ceb75'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.107612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:54.138591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] The token cache is being invalidate because project 1befee7230d44241b69bd63aca2ceeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:54.140147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.143782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.154168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3557/7111] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:53 2022] DELETE /identity/v3/projects/1befee7230d44241b69bd63aca2ceeca => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:02:54.158280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:54.160650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:54.163253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:54.168990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:54.168990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:54.170302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:54.174869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:54.185787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:54.215546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe98c3b-9826-4c9f-ab58-c164103ceb75 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:54.234969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:54.237397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:54.238025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:54.238826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] PATH_INFO: `/v3/users/79c273e585a648fd89ad6da0b7fb400f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:54.241794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c273e585a648fd89ad6da0b7fb400f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:54.246352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:54.372195 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3555/7112] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:53 2022] POST /identity/v3/users => generated 309 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:54.378563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:54.382759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:54.424539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db54e-c625-4829-b192-a193889b4533 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:54.434747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:54.436710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:54.437678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:54.438503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:54.441837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:54.448412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:54.559809 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3556/7113] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:02:54.562342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:54.585091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990e07-37bf-4122-a6b0-1da66f3c9de3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:54.600556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:54.601975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:54.602645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:54.603314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] PATH_INFO: `/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008/users/f48c0d83e1c649b9a3db7a21d153a84a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:54.679601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9acdfb9f8e47e68734fb70ec3d1008, user_id=f48c0d83e1c649b9a3db7a21d153a84a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:54.690625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:54.721574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c273e585a648fd89ad6da0b7fb400f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.723606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c273e585a648fd89ad6da0b7fb400f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.829314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3557/7114] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:54 2022] PUT /identity/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008/users/f48c0d83e1c649b9a3db7a21d153a84a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:54.835984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:54.850642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c273e585a648fd89ad6da0b7fb400f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.913638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:54.928072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c273e585a648fd89ad6da0b7fb400f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.955431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c273e585a648fd89ad6da0b7fb400f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:54.991625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3558/7115] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:54 2022] DELETE /identity/v3/users/79c273e585a648fd89ad6da0b7fb400f => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:02:55.051650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f16639-79a3-429e-9e27-a11aebc895a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:55.242932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:55.244291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:55.244731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:55.245147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:55.256574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:55.260737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e61d-013f-4cd0-aa2e-3d325373db7b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:55.299237 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3558/7116] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:02:55.305020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:55.306851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:55.362279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a478c6-f44c-4436-b624-3dc10c3ed688 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:55.413107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:55.415323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:55.416176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:55.417438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] PATH_INFO: `/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008/users/f48c0d83e1c649b9a3db7a21d153a84a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:55.421631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9acdfb9f8e47e68734fb70ec3d1008, user_id=f48c0d83e1c649b9a3db7a21d153a84a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:55.428268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:55.472522 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3559/7117] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:02:55 2022] PUT /identity/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008/users/f48c0d83e1c649b9a3db7a21d153a84a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:55.479328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:55.482079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:55.482079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:55.599050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] MFA Rules not processed for user `f48c0d83e1c649b9a3db7a21d153a84a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:55.601926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:55.867383 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3559/7118] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:55.909893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:55.916250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:56.267252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a501-dd94-494b-9f40-1deb440464f5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:56.287998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:56.292747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:56.301952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:56.301952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:56.339025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:56.343938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:56.383491 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3560/7119] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:02:56.860425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:57.085430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:57.126588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469ccc-4c7f-43b2-8abd-a6edc74dfb06 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:57.140559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:57.142498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:57.143480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:57.144310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] PATH_INFO: `/v3/users/a8e663a672cf4139b6d830c19b1630dd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:57.148477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e663a672cf4139b6d830c19b1630dd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:57.156285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:57.938638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e663a672cf4139b6d830c19b1630dd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:57.951234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:57.954593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:58.003387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73344-ab39-4014-a301-86de5ac088c2 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:58.029219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:58.030824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:58.031618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:58.036942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] PATH_INFO: `/v3/projects/63daeda625fe4ea68c6696cddcdef2d2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:58.040711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63daeda625fe4ea68c6696cddcdef2d2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:58.045341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:58.083004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e663a672cf4139b6d830c19b1630dd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.115166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e663a672cf4139b6d830c19b1630dd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.178068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e663a672cf4139b6d830c19b1630dd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.179431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e32c22cc-3092-42c0-9f04-a598f34a6ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e663a672cf4139b6d830c19b1630dd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.204967 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3560/7120] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:02:56 2022] DELETE /identity/v3/users/a8e663a672cf4139b6d830c19b1630dd => generated 0 bytes in 1343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:58.208557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710450f1-5196-4ad3-b24d-eec7fd91d7b2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:58.210029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710450f1-5196-4ad3-b24d-eec7fd91d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:58.210855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710450f1-5196-4ad3-b24d-eec7fd91d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:58.282930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-710450f1-5196-4ad3-b24d-eec7fd91d7b2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:58.290988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-710450f1-5196-4ad3-b24d-eec7fd91d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:58.378170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63daeda625fe4ea68c6696cddcdef2d2', 'request_id': 'req-4d395476-18ea-49ae-9aaa-96e572b6c3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.394945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:58.499905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63daeda625fe4ea68c6696cddcdef2d2', 'request_id': 'req-4d395476-18ea-49ae-9aaa-96e572b6c3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.518108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63daeda625fe4ea68c6696cddcdef2d2', 'request_id': 'req-4d395476-18ea-49ae-9aaa-96e572b6c3b6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.518694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3561/7121] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:02:58.572177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] The token cache is being invalidate because project 63daeda625fe4ea68c6696cddcdef2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:02:58.572680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.578405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:02:58.592271 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3561/7122] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:02:57 2022] DELETE /identity/v3/projects/63daeda625fe4ea68c6696cddcdef2d2 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:02:58.604600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe03-8f1d-431c-8976-66ad3153fe01 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:58.610411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe03-8f1d-431c-8976-66ad3153fe01 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:58.611377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe03-8f1d-431c-8976-66ad3153fe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:58.666716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:58.670335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:58.718149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6b3cfe03-8f1d-431c-8976-66ad3153fe01 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:58.724186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b3cfe03-8f1d-431c-8976-66ad3153fe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:58.942126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395476-18ea-49ae-9aaa-96e572b6c3b6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:58.962398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:58.964255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:58.965532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:58.967122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:58.973237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:58.982906 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3562/7123] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:58.999501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:59.000132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:59.001710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:59.058672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:59.065627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:59.113158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:02:59.120571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3562/7124] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:02:59.121784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:02:59.178821 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3563/7125] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:02:59.184948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:59.211411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c01e-cb94-42d4-b63b-3beda9c852e6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:59.246958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:59.248862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:59.249900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:59.251381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:59.255999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:02:59.263217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:59.278919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:59.325353 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3563/7126] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:02:59.332091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:59.344433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:59.366380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f05c-1e9e-4451-993f-c1a41e3b4598 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:59.386480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:59.387595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:59.388044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:59.388512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:59.389954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:59.395769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:02:59.566536 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3564/7127] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:02:59 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:02:59.573351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:02:59.624334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509745de-b99a-4d98-b04e-d148f1f692be admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:02:59.837660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:02:59.839543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:02:59.842879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:02:59.844834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:02:59.846639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:02:59.853173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:00.031602 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3564/7128] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:02:59 2022] POST /identity/v3/users => generated 292 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:00.033768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:00.087614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8e217-a848-45ac-9a54-bcf0a875bc83 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:00.113149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:00.114890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:00.120143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:00.142106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:00.155921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:00.159311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:00.200799 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3565/7129] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:00.207748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:00.247982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346e6fa-7f6d-48a9-8856-f3de26cb7007 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:00.266620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:00.268199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:00.268985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:00.269711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:00.271892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:00.275573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1ef6-4a6d-4623-919c-62729b6e6701 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:00.344601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:00.354609 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3565/7130] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:00.373182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8f51-8ed8-43c7-bb2c-94ae1f2aaafc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:00.401788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:00.402069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:00.402530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:00.402953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] PATH_INFO: `/v3/projects/0efea104523745c688794c7d921e68a1/users/8ff98e8d4ebf4c0bafe2a2aef9266aad/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:00.440442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efea104523745c688794c7d921e68a1, user_id=8ff98e8d4ebf4c0bafe2a2aef9266aad, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:00.447694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:00.563197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3566/7131] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:00 2022] PUT /identity/v3/projects/0efea104523745c688794c7d921e68a1/users/8ff98e8d4ebf4c0bafe2a2aef9266aad/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:00.576115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:00.576519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:00.577171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:00.707820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] MFA Rules not processed for user `8ff98e8d4ebf4c0bafe2a2aef9266aad`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:00.714440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:00.919931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:01.034740 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3566/7132] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:01.035747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:01.201061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1482138-0288-4398-8d9a-281f7365fbe2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:01.219552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c44c5-8550-495d-8990-862078df713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:01.219552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c44c5-8550-495d-8990-862078df713a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:01.219552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c44c5-8550-495d-8990-862078df713a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:01.219552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c44c5-8550-495d-8990-862078df713a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:01.221505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c44c5-8550-495d-8990-862078df713a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:01.226851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c44c5-8550-495d-8990-862078df713a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:01.517332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:01.523564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3567/7133] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:01 2022] POST /identity/v3/projects => generated 383 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:01.548181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849098-853e-44a2-b280-7b6b37933333 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:01.772114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:01.773465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:01.773788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:01.774253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:01.776370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:01.781643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:01.963211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3567/7134] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:01 2022] POST /identity/v3/users => generated 298 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:01.969644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c44c5-8550-495d-8990-862078df713a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:02.017358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c44c5-8550-495d-8990-862078df713a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:02.044708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:02.046019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:02.046928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:02.047772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:02.049420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:02.053427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:02.103581 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3568/7135] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:02.111403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:02.134387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e49d0-17da-4d9d-bff7-aa34c52d75f7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:02.146099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:02.153620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:02.153620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:02.153620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] PATH_INFO: `/v3/projects/72f7ed7d256a4216bda4366585ba80bc/users/6fb9d30d37994e1c886bd681c056ce2f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:02.196287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f7ed7d256a4216bda4366585ba80bc, user_id=6fb9d30d37994e1c886bd681c056ce2f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:02.207537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:02.407766 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3568/7136] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:02 2022] PUT /identity/v3/projects/72f7ed7d256a4216bda4366585ba80bc/users/6fb9d30d37994e1c886bd681c056ce2f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:02.415028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:02.454019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32104-3aa1-4051-8313-a9b33cc629fc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:02.671272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:02.676558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:02.677763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:02.678316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:02.698349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:02.706273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245ab80-31fe-47df-9fbe-439e335334f2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:02.767361 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3569/7137] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:02.775424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:02.833682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57e711-90ba-4884-93f6-d76bf01303e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:02.860280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:02.861896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:02.862725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:02.863483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] PATH_INFO: `/v3/projects/72f7ed7d256a4216bda4366585ba80bc/users/6fb9d30d37994e1c886bd681c056ce2f/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:02.871061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f7ed7d256a4216bda4366585ba80bc, user_id=6fb9d30d37994e1c886bd681c056ce2f, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:02.896871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:02.947703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:02.948673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:02.949443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:02.954571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3569/7138] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:02 2022] PUT /identity/v3/projects/72f7ed7d256a4216bda4366585ba80bc/users/6fb9d30d37994e1c886bd681c056ce2f/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:03.024267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:03.028552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] MFA Rules not processed for user `6fb9d30d37994e1c886bd681c056ce2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:03.032477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:03.033140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:03.042715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:03.276626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657a603-3bb6-4a69-89d6-39fbebf00df5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:03.291695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:03.293963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:03.294902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:03.295701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] PATH_INFO: `/v3/projects/1562d48ed80140b0ab30161d95fcf5d6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:03.300840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1562d48ed80140b0ab30161d95fcf5d6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:03.306966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:03.379333 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3570/7139] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:03.403744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:03.410101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:03.514923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:03.568328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1562d48ed80140b0ab30161d95fcf5d6', 'request_id': 'req-f324aa45-d703-4333-a9c1-2dee8450fd41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:03.655434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1562d48ed80140b0ab30161d95fcf5d6', 'request_id': 'req-f324aa45-d703-4333-a9c1-2dee8450fd41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:03.681263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1562d48ed80140b0ab30161d95fcf5d6', 'request_id': 'req-f324aa45-d703-4333-a9c1-2dee8450fd41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:03.735994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] The token cache is being invalidate because project 1562d48ed80140b0ab30161d95fcf5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:03.737424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:03.744119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:03.755322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3570/7140] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:03 2022] DELETE /identity/v3/projects/1562d48ed80140b0ab30161d95fcf5d6 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:03.758003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:03.766454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:03.883959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c9446-0728-4527-aa3d-b441e665bf14 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:04.098157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324aa45-d703-4333-a9c1-2dee8450fd41 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:04.114817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:04.116692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:04.118832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:04.120142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] PATH_INFO: `/v3/users/f48c0d83e1c649b9a3db7a21d153a84a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:04.128317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48c0d83e1c649b9a3db7a21d153a84a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:04.135406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:04.225691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:04.231213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:04.231213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:04.231213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:04.231213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:04.478401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:04.483103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:04.521582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3571/7141] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:04.523289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:04.549578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:04.564192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:04.618226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48c0d83e1c649b9a3db7a21d153a84a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:04.622570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48c0d83e1c649b9a3db7a21d153a84a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:04.775430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48c0d83e1c649b9a3db7a21d153a84a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:04.858339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48c0d83e1c649b9a3db7a21d153a84a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:04.877355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524ad79-2443-48ad-b4cd-87916a3fc4bd service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:04.900583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:04.902641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:04.904152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19ebbc99-d86e-4e76-b5bb-10acc6dc56b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48c0d83e1c649b9a3db7a21d153a84a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:04.908797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:04.908797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:04.919650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:04.937225 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3571/7142] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:03 2022] DELETE /identity/v3/users/f48c0d83e1c649b9a3db7a21d153a84a => generated 0 bytes in 1181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:04.982841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:04.985866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:05.024386 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3572/7143] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:06.800674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:06.802285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:06.803114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:06.842167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] MFA Rules not processed for user `626d1f96e801458eba55b56ff8fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:06.845105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:06.965577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:07.043871 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3572/7144] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:07.222126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:07.224383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:07.563712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88106beb-5135-4469-81ac-97b85be5be76 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:07.848333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:07.849592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:07.850091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:07.850587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:07.861583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:08.153979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:08.156191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7821d8-eee7-49f6-838b-18fe6c0c98a3 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:08.165856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:08.215353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3573/7145] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 994 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:08.923669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:08.929655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:09.281942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d69e38-1aa5-4186-9ae6-92de8adb2fbf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:09.293299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:09.294183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:09.295405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:09.296026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] PATH_INFO: `/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:09.300192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9acdfb9f8e47e68734fb70ec3d1008)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:09.305769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:09.583105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9acdfb9f8e47e68734fb70ec3d1008', 'request_id': 'req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:09.785950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9acdfb9f8e47e68734fb70ec3d1008', 'request_id': 'req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:09.816451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9acdfb9f8e47e68734fb70ec3d1008', 'request_id': 'req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:09.861859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] The token cache is being invalidate because project 2c9acdfb9f8e47e68734fb70ec3d1008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:09.862596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:09.866411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9edbf551-2bf1-4e55-a781-fc2f7d29efd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:09.871786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3573/7146] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:08 2022] DELETE /identity/v3/projects/2c9acdfb9f8e47e68734fb70ec3d1008 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:09.881836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:09.882619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:09.883017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:09.958030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:09.960209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:10.019980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:10.020871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:10.021390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-74618e71-ddc9-4f13-bfe8-a896dbcb0c81 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:03:10.050044 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:03:10.052864 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:03:10.057937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3574/7147] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:03:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:03:10.265640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3574/7148] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:10.279350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:10.279992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:10.280650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:10.363327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:10.368054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:10.401937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3575/7149] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:10.408355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:10.445332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837f4a3-ba5e-490c-80e4-65ba18bda198 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:10.464515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:10.470655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:10.473073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:10.474588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:10.476828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:10.477992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:10.483390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:10.529673 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3575/7150] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:03:10.535802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:10.598200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d600-76cf-47a8-b13c-91c445fbad89 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:10.619618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:10.622411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:10.623511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:10.624982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:10.626768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:10.636519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:10.831277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3576/7151] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:10 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:03:10.835249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:10.857665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5283b7-6ad5-41c8-9a3a-9f0d61cdcb10 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:11.088473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:11.090572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:11.091441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:11.092092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:11.113234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:11.126748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:11.300695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:11.302957 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3576/7152] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:10 2022] POST /identity/v3/users => generated 292 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:11.356253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb96abc-33d7-4872-bcfd-fa9302de9e7c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:11.393244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:11.395128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:11.400512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:11.401823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:11.405000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:11.411675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:11.464634 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3577/7153] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:11.467009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:11.497731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33834-4b3e-434f-8c1d-edaa3ce2c2f3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:11.524422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:11.525450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:11.525902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:11.526445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:11.528728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:11.531585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ac19b-bf5a-4e57-ad3b-4f16a89f50d1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:11.606764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3577/7154] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:11.610334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:11.692558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f502-299f-484c-80ca-0f0f660abb04 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:11.707465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:11.712478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:11.713692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:11.714670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] PATH_INFO: `/v3/projects/a3d8514caa9e40af95f2a6210e12d0e0/users/091a4b02b24c4822a3d522e327298a15/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:11.768368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8514caa9e40af95f2a6210e12d0e0, user_id=091a4b02b24c4822a3d522e327298a15, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:11.774669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:11.897113 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3578/7155] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:11 2022] PUT /identity/v3/projects/a3d8514caa9e40af95f2a6210e12d0e0/users/091a4b02b24c4822a3d522e327298a15/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:11.918580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:11.919231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:11.920272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:12.074193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] MFA Rules not processed for user `091a4b02b24c4822a3d522e327298a15`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:12.075560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:12.356728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:12.416211 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3578/7156] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:12.418794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:12.482339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:12.720519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4070-c41e-4cca-ace9-008f7fe33cee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:12.746150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:12.750157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:12.750157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:12.750599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:12.751844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:12.770536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:12.981791 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3579/7157] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:12 2022] POST /identity/v3/projects => generated 385 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:12.992475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:13.085673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29800-b83c-499d-b150-3a5c92891cf0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:13.439378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:13.440366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:13.440828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:13.441329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:13.442676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:13.449908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:13.625388 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3579/7158] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:12 2022] POST /identity/v3/users => generated 299 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:13.632526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:13.682939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39722-0640-422d-859d-027455b16d88 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:13.734937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:13.736089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:13.736578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:13.737062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:13.749238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:13.764427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:13.856573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3580/7159] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:13.857528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:13.891354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e552f35-129a-4565-9c86-d34111ca1d93 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:13.925705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:13.927784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:13.928484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:13.929144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] PATH_INFO: `/v3/projects/956ed64e6c534054bd870acdd647d56e/users/d93167cbb032493997b4de39b87d702e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:13.995095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956ed64e6c534054bd870acdd647d56e, user_id=d93167cbb032493997b4de39b87d702e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:14.001072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:14.131994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:14.134084 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3580/7160] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:13 2022] PUT /identity/v3/projects/956ed64e6c534054bd870acdd647d56e/users/d93167cbb032493997b4de39b87d702e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:03:14.182237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed475-b88a-4a08-8882-a1a9cc318bc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:14.475882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:14.476995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:14.477668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:14.478305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:14.479859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:14.484512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6204187-62da-4865-b8a8-4a69081a8325 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:14.530169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:14.544963 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3581/7161] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:14.564803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06cda-3394-40ed-b9f5-3c6d35230211 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:14.591322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:14.594442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:14.595552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:14.596262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] PATH_INFO: `/v3/projects/956ed64e6c534054bd870acdd647d56e/users/d93167cbb032493997b4de39b87d702e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:14.602748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956ed64e6c534054bd870acdd647d56e, user_id=d93167cbb032493997b4de39b87d702e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:14.610594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:14.642495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3581/7162] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:14 2022] PUT /identity/v3/projects/956ed64e6c534054bd870acdd647d56e/users/d93167cbb032493997b4de39b87d702e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:14.666908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:14.666908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:14.666908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:14.818002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] MFA Rules not processed for user `d93167cbb032493997b4de39b87d702e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:14.829776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:15.284048 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3582/7163] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 620 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:15.317086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:15.322138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:15.666682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef9be-b909-4a79-88c3-c9cc44e9baf4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:15.694367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:15.694367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:15.694367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:15.694367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:15.956051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:15.959333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:15.990727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:15.999064 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3582/7164] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:16.565314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:16.619080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572a55-5ef3-4cfa-90a2-9e2a9b72be8c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:16.623499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:16.625154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:16.625949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:16.626761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:16.640590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:16.656112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:16.933695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:16.937747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcf532-d6e8-4c8c-b94c-be9bd9134443 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:17.009860 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3583/7165] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:20.985530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:20.993473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:21.184721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53711400-c98d-4137-810c-7bc592b48e81 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:21.194868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:21.196473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:21.196951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:21.197648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] PATH_INFO: `/v3/users/121a0e5737b84510b68f761b1b228fd1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:21.200188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121a0e5737b84510b68f761b1b228fd1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:21.205630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:21.556604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121a0e5737b84510b68f761b1b228fd1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:21.693135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121a0e5737b84510b68f761b1b228fd1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:21.734331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121a0e5737b84510b68f761b1b228fd1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:21.768801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121a0e5737b84510b68f761b1b228fd1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:21.770107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121a0e5737b84510b68f761b1b228fd1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:21.790735 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3583/7166] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:20 2022] DELETE /identity/v3/users/121a0e5737b84510b68f761b1b228fd1 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:21.798473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:21.799224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:21.799883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:21.884858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:21.887546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:22.154615 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3584/7167] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:22.184225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:22.187851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:22.428890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39ecf-5e07-4919-870f-86fe38a7a2f9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:22.447468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:22.449369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:22.450396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:22.451906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:22.510625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:22.518222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:22.564682 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3584/7168] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:24.643831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:24.647766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:24.692281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d26e0-080c-4d90-affb-9a7c37b49157 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:24.719830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:24.721430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:24.722257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:24.723041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] PATH_INFO: `/v3/projects/d5b04031831a47bb8165bc6090e713ee` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:24.733780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b04031831a47bb8165bc6090e713ee)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:24.733780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:25.068322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:25.071684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:25.112153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b04031831a47bb8165bc6090e713ee', 'request_id': 'req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:25.121075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239d32e-28ab-4b1d-8495-345c36267cd6 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:25.197159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:25.306596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b04031831a47bb8165bc6090e713ee', 'request_id': 'req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:25.354656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b04031831a47bb8165bc6090e713ee', 'request_id': 'req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:25.457006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:25.457006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:25.457006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:25.467637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] PATH_INFO: `/v3/users/586bb0dbb658479a908154b21693a735` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:25.474655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] The token cache is being invalidate because project d5b04031831a47bb8165bc6090e713ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:25.476655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=586bb0dbb658479a908154b21693a735)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:25.477609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:25.480931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:25.492796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:25.496491 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3585/7169] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:24 2022] DELETE /identity/v3/projects/d5b04031831a47bb8165bc6090e713ee => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:25.503313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:25.513734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:25.583214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c1d63-8abd-4d96-9f8b-9fd8835eedc0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:25.610611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:25.614265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:25.615608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:25.616301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] PATH_INFO: `/v3/users/3dc865fe462e474c8eca397ae89f3e64` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:25.643536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc865fe462e474c8eca397ae89f3e64)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:25.653492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:25.826243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:26.012192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586bb0dbb658479a908154b21693a735'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.180799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586bb0dbb658479a908154b21693a735'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.187295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc865fe462e474c8eca397ae89f3e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.189504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc865fe462e474c8eca397ae89f3e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.204905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586bb0dbb658479a908154b21693a735'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.249537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586bb0dbb658479a908154b21693a735'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.251754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-51b2d084-71fc-4bf2-b12d-da00668f5baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586bb0dbb658479a908154b21693a735'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.268276 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3585/7170] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:25 2022] DELETE /identity/v3/users/586bb0dbb658479a908154b21693a735 => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:26.280983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:26.282747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:26.284592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:26.289782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc865fe462e474c8eca397ae89f3e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.338318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc865fe462e474c8eca397ae89f3e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.340667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:26.343352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:26.391990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc865fe462e474c8eca397ae89f3e64'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:26.433808 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3586/7171] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:25 2022] DELETE /identity/v3/users/3dc865fe462e474c8eca397ae89f3e64 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:26.544710 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3586/7172] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:26.596302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:26.596302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:26.972344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062aed-f8ff-483c-962b-ad9f68b3df1d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:26.979710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:26.981538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:26.986537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:26.986537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:27.268218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:27.275772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120f96-9345-4f08-98a3-d4c0c0fe8a90 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:27.324103 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3587/7173] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:28.050058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:28.053915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:28.106947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db010e5-9984-4e52-9d1f-99e90550f7fa None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:28.125547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:28.126851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:28.127551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:28.128214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] PATH_INFO: `/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:28.140651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09b9c0d050c4bd28053a22fabbc84e0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:28.144961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:28.461697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:28.498087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09b9c0d050c4bd28053a22fabbc84e0', 'request_id': 'req-e7f2d541-a129-4fde-86da-c4d11947b22d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:28.527571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09b9c0d050c4bd28053a22fabbc84e0', 'request_id': 'req-e7f2d541-a129-4fde-86da-c4d11947b22d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:28.551327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09b9c0d050c4bd28053a22fabbc84e0', 'request_id': 'req-e7f2d541-a129-4fde-86da-c4d11947b22d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:28.721443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] The token cache is being invalidate because project e09b9c0d050c4bd28053a22fabbc84e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:28.722314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:28.724531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e7f2d541-a129-4fde-86da-c4d11947b22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:28.729678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3587/7174] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:28 2022] DELETE /identity/v3/projects/e09b9c0d050c4bd28053a22fabbc84e0 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:28.737536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:28.738380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:28.738570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:28.822185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:28.831864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:29.029228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:29.177966 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3588/7175] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:29.189798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:29.190587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:29.190907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:29.306897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:29.315739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:29.345930 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3588/7176] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:29.351171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:29.383284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf3f34-3cc0-417a-897d-076164aedcec None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:29.405790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:29.407047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:29.407485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:29.407841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:29.408853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:29.409459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:29.422893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:29.447225 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3589/7177] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:03:29.454453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:29.479554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9366-31d2-4bd7-bde6-f402eed1c2fd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:29.489380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:29.491085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:29.493329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:29.494164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:29.495703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:29.499344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:29.712811 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3589/7178] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:29 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:03:29.719513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:29.750442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be236a8-961d-4948-ae76-e4c19cc9f9bc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:29.976184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:29.977315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:29.980748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:29.981315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:29.982674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:29.996456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:30.051319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:30.056021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:30.161623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3590/7179] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:29 2022] POST /identity/v3/users => generated 287 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:03:30.166029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:30.196075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23536a2-7d47-4a2b-a3a7-1d46959e7407 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:30.210981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:30.212487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:30.214447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:30.215378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:30.218011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:30.223101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:30.270123 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3591/7180] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:30.272547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:30.294710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395e8b5-d556-4ed3-a770-28c8f31b026e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:30.325456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:30.332425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:30.335205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:30.338753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:30.352512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:30.353849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb562ac-692a-4310-80c1-40e07d6ac3e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:30.370035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:30.375243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:30.378725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:30.384557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:30.387525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:30.394544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:30.427309 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3592/7181] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:30.436754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:30.465170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897b26-08e9-4ffb-8bbd-84bf396fa0ae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:30.477055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:30.479005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:30.479523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:30.479978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] PATH_INFO: `/v3/projects/f4872a04574d47aabfb6307f2168c799/users/6657b8acdd364b7fb2d3926bb783f6f0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:30.561166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4872a04574d47aabfb6307f2168c799, user_id=6657b8acdd364b7fb2d3926bb783f6f0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:30.574670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:30.667947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:30.671234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e7e14-7bd5-48ee-8093-5871de4291ec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:30.716334 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3590/7182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:30.747551 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3593/7183] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:30 2022] PUT /identity/v3/projects/f4872a04574d47aabfb6307f2168c799/users/6657b8acdd364b7fb2d3926bb783f6f0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:30.765444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:30.765948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:30.766499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:30.773503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:30.787206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:30.920238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] MFA Rules not processed for user `6657b8acdd364b7fb2d3926bb783f6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:30.930063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:31.040192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d2d-e35b-4ade-8508-5283a7cc28cf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:31.064857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:31.066585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:31.067508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:31.068481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] PATH_INFO: `/v3/projects/38c1b9e029124bf4baadecd5672ec482` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:31.071111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c1b9e029124bf4baadecd5672ec482)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:31.072945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:31.077433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:31.214891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:31.228642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3591/7184] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:31.248181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:31.466480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c1b9e029124bf4baadecd5672ec482', 'request_id': 'req-4504815f-7076-4055-a485-6b7df9447e0e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:31.521299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524125-b7bc-496d-80a6-0d52778666ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:31.575806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c1b9e029124bf4baadecd5672ec482', 'request_id': 'req-4504815f-7076-4055-a485-6b7df9447e0e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:31.616022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c1b9e029124bf4baadecd5672ec482', 'request_id': 'req-4504815f-7076-4055-a485-6b7df9447e0e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:31.651720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] The token cache is being invalidate because project 38c1b9e029124bf4baadecd5672ec482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:31.652098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:31.653669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4504815f-7076-4055-a485-6b7df9447e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:31.657239 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3594/7185] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:30 2022] DELETE /identity/v3/projects/38c1b9e029124bf4baadecd5672ec482 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:31.666774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da658cc-5516-4e53-b44b-78b303282fef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:31.667735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da658cc-5516-4e53-b44b-78b303282fef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:31.668666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da658cc-5516-4e53-b44b-78b303282fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:31.723228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1da658cc-5516-4e53-b44b-78b303282fef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:31.723228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1da658cc-5516-4e53-b44b-78b303282fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:31.725089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:31.726855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:31.729896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:31.730842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:31.734277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:32.099242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3595/7186] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:32.110332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:32.110747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:32.111282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:32.173025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:32.182283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:32.228222 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3596/7187] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:32.234362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:32.285643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713711f0-28ce-48ac-8ccd-5036c93a4bb8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:32.303943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:32.306414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:32.307042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:32.307592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:32.308929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:32.309508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:32.316496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:32.316936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:32.321015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:32.346642 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3597/7188] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:03:32.354376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:32.360472 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3592/7189] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:32.362790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:32.366518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:32.396546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f49f0-82fe-4766-8ffb-6b92f75824a2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:32.408748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:32.412216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:32.412216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:32.412216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:32.412759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:32.416639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:32.644290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:32.685060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0ffa0-d3ad-43ef-b0e4-ed5a93a933d5 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:32.704415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:32.705516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:32.706001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:32.707222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:32.722822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:32.948921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:32.953445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:33.007048 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3593/7190] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:33.028850 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3598/7191] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:32 2022] POST /identity/v3/projects => generated 353 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:03:33.036986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:33.080656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508405-b6de-47d5-8f3e-7d1009a5cc2c service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:33.440481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:33.444433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:33.446094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:33.448299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:33.451298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:33.460634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:33.748104 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3594/7192] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:33 2022] POST /identity/v3/users => generated 277 bytes in 712 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:33.749185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:33.789143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474039f7-b17c-465f-94d9-43f92f21a13c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:33.819513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:33.820674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:33.821187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:33.821699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:33.822993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:33.826489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:33.896178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3599/7193] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:33.898048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:33.930130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87559017-24db-4ad5-9d7b-42b0beb5bfd9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:33.990992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:33.992541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:33.993037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:33.997594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:33.997594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:34.004412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec734d0-24c6-4335-ab53-dcde811d17ef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:34.047683 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3595/7194] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:34.058107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:34.117393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d052e8-c90a-407d-81c5-ac66150676c2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:34.141473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:34.143634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:34.144603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:34.145998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] PATH_INFO: `/v3/projects/8d9cd93bf89c475191bb541932d8ee93/users/64597d01285946d4b03c57f3fef34a19/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:34.217662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9cd93bf89c475191bb541932d8ee93, user_id=64597d01285946d4b03c57f3fef34a19, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:34.231066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:34.531711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3600/7195] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:34 2022] PUT /identity/v3/projects/8d9cd93bf89c475191bb541932d8ee93/users/64597d01285946d4b03c57f3fef34a19/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:34.531996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:34.533460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:34.534403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:34.761737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] MFA Rules not processed for user `64597d01285946d4b03c57f3fef34a19`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:34.765692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:35.131239 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3596/7196] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 596 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:35.379506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:35.382084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:35.564695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:35.679065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead348-5aea-4e53-8dff-3470ef314666 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:35.697971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:35.699686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:35.700444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:35.701178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:35.749610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:35.755464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7535aa0-3d02-4ca2-84d4-f0c731fc59ba service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:35.798332 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3601/7197] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:37.157072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:37.158953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:37.179485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:37.450926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5438d-716d-4370-82e1-7ab680b0440a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:37.468892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:37.468892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:37.468892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:37.468892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] PATH_INFO: `/v3/users/6657b8acdd364b7fb2d3926bb783f6f0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:37.472418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6657b8acdd364b7fb2d3926bb783f6f0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:37.484882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:37.848151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6657b8acdd364b7fb2d3926bb783f6f0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:37.998159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6657b8acdd364b7fb2d3926bb783f6f0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:38.027514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6657b8acdd364b7fb2d3926bb783f6f0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:38.089019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6657b8acdd364b7fb2d3926bb783f6f0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:38.091987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6657b8acdd364b7fb2d3926bb783f6f0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:38.126748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3597/7198] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:37 2022] DELETE /identity/v3/users/6657b8acdd364b7fb2d3926bb783f6f0 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:38.128859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:38.129631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:38.130118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:38.208991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:38.218133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:38.556817 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3602/7199] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:38.723827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:38.728038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:39.041631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197820c-b4b2-4077-bc76-2d00ecf81cad admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:39.058354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:39.059381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:39.059834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:39.060272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:39.100819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:39.104698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4c7a6-927d-4dd2-9501-ae17bfc9f74d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:39.151099 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3598/7200] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:40.797411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:40.801777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:40.858104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0117ee-0bd6-4ff4-bf1b-2e99f227d903 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:40.881554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:40.886312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:40.890026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:40.890874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] PATH_INFO: `/v3/users/8ff98e8d4ebf4c0bafe2a2aef9266aad` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:40.897385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff98e8d4ebf4c0bafe2a2aef9266aad)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:40.905968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:41.467121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff98e8d4ebf4c0bafe2a2aef9266aad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:41.468877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff98e8d4ebf4c0bafe2a2aef9266aad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:41.610184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff98e8d4ebf4c0bafe2a2aef9266aad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:41.694204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff98e8d4ebf4c0bafe2a2aef9266aad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:41.732646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff98e8d4ebf4c0bafe2a2aef9266aad'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:41.765415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3603/7201] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:40 2022] DELETE /identity/v3/users/8ff98e8d4ebf4c0bafe2a2aef9266aad => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:41.778775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:41.779511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:41.779776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:41.827751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:41.830233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:41.942548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:42.203458 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3599/7202] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:42.253881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:42.258113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:42.553897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:42.576792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1708cf-6eb2-420d-bf0e-30a0c76f2fe8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:42.603628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:42.607106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:42.608981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:42.612285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:42.616881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:42.617481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:42.700731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33029b-3c20-4973-a0aa-010ff99d8fa0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:42.711958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:42.716299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0495b3-e6a6-4c97-a8ce-93f35aadda12 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:42.753678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:42.755422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:42.755935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:42.759499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] PATH_INFO: `/v3/projects/f4872a04574d47aabfb6307f2168c799` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:42.772267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3604/7203] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:03:42.780454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4872a04574d47aabfb6307f2168c799)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:42.794979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:43.139434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4872a04574d47aabfb6307f2168c799', 'request_id': 'req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:43.174385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4872a04574d47aabfb6307f2168c799', 'request_id': 'req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:43.205084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4872a04574d47aabfb6307f2168c799', 'request_id': 'req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:43.353056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] The token cache is being invalidate because project f4872a04574d47aabfb6307f2168c799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:43.354502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:43.359298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d7c078b7-3c29-431b-84c6-4ea4e6d345b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:43.369755 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3600/7204] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:42 2022] DELETE /identity/v3/projects/f4872a04574d47aabfb6307f2168c799 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:43.381022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:43.381919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:43.382848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:43.477081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:43.480125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:43.662026 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3605/7205] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:43.679505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:43.679505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:43.679505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:43.746824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:43.749609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:43.773527 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3601/7206] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:43.776207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:43.842204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cfdd9-29d5-417f-94bf-a22e3fbfd425 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:43.865269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:43.866906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:43.867695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:43.868388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:43.873442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:43.883383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:43.883383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:43.935476 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3606/7207] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:03:43.943591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:43.993994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef21fb5-313d-4355-841b-55f9d83aa592 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:44.019414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:44.024564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:44.027864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:44.028671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:44.031529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:44.044237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:44.236350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3602/7208] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:43 2022] POST /identity/v3/projects => generated 393 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:44.243167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:44.277002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53260e-ebae-493c-a7a2-246ef844164d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:44.652237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:44.657817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:44.659078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:44.661640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:44.664537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:44.689395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:44.769605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:44.773942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:44.824817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df776e-e0b2-4f42-a9c1-e46ce93ac098 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:44.858010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:44.860432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:44.861595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:44.863791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] PATH_INFO: `/v3/users/64597d01285946d4b03c57f3fef34a19` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:44.872145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=64597d01285946d4b03c57f3fef34a19)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:44.876551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:44.965164 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3607/7209] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:44 2022] POST /identity/v3/users => generated 297 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:44.968801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:45.011896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c408-6891-4f90-8294-34137747beae admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:45.023234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:45.024499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:45.025093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:45.025802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:45.027996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:45.033144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:45.078022 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3608/7210] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:45.085448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:45.110294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9eefd-164a-4390-84f1-8ca10234e082 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:45.122081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:45.123760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:45.124541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:45.125250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:45.126669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:45.132339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:45.156429 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3609/7211] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:45.167781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:45.198130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba5dfb-62c7-4be9-8ef2-3e1f8bc78828 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:45.209320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:45.212444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:45.213526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:45.214232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] PATH_INFO: `/v3/projects/4c038e57ff4040eba77793d76e0d7bd9/users/ec031465536d43179c584558e330d6ec/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:45.278658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c038e57ff4040eba77793d76e0d7bd9, user_id=ec031465536d43179c584558e330d6ec, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:45.285577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:45.457165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64597d01285946d4b03c57f3fef34a19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:45.467311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3610/7212] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:45 2022] PUT /identity/v3/projects/4c038e57ff4040eba77793d76e0d7bd9/users/ec031465536d43179c584558e330d6ec/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:45.469096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:45.481335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:45.589994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:45.665649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64597d01285946d4b03c57f3fef34a19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:45.700143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64597d01285946d4b03c57f3fef34a19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:45.766039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:45.782207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870daa02-208f-4b5e-b137-50864dcd802c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:45.785759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64597d01285946d4b03c57f3fef34a19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:45.793210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-4fa4e995-a09c-4237-adb5-373f4efbf5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64597d01285946d4b03c57f3fef34a19'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:45.817875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:45.820006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:45.821810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:45.822292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] PATH_INFO: `/v3/projects/0efea104523745c688794c7d921e68a1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:45.842262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3603/7213] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:44 2022] DELETE /identity/v3/users/64597d01285946d4b03c57f3fef34a19 => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:03:45.842737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efea104523745c688794c7d921e68a1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:45.850006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:45.856122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07814fe-c984-42ee-b858-5e7d4b7ab10d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:45.857246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07814fe-c984-42ee-b858-5e7d4b7ab10d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:45.859715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07814fe-c984-42ee-b858-5e7d4b7ab10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:46.029622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a07814fe-c984-42ee-b858-5e7d4b7ab10d None None] MFA Rules not processed for user `ec031465536d43179c584558e330d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:46.037185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a07814fe-c984-42ee-b858-5e7d4b7ab10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:46.182605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efea104523745c688794c7d921e68a1', 'request_id': 'req-44f7b929-2ccf-40df-99a2-87b023f56a52'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:46.330713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efea104523745c688794c7d921e68a1', 'request_id': 'req-44f7b929-2ccf-40df-99a2-87b023f56a52'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:46.362701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efea104523745c688794c7d921e68a1', 'request_id': 'req-44f7b929-2ccf-40df-99a2-87b023f56a52'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:46.410183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] The token cache is being invalidate because project 0efea104523745c688794c7d921e68a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:46.410183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:46.411701 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3604/7214] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:46.415489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:46.416610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:46.417172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:46.418312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:46.420728 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3611/7215] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:45 2022] DELETE /identity/v3/projects/0efea104523745c688794c7d921e68a1 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:46.428840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:46.461005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:46.580930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:46.593330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:46.894670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b929-2ccf-40df-99a2-87b023f56a52 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:46.896180 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3605/7216] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:46.902962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:46.905883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:46.936245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:46.943076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:46.945001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:46.946256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] PATH_INFO: `/v3/users/6fb9d30d37994e1c886bd681c056ce2f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:46.954760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb9d30d37994e1c886bd681c056ce2f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:46.969419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:47.102840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919a67e-ab15-4b7b-8b6f-9b5840a40c36 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:47.110531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:47.111929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:47.112571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:47.113753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:47.117024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:47.238550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:47.349748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:47.352507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:47.390314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb9d30d37994e1c886bd681c056ce2f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:47.394292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb9d30d37994e1c886bd681c056ce2f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:47.397602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3606/7217] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:47.399251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:47.438728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9de1-a93b-43a2-afec-660a8ac2319a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:47.463117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:47.464267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:47.464774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:47.465281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:47.514495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:47.519686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:47.562623 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3607/7218] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:47.621927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb9d30d37994e1c886bd681c056ce2f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:47.624716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:47.670555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb9d30d37994e1c886bd681c056ce2f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:47.701078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bfe772d2-271e-4e54-91e0-1710a07de60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb9d30d37994e1c886bd681c056ce2f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:47.721898 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3612/7219] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:03:46 2022] DELETE /identity/v3/users/6fb9d30d37994e1c886bd681c056ce2f => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:50.100311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:50.103610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:50.195963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fac226-34f8-43db-9c9c-d565f09244e3 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:50.535625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:50.536834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:50.537253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:50.537634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] PATH_INFO: `/v3/projects/8d9cd93bf89c475191bb541932d8ee93` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:50.549051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9cd93bf89c475191bb541932d8ee93)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:50.552638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:50.890224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9cd93bf89c475191bb541932d8ee93', 'request_id': 'req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:50.920807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9cd93bf89c475191bb541932d8ee93', 'request_id': 'req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:50.940809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9cd93bf89c475191bb541932d8ee93', 'request_id': 'req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:51.100525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] The token cache is being invalidate because project 8d9cd93bf89c475191bb541932d8ee93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:51.105790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:51.105790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:51.113767 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3608/7220] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:50 2022] DELETE /identity/v3/projects/8d9cd93bf89c475191bb541932d8ee93 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:51.123084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0db9-e311-428d-acdb-ca1c82aa59b8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:51.123972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0db9-e311-428d-acdb-ca1c82aa59b8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:51.124354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0db9-e311-428d-acdb-ca1c82aa59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:51.203925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:51.203925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:51.277055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fe2e0db9-e311-428d-acdb-ca1c82aa59b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:51.291958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fe2e0db9-e311-428d-acdb-ca1c82aa59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:51.483274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:51.501019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09e5b-8f1f-4c84-bf74-f92fcb9689b7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:51.527998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:51.529351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:51.529839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:51.530600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] PATH_INFO: `/v3/projects/72f7ed7d256a4216bda4366585ba80bc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:51.535100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f7ed7d256a4216bda4366585ba80bc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:51.546807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:51.610962 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3613/7221] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:51.625708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:51.626588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:51.627374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:51.749087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:51.755210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:51.808692 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3614/7222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:51.810364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:51.856560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac9817-fd89-4c1b-ae5c-0c5e806e5659 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:51.907968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f7ed7d256a4216bda4366585ba80bc', 'request_id': 'req-3ee3f78d-86d6-486e-b252-0e981ccbff10'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:51.930136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f7ed7d256a4216bda4366585ba80bc', 'request_id': 'req-3ee3f78d-86d6-486e-b252-0e981ccbff10'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:51.974196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f7ed7d256a4216bda4366585ba80bc', 'request_id': 'req-3ee3f78d-86d6-486e-b252-0e981ccbff10'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:52.160765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] The token cache is being invalidate because project 72f7ed7d256a4216bda4366585ba80bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:03:52.162471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:52.164940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3ee3f78d-86d6-486e-b252-0e981ccbff10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:03:52.180236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3609/7223] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:03:51 2022] DELETE /identity/v3/projects/72f7ed7d256a4216bda4366585ba80bc => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:03:52.183095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f818d1-5332-447b-9a09-eecb41547188 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:52.194890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f818d1-5332-447b-9a09-eecb41547188 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:52.196021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f818d1-5332-447b-9a09-eecb41547188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:52.198993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:52.200649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:52.201484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:52.202187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:52.209759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:52.210391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:52.214730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:52.282415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3615/7224] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:03:52.292968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:52.303654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-59f818d1-5332-447b-9a09-eecb41547188 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:52.305975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-59f818d1-5332-447b-9a09-eecb41547188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:52.322835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:52.338550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3610/7225] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:52.353915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:52.354770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:52.355660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:52.364783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13c7c-84e1-4db2-90d9-000432b87929 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:52.391058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:52.393021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:52.393509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:52.393965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:52.397810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:52.405480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:52.485840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:52.497798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:52.553822 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3611/7226] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:52.562232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:52.606158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933f6a-fd21-401d-a222-e10db03209c7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:52.662199 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3616/7227] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:52 2022] POST /identity/v3/projects => generated 365 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:52.668570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:52.670134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:52.677211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:52.678234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:52.679396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:52.684543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:03:52.689324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:52.711429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:52.816540 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3612/7228] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:03:52.838665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:52.900209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199692-73a1-4d38-994c-eae580391188 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:52.964288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:53.052145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c330a-dcf2-4a88-a982-fc9272504a67 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:53.079648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:53.080843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:53.081332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:53.081820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:53.083103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:53.087218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:53.180480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:53.181655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:53.182021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:53.182479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:53.183669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:53.187706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:53.340923 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3617/7229] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:52 2022] POST /identity/v3/users => generated 283 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:53.343091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:53.396699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ef4e-4c9b-40d4-8f89-bef910e90da6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:53.427693 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3613/7230] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:52 2022] POST /identity/v3/projects => generated 379 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:53.431048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:53.432628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:53.435341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:53.435836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:53.436590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:53.439461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:53.449118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:53.517203 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3618/7231] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:53.522466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:53.568014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d60a3f-1e35-4acf-91b7-082c2e663545 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:53.630257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:53.703372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b4581-0251-4a30-a7e6-faf4c62fd794 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:53.746276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:53.749331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:53.750795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:53.753638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:53.758985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:53.774471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:53.885500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:53.886723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:53.887266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:53.887759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:53.889124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:53.898163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:53.966372 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3619/7232] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:53.972969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:53.996394 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3614/7233] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:53 2022] POST /identity/v3/users => generated 290 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:54.004212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:54.024110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f483-61be-409e-8399-ee182c682d49 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:54.046785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:54.053698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.056790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.057498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] PATH_INFO: `/v3/projects/dc65e75149734fe8ab3c20064383e353/users/937ec97100c341ec91af229260881a5c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.058365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f94c-0d6f-4068-8d99-c0e085e729e2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:54.082495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:54.086913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.094818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.096590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.099989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:54.127603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:54.147285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc65e75149734fe8ab3c20064383e353, user_id=937ec97100c341ec91af229260881a5c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:54.157373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7e3eb-4522-4592-b5a1-3bd752fe8f89 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:54.175288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3615/7234] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:54.183371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:54.222154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d29d1-dbf4-4b14-8a61-1405a525a23a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:54.262235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:54.267883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.268964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.269283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.273052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:54.288650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:54.349256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3616/7235] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:54.351111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:54.376431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb193b6-40ff-42bb-bbad-cbaf811a43bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:54.390043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:54.393311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.393894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.394473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] PATH_INFO: `/v3/projects/a1cc298ab9434263bbac11ef2fe58166/users/8c996ae588ba451e9c4f3f919cb25dde/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.438366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cc298ab9434263bbac11ef2fe58166, user_id=8c996ae588ba451e9c4f3f919cb25dde, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:54.448656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192ad96-8cb8-4b55-bfd5-9127392fe834 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:54.617047 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3620/7236] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:53 2022] PUT /identity/v3/projects/dc65e75149734fe8ab3c20064383e353/users/937ec97100c341ec91af229260881a5c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:03:54.632736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.637843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.638279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.671508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3617/7237] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:54 2022] PUT /identity/v3/projects/a1cc298ab9434263bbac11ef2fe58166/users/8c996ae588ba451e9c4f3f919cb25dde/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:54.694806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:54.697887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:54.699529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:54.792539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] MFA Rules not processed for user `937ec97100c341ec91af229260881a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:54.795787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:54.831183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] MFA Rules not processed for user `8c996ae588ba451e9c4f3f919cb25dde`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:54.838430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:55.125101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3618/7238] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:55.126803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:55.185586 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3621/7239] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:55.193932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:55.329225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:55.457044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961bcf-04d8-4042-b4a0-157933b9aebd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:55.480508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:55.482027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:55.482783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:55.483516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:55.492011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:55.492011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:55.623958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a011e7-48d8-4bad-8985-99ad25bb2579 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:55.641243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:55.648084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:55.648084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:55.648084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:55.648084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:55.650788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:55.759860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3619/7240] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:55 2022] POST /identity/v3/projects => generated 383 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:55.765799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:55.777716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:55.935130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334069-a035-41fb-8a3c-e3b61d2a474b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:55.943290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:55.945725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:55.946748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:55.947292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:55.950695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:55.952891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:55.983450 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3622/7241] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:03:55 2022] POST /identity/v3/projects => generated 365 bytes in 789 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:03:55.990244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.178550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3620/7242] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:55 2022] POST /identity/v3/users => generated 298 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:56.180668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.229469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d13c-e4d8-4cd6-aff8-78e3d530784a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.245154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.247170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.247503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.248472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.249943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704172a-24c9-4a55-b56b-c05cad811334 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.250918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.275280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:56.280325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.280325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.280325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.280325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.282443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.294496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:56.329119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3621/7243] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:56.336516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.357822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439a10-5986-4f9b-a909-bedae23f45b3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.369647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.371289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.371892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.372459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] PATH_INFO: `/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55/users/5e0a062755c64ab0ae009e8342dac793/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.411817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc8e2fe8d7e4228b54c5fecf4d9ab55, user_id=5e0a062755c64ab0ae009e8342dac793, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.417723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:56.462761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3623/7244] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:03:55 2022] POST /identity/v3/users => generated 289 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:03:56.465264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.498060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cd888-6da0-4603-9069-9e7017c312a8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.511973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.513417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.513941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.514518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.516289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.520030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:56.583657 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3624/7245] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:56.590838 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3622/7246] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:56 2022] PUT /identity/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55/users/5e0a062755c64ab0ae009e8342dac793/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:56.597154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.601484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.629865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346858-64f7-4640-a2c6-f7c7638f4d0c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.860875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.864136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.864658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.865130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] PATH_INFO: `/v3/projects/5f34afeaf64c40309f6c0689596292da/users/68b41db0dc16493aa36310c13d986023/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.868763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55b368-74cf-4972-b1c5-c1a4049d6c62 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.891986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:56.893208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:56.893571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:56.895953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:56.895953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.899251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:56.946310 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3623/7247] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:03:56.948454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:56.968777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f34afeaf64c40309f6c0689596292da, user_id=68b41db0dc16493aa36310c13d986023, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:56.987395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb59-8b82-4f8b-9519-c7ce3c1720e3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:56.987672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:57.004844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:57.006592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.007546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.008707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] PATH_INFO: `/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55/users/5e0a062755c64ab0ae009e8342dac793/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:57.015929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc8e2fe8d7e4228b54c5fecf4d9ab55, user_id=5e0a062755c64ab0ae009e8342dac793, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:57.024361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ca159-ecce-4b5c-9c63-634203f8044b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:57.067677 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3624/7248] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:56 2022] PUT /identity/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55/users/5e0a062755c64ab0ae009e8342dac793/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:03:57.081852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.082600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.083634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:57.153762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] MFA Rules not processed for user `5e0a062755c64ab0ae009e8342dac793`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:57.155548 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3625/7249] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:56 2022] PUT /identity/v3/projects/5f34afeaf64c40309f6c0689596292da/users/68b41db0dc16493aa36310c13d986023/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:57.156844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:57.162129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:57.177747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:57.291529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:57.388887 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3625/7250] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:03:57.420793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc4f2-9d7d-4119-a3e2-6b452be79b1c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:57.421673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:57.424554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:57.444963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:57.446016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.446499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.446976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:57.448538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:57.451611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:57.489164 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3626/7251] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:03:57.490754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:57.524418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90e738-385f-4162-91a4-77f3fe21d463 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:57.548863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:57.554058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.554946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.556068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] PATH_INFO: `/v3/projects/5f34afeaf64c40309f6c0689596292da/users/68b41db0dc16493aa36310c13d986023/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:57.566834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f34afeaf64c40309f6c0689596292da, user_id=68b41db0dc16493aa36310c13d986023, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:57.589944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78365b8-722e-42fc-96fa-830affcd0516 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:57.645074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528e74-68e3-48df-b196-fd91fecc386d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:57.661440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3627/7252] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:03:57 2022] PUT /identity/v3/projects/5f34afeaf64c40309f6c0689596292da/users/68b41db0dc16493aa36310c13d986023/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:03:57.692526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.693191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.694727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:57.830590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] MFA Rules not processed for user `68b41db0dc16493aa36310c13d986023`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:03:57.834281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:57.919512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:57.921206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:57.922582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:57.923610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:58.198433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3628/7253] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:03:58.246369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:58.265999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:58.313305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3626/7254] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 892 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:58.359006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:58.410252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8821c8-01b2-49b2-95db-cb842ddca3d5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:58.434428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:58.437745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:58.438664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:58.441109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:58.509201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:58.514487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:58.560430 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3629/7255] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:03:58.781771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:03:58.788049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:03:58.838253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990193-38d5-4a40-9944-7f1cad45376a service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:03:58.841864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:03:58.842948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:03:58.843456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:03:58.843927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:03:58.995103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:59.109897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:03:59.116884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f5840-85db-4a3f-94b2-a04283b0a8e2 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:03:59.173080 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3627/7256] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:01.650147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:01.857522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06952f3-b3e8-42ef-8307-c684f94693a3 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:01.871976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:01.873455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:01.874067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:01.874581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] PATH_INFO: `/v3/users/937ec97100c341ec91af229260881a5c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:01.877602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937ec97100c341ec91af229260881a5c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:01.882015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:01.886967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:02.311906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937ec97100c341ec91af229260881a5c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:02.316289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937ec97100c341ec91af229260881a5c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:02.420516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937ec97100c341ec91af229260881a5c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:02.485489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937ec97100c341ec91af229260881a5c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:02.540987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937ec97100c341ec91af229260881a5c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:02.570678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3630/7257] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:01 2022] DELETE /identity/v3/users/937ec97100c341ec91af229260881a5c => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:02.578367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:02.579414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:02.579414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:02.705685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:02.708676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:02.990676 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3628/7258] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:03.583906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:03.586735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:03.942388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0ffd-a45b-4038-9fe7-c4c362904757 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:03.965634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:03.967182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:03.972112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:03.973066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:04.032948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:04.049854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3208-8798-4622-8a88-8bc3e7bbe13e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:04.136678 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3631/7259] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:05.805481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:05.808032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:05.862027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be40c-f1b9-4453-8fd3-4d45e6235b55 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:05.894854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:05.897892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:05.898696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:05.900426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] PATH_INFO: `/v3/users/091a4b02b24c4822a3d522e327298a15` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:05.903976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091a4b02b24c4822a3d522e327298a15)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:05.908845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:06.314501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091a4b02b24c4822a3d522e327298a15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:06.427840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091a4b02b24c4822a3d522e327298a15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:06.463625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091a4b02b24c4822a3d522e327298a15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:06.539862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091a4b02b24c4822a3d522e327298a15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:06.544403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091a4b02b24c4822a3d522e327298a15'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:06.591612 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3629/7260] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:05 2022] DELETE /identity/v3/users/091a4b02b24c4822a3d522e327298a15 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:04:06.594887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:06.596584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:06.597324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:06.704979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:06.707301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:06.996037 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3632/7261] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:07.144138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:07.148668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:07.305418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:07.342559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eddcb-4ede-4424-886c-86431b5d3a99 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:07.352610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:07.354289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:07.355229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:07.359432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:07.382874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:07.387996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:07.416154 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3630/7262] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:08.038239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:08.076246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f89e-f810-4b6d-b1ac-e50151b305fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:08.105086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:08.107477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:08.110518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:08.111411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:08.122816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:08.217207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:08.304486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:08.307083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:08.348696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9496-afc0-4182-8427-65a0e275d42c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:08.351909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:08.355435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:08.373639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:08.374817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:08.375637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:08.376140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] PATH_INFO: `/v3/projects/dc65e75149734fe8ab3c20064383e353` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:08.381525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3633/7263] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:08.381896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc65e75149734fe8ab3c20064383e353)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:08.386546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:08.721184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc65e75149734fe8ab3c20064383e353', 'request_id': 'req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:08.748110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc65e75149734fe8ab3c20064383e353', 'request_id': 'req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:08.824382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc65e75149734fe8ab3c20064383e353', 'request_id': 'req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:08.958745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] The token cache is being invalidate because project dc65e75149734fe8ab3c20064383e353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:08.964124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:08.965489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:08.969694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3631/7264] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:08 2022] DELETE /identity/v3/projects/dc65e75149734fe8ab3c20064383e353 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:08.977100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:09.017213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a91d-f2ed-4d46-8d6e-f60a3fb504b0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:09.271200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:09.272665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:09.273219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:09.274228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] PATH_INFO: `/v3/users/68b41db0dc16493aa36310c13d986023` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:09.281929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b41db0dc16493aa36310c13d986023)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:09.290143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:09.744381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b41db0dc16493aa36310c13d986023'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:09.749929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b41db0dc16493aa36310c13d986023'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:09.913132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b41db0dc16493aa36310c13d986023'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:09.982522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b41db0dc16493aa36310c13d986023'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.014112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b41db0dc16493aa36310c13d986023'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.046949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3634/7265] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:08 2022] DELETE /identity/v3/users/68b41db0dc16493aa36310c13d986023 => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:10.153837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:10.157146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:10.189822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8691-22b2-40d1-82ef-cba50caf8fc7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:10.382493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:10.385233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:10.390554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:10.390861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] PATH_INFO: `/v3/projects/a3d8514caa9e40af95f2a6210e12d0e0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:10.394043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d8514caa9e40af95f2a6210e12d0e0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:10.399364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:10.738902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d8514caa9e40af95f2a6210e12d0e0', 'request_id': 'req-244649e9-6858-4889-b791-4b9bffad8254'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.755418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d8514caa9e40af95f2a6210e12d0e0', 'request_id': 'req-244649e9-6858-4889-b791-4b9bffad8254'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.769950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d8514caa9e40af95f2a6210e12d0e0', 'request_id': 'req-244649e9-6858-4889-b791-4b9bffad8254'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.909732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:10.920198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] The token cache is being invalidate because project a3d8514caa9e40af95f2a6210e12d0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:10.921555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.922613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:10.927283 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3632/7266] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:10 2022] DELETE /identity/v3/projects/a3d8514caa9e40af95f2a6210e12d0e0 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:10.932666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:10.935368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:10.961512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16be9d-679e-4530-a50d-64c6a2796716 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:11.092706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:11.134765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:11.136048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:11.137452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:11.137452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] PATH_INFO: `/v3/users/d93167cbb032493997b4de39b87d702e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:11.140576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93167cbb032493997b4de39b87d702e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:11.144775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:11.581810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93167cbb032493997b4de39b87d702e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:11.583627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93167cbb032493997b4de39b87d702e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:11.729648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:11.732037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93167cbb032493997b4de39b87d702e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:11.736547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:11.821471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93167cbb032493997b4de39b87d702e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:11.829308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244649e9-6858-4889-b791-4b9bffad8254 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:11.859956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:11.864204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:11.864663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:11.865185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] PATH_INFO: `/v3/users/8c996ae588ba451e9c4f3f919cb25dde` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:11.868757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-891b1c9a-a046-4c1a-a225-6d0391d5093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93167cbb032493997b4de39b87d702e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:11.872365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c996ae588ba451e9c4f3f919cb25dde)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:11.889106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:11.911879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3635/7267] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:10 2022] DELETE /identity/v3/users/d93167cbb032493997b4de39b87d702e => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:12.527685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c996ae588ba451e9c4f3f919cb25dde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:12.707391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c996ae588ba451e9c4f3f919cb25dde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:12.732877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c996ae588ba451e9c4f3f919cb25dde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:12.783755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c996ae588ba451e9c4f3f919cb25dde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:12.785453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c996ae588ba451e9c4f3f919cb25dde'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:12.809895 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3633/7268] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:11 2022] DELETE /identity/v3/users/8c996ae588ba451e9c4f3f919cb25dde => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:12.813070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:12.815501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:12.815501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:12.853683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:12.856515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:13.005968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3636/7269] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:13.133122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:13.142115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:13.504199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b979-254f-47c2-a072-a371e115c2e8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:13.526331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:13.530982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:13.531617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:13.532207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:13.591479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:13.594419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17c05-0318-4062-98f8-ac354e17a090 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:13.648662 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3634/7270] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:13.979411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:13.981779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:14.007374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b382e-ca55-4108-b30f-a826354adcd2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:14.024899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:14.027613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:14.028700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:14.029715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] PATH_INFO: `/v3/projects/5f34afeaf64c40309f6c0689596292da` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:14.033571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f34afeaf64c40309f6c0689596292da)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:14.038450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:14.424290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f34afeaf64c40309f6c0689596292da', 'request_id': 'req-7238a9c0-c326-4653-b951-fbe8d64e3392'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:14.434608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:14.541751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f34afeaf64c40309f6c0689596292da', 'request_id': 'req-7238a9c0-c326-4653-b951-fbe8d64e3392'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:14.569692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f34afeaf64c40309f6c0689596292da', 'request_id': 'req-7238a9c0-c326-4653-b951-fbe8d64e3392'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:14.635093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] The token cache is being invalidate because project 5f34afeaf64c40309f6c0689596292da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:14.635929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:14.637093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:14.640689 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3637/7271] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:13 2022] DELETE /identity/v3/projects/5f34afeaf64c40309f6c0689596292da => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:14.649631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae48e4-e5ab-47df-963e-1d2a48b521ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:14.650485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae48e4-e5ab-47df-963e-1d2a48b521ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:14.650728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae48e4-e5ab-47df-963e-1d2a48b521ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:14.712677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-66ae48e4-e5ab-47df-963e-1d2a48b521ff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:14.715610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-66ae48e4-e5ab-47df-963e-1d2a48b521ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:14.822471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:14.826091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:14.899202 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3635/7272] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:14.914036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:14.914360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:14.914675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:14.969385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:14.972095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:14.986265 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3636/7273] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:14.993580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:15.015219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd190a8-f669-422b-aa91-e11ddcff9610 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:15.027680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:15.029898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:15.029898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:15.039740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:15.039740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:04:15.039740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:15.039740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:15.043040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:15.093822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238a9c0-c326-4653-b951-fbe8d64e3392 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:15.107358 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3637/7274] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:04:15.114678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:15.116231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:15.117961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:15.118882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:15.119674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] PATH_INFO: `/v3/projects/956ed64e6c534054bd870acdd647d56e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:15.133361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956ed64e6c534054bd870acdd647d56e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:15.142702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:15.156260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b40-99cf-4198-81e5-b82f8db33f44 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:15.173545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:15.176040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:15.177250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:15.178311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:15.182476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:15.191324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:15.480677 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3638/7275] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:15 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:15.487480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:15.549116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956ed64e6c534054bd870acdd647d56e', 'request_id': 'req-71f103dd-5eea-4fef-877e-2ff19a8134d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:15.788866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728422-138a-40d7-a9eb-72e84fc0eed2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:15.800751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:15.802437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:15.802898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:15.803445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:15.804446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956ed64e6c534054bd870acdd647d56e', 'request_id': 'req-71f103dd-5eea-4fef-877e-2ff19a8134d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:15.804696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:15.809836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:15.827817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956ed64e6c534054bd870acdd647d56e', 'request_id': 'req-71f103dd-5eea-4fef-877e-2ff19a8134d5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:15.935076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] The token cache is being invalidate because project 956ed64e6c534054bd870acdd647d56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:15.935627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:15.941280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-71f103dd-5eea-4fef-877e-2ff19a8134d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:15.963976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3638/7276] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:14 2022] DELETE /identity/v3/projects/956ed64e6c534054bd870acdd647d56e => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:15.977006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:15.978068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:15.981003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.045806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3639/7277] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:15 2022] POST /identity/v3/users => generated 283 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:16.046849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.059708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.083207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:16.087612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.125205 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3639/7278] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:16.130219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.136439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.178279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994de88-0f9f-4cc7-9e80-dd6d69965390 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.191914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.194945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.196801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.197493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.200785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.204891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b58b-e453-4a45-8efe-4fdaac1b840d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.238302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3640/7279] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:16.238302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.238302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.238302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.264018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c81e-6919-499c-839c-97577a827c59 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.275680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.277612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.277612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.278935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.283273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.291161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:16.294968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.324496 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3641/7280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:16.324496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.352681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52df63-41ab-46a4-b0c9-055dac3481e3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.363252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.367289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.369177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.369921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.370661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.372119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.376420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.379618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.420336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3642/7281] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:16.420336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.420790 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3640/7282] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:16.434425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.441625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41532d-62b3-42b5-a6b9-523f0d62d575 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.452314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.454632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.455653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.460120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.462053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:04:16.462734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.481422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.485316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7c8e-b246-46c1-a6a0-d49334b71111 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.520545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.521809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.522240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.522727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] PATH_INFO: `/v3/projects/f799e7230ce049158fd527994b2cf0fd/users/faa264670a1b449ea3083c6e51021011/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.528439 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3643/7283] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:04:16.533033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.540424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:16.585877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f799e7230ce049158fd527994b2cf0fd, user_id=faa264670a1b449ea3083c6e51021011, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.591628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.616578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf7761-9c69-4a9c-9b93-f0f7532aa57a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:16.636965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:16.638334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:16.638946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:16.639683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] PATH_INFO: `/v3/projects/a1cc298ab9434263bbac11ef2fe58166` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:16.644786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cc298ab9434263bbac11ef2fe58166)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:16.648332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:16.739498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:16.905066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3641/7284] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:16 2022] PUT /identity/v3/projects/f799e7230ce049158fd527994b2cf0fd/users/faa264670a1b449ea3083c6e51021011/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:16.909428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:16.979976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cc298ab9434263bbac11ef2fe58166', 'request_id': 'req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:17.137479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94085688-d482-48d2-9685-4704859bb7e8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:17.184587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cc298ab9434263bbac11ef2fe58166', 'request_id': 'req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:17.208384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cc298ab9434263bbac11ef2fe58166', 'request_id': 'req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:17.235192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] The token cache is being invalidate because project a1cc298ab9434263bbac11ef2fe58166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:17.235598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:17.236408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e5ea81eb-c3c0-41cc-8e05-3b6c4a0318ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:17.238338 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3644/7285] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:16 2022] DELETE /identity/v3/projects/a1cc298ab9434263bbac11ef2fe58166 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:17.244253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:17.244663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:17.244806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:17.337677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:17.344004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:17.344646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:17.345167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:17.352099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] MFA Rules not processed for user `faa264670a1b449ea3083c6e51021011`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:17.352663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:17.359057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:17.361775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:17.639043 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3645/7286] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:17.640021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3642/7287] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:16 2022] POST /identity/v3/projects => generated 385 bytes in 734 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:17.641774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:17.645519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:17.646561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:17.654600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:17.696188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea745-62f8-4d3e-aed6-2a6a934a6247 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:17.917131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:17.918142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:17.918613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:17.919062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:17.920404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:17.925544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:17.941262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317827-f0fb-4ff1-a9da-cd0f10f08898 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:17.966291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:17.967197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:17.967681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:17.968034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] PATH_INFO: `/v3/users/5e0a062755c64ab0ae009e8342dac793` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:17.970876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0a062755c64ab0ae009e8342dac793)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:17.978703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:18.089618 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3646/7288] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:17 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:18.091784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:18.097150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:18.139127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346865-55ce-4c1a-9960-c0922bc59f1c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:18.167567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:18.168827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:18.169444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:18.170049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:18.171495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:18.181158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:18.264976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:18.438378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3647/7289] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:18 2022] POST /identity/v3/projects => generated 365 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:18.440251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:18.472572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0a062755c64ab0ae009e8342dac793'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:18.616512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0a062755c64ab0ae009e8342dac793'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:18.649195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0a062755c64ab0ae009e8342dac793'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:18.692720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0a062755c64ab0ae009e8342dac793'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:18.698201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0a062755c64ab0ae009e8342dac793'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:18.730834 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3643/7290] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:17 2022] DELETE /identity/v3/users/5e0a062755c64ab0ae009e8342dac793 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:18.777734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:18.784201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:18.833883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028e40-b5be-453f-9ead-9d3f10636420 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:18.994009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:18.995204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:18.995726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:18.996704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:18.997911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:19.001601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:19.069412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3648/7291] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:19.081213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:19.088212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d921d8a-570a-4f30-aa07-c450933e9740 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:19.089266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:19.111864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:19.112984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.114693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.114957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.118897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:19.131038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:19.145713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ae02-671b-4b64-998c-41e322095a59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:19.173053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:19.181328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.181328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.181328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.181328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:19.186321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:19.237136 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3649/7292] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:19.238422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:19.274258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e521d6-7d39-4669-ab90-b6d134b5199f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:19.284401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:19.286165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.287646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.288487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] PATH_INFO: `/v3/projects/774f9ed580974ec182fa011f41cb6b9b/users/41edc7113a5c48c69fa4c62c69772560/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.333213 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3644/7293] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:18 2022] POST /identity/v3/users => generated 289 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:19.337050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:19.353671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774f9ed580974ec182fa011f41cb6b9b, user_id=41edc7113a5c48c69fa4c62c69772560, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:19.362998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada804f6-2240-45e9-8df0-8ebd42b0b283 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:19.376006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13dd8f-f2d1-4b0c-b492-ad9dc74cb4ab admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:19.395047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:19.398794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.399624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.400095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.403314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:19.412900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:19.448572 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3645/7294] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:04:19.461409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:19.502118 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3650/7295] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:19 2022] PUT /identity/v3/projects/774f9ed580974ec182fa011f41cb6b9b/users/41edc7113a5c48c69fa4c62c69772560/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:19.530607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.533299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.533833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.567806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8596cc-c947-49e0-855d-2ae67f85dcdd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:19.696959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] MFA Rules not processed for user `41edc7113a5c48c69fa4c62c69772560`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:19.699545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:19.763805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:19.892162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:19.898283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:19.899123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:19.899803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] PATH_INFO: `/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8/users/5766e3f9bee54a91b8859e98c81abf58/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:19.941139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:19.990976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ad8a5a1f594d368cf78461e4da2de8, user_id=5766e3f9bee54a91b8859e98c81abf58, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:20.004051 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3651/7296] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:20.005366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:20.016767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:20.029151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006be49f-e985-4269-8bda-b9035f1e6168 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:20.040414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:20.041404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:20.041948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:20.042263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:20.043320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:20.048802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:20.166504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3646/7297] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:19 2022] PUT /identity/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8/users/5766e3f9bee54a91b8859e98c81abf58/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:20.174117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:20.352841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3652/7298] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:20 2022] POST /identity/v3/projects => generated 385 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:20.369444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:20.494061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926508-63ae-42c2-8b17-6d4e856db03b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:20.640514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8aa9f-4d1a-4031-a24c-076ea566d901 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:20.655222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:20.658101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:20.658998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:20.660036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:20.664314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:20.671610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:20.733513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:20.734710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:20.734916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:20.735399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:20.736487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:20.739293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:20.779094 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3647/7299] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:04:20.781430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:20.820107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245f98-1eff-4c3a-8d74-6ce27330e7cf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:20.837231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:20.838350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:20.838772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:20.839058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] PATH_INFO: `/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8/users/5766e3f9bee54a91b8859e98c81abf58/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:20.860594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ad8a5a1f594d368cf78461e4da2de8, user_id=5766e3f9bee54a91b8859e98c81abf58, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:20.865823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456c2e-4618-46d8-a5ea-29daf3f6d85d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:20.943353 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3648/7300] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:20 2022] PUT /identity/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8/users/5766e3f9bee54a91b8859e98c81abf58/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:20.950646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:20.954770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:20.955035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:20.980172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3653/7301] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:20 2022] POST /identity/v3/users => generated 293 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:20.985994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:21.038107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24843d5a-fc46-414a-be5b-ace1a2e701b8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:21.121081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] MFA Rules not processed for user `5766e3f9bee54a91b8859e98c81abf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:21.123729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:21.272943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:21.274034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:21.274572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:21.276127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:21.276508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:21.283634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:21.335313 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3654/7302] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:21.337695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:21.400340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954efd0-fd8c-4c74-8466-5b927ad1895f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:21.432431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:21.433586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:21.434074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:21.437594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:21.438894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:21.450158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:21.461950 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3649/7303] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:21.493207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:21.496305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:21.498442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3655/7304] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:21.503900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:21.550108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcf29f-adb8-4466-bdd1-cd3615d11c5c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:21.566249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:21.568527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:21.569000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:21.571204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] PATH_INFO: `/v3/projects/baf5190d911a4e57b0e032263fbe29ee/users/5baf48bf4f814bd182f9ee1167b18df1/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:21.634056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf5190d911a4e57b0e032263fbe29ee, user_id=5baf48bf4f814bd182f9ee1167b18df1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:21.641099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:21.722060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653592f1-a7d3-4b16-bdf6-2ba1f4eff181 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:21.730632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:21.737533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:21.739679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:21.741569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:21.742646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:21.771665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:21.776726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d544-3a76-4a7d-91ba-5b5cb9552c56 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:21.810029 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3650/7305] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:04:21.950908 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3656/7306] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:21 2022] PUT /identity/v3/projects/baf5190d911a4e57b0e032263fbe29ee/users/5baf48bf4f814bd182f9ee1167b18df1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:21.972420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:21.973946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:21.974783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:22.194842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] MFA Rules not processed for user `5baf48bf4f814bd182f9ee1167b18df1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:22.203351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:22.205118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:22.208644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:22.399635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f2b1-1a8a-4060-83a0-e98bfbfc23fe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:22.416035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:22.417678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:22.418498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:22.419310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] PATH_INFO: `/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:22.422394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc8e2fe8d7e4228b54c5fecf4d9ab55)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:22.427467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:22.477090 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3651/7307] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:22.480356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:22.594182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:22.795500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bce52-16e2-4c77-be49-fcd027cffb85 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:22.820607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc8e2fe8d7e4228b54c5fecf4d9ab55', 'request_id': 'req-3471ba3c-bc18-472f-84b3-262108fb4778'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:22.938838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:22.940292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:22.941143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:22.951470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:22.951470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:23.063206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc8e2fe8d7e4228b54c5fecf4d9ab55', 'request_id': 'req-3471ba3c-bc18-472f-84b3-262108fb4778'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:23.092134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc8e2fe8d7e4228b54c5fecf4d9ab55', 'request_id': 'req-3471ba3c-bc18-472f-84b3-262108fb4778'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:23.160315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] The token cache is being invalidate because project bbc8e2fe8d7e4228b54c5fecf4d9ab55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:23.160946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:23.162284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:23.174885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:23.176977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3657/7308] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:22 2022] DELETE /identity/v3/projects/bbc8e2fe8d7e4228b54c5fecf4d9ab55 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:23.178467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:23.180208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:23.180966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:23.206780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3652/7309] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:23.209758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:23.223473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:23.437888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471ba3c-bc18-472f-84b3-262108fb4778 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:23.450523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:23.452201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:23.453486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:23.454807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:23.456446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:23.461108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f816fa-3de1-444e-9387-67e1a0bd9952 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:23.476928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7400-1762-4879-ab4e-a809490ee8d8 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:23.487059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:23.490591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:23.491786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:23.492642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] PATH_INFO: `/v3/users/ec031465536d43179c584558e330d6ec` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:23.496099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec031465536d43179c584558e330d6ec)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:23.501567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:23.674588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3658/7310] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:23 2022] POST /identity/v3/projects => generated 385 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:23.680452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:23.680993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:23.681421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:23.751940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:23.767038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:23.927409 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3659/7311] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:23.927409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:23.966501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798209d1-7398-4307-bc1a-1dccc8748fd3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:23.976879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:23.978048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:23.979106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:23.979473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:23.980897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:23.988405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22b32a-d3d4-4fab-a25d-61f839c8c3b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:23.998112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec031465536d43179c584558e330d6ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:24.174485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec031465536d43179c584558e330d6ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:24.205933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec031465536d43179c584558e330d6ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:24.206443 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3660/7312] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:23 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:24.212343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5918e-37b5-425c-9cd5-9def1b661c3b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:24.220803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5918e-37b5-425c-9cd5-9def1b661c3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:24.225759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5918e-37b5-425c-9cd5-9def1b661c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:24.296326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec031465536d43179c584558e330d6ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:24.297819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec031465536d43179c584558e330d6ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:24.307518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dfa5918e-37b5-425c-9cd5-9def1b661c3b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:24.310889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dfa5918e-37b5-425c-9cd5-9def1b661c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:24.321455 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3653/7313] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:23 2022] DELETE /identity/v3/users/ec031465536d43179c584558e330d6ec => generated 0 bytes in 1114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:24.324824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:24.328444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:24.340447 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3661/7314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:24.342648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:24.343170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:24.346319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:24.415487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:24.417865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:24.567559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:24.641239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5567-08e0-4576-a85d-6fb1434eebdd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:24.660170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:24.660170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:24.660170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:24.660170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:24.661440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:24.665631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:24.696824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3662/7315] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:24.707177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:24.744202 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3654/7316] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:24.750837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:24.756686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3963a-3db5-442e-b108-e1ce6b127d06 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:24.757959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:24.791093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:24.796806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:24.797356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:24.797857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:24.803359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:04:24.803969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:24.807737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:24.873724 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3663/7317] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:04:24.876073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:24.947072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c6e-74e8-4b09-88e1-3905db389e39 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:24.976558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:24.977767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:24.978214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:24.978659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] PATH_INFO: `/v3/projects/fac8b0f3248e42d28c063689a578221d/users/3f512ed26054452da2035f31c2feb001/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.025366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cfd-d6fc-4853-800d-194ad3a10626 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:25.030939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac8b0f3248e42d28c063689a578221d, user_id=3f512ed26054452da2035f31c2feb001, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.033946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:25.035546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:25.036506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:25.037301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.046631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.077158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.081740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.123005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3655/7318] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:25.124139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:25.157874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5924c33-cdfe-4771-8155-af03e7f04718 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:25.188031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:25.190468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:25.193022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:25.194356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.196594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.203118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.207553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3664/7319] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:24 2022] PUT /identity/v3/projects/fac8b0f3248e42d28c063689a578221d/users/3f512ed26054452da2035f31c2feb001/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:25.214179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:25.463043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95a39-6ac3-4fb5-802e-738575d050e3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:25.496886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:25.498022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:25.498593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:25.499043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.500645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.504905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.561814 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3665/7320] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:04:25.570765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:25.587193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3656/7321] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:25.604064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:25.618220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe323dd-c355-4bb5-b6fd-4b41f9b0cd16 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:25.897525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99156b0-1d52-4549-992b-1f2d22ff43cb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:25.899035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:25.900236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:25.900722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:25.901472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] PATH_INFO: `/v3/projects/fac8b0f3248e42d28c063689a578221d/users/3f512ed26054452da2035f31c2feb001/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.918602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:25.920172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:25.920775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:25.921413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:25.921933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac8b0f3248e42d28c063689a578221d, user_id=3f512ed26054452da2035f31c2feb001, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.927015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:25.932090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.934390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233dfd-6204-4c59-a180-0d3aeae81f58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:25.986131 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3666/7322] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:25 2022] PUT /identity/v3/projects/fac8b0f3248e42d28c063689a578221d/users/3f512ed26054452da2035f31c2feb001/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:26.012813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:26.014157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:26.015033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:26.115718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3657/7323] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:25 2022] POST /identity/v3/users => generated 293 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:26.131883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] MFA Rules not processed for user `3f512ed26054452da2035f31c2feb001`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:26.133918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:26.136555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:26.139599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:26.199649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b65a-2a2b-415a-b822-61e1633707a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:26.345968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3667/7324] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:26.367283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:26.370689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:26.464679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:26.466517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:26.467086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:26.467855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:26.469495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:26.474020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:26.506147 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3658/7325] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:26.508130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:26.513919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:26.557636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60dc97-1eee-4556-90b3-f3f7dd09e167 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:26.575481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183779-6c70-466a-ae01-fb3dd7c1b743 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:26.575678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:26.575678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:26.575678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:26.575678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] PATH_INFO: `/v3/projects/4c038e57ff4040eba77793d76e0d7bd9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:26.576249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c038e57ff4040eba77793d76e0d7bd9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:26.576249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:26.587978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:26.589062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:26.589548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:26.590031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:26.601042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:26.698610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:26.847204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:26.850239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:26.906078 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3668/7326] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:26.918239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:26.956824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c038e57ff4040eba77793d76e0d7bd9', 'request_id': 'req-a79e17a1-db28-4704-94a0-a3448332d09c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:26.964998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22060a-9ab8-4ad1-b35f-0a6e3b76e998 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:26.980671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c038e57ff4040eba77793d76e0d7bd9', 'request_id': 'req-a79e17a1-db28-4704-94a0-a3448332d09c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:27.027727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c038e57ff4040eba77793d76e0d7bd9', 'request_id': 'req-a79e17a1-db28-4704-94a0-a3448332d09c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:27.152482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] The token cache is being invalidate because project 4c038e57ff4040eba77793d76e0d7bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:27.153079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:27.160986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:27.162422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.166532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.166532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.168304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:27.177105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:27.179854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a79e17a1-db28-4704-94a0-a3448332d09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:27.199943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3659/7327] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:26 2022] DELETE /identity/v3/projects/4c038e57ff4040eba77793d76e0d7bd9 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:27.212537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554359-0d64-49bd-a7cf-d30cccc74920 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.213105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554359-0d64-49bd-a7cf-d30cccc74920 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.213491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554359-0d64-49bd-a7cf-d30cccc74920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.253536 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3669/7328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:27.262696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:27.272478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:27.325876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-09554359-0d64-49bd-a7cf-d30cccc74920 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:27.333296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-09554359-0d64-49bd-a7cf-d30cccc74920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:27.364105 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3660/7329] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:27.383987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1acb-9980-4e55-985c-4284d809f557 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:27.386555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.387408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.388175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.420774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:27.421871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.422343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.422834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] PATH_INFO: `/v3/projects/df8bb92988f840f2a43168bd1197e4ef/users/b8548d4cd2214f69bac1d35041f18eb7/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.471362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:27.479052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:27.513070 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3661/7330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:27.520170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:27.541921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e7cff-609c-4532-8ab6-d2b47a7eb4c9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:27.553297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:27.555101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.556167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.556799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8bb92988f840f2a43168bd1197e4ef, user_id=b8548d4cd2214f69bac1d35041f18eb7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:27.557412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.559118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:04:27.560054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:27.564067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:27.576038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73666b-e765-44cc-9488-5a3ff76e8222 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:27.591883 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3662/7331] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:04:27.603902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:27.657020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c94c9-e77d-419b-a3bb-e1822254319b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:27.698203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:27.698203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.700118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.701746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.703940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:27.708242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:27.732720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:27.759436 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3670/7332] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:27 2022] PUT /identity/v3/projects/df8bb92988f840f2a43168bd1197e4ef/users/b8548d4cd2214f69bac1d35041f18eb7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:27.784789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:27.785946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:27.786854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:27.888677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] MFA Rules not processed for user `b8548d4cd2214f69bac1d35041f18eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:27.893302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:28.027816 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3663/7333] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:27 2022] POST /identity/v3/projects => generated 361 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:28.034696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:28.095213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3671/7334] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:28.101554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:28.298736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22006-2be5-4eb0-ab8f-8c8075b5a176 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:28.327757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:28.329837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:28.333293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:28.335792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:28.340181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:28.345573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:28.444762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa2cf-6191-46b3-8677-6981321c27e3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:28.472218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:28.473922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:28.474413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:28.474906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:28.480555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:28.489806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:28.544372 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3664/7335] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:28 2022] POST /identity/v3/users => generated 281 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:04:28.557321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:28.565254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:28.654151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d9bc3-cf70-4b2d-944c-655abc459727 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:28.687455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:28.690916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:28.691533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:28.696668 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3672/7336] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:28 2022] POST /identity/v3/projects => generated 383 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:04:28.703770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:28.715699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:28.717092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:28.724490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:28.810516 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3665/7337] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:28.810826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:28.855539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b31b3-6dce-4cc3-be80-cabe5d70795b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:29.098154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a635b8-eb72-4b87-bdf6-e285aaa6514c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:29.129207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:29.130469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:29.136902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:29.137780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:29.141116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:29.150936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:29.170370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:29.173610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:29.173610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:29.178295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:29.180655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:29.187695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:29.251422 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3666/7338] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:29.263431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:29.344485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8bf7-7b0b-466a-84b1-3c447519036f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:29.364457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:29.368141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:29.373166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:29.387988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] PATH_INFO: `/v3/projects/3e52093341534ca5a76295afd3cfd196/users/4c455d23998744ef80027ceddc797279/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:29.423941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3673/7339] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:28 2022] POST /identity/v3/users => generated 292 bytes in 726 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:29.431210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:29.463479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f175009-3bf1-4f29-9085-cbeb6a6e15c2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:29.465540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e52093341534ca5a76295afd3cfd196, user_id=4c455d23998744ef80027ceddc797279, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:29.481619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ffc0-4e7a-46a9-ae65-5e1f9c1a52af admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:29.502282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:29.504956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:29.505579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:29.506075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:29.512148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:29.534623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:29.537810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:29.576533 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3674/7340] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:29.586238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:29.612900 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3667/7341] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:29 2022] PUT /identity/v3/projects/3e52093341534ca5a76295afd3cfd196/users/4c455d23998744ef80027ceddc797279/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:29.634281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:29.634799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:29.635326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:29.665625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e0d2-e25b-4f47-b962-f3ceb84c3a91 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:29.864821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] MFA Rules not processed for user `4c455d23998744ef80027ceddc797279`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:29.873993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:30.029060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:30.032048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:30.041494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:30.042787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:30.047941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:30.053818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:30.128238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3675/7342] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:30.138309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:30.202105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3997-1c9e-4f16-9e00-28bf7f636011 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:30.230963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:30.233817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:30.235043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:30.237103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] PATH_INFO: `/v3/projects/0909912e1c3a4480ad1c8813c3b7dd26/users/81e4697967d14afa92c9de918a90fd32/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:30.338385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0909912e1c3a4480ad1c8813c3b7dd26, user_id=81e4697967d14afa92c9de918a90fd32, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:30.348575 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3668/7343] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 715 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:30.360943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3135b-6d8a-4093-9d79-224f6fbb814b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:30.433293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:30.437657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:30.555765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3676/7344] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:30 2022] PUT /identity/v3/projects/0909912e1c3a4480ad1c8813c3b7dd26/users/81e4697967d14afa92c9de918a90fd32/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:30.581315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:30.583059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:30.583875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:30.791582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] MFA Rules not processed for user `81e4697967d14afa92c9de918a90fd32`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:30.795358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:30.888125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957d67b-5f9a-425a-821d-bac34db400a9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:30.946121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:31.093237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:31.094698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:31.095434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:31.096093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:31.164429 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3677/7345] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 580 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:31.166552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:31.243736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:31.425313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:31.429482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:31.470437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd665a-c98a-47ef-aedf-e81a5e843199 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:31.491767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:31.494608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:31.495505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:31.496231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:31.498577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:31.502855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:31.506937 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3669/7346] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 1075 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:04:31.748743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3678/7347] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:31 2022] POST /identity/v3/projects => generated 385 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:31.754960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:31.794676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966826-c26a-4580-b135-ad527d24e027 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:32.120490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:32.121657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:32.122159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:32.123460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:32.124984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:32.130025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:32.293291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:32.302943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3670/7348] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:31 2022] POST /identity/v3/users => generated 299 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:04:32.389058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8613b6-0272-4532-9899-98b7dc1fb8fb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:32.405206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:32.412124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:32.412124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:32.412124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:32.412124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:32.417251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:32.463839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:32.474240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3679/7349] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:04:32.478909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:32.506696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447fc24-1985-4e07-83c8-2c0b0a20cf53 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:32.518577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:32.521595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:32.522882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:32.525647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] PATH_INFO: `/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c/users/624a77586279493282b354e26b5287e9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:32.560106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1902111d2749aeaf2ccaf0ab410b4c, user_id=624a77586279493282b354e26b5287e9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:32.568220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4335011-f55b-41ec-821c-791ba4e7b25c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:32.876301 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3671/7350] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:32 2022] PUT /identity/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c/users/624a77586279493282b354e26b5287e9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:32.883471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:32.942610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425bb09-a22d-4a33-be89-12da2038a90a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:33.039945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:33.213549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:33.213549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:33.213549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:33.213549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:33.214283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:33.219091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:33.243857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:33.244352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:33.244853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:33.260177 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3680/7351] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:33.267276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:33.302172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd20e-4505-4a4c-b973-de4a8f782974 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:33.324740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:33.326013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:33.326637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:33.327179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] PATH_INFO: `/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c/users/624a77586279493282b354e26b5287e9/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:33.338614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] MFA Rules not processed for user `626d1f96e801458eba55b56ff8fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:33.338884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1902111d2749aeaf2ccaf0ab410b4c, user_id=624a77586279493282b354e26b5287e9, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:33.349783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:33.356340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c2578-1cac-4503-a622-98bae0353443 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:33.417215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3681/7352] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:33 2022] PUT /identity/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c/users/624a77586279493282b354e26b5287e9/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:33.436288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:33.436794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:33.437162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:33.548172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] MFA Rules not processed for user `624a77586279493282b354e26b5287e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:33.550820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:33.558205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3672/7353] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:33.730042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:33.734554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:33.821704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a54d-5a16-4d25-bca2-d25fdacd39f9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:33.885001 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3682/7354] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:33.886532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:33.894133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:34.276442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:34.279849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:34.281357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:34.282956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] PATH_INFO: `/v3/users/3dd22200c78348c1816f705533d605bd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:34.285435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88e11c-510d-409a-a6e0-718db69d7bc4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:34.289857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd22200c78348c1816f705533d605bd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:34.295526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:34.306856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:34.308019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:34.308604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:34.309270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:34.329810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:34.453612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:34.749749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:34.752674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:34.781623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd22200c78348c1816f705533d605bd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:34.817053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3683/7355] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 931 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:34.838758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:34.856720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:35.040226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd22200c78348c1816f705533d605bd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:35.104234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd22200c78348c1816f705533d605bd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:35.244025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd22200c78348c1816f705533d605bd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:35.247880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d37045e4-13b6-41be-86cc-a2f614e575e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd22200c78348c1816f705533d605bd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:35.286130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c2ee-d277-4ca4-8777-12cf97aa0ed3 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:35.311851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:35.313088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:35.313698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:35.314269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:35.328503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:35.339760 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3673/7356] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:33 2022] DELETE /identity/v3/users/3dd22200c78348c1816f705533d605bd => generated 0 bytes in 1611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:35.346911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:35.351739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:35.352784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:35.487767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:35.496898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:35.697330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:35.721334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:35.726807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:35.777123 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3684/7357] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 940 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:35.866802 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3674/7358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:35.915818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.080375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:36.083538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:36.117799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:36.119867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:36.145665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.190959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.420904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5c66-45c5-4324-b08a-819df0dca454 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:36.486198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e3ce7-494d-4059-a15c-052e8c1d20af None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:36.514647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:36.515779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:36.516298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:36.516791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:36.529637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:36.575576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.618223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:36.619915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:36.620828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:36.621578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:36.663169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:36.666388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c29b3-402b-4b3a-a7be-df27332adccb service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:36.706954 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3685/7359] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:36.811832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:36.814949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:36.852318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3675/7360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:04:37.027415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:37.028358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:37.029217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:04:37.062001 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:04:37.068132 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:04:37.124169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3686/7361] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:04:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:04:41.023785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:41.077638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b5ce0-102d-4356-968c-e52158f8e68d service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:41.099091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:41.100381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:41.100892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:41.101370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:41.107384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:41.524454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:41.530573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:41.565051 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3676/7362] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:41.647434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:41.651075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:41.760582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d260-ac29-435e-8f79-8f52bfac9866 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:41.794154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:41.794154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:41.794787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:41.795595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] PATH_INFO: `/v3/projects/e374235b0aa04257b4a95733728540f3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:41.804326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e374235b0aa04257b4a95733728540f3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:41.808563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:42.172689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e374235b0aa04257b4a95733728540f3', 'request_id': 'req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:42.196542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:42.294095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e374235b0aa04257b4a95733728540f3', 'request_id': 'req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:42.314223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e374235b0aa04257b4a95733728540f3', 'request_id': 'req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:42.364759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] The token cache is being invalidate because project e374235b0aa04257b4a95733728540f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:42.377162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:42.380299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:42.393571 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3687/7363] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:41 2022] DELETE /identity/v3/projects/e374235b0aa04257b4a95733728540f3 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:42.399866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:42.433976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221b1b5-c7cc-400c-a972-ec0a46e02bb2 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:42.788512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:42.789770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:42.790267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:42.796884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] PATH_INFO: `/v3/users/cd3e6d09ab29406eb6918ad57c5385ec` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:42.802657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3e6d09ab29406eb6918ad57c5385ec)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:42.821860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:43.021528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:43.025459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:43.084806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:43.282318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3e6d09ab29406eb6918ad57c5385ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:43.350439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd0e5a-233e-47d3-a46b-a0ecdcea86ff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:43.377608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:43.378778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:43.382701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:43.385550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:43.401869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:43.407554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3e6d09ab29406eb6918ad57c5385ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:43.445453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3e6d09ab29406eb6918ad57c5385ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:43.536002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3e6d09ab29406eb6918ad57c5385ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:43.540494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3e6d09ab29406eb6918ad57c5385ec'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:43.586559 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3677/7364] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:42 2022] DELETE /identity/v3/users/cd3e6d09ab29406eb6918ad57c5385ec => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:04:43.817789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:43.820790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c2cfa-a606-4a9c-a5c5-9ff510e21641 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:43.882677 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3688/7365] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:46.038380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:46.041942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:46.392231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661a08-edc8-40e4-a558-fb5c584b17b3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:46.405475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:46.407179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:46.407932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:46.408620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] PATH_INFO: `/v3/projects/d707b239f54e4f1192cd13ffdb6ee144` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:46.412779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d707b239f54e4f1192cd13ffdb6ee144)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:46.417662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:46.735258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd707b239f54e4f1192cd13ffdb6ee144', 'request_id': 'req-8bed24fe-d46e-408c-8686-67f2496e5dfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:46.775110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd707b239f54e4f1192cd13ffdb6ee144', 'request_id': 'req-8bed24fe-d46e-408c-8686-67f2496e5dfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:46.806853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd707b239f54e4f1192cd13ffdb6ee144', 'request_id': 'req-8bed24fe-d46e-408c-8686-67f2496e5dfb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:46.918075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] The token cache is being invalidate because project d707b239f54e4f1192cd13ffdb6ee144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:04:46.919104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:46.926800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8bed24fe-d46e-408c-8686-67f2496e5dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:46.933898 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3678/7366] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:04:46 2022] DELETE /identity/v3/projects/d707b239f54e4f1192cd13ffdb6ee144 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:46.941918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:46.942814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:46.944042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:47.059299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:47.061573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:47.362346 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3689/7367] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:47.374958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:47.376435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:47.377125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:47.445426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:47.453546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:47.486320 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3679/7368] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:47.492689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:47.529193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df504d33-88ff-402d-bacd-38b8622f6633 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:47.551499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:47.552773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:47.553748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:47.555188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:47.566267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:04:47.567460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:47.570584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:47.579340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:47.583516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:47.648698 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3690/7369] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:04:47.649873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:47.672619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502977c-01aa-41ed-aca7-e9dc8871da1f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:47.701670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:47.703226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:47.705534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:47.706400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:47.708229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:47.714419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:47.723750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:47.846077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df439c-f97b-488a-a26a-c46f134ed3f3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:47.860019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:47.861119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:47.862595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:47.863106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:47.870280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:47.903533 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3691/7370] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:04:47 2022] POST /identity/v3/projects => generated 397 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:47.914369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:47.945243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:48.143391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:48.152998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:48.212276 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3680/7371] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:04:48.246629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9aea9-a521-493d-b1e7-1afa34175123 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:48.257517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:48.266401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:48.266401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:48.266401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:48.266401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:48.268108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:48.460364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3692/7372] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:04:47 2022] POST /identity/v3/users => generated 299 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:04:48.467076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:48.529407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193d7c-8d68-4376-81e8-969524ad22d3 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:48.559656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:48.559656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:48.559656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:48.560454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:48.561402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:48.563199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:48.683265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:48.700963 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3681/7373] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:04:48.751050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccff58-8a34-46aa-bf46-90ec04cdd936 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:48.787963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:48.789377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:48.790045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:48.792025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:48.795376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:48.805756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e909-710f-4b11-a0f9-8995fc6959cb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:48.854125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3693/7374] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:04:48.861290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:48.948949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2608-1b5f-4e1a-bacf-663853c9da09 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:48.975231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:48.980775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:48.985510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:48.985510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] PATH_INFO: `/v3/projects/fea29c0c39584f28b297f628a73b7646/users/cfa926f35d6043068e7aa32873701df1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:49.100910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea29c0c39584f28b297f628a73b7646, user_id=cfa926f35d6043068e7aa32873701df1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:49.112611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:49.309550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3682/7375] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:04:48 2022] PUT /identity/v3/projects/fea29c0c39584f28b297f628a73b7646/users/cfa926f35d6043068e7aa32873701df1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:04:49.330240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:49.335604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:49.335604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:49.492143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] MFA Rules not processed for user `cfa926f35d6043068e7aa32873701df1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:49.494493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:49.881623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3694/7376] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:50.143868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:50.149668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:50.480489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1e48c-a0c9-4e53-b224-aa390541db4c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:50.499475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:50.500831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:50.506097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:50.507413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:50.559995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:50.564177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:50.636669 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3683/7377] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:04:56.699452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:56.701015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:56.927966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47aab1-ff62-4151-814f-96ae484a9255 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:56.952784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:56.955863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:56.959759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:56.960611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] PATH_INFO: `/v3/users/6f9b945a4f00469bb06878d384cf1de3` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:56.965867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9b945a4f00469bb06878d384cf1de3)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:56.974848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:57.032330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:57.349533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:57.352293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:57.441107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599c4-33f7-4660-a7a4-22877f2d8daf service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:57.459191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:57.461016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:57.461885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:57.462686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] PATH_INFO: `/v3/users/0907cb7b366c4ca1bbfa529663952c9f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:57.465298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0907cb7b366c4ca1bbfa529663952c9f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:57.470970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:57.536673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9b945a4f00469bb06878d384cf1de3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:57.544343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9b945a4f00469bb06878d384cf1de3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:57.685772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9b945a4f00469bb06878d384cf1de3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:57.738631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9b945a4f00469bb06878d384cf1de3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:57.759620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca90c3ac-745b-4df8-b909-ad5a97c2f72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9b945a4f00469bb06878d384cf1de3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:57.774288 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3695/7378] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:56 2022] DELETE /identity/v3/users/6f9b945a4f00469bb06878d384cf1de3 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:04:57.790476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:57.791632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:57.794505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:57.869384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:57.872795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:57.926468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:57.969807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0907cb7b366c4ca1bbfa529663952c9f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:58.161692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0907cb7b366c4ca1bbfa529663952c9f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:58.183617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0907cb7b366c4ca1bbfa529663952c9f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:58.208411 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3696/7379] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:04:58.262905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0907cb7b366c4ca1bbfa529663952c9f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:58.264572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-75b1209e-e811-4256-a73c-c4a152946a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0907cb7b366c4ca1bbfa529663952c9f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:04:58.272590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:58.277325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:58.282833 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3684/7380] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:04:57 2022] DELETE /identity/v3/users/0907cb7b366c4ca1bbfa529663952c9f => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:04:58.291208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:58.291740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:58.292796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:58.356885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:04:58.371057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:58.498658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d446d3-0256-4b0a-ad5f-4f8cf4db126c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:58.672692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3685/7381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:04:58.676570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:58.708243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49915342-f00b-4b29-b360-58983188936e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:58.715521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49915342-f00b-4b29-b360-58983188936e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:58.715521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49915342-f00b-4b29-b360-58983188936e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:58.715521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49915342-f00b-4b29-b360-58983188936e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:58.715521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-49915342-f00b-4b29-b360-58983188936e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:58.747952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49915342-f00b-4b29-b360-58983188936e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:58.750693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49915342-f00b-4b29-b360-58983188936e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:58.762909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:04:58.768218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:04:58.769175 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3697/7382] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:04:58.813493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec666-21d7-43a9-8ee5-78d4377dfeb6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:04:58.844802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:04:58.859289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:04:58.859289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:04:58.859289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:04:58.900770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:04:58.907980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:04:59.015640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3686/7383] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:05:00.326803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49915342-f00b-4b29-b360-58983188936e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:00.331637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-49915342-f00b-4b29-b360-58983188936e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:00.365056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:00.370764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:00.532003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49915342-f00b-4b29-b360-58983188936e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:00.545292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:00.553352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:00.554380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:00.555274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] PATH_INFO: `/v3/projects/07aabd9030f3444e986d02991f96bb44` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:00.558142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07aabd9030f3444e986d02991f96bb44)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:00.563240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:00.586339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102267cf-539c-4d52-b1d4-cae0b7f553ec service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:00.624632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:00.626448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:00.627269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:00.628033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] PATH_INFO: `/v3/projects/ec1b0b0f9b7d4529945c159db6187b31` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:00.631226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1b0b0f9b7d4529945c159db6187b31)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:00.718157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:00.921798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07aabd9030f3444e986d02991f96bb44', 'request_id': 'req-8411daca-14d1-40f3-8aa5-43dd70d861d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.103628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07aabd9030f3444e986d02991f96bb44', 'request_id': 'req-8411daca-14d1-40f3-8aa5-43dd70d861d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.109528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1b0b0f9b7d4529945c159db6187b31', 'request_id': 'req-077ee487-31f2-4854-b2b4-2720491ea66c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.166905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07aabd9030f3444e986d02991f96bb44', 'request_id': 'req-8411daca-14d1-40f3-8aa5-43dd70d861d3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.182057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1b0b0f9b7d4529945c159db6187b31', 'request_id': 'req-077ee487-31f2-4854-b2b4-2720491ea66c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.224187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1b0b0f9b7d4529945c159db6187b31', 'request_id': 'req-077ee487-31f2-4854-b2b4-2720491ea66c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.250624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] The token cache is being invalidate because project 07aabd9030f3444e986d02991f96bb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:01.251164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.258181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8411daca-14d1-40f3-8aa5-43dd70d861d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.269772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3698/7384] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:00 2022] DELETE /identity/v3/projects/07aabd9030f3444e986d02991f96bb44 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:01.280055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5373e-f220-4eb6-955e-a6e2cf648242 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:01.280586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5373e-f220-4eb6-955e-a6e2cf648242 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:01.281072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5373e-f220-4eb6-955e-a6e2cf648242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:01.365545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-79c5373e-f220-4eb6-955e-a6e2cf648242 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:01.375895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79c5373e-f220-4eb6-955e-a6e2cf648242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:01.403676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] The token cache is being invalidate because project ec1b0b0f9b7d4529945c159db6187b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:01.407718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.407718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:01.427993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3687/7385] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:00 2022] DELETE /identity/v3/projects/ec1b0b0f9b7d4529945c159db6187b31 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:01.446658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:01.450032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:01.519891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:01.954587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ee487-31f2-4854-b2b4-2720491ea66c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:01.984837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:01.986356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:01.997392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:01.998195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] PATH_INFO: `/v3/users/08c4edd2869b47dcbd2c1b987b45b81a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:02.000636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c4edd2869b47dcbd2c1b987b45b81a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:02.005011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:02.019066 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3699/7386] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 742 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:02.038393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:02.042057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:02.042577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:02.125181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:02.127881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:02.165844 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3700/7387] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:02.173815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:02.263422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b694f-82ad-4b22-a106-be41749f8d08 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:02.287248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:02.288998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:02.292030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:02.292030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:02.293494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:02.294075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:02.300047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:02.395943 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3701/7388] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:05:02.404275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:02.452800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a21c-f745-45b9-ad72-b2bb13d55dad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:02.475568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:02.478903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:02.479711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:02.482533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:02.486870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:02.497489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:02.505875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:02.506813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c4edd2869b47dcbd2c1b987b45b81a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:02.656703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c4edd2869b47dcbd2c1b987b45b81a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:02.713664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c4edd2869b47dcbd2c1b987b45b81a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:02.782830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3702/7389] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:02 2022] POST /identity/v3/projects => generated 373 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:05:02.795954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:02.827272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c4edd2869b47dcbd2c1b987b45b81a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:02.829481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c4edd2869b47dcbd2c1b987b45b81a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:02.879504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3688/7390] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:01 2022] DELETE /identity/v3/users/08c4edd2869b47dcbd2c1b987b45b81a => generated 0 bytes in 1434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:03.211017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af87b-58fb-44ac-9e64-96eacf9fbc9b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:03.806721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:03.807978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:03.808457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:03.815590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:03.821670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:03.826286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:04.061601 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3703/7391] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:02 2022] POST /identity/v3/users => generated 287 bytes in 1276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:04.063058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:04.083039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:04.254489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1109dd-826a-42c0-a215-37910df2fdf2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:04.296440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:04.298220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:04.304207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:04.305230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:04.308647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:04.311051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:04.369459 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3689/7392] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:04.377080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:04.423727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451b713-6799-4762-ad13-86c1c7893da1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:04.455085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:04.482576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:04.482576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:04.482576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:04.482576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:04.527498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9828553-cc87-43da-a736-c8b540e035fe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:04.601814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:04.618401 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3704/7393] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:04.648216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6f2e3-7985-4dc6-aa6b-99bd76e9895f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:04.672990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:04.690362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:04.691260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:04.692016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] PATH_INFO: `/v3/projects/c9d031eca7c04999aa55fbbda9e616c2/users/dad067bd3a694ae1a67e14b7e83c804d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:04.767191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d031eca7c04999aa55fbbda9e616c2, user_id=dad067bd3a694ae1a67e14b7e83c804d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:04.772673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:04.976882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3690/7394] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:04 2022] PUT /identity/v3/projects/c9d031eca7c04999aa55fbbda9e616c2/users/dad067bd3a694ae1a67e14b7e83c804d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:05.001734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:05.003324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:05.004453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:05.197150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] MFA Rules not processed for user `dad067bd3a694ae1a67e14b7e83c804d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:05.211912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:05.314285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:05.319708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:05.494773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:05.654147 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3705/7395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 657 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:05.692230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:05.714376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98604-d924-498e-8699-669c65e1fd1f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:05.742758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:05.744457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:05.745306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:05.746115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] PATH_INFO: `/v3/projects/4e0db5a97f1441379250ee402cb8fece` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:05.752670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0db5a97f1441379250ee402cb8fece)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:05.762851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:05.763859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:05.809197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a4619-0d17-4cb6-9680-872208b0b380 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:05.867648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:05.868939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:05.869446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:05.873474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:05.878463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:05.885409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:06.112347 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3706/7396] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:05 2022] POST /identity/v3/projects => generated 373 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:06.115273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:06.159462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0db5a97f1441379250ee402cb8fece', 'request_id': 'req-1adf56df-2f30-4590-822a-6ceb1ea7ddea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:06.193198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0db5a97f1441379250ee402cb8fece', 'request_id': 'req-1adf56df-2f30-4590-822a-6ceb1ea7ddea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:06.224525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0db5a97f1441379250ee402cb8fece', 'request_id': 'req-1adf56df-2f30-4590-822a-6ceb1ea7ddea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:06.400147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] The token cache is being invalidate because project 4e0db5a97f1441379250ee402cb8fece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:06.402384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:06.405879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:06.416470 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3691/7397] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:05 2022] DELETE /identity/v3/projects/4e0db5a97f1441379250ee402cb8fece => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:06.421685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:06.430081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:06.487687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcda13-9914-4cce-a93f-93f1343e8cdc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:06.533280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:06.538950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:06.542990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:06.543819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:06.545079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:06.558527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:06.726376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf56df-2f30-4590-822a-6ceb1ea7ddea admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:06.743738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:06.745363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:06.746063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:06.747017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] PATH_INFO: `/v3/users/0c8fa9a03a564ed49107a476d239a3c0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:06.750091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8fa9a03a564ed49107a476d239a3c0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:06.754342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:06.841331 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3707/7398] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:06 2022] POST /identity/v3/users => generated 293 bytes in 726 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:06.843041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:06.854590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:06.921517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95445-efec-4b44-93b1-bd69e2ab012f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:06.960548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:06.961756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:06.962211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:06.962695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:06.964036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:06.968115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:07.020786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3708/7399] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:07.027913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:07.070236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ff98-3a7c-4386-b4e3-15d22f41d6cc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:07.098036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:07.099500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:07.099966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:07.100443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] PATH_INFO: `/v3/projects/8f0263a110c84f1db828d07032ad0e59/users/1e9672a374064f3990f022bdafc4000a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:07.170319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0263a110c84f1db828d07032ad0e59, user_id=1e9672a374064f3990f022bdafc4000a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:07.187377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:07.284415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8fa9a03a564ed49107a476d239a3c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:07.364326 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3709/7400] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:07 2022] PUT /identity/v3/projects/8f0263a110c84f1db828d07032ad0e59/users/1e9672a374064f3990f022bdafc4000a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:07.364326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:07.366780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:07.507653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8fa9a03a564ed49107a476d239a3c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:07.545697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:07.566929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8fa9a03a564ed49107a476d239a3c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:07.625033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8fa9a03a564ed49107a476d239a3c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:07.626628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8fa9a03a564ed49107a476d239a3c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:07.688847 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3692/7401] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:06 2022] DELETE /identity/v3/users/0c8fa9a03a564ed49107a476d239a3c0 => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:07.690640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:07.700497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:07.826317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b28bbb-41fa-46d7-ae57-088272466101 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:08.082808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:08.141473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09001a-a8f9-4549-a1cc-e5d57ee5414c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:08.190343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:08.190343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:08.190343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:08.190343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:08.195815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:08.208666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:08.258429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:08.274454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:08.274867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:08.279369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:08.283028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3693/7402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 593 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:08.286747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:08.291383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:08.400483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4398458-2b16-4f05-9ece-1f69a6a4e229 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:08.450055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:08.451582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:08.457117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:08.457117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] PATH_INFO: `/v3/projects/8f0263a110c84f1db828d07032ad0e59/users/1e9672a374064f3990f022bdafc4000a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:08.458963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:08.471391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:08.479430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0263a110c84f1db828d07032ad0e59, user_id=1e9672a374064f3990f022bdafc4000a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:08.508844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691e75-5686-4f96-83c1-57da29b3c732 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:08.593469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3694/7403] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:08 2022] PUT /identity/v3/projects/8f0263a110c84f1db828d07032ad0e59/users/1e9672a374064f3990f022bdafc4000a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:08.612115 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3710/7404] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 1248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:08.616478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:08.617451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:08.618207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:08.831584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] MFA Rules not processed for user `1e9672a374064f3990f022bdafc4000a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:08.834360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:09.282803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:09.286641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:09.370143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb95ca-4c63-4ea5-9b96-69dedb17eb6c service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:09.453260 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3695/7405] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 839 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:09.485753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:09.497000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:09.741177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:09.800300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94c5ad-10fc-4e90-98c2-d9797c9e68b8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:09.817261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:09.818887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:09.824911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:09.825785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:09.867100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:09.870648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:09.885801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:09.892002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:09.892002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:09.892002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] PATH_INFO: `/v3/users/41edc7113a5c48c69fa4c62c69772560` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:09.898116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41edc7113a5c48c69fa4c62c69772560)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:09.905860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:09.959700 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3696/7406] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:10.440415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41edc7113a5c48c69fa4c62c69772560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:10.446752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41edc7113a5c48c69fa4c62c69772560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:10.456711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:10.464498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:10.526298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f5a2-a2c7-41d3-a95d-99c42e5488ad service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:10.553802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:10.578425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:10.581868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:10.585719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] PATH_INFO: `/v3/projects/87105786ed774112b160fb3d6aeb914f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:10.602122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87105786ed774112b160fb3d6aeb914f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:10.614580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:10.634493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41edc7113a5c48c69fa4c62c69772560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:10.703769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41edc7113a5c48c69fa4c62c69772560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:10.758651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41edc7113a5c48c69fa4c62c69772560'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:10.829189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3711/7407] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:09 2022] DELETE /identity/v3/users/41edc7113a5c48c69fa4c62c69772560 => generated 0 bytes in 1543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:10.841880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:10.847771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:11.144064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87105786ed774112b160fb3d6aeb914f', 'request_id': 'req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:11.171526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87105786ed774112b160fb3d6aeb914f', 'request_id': 'req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:11.199388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87105786ed774112b160fb3d6aeb914f', 'request_id': 'req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:11.203767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:11.230865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f97b80-29f4-4967-834d-8a499bc86338 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:11.399545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] The token cache is being invalidate because project 87105786ed774112b160fb3d6aeb914f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:11.400045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:11.406675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7e8dc255-cc17-4a20-b9d3-b3049d0557f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:11.416103 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3697/7408] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:10 2022] DELETE /identity/v3/projects/87105786ed774112b160fb3d6aeb914f => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:11.416103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5943d-9c76-4f94-92d0-2d5a7b139a72 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:11.416103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5943d-9c76-4f94-92d0-2d5a7b139a72 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:11.416103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5943d-9c76-4f94-92d0-2d5a7b139a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:11.532803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:11.545248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:11.545886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:11.546434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:11.555991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ddd5943d-9c76-4f94-92d0-2d5a7b139a72 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:11.567816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ddd5943d-9c76-4f94-92d0-2d5a7b139a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:11.573872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:11.986090 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3698/7409] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:11.986090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9b6a-2d0b-44b0-af18-8d3048d009d9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:11.986090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9b6a-2d0b-44b0-af18-8d3048d009d9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:11.986090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9b6a-2d0b-44b0-af18-8d3048d009d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:11.995945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:12.000605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:12.060066 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3712/7410] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:12.071960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:12.083467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:12.251528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1d0d9b6a-2d0b-44b0-af18-8d3048d009d9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:12.254846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d0d9b6a-2d0b-44b0-af18-8d3048d009d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:12.310971 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3699/7411] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:12.332558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:12.333090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:12.333837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:12.406244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:12.411417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:12.437155 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3700/7412] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:12.439526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:12.467224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fa696-9bce-4252-a547-a46bac1fde45 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:12.486194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d616-59d7-4bb1-b1c6-565701611462 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:12.490901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:12.492273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:12.492778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:12.493260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:12.512940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:12.514237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:12.514909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:12.515547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:12.516851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:12.525951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:12.529541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:12.536083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:12.540438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:12.582307 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3713/7413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:12.587928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3701/7414] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:05:12.589975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:12.630202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d593c-0739-4261-989e-49e56477339c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:12.649744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:12.659429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:12.660122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:12.660997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:12.662333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:12.678110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:12.964261 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3714/7415] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:12 2022] POST /identity/v3/projects => generated 371 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:12.964868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:13.014187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae46c0-5091-42f7-be19-57ae78f1b75a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:13.133692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:13.416138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:13.417998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:13.418733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:13.419976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:13.421525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:13.435524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:13.595508 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3702/7416] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:12 2022] POST /identity/v3/users => generated 286 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:13.605744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:13.639747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a9f64-e116-4b87-a3d1-8caeb699062e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:13.656606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:13.658712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:13.659577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:13.660348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:13.661948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:13.665485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:13.715012 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3715/7417] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:13.721535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:13.789518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352b65-786c-41cf-bf54-d94a476eab1f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:13.825653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:13.830442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:13.830442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:13.830442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:13.833924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:13.846017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:13.887394 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3703/7418] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:13.898075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:13.921128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae19ea-3afd-490b-8d3b-f540f602b56b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:13.938728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:13.942640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:13.943925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:13.945864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] PATH_INFO: `/v3/projects/afee0f06e20e463cbf4478f69a60dd8c/users/1239809ca5034829a3b8425fa98d8b3f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:13.992993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=afee0f06e20e463cbf4478f69a60dd8c, user_id=1239809ca5034829a3b8425fa98d8b3f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:13.999227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861acbc-96b6-4137-9d5e-41ffd90e8fca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:14.008465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:14.095989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:14.100141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:14.151166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af827e-7300-4d45-b403-24dd6d4a8aba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:14.195211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3716/7419] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:13 2022] PUT /identity/v3/projects/afee0f06e20e463cbf4478f69a60dd8c/users/1239809ca5034829a3b8425fa98d8b3f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:14.204976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:14.205446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:14.205924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:14.293870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] MFA Rules not processed for user `1239809ca5034829a3b8425fa98d8b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:14.296628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:14.396121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:14.397513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:14.398584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:14.399370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] PATH_INFO: `/v3/projects/774f9ed580974ec182fa011f41cb6b9b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:14.411674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774f9ed580974ec182fa011f41cb6b9b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:14.413369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:14.543437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3717/7420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:14.548378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:14.592285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a988ae-16ab-4f07-8d19-eb4e98171662 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:14.620137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:14.621224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:14.621866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:14.622367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:14.629006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:14.633442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:14.783979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774f9ed580974ec182fa011f41cb6b9b', 'request_id': 'req-839075bb-e4c0-43a1-986f-6e3f4e96e568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:14.819475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774f9ed580974ec182fa011f41cb6b9b', 'request_id': 'req-839075bb-e4c0-43a1-986f-6e3f4e96e568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:14.844081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774f9ed580974ec182fa011f41cb6b9b', 'request_id': 'req-839075bb-e4c0-43a1-986f-6e3f4e96e568'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:15.052621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] The token cache is being invalidate because project 774f9ed580974ec182fa011f41cb6b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:15.053064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:15.053891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3718/7421] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:14 2022] POST /identity/v3/projects => generated 373 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:15.055594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:15.059850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:15.070416 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3704/7422] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:14 2022] DELETE /identity/v3/projects/774f9ed580974ec182fa011f41cb6b9b => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:15.078220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:15.078438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:15.086644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:15.207976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:15.385226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3520a1-d71e-4a4c-8392-7bf32f26ab2c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:15.456370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:15.461683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:15.462248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:15.468052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:15.469423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:15.473644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839075bb-e4c0-43a1-986f-6e3f4e96e568 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:15.473930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:15.549374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:15.550964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:15.562642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:15.563287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] PATH_INFO: `/v3/users/5baf48bf4f814bd182f9ee1167b18df1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:15.567825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baf48bf4f814bd182f9ee1167b18df1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:15.574265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:15.808253 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3719/7423] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:15 2022] POST /identity/v3/users => generated 293 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:15.814350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:15.869519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a88519-3833-4f84-b744-e00c551a10e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:15.892354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:15.893470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:15.898996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:15.900209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:15.906078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:15.909482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:15.991072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3720/7424] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:05:15.993558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:16.046276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975b393-23b3-486f-b0d4-7241454f9cc4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:16.064841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baf48bf4f814bd182f9ee1167b18df1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:16.068372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:16.070091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:16.077891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:16.078510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] PATH_INFO: `/v3/projects/60eb927b8ea94e4cba9f89953fd90266/users/2d54a1d799664f1c9c7e49e8a4d60710/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:16.136418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb927b8ea94e4cba9f89953fd90266, user_id=2d54a1d799664f1c9c7e49e8a4d60710, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:16.170721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:16.226205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baf48bf4f814bd182f9ee1167b18df1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:16.265257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baf48bf4f814bd182f9ee1167b18df1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:16.326747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baf48bf4f814bd182f9ee1167b18df1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:16.329027 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3721/7425] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:15 2022] PUT /identity/v3/projects/60eb927b8ea94e4cba9f89953fd90266/users/2d54a1d799664f1c9c7e49e8a4d60710/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:16.329325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baf48bf4f814bd182f9ee1167b18df1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:16.335350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:16.356999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:16.383939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3705/7426] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:15 2022] DELETE /identity/v3/users/5baf48bf4f814bd182f9ee1167b18df1 => generated 0 bytes in 1313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:16.461420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:16.858244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6e69-504c-4e8c-adbd-b1fa851a2c64 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:17.262679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:17.265639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:17.268679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:17.274898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:17.276072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:17.282780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:17.284457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:17.284711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:17.336962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb2e0-89bb-4c40-a5d0-701d86578a84 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:17.363652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3722/7427] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 1028 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:17.372608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:17.373819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:17.376636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:17.377536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:17.390051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] PATH_INFO: `/v3/users/b8548d4cd2214f69bac1d35041f18eb7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:17.398965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8548d4cd2214f69bac1d35041f18eb7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:17.418551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:17.436739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ac703-8e69-4869-8ee9-5c4e0547734a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:17.481560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:17.484345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:17.488892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:17.489903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] PATH_INFO: `/v3/projects/60eb927b8ea94e4cba9f89953fd90266/users/2d54a1d799664f1c9c7e49e8a4d60710/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:17.499833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eb927b8ea94e4cba9f89953fd90266, user_id=2d54a1d799664f1c9c7e49e8a4d60710, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:17.517299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0821db-298e-424f-83bb-26af18504d55 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:17.592549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3723/7428] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:17 2022] PUT /identity/v3/projects/60eb927b8ea94e4cba9f89953fd90266/users/2d54a1d799664f1c9c7e49e8a4d60710/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:17.621044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:17.622064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:17.622876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:17.813631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] MFA Rules not processed for user `2d54a1d799664f1c9c7e49e8a4d60710`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:17.822805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:17.824257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8548d4cd2214f69bac1d35041f18eb7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:17.998606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8548d4cd2214f69bac1d35041f18eb7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:18.040870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8548d4cd2214f69bac1d35041f18eb7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:18.174172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3724/7429] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:18.178213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:18.184605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8548d4cd2214f69bac1d35041f18eb7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:18.186267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-38a49409-1262-439a-9a16-c9149b11ba4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8548d4cd2214f69bac1d35041f18eb7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:18.224806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3706/7430] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:17 2022] DELETE /identity/v3/users/b8548d4cd2214f69bac1d35041f18eb7 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:18.232455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:18.233854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:18.234811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:18.237604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91d84-b3ad-4ce8-8c73-0858953cd6cc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:18.370822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:18.383705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:18.397634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:18.453305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:18.517137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d54a1d799664f1c9c7e49e8a4d60710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60eb927b8ea94e4cba9f89953fd90266', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:18.520619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:18.524882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:18.525744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:18.527553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:18.529631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:18.537034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:18.590528 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3725/7431] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:05:18.598548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:18.602413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:18.652732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8a0c-c132-4549-a2d3-d9b55f4a0eef tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:18.668488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d54a1d799664f1c9c7e49e8a4d60710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60eb927b8ea94e4cba9f89953fd90266', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:18.670257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:18.672283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:18.675995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:18.677936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:18.690937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:18.732008 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3707/7432] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:18.837240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:18.839938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:19.010901 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3726/7433] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:18 2022] POST /identity/v3/projects => generated 348 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:05:19.025999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:19.431736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776b349-88b8-4354-b7df-b93bae2e14e2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:19.472820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37fc1-d8c3-4a3b-87c2-d5d60e32bc99 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:19.482482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d54a1d799664f1c9c7e49e8a4d60710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60eb927b8ea94e4cba9f89953fd90266', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:19.483848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:19.484459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:19.485189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:19.486749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:19.487530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:19.491551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:19.532131 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3727/7434] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:05:19.547940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:19.552883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:19.824117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:19.824117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:19.831377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:19.832733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:19.866271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74096aff-3838-418c-b205-be4a148b4819 tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:19.883564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:19.884630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:19.885764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:19.885764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:19.940261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:19.944616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:19.995638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3728/7435] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:05:20.008160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:20.016396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:20.194948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:20.198664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:20.235576 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3708/7436] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:05:20.250549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:20.405845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af69d-7424-4da4-90e4-b9cec1b5697c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:20.454191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:20.455503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:20.456001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:20.458716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] PATH_INFO: `/v3/projects/baf5190d911a4e57b0e032263fbe29ee` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:20.462791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf5190d911a4e57b0e032263fbe29ee)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:20.471594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:20.879601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf5190d911a4e57b0e032263fbe29ee', 'request_id': 'req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:21.090786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf5190d911a4e57b0e032263fbe29ee', 'request_id': 'req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:21.127410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf5190d911a4e57b0e032263fbe29ee', 'request_id': 'req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:21.222414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] The token cache is being invalidate because project baf5190d911a4e57b0e032263fbe29ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:21.229415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:21.240328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:21.256154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3729/7437] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:19 2022] DELETE /identity/v3/projects/baf5190d911a4e57b0e032263fbe29ee => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:21.258341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:21.277487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:21.294595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a477-afd4-415c-a908-6acd2277af16 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:21.569806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:21.583038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:21.583038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:21.583038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] PATH_INFO: `/v3/users/3f512ed26054452da2035f31c2feb001` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:21.583038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f512ed26054452da2035f31c2feb001)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:21.589099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:22.195837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f512ed26054452da2035f31c2feb001'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:22.350137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f512ed26054452da2035f31c2feb001'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:22.374902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f512ed26054452da2035f31c2feb001'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:22.445122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f512ed26054452da2035f31c2feb001'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:22.445993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f512ed26054452da2035f31c2feb001'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:22.476345 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3709/7438] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:21 2022] DELETE /identity/v3/users/3f512ed26054452da2035f31c2feb001 => generated 0 bytes in 1212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:24.631509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:24.634045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:24.699364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59d48-21a6-4ea0-a0ea-0a7c5f9bfae0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:24.901530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:24.902863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:24.903544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:24.904189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] PATH_INFO: `/v3/projects/df8bb92988f840f2a43168bd1197e4ef` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:24.911237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8bb92988f840f2a43168bd1197e4ef)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:24.917110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:25.299864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8bb92988f840f2a43168bd1197e4ef', 'request_id': 'req-42fbc45a-b613-4e3d-a889-722df20487ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:25.412860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8bb92988f840f2a43168bd1197e4ef', 'request_id': 'req-42fbc45a-b613-4e3d-a889-722df20487ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:25.449196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8bb92988f840f2a43168bd1197e4ef', 'request_id': 'req-42fbc45a-b613-4e3d-a889-722df20487ed'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:25.484321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:25.495686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] The token cache is being invalidate because project df8bb92988f840f2a43168bd1197e4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:25.496652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:25.498214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:25.508802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3730/7439] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:24 2022] DELETE /identity/v3/projects/df8bb92988f840f2a43168bd1197e4ef => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:25.515527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:25.515527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:25.560223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93856fb9-d00f-488d-ae82-6ff3dd22599a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:25.854017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:25.855173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:25.855682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:25.861359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] PATH_INFO: `/v3/users/81e4697967d14afa92c9de918a90fd32` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:25.868825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e4697967d14afa92c9de918a90fd32)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:25.872210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:26.070899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:26.287993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e4697967d14afa92c9de918a90fd32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:26.453407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e4697967d14afa92c9de918a90fd32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:26.483886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e4697967d14afa92c9de918a90fd32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:26.560124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e4697967d14afa92c9de918a90fd32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:26.564974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cf67f80e-a9f4-46b5-8336-aa379aeb5b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e4697967d14afa92c9de918a90fd32'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:26.608498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3710/7440] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:25 2022] DELETE /identity/v3/users/81e4697967d14afa92c9de918a90fd32 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:27.240566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:27.254158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:27.341346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc45a-b613-4e3d-a889-722df20487ed admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:27.620512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:27.623592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:27.623592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:27.624197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] PATH_INFO: `/v3/projects/fac8b0f3248e42d28c063689a578221d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:27.628158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac8b0f3248e42d28c063689a578221d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:27.633976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:27.899712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac8b0f3248e42d28c063689a578221d', 'request_id': 'req-e1dc8253-3772-4d79-b016-0977bc4c878d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:28.009461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac8b0f3248e42d28c063689a578221d', 'request_id': 'req-e1dc8253-3772-4d79-b016-0977bc4c878d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:28.027580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac8b0f3248e42d28c063689a578221d', 'request_id': 'req-e1dc8253-3772-4d79-b016-0977bc4c878d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:28.075298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] The token cache is being invalidate because project fac8b0f3248e42d28c063689a578221d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:28.075962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:28.080818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e1dc8253-3772-4d79-b016-0977bc4c878d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:28.089256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3731/7441] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:27 2022] DELETE /identity/v3/projects/fac8b0f3248e42d28c063689a578221d => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:28.099120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:28.099899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:28.100148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:28.192831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:28.195935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:28.499228 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3711/7442] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:28.531410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:28.531410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:28.531410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:28.640708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:28.640708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:28.689419 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3732/7443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:28.697915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:28.732649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d65f-4c7b-4031-b9d5-1938df3e1f59 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:28.762166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:28.774309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:28.774309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:28.774309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:28.774309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:28.774309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:28.779399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:28.834835 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3712/7444] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:05:28.838082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:28.859538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7255c5-e962-4d0a-a951-351ed5f1b40e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:28.870543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:28.872374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:28.873151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:28.873667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:28.874965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:28.883523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:29.280087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3733/7445] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:28 2022] POST /identity/v3/projects => generated 389 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:05:29.288309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:29.326593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dabc0-919f-4c70-b8e6-5a72b2b28ea2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:29.521437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:29.522927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:29.523495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:29.526577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:29.526577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:29.530802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:29.756192 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3713/7446] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:29 2022] POST /identity/v3/users => generated 295 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:29.763181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:29.793401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12067-0803-4f83-b9f4-5c9d58817fb9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:29.816948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:29.818723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:29.819125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:29.819645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:29.825824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:29.829710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:29.869581 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3734/7447] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:29.871307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:29.912065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d572-44e9-4321-a748-b3bfe7f351e3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:29.929579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:29.938026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:29.938026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:29.938026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:29.939736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:29.946432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:29.971109 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3714/7448] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:05:29.979286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:30.000828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1be27-ec8f-45bf-b3d5-7a6dbd616bef admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:30.010739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:30.018544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:30.019903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:30.023451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] PATH_INFO: `/v3/projects/42290e303c56447082419baf9e037472/users/8784a9c574a34c7dad4d96760dad1c7f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:30.091761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42290e303c56447082419baf9e037472, user_id=8784a9c574a34c7dad4d96760dad1c7f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:30.100205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37d7f5-2514-4f28-a894-c507209cc310 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:30.112105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:30.116608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:30.166983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ae2b-954a-4f0c-a783-4c1338d9ebe6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:30.189505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:30.192450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:30.193213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:30.194190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] PATH_INFO: `/v3/projects/0909912e1c3a4480ad1c8813c3b7dd26` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:30.198437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0909912e1c3a4480ad1c8813c3b7dd26)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:30.203170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:30.211794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:30.253976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3735/7449] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:29 2022] PUT /identity/v3/projects/42290e303c56447082419baf9e037472/users/8784a9c574a34c7dad4d96760dad1c7f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:30.281666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:30.282186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:30.282674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:30.485883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] MFA Rules not processed for user `8784a9c574a34c7dad4d96760dad1c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:30.494489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:30.512155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0909912e1c3a4480ad1c8813c3b7dd26', 'request_id': 'req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:30.525372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0909912e1c3a4480ad1c8813c3b7dd26', 'request_id': 'req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:30.549397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0909912e1c3a4480ad1c8813c3b7dd26', 'request_id': 'req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:30.559802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:30.755659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] The token cache is being invalidate because project 0909912e1c3a4480ad1c8813c3b7dd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:30.756193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:30.762537 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3736/7450] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:30.763971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:30.768578 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3715/7451] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:30 2022] DELETE /identity/v3/projects/0909912e1c3a4480ad1c8813c3b7dd26 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:30.771618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:30.786086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:30.799968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:31.033025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b472ab-588f-487c-bcd7-7040d62eabf2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:31.052361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:31.053560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:31.054060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:31.054544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:31.055879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:31.067049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:31.103655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21c551-a8cb-4fc0-a0c1-fa65e1eac625 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:31.123206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:31.125682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:31.128009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:31.129706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] PATH_INFO: `/v3/users/624a77586279493282b354e26b5287e9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:31.138563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624a77586279493282b354e26b5287e9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:31.144872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:31.311717 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3737/7452] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:30 2022] POST /identity/v3/projects => generated 387 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:31.313922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:31.317830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:31.600690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624a77586279493282b354e26b5287e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:31.653661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525168f-7dcd-4df4-af58-d91eb82e29ac admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:31.689889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:31.691896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:31.691896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:31.692420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:31.693728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:31.702871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:31.751924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624a77586279493282b354e26b5287e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:31.795587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624a77586279493282b354e26b5287e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:31.879895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624a77586279493282b354e26b5287e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:31.884183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624a77586279493282b354e26b5287e9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:31.924562 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3738/7454] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:31 2022] POST /identity/v3/users => generated 294 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:31.925550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3716/7454] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:30 2022] DELETE /identity/v3/users/624a77586279493282b354e26b5287e9 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:31.928051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:31.931079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:31.938095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:31.939053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:32.024827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8478a-ac89-4621-88b1-954ef6677edd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:32.287633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:32.348834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:32.349735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:32.350241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:32.355065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:32.356629 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:32.369551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:32.384335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6c7d-6d40-4bde-8aa3-b1e52b9c1439 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:32.416585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d54a1d799664f1c9c7e49e8a4d60710', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60eb927b8ea94e4cba9f89953fd90266', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:32.420983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:32.429181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:32.429739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] PATH_INFO: `/v3/projects/f3549f3be408473db3405cdcd0f9c475` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:32.434216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3549f3be408473db3405cdcd0f9c475)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:32.436510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:32.438208 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3739/7455] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:32.440280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:32.450284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:32.504307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0e03-446d-448b-9d6a-269a0bd07ab5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:32.528112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:32.530145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:32.533024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:32.533548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:32.537316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:32.550700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:32.625472 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3740/7456] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:32.632799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:32.674401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a523d-8501-4ec2-913d-d8921dd9b7bf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:32.720572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:32.722528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:32.723049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:32.723592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] PATH_INFO: `/v3/projects/b619d23cebba4f1aa0956ea4c1320ad5/users/095c14a85e1e4b4482097b2e22ed3084/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:32.787511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b619d23cebba4f1aa0956ea4c1320ad5, user_id=095c14a85e1e4b4482097b2e22ed3084, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:32.794858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77917-8939-4ff6-b263-5969507d0a8c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:32.911742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3549f3be408473db3405cdcd0f9c475', 'request_id': 'req-a233cef3-2d2c-4097-bad7-0b1c681d250f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:32.939766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3549f3be408473db3405cdcd0f9c475', 'request_id': 'req-a233cef3-2d2c-4097-bad7-0b1c681d250f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:32.970268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3549f3be408473db3405cdcd0f9c475', 'request_id': 'req-a233cef3-2d2c-4097-bad7-0b1c681d250f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:32.994340 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3741/7457] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:32 2022] PUT /identity/v3/projects/b619d23cebba4f1aa0956ea4c1320ad5/users/095c14a85e1e4b4482097b2e22ed3084/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:33.030044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:33.030044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:33.030044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:33.150830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] MFA Rules not processed for user `095c14a85e1e4b4482097b2e22ed3084`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:33.162460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:33.168087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] The token cache is being invalidate because project f3549f3be408473db3405cdcd0f9c475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:33.169709 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:33.174263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:33.185702 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3717/7458] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:31 2022] DELETE /identity/v3/projects/f3549f3be408473db3405cdcd0f9c475 => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:33.196613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:33.205366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:33.505446 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3742/7459] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:33.524364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:33.531843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:33.711892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233cef3-2d2c-4097-bad7-0b1c681d250f tempest-QuotasNegativeTest-2143395951 tempest-QuotasNegativeTest-2143395951-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:33.875286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c3b28-b5c3-46f1-a083-ab04b7cba8fa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:33.900799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:33.901512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:33.901897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:33.902291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:33.909307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:33.914275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:34.069687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:34.157488 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3743/7460] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:33 2022] POST /identity/v3/projects => generated 389 bytes in 644 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:34.167279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:34.173924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:34.184587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:34.187853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:34.189023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] PATH_INFO: `/v3/users/1239809ca5034829a3b8425fa98d8b3f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:34.210426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1239809ca5034829a3b8425fa98d8b3f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:34.221017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:34.233265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:34.682141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f89d15-fb0b-47fa-b209-a8e685932821 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:34.733323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:34.735209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:34.740719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:34.740719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:34.749588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:34.758929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1239809ca5034829a3b8425fa98d8b3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:34.775714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:34.949120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1239809ca5034829a3b8425fa98d8b3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:34.972681 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3744/7461] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:34 2022] POST /identity/v3/users => generated 301 bytes in 811 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:34.981145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:34.986468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1239809ca5034829a3b8425fa98d8b3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:35.052100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc4b0-fdc7-4860-bbb4-835ad2d12f8b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:35.084588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1239809ca5034829a3b8425fa98d8b3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:35.090885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab3a366d-3be8-47f0-a5b8-c10a92dc0501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1239809ca5034829a3b8425fa98d8b3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:35.091360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:35.093175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:35.093690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:35.094244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:35.102863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:35.109179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:35.131629 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3718/7462] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:33 2022] DELETE /identity/v3/users/1239809ca5034829a3b8425fa98d8b3f => generated 0 bytes in 1937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:35.141860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:35.142920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:35.144090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:35.201270 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3745/7463] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:35.208310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:35.218580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:35.234116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:35.240487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:35.324363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e8cab-a9fc-4f2c-930e-73081c1b144d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:35.698471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3719/7464] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:35.737843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:35.738974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:35.740032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:35.740568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] PATH_INFO: `/v3/projects/258627764cb34450afd603e926d0b2e4/users/c61c2f0c892040d38e5acaad2a447266/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:35.764979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:35.768075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:35.778308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] RBAC: Authorizing `identity:create_grant(project_id=258627764cb34450afd603e926d0b2e4, user_id=c61c2f0c892040d38e5acaad2a447266, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:35.786827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:35.926215 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3746/7465] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:35 2022] PUT /identity/v3/projects/258627764cb34450afd603e926d0b2e4/users/c61c2f0c892040d38e5acaad2a447266/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:35.936362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:36.355333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682649b6-5fb1-44e6-a155-51f504d9103a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:36.382224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:36.382572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee0bb-8625-419a-8ca7-41c254f624fb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:36.383514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:36.384027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:36.395535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:36.397094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:36.407696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:36.458462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:36.495879 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3747/7466] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:36.499989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:36.538421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:36.557295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884bb82-f3df-42b8-aaaa-3708a40dd834 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:36.592014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:36.593573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:36.596744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:36.597543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] PATH_INFO: `/v3/projects/258627764cb34450afd603e926d0b2e4/users/c61c2f0c892040d38e5acaad2a447266/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:36.618843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258627764cb34450afd603e926d0b2e4, user_id=c61c2f0c892040d38e5acaad2a447266, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:36.626774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b82ed-8312-4e49-a438-3c2493d540e7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:36.697887 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3748/7467] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:36 2022] PUT /identity/v3/projects/258627764cb34450afd603e926d0b2e4/users/c61c2f0c892040d38e5acaad2a447266/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:36.716994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:36.717718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:36.718372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:36.724673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:36.726057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:36.726764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:36.727472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:36.793163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:36.796511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:36.875273 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3720/7468] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:36.912027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] MFA Rules not processed for user `c61c2f0c892040d38e5acaad2a447266`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:36.914663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:37.183095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:37.187074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:37.275002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08921ab-5f8c-4d86-a695-b3490e786525 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:37.582303 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3749/7469] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 856 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:37.610939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:37.614141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:37.799377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:37.805914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:37.806606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:37.807300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] PATH_INFO: `/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:37.818132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1902111d2749aeaf2ccaf0ab410b4c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:37.832457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:38.137133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c1cb6-33c9-4f25-92f4-63874c8a0b99 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:38.160954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:38.161897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:38.162397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:38.162870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:38.173173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:38.245211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1902111d2749aeaf2ccaf0ab410b4c', 'request_id': 'req-2dd25925-f658-4eaf-8081-41bf591eac3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:38.285207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1902111d2749aeaf2ccaf0ab410b4c', 'request_id': 'req-2dd25925-f658-4eaf-8081-41bf591eac3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:38.328981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1902111d2749aeaf2ccaf0ab410b4c', 'request_id': 'req-2dd25925-f658-4eaf-8081-41bf591eac3f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:38.459455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] The token cache is being invalidate because project bd1902111d2749aeaf2ccaf0ab410b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:38.459986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:38.466834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2dd25925-f658-4eaf-8081-41bf591eac3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:38.481885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3721/7470] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:37 2022] DELETE /identity/v3/projects/bd1902111d2749aeaf2ccaf0ab410b4c => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:05:38.489845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:38.490598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:38.491169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:38.491477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:38.495301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416e9d4-37e8-4ba5-b9a2-825574a8d140 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:38.546355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3750/7471] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 937 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:05:38.655167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:38.657737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:39.008465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:39.105491 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3722/7472] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:39.124398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:39.126077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:39.126963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:39.278634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:39.283273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:39.367931 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3751/7473] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:39.375030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:39.424613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc0ad0-3f40-4de5-b55a-bb5c62c2c379 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:39.449396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:39.450502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:39.452298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:39.459713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:39.461081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:39.468401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:39.477036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:39.562798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:39.565874 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3723/7474] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:05:39.641285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a561-fe58-424e-baa8-e6fef2795979 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:39.698046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:39.699303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:39.699804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:39.700300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:39.713481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:39.724729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:39.754779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:40.037295 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3752/7475] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:39 2022] POST /identity/v3/projects => generated 371 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:40.044057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:40.102804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cbdfb-ebd4-4443-b4bb-ae9123399b00 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:40.410905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:40.413855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:40.416031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:40.416601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:40.420939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:40.429160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:40.640900 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3724/7476] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:40 2022] POST /identity/v3/users => generated 286 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:40.647359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:40.724238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca6a6-719a-411a-884f-87ab8abbebfe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:40.756817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:40.759498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:40.760439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:40.763620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:40.781891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:40.794703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:40.881665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3753/7477] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:40.890665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:40.932538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b462-35fc-4cf9-bcde-9455e370ec35 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:40.962038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:40.964457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:40.965345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:40.967670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:40.972565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:40.982197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3af88-ec94-4da2-9ee8-c3012fd87137 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:41.079338 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3725/7478] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:41.096084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:41.133134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc2b0-f7bf-44d7-af7b-261335b10bfa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:41.156614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:41.158311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:41.158903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:41.159506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] PATH_INFO: `/v3/projects/f1825a1177a04e78bd4d42c9ab83c051/users/77c793eaa0c14d9886a6a8f2e721cf9e/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:41.230903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1825a1177a04e78bd4d42c9ab83c051, user_id=77c793eaa0c14d9886a6a8f2e721cf9e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:41.239423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:41.415350 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3754/7479] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:41 2022] PUT /identity/v3/projects/f1825a1177a04e78bd4d42c9ab83c051/users/77c793eaa0c14d9886a6a8f2e721cf9e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:41.450615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:41.451336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:41.456044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:41.607968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] MFA Rules not processed for user `77c793eaa0c14d9886a6a8f2e721cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:41.618042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:41.976894 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3726/7480] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:41.991712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:41.995782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:42.331402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187403-94b8-4a17-b4b9-076efe9f7987 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:42.381605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:42.382876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:42.383549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:42.384411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:42.474401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:42.482825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:42.514994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3755/7481] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:43.889544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:43.892191 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:44.160563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:44.321502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71fc0b-a066-4f15-9ef3-05aea74dc576 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:44.356478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eece0-1545-4714-807a-8a482430870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:44.366220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eece0-1545-4714-807a-8a482430870b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:44.367875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eece0-1545-4714-807a-8a482430870b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:44.372387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eece0-1545-4714-807a-8a482430870b admin admin] PATH_INFO: `/v3/projects/afee0f06e20e463cbf4478f69a60dd8c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:44.379623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eece0-1545-4714-807a-8a482430870b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afee0f06e20e463cbf4478f69a60dd8c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:44.405299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eece0-1545-4714-807a-8a482430870b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:44.932443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afee0f06e20e463cbf4478f69a60dd8c', 'request_id': 'req-769eece0-1545-4714-807a-8a482430870b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:44.970122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afee0f06e20e463cbf4478f69a60dd8c', 'request_id': 'req-769eece0-1545-4714-807a-8a482430870b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:45.002474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afee0f06e20e463cbf4478f69a60dd8c', 'request_id': 'req-769eece0-1545-4714-807a-8a482430870b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:45.258564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] The token cache is being invalidate because project afee0f06e20e463cbf4478f69a60dd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:45.262865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:45.269964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:45.278163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3727/7482] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:43 2022] DELETE /identity/v3/projects/afee0f06e20e463cbf4478f69a60dd8c => generated 0 bytes in 1390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:45.287280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:45.295390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:45.299473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:45.359928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45d48-5841-4c26-8664-60dfb0b1ca5c service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:45.801111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:45.825332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eece0-1545-4714-807a-8a482430870b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:45.850470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:45.852205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:45.855375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:45.855650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:45.856363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] PATH_INFO: `/v3/users/faa264670a1b449ea3083c6e51021011` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:45.861053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:45.863213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa264670a1b449ea3083c6e51021011)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:45.877921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:45.879657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] PATH_INFO: `/v3/users/2d54a1d799664f1c9c7e49e8a4d60710` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:45.892051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d54a1d799664f1c9c7e49e8a4d60710)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:45.915641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:46.521191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d54a1d799664f1c9c7e49e8a4d60710'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.523815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d54a1d799664f1c9c7e49e8a4d60710'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.539449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa264670a1b449ea3083c6e51021011'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.649233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d54a1d799664f1c9c7e49e8a4d60710'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.653409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:46.734173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d54a1d799664f1c9c7e49e8a4d60710'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.782248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c24e1409-ca0e-424c-b29e-350239fd8344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d54a1d799664f1c9c7e49e8a4d60710'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.811690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa264670a1b449ea3083c6e51021011'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.845052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa264670a1b449ea3083c6e51021011'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.847827 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3756/7483] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:45 2022] DELETE /identity/v3/users/2d54a1d799664f1c9c7e49e8a4d60710 => generated 0 bytes in 1564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:46.931970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:46.983551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa264670a1b449ea3083c6e51021011'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:46.984828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa264670a1b449ea3083c6e51021011'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:47.057646 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3728/7484] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:45 2022] DELETE /identity/v3/users/faa264670a1b449ea3083c6e51021011 => generated 0 bytes in 1764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:47.065386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675be7-5c8e-42e6-8841-853fe90be970 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:47.067415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675be7-5c8e-42e6-8841-853fe90be970 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:47.070771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675be7-5c8e-42e6-8841-853fe90be970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:47.184317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-88675be7-5c8e-42e6-8841-853fe90be970 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:47.203613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-88675be7-5c8e-42e6-8841-853fe90be970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:47.627364 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3757/7485] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:47.676977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:47.679584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:48.024117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701b240-b1ba-4077-963f-c700a97575bb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:48.036442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:48.037553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:48.038165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:48.038519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:48.085492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:48.088618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dff99c-cf9b-439d-b54d-9d498b253e6f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:48.137186 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3729/7486] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:48.463745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b895-6327-468b-a67d-42c17b4483ee None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:48.464820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b895-6327-468b-a67d-42c17b4483ee None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:48.465707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b895-6327-468b-a67d-42c17b4483ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:48.599257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cb02b895-6327-468b-a67d-42c17b4483ee None None] MFA Rules not processed for user `626d1f96e801458eba55b56ff8fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:48.618454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cb02b895-6327-468b-a67d-42c17b4483ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:49.094151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3758/7487] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 633 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:50.140876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:50.141640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:50.141795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:50.235391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] MFA Rules not processed for user `77c793eaa0c14d9886a6a8f2e721cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:50.244061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:50.548774 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3730/7488] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:50.953841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6d597-8909-468c-8410-07b3f60cf282 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:50.956039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6d597-8909-468c-8410-07b3f60cf282 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:50.957722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6d597-8909-468c-8410-07b3f60cf282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2eb6d597-8909-468c-8410-07b3f60cf282 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:05:50.989359 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:05:50.992032 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:05:51.004516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3759/7489] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:05:52.066699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:52.070216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:52.120108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8ee3b-7ae1-44de-a0f6-d7d11095dcb1 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:52.131391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:52.132634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:52.133114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:52.133761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] PATH_INFO: `/v3/projects/60eb927b8ea94e4cba9f89953fd90266` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:52.136567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eb927b8ea94e4cba9f89953fd90266)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:52.142133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:52.442844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eb927b8ea94e4cba9f89953fd90266', 'request_id': 'req-b2a40c73-45a5-4330-852a-93f331a66420'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:52.480155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eb927b8ea94e4cba9f89953fd90266', 'request_id': 'req-b2a40c73-45a5-4330-852a-93f331a66420'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:52.517107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eb927b8ea94e4cba9f89953fd90266', 'request_id': 'req-b2a40c73-45a5-4330-852a-93f331a66420'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:52.745581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] The token cache is being invalidate because project 60eb927b8ea94e4cba9f89953fd90266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:52.746075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:52.747442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:52.757428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3731/7490] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:52 2022] DELETE /identity/v3/projects/60eb927b8ea94e4cba9f89953fd90266 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:52.760855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce266cc-3750-4f4b-99a8-9df2825c9ed6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:52.763308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce266cc-3750-4f4b-99a8-9df2825c9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:52.764521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce266cc-3750-4f4b-99a8-9df2825c9ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:52.861257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9ce266cc-3750-4f4b-99a8-9df2825c9ed6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:52.875476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9ce266cc-3750-4f4b-99a8-9df2825c9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:52.972349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:52.976383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:53.104840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:53.143563 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3760/7491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:05:53.158276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:53.161001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:53.162113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:53.234873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:53.243441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:53.275336 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3761/7492] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:53.283699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:53.310327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40c73-45a5-4330-852a-93f331a66420 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:53.315101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad794c-db2e-4b8f-9d63-030490aae44a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:53.319177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:53.320347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:53.320825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:53.321299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] PATH_INFO: `/v3/projects/f799e7230ce049158fd527994b2cf0fd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:53.323401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f799e7230ce049158fd527994b2cf0fd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:53.325602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:53.331675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:53.333510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:53.335553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:53.336902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:53.344732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:05:53.344732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:53.348866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:53.374261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:53.394007 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3762/7493] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:05:53.401685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:53.434756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618949e8-848e-4d49-9e96-974aa32352f4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:53.451365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:53.452862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:53.453573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:53.454556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:53.456812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:53.461926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:53.633580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f799e7230ce049158fd527994b2cf0fd', 'request_id': 'req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:53.652181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f799e7230ce049158fd527994b2cf0fd', 'request_id': 'req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:53.672419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f799e7230ce049158fd527994b2cf0fd', 'request_id': 'req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:53.778384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3763/7494] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:05:53 2022] POST /identity/v3/projects => generated 391 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:05:53.778384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:53.803881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:53.867811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] The token cache is being invalidate because project f799e7230ce049158fd527994b2cf0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:53.868258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:53.871796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:53.894492 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3732/7495] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:52 2022] DELETE /identity/v3/projects/f799e7230ce049158fd527994b2cf0fd => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:53.908481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:53.915212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:54.119503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d788e8-6830-4d1d-b742-7ee4e136fc01 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:54.141677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:54.142795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:54.147941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:54.149600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:54.159912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:54.227483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:54.230617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:54.298075 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3764/7496] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:54.299523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:54.305256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:54.454476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bcde5-87b9-4203-86e4-3dacdacfeb56 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:54.751877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe316d-a1a4-41bc-888e-5ab4d1428646 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:54.788429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:54.789322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:54.789518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:54.789875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:54.790842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:54.802695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:54.818207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:54.823949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:54.833314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:54.833774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] PATH_INFO: `/v3/users/5766e3f9bee54a91b8859e98c81abf58` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:54.836337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5766e3f9bee54a91b8859e98c81abf58)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:54.837463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:54.849835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:55.067093 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3733/7497] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:05:53 2022] POST /identity/v3/users => generated 296 bytes in 1172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:05:55.085901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:55.149563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a60c-396c-4bf8-97ed-a135ab8e0a3f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:55.204130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:55.205731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:55.206593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:55.207534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:55.209505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:55.213609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:55.265784 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3734/7498] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:55.269447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:55.304401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697edf-7154-4659-a377-9f37a8967fe9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:55.336182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:55.338309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:55.342267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:55.344992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:55.346772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:55.362026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:55.363693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5766e3f9bee54a91b8859e98c81abf58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:55.367842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5766e3f9bee54a91b8859e98c81abf58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:55.424280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3735/7499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:05:55.443752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:55.485764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5766e3f9bee54a91b8859e98c81abf58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:55.526806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc4e31-231f-4329-9ead-69ba8ab9926e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:55.536782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:55.543007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5766e3f9bee54a91b8859e98c81abf58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:55.572200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-88880008-fed9-45d2-b2cd-76cf8fc8605c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5766e3f9bee54a91b8859e98c81abf58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:55.586509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:55.587793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:55.588369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:55.589492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] PATH_INFO: `/v3/projects/2164acebbe304ced9acdd7c52924e210/users/647c66e2bb6b449ea25a3ddcb303bc24/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:55.600464 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3765/7500] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:54 2022] DELETE /identity/v3/users/5766e3f9bee54a91b8859e98c81abf58 => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:55.696962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2164acebbe304ced9acdd7c52924e210, user_id=647c66e2bb6b449ea25a3ddcb303bc24, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:55.708305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:55.952405 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3736/7501] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:05:55 2022] PUT /identity/v3/projects/2164acebbe304ced9acdd7c52924e210/users/647c66e2bb6b449ea25a3ddcb303bc24/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:55.970528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:55.970528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:55.970528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:56.116896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] MFA Rules not processed for user `647c66e2bb6b449ea25a3ddcb303bc24`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:56.120066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:56.467310 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3766/7502] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:56.617478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:56.623403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:57.020452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150717b-ccd8-4800-b25b-512a15f6c875 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:57.042306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:57.045013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:57.045403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:57.045694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:57.112899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:57.133334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90526e5-d0be-46da-af54-155192fd248d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:57.191839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3737/7503] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:57.508412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:57.513368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:57.812758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f460d-ca80-429d-b189-fc9fe984e7e0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:57.843481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:57.844773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:57.845516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:57.846144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] PATH_INFO: `/v3/users/647c66e2bb6b449ea25a3ddcb303bc24` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:57.854023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=647c66e2bb6b449ea25a3ddcb303bc24)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:57.860116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:58.332264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647c66e2bb6b449ea25a3ddcb303bc24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:58.347864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647c66e2bb6b449ea25a3ddcb303bc24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:58.446665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647c66e2bb6b449ea25a3ddcb303bc24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:58.515776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647c66e2bb6b449ea25a3ddcb303bc24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:58.553892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:58.561532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647c66e2bb6b449ea25a3ddcb303bc24'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:58.580713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3767/7504] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:05:57 2022] DELETE /identity/v3/users/647c66e2bb6b449ea25a3ddcb303bc24 => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:58.597844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:58.599949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:58.600736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:58.676026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:58.684279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:58.815545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:58.818892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:59.047964 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3738/7505] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:05:59.112687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09844ccb-ea30-4533-a638-2e51aebfdbee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:59.136500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:59.140583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:59.143084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:59.145559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] PATH_INFO: `/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:59.150289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ad8a5a1f594d368cf78461e4da2de8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:59.156592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:59.204792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:05:59.208907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:05:59.448130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:59.468575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b404-4e66-406e-af85-e570a29343a6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:05:59.476106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:05:59.477318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:59.477886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:59.478372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:59.532239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:05:59.536251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68ac24-c5e2-4f9e-a9de-944655c9b65c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:05:59.577479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3739/7506] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:05:59.588827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ad8a5a1f594d368cf78461e4da2de8', 'request_id': 'req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:59.779182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ad8a5a1f594d368cf78461e4da2de8', 'request_id': 'req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:59.808815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ad8a5a1f594d368cf78461e4da2de8', 'request_id': 'req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:59.872795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] The token cache is being invalidate because project e7ad8a5a1f594d368cf78461e4da2de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:05:59.873521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:59.879217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-c34c8a21-b30d-4f3b-9323-18b95d7f6d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:05:59.881812 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3768/7507] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:05:58 2022] DELETE /identity/v3/projects/e7ad8a5a1f594d368cf78461e4da2de8 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:05:59.889616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:05:59.890466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:05:59.890630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:05:59.976681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:05:59.982196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:00.223242 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3740/7508] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:00.238856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:00.238856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:00.238856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:00.335188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:00.338016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:00.376308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:00.378014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3769/7509] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:00.399909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca4212-2c7c-4e0f-bd77-3e02b7f09ed3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:00.409962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:00.417220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:00.418518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:00.421873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:00.421873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:06:00.422210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:00.427053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:00.492119 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3741/7510] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:06:00.566058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:00.603704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007dd5-2ca3-49cf-8295-bde46f6402d8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:00.621731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:00.624979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:00.625812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:00.631495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:00.638319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:00.644652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:00.656757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:00.659583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:01.026137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6f161-b103-4769-9dd5-460b994b57a9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:01.033470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3770/7511] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:06:00 2022] POST /identity/v3/projects => generated 377 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:01.036276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:01.300949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:01.322413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081ad3f-47a7-4af9-b2bb-5ffba3587cab admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:01.348647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:01.349853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:01.350653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:01.352354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:01.352750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:01.375271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:01.454276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:01.455657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:01.461599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:01.462260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:01.476773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:01.652014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3771/7512] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:06:01 2022] POST /identity/v3/users => generated 289 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:01.654307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:01.714650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef8ccf-fab1-467c-8eb7-eb8e2be9c5e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:01.744876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:01.753342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:01.753859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:01.761923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:01.766665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:01.770190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:01.789151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:01.863872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3772/7513] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:01.865723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:01.927364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:01.937156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:01.953794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4274cde-23c5-449c-ac0d-a3220e312bff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:01.977869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:01.979334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:01.981021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:01.981758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:01.983314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:01.994901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:01.997034 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3742/7514] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 1341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:06:02.050266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3773/7515] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:02.058290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:02.101919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc44bb7-13fb-47c2-a8ee-007a8de40815 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:02.122333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:02.123964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:02.124504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:02.124989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] PATH_INFO: `/v3/projects/3c8a8cc284ae4a0b97b013b0a871390c/users/9ef9de1c9dbd4372a07b4d1e26463cc0/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:02.214692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8a8cc284ae4a0b97b013b0a871390c, user_id=9ef9de1c9dbd4372a07b4d1e26463cc0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:02.245071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccba0f0-01a4-4e74-ae9c-6029ede651af admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:02.295673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:02.300851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:02.351377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c990-5c48-405a-9106-9980fe596cc2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:02.400249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:02.407241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:02.408157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:02.410138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] PATH_INFO: `/v3/projects/2164acebbe304ced9acdd7c52924e210` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:02.417012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2164acebbe304ced9acdd7c52924e210)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:02.427300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:02.434078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3743/7516] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:06:02 2022] PUT /identity/v3/projects/3c8a8cc284ae4a0b97b013b0a871390c/users/9ef9de1c9dbd4372a07b4d1e26463cc0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:02.465074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:02.469700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:02.470453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:02.637820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] MFA Rules not processed for user `9ef9de1c9dbd4372a07b4d1e26463cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:02.640490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:02.874569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2164acebbe304ced9acdd7c52924e210', 'request_id': 'req-352769f2-2b48-46a4-ada5-e2f0c2826f74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:02.892881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3744/7517] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:02.913445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:03.062866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2164acebbe304ced9acdd7c52924e210', 'request_id': 'req-352769f2-2b48-46a4-ada5-e2f0c2826f74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:03.090068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2164acebbe304ced9acdd7c52924e210', 'request_id': 'req-352769f2-2b48-46a4-ada5-e2f0c2826f74'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:03.137839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] The token cache is being invalidate because project 2164acebbe304ced9acdd7c52924e210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:06:03.137839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:03.139912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-352769f2-2b48-46a4-ada5-e2f0c2826f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:03.147211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3774/7518] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:06:02 2022] DELETE /identity/v3/projects/2164acebbe304ced9acdd7c52924e210 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:03.154519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-2270-4264-b53d-a706e9e3563a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:03.155238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-2270-4264-b53d-a706e9e3563a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:03.155866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-2270-4264-b53d-a706e9e3563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:03.213161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d22fe-24ab-4e06-900f-454645245a39 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:03.246309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d46a65de-2270-4264-b53d-a706e9e3563a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:03.257898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d46a65de-2270-4264-b53d-a706e9e3563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:03.517797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:03.546286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:03.557721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:03.558248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:03.558882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:03.570736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:03.580669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:03.588592 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3775/7519] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:03.607717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:03.608369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:03.609510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:03.649332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:03.652583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:03.701461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3776/7520] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:03.729311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:03.757141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee05a-4ff1-4e2a-b346-bd019bb5c0bc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:03.787544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:03.812872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:03.812872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:03.812872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:03.855590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:06:03.855590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:03.862007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:03.869921 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3745/7521] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:06:02 2022] POST /identity/v3/projects => generated 377 bytes in 957 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:03.874957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:03.880574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:03.939445 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3777/7522] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:06:03.949806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:03.995567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b710-c578-4436-9b75-aa6e45425bfd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:04.133724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:04.250437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:04.251735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:04.252179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:04.252667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:04.254143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:04.258797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:04.361006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e610-1781-4fc9-8511-f036a588d4cc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:04.412078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:04.417139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:04.417651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:04.418168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:04.426738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:04.430537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:04.442367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3778/7523] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:06:03 2022] POST /identity/v3/projects => generated 371 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:04.457155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:04.640286 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3746/7524] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:06:03 2022] POST /identity/v3/users => generated 295 bytes in 759 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:04.643808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:04.704679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0d55d-e0b8-49de-8287-8a13d5adddd4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:04.776591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a4cb-d93a-4142-ae7a-3aa98058a43f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:04.803983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:04.809126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:04.809598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:04.811612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:04.811612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:04.828061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.045243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:05.047051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.047880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.048606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.051073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:05.057547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.098008 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3779/7525] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:06:04 2022] POST /identity/v3/users => generated 286 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:05.104873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:05.133130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992efe-69b4-4d71-9efe-99461c987f64 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:05.158241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3747/7526] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:05.164153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:05.165632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:05.167995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.175497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.176218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.177546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:05.182589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.244906 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3780/7527] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:05.247089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905949-5979-4bd4-8a1c-3b5e650cfe09 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:05.261493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:05.276367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:05.278687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.279665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.280496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] PATH_INFO: `/v3/projects/81083e57a9d44814b3f6d178b23ba3ce/users/9e47db6d6d544a9cb10dd7172c18eb4a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.316378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e000cf-cbf3-4b62-b54e-138b806aa3c1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:05.345783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:05.346916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.347449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.348139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.349191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:05.358828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.366159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81083e57a9d44814b3f6d178b23ba3ce, user_id=9e47db6d6d544a9cb10dd7172c18eb4a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:05.373937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.414608 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3781/7528] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:05.421704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:05.459852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8f397-f88d-498b-9091-4b423bc35190 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:05.485956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:05.505742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.507022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.514685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] PATH_INFO: `/v3/projects/f31334bc846b471aace4cb8b5f10ff51/users/8dfbc506e19a46b6b61b66ca1b5dcce6/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.577317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3748/7529] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:06:05 2022] PUT /identity/v3/projects/81083e57a9d44814b3f6d178b23ba3ce/users/9e47db6d6d544a9cb10dd7172c18eb4a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:06:05.589532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:05.604502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31334bc846b471aace4cb8b5f10ff51, user_id=8dfbc506e19a46b6b61b66ca1b5dcce6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:05.619913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c3bd6-07f5-4e76-9409-197064a40cef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:05.854998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:05.897896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3782/7530] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:06:05 2022] PUT /identity/v3/projects/f31334bc846b471aace4cb8b5f10ff51/users/8dfbc506e19a46b6b61b66ca1b5dcce6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:05.917744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8fa74-0386-411e-a69a-40c39b96b1c6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:05.918579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8fa74-0386-411e-a69a-40c39b96b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:05.919390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8fa74-0386-411e-a69a-40c39b96b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:05.949051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fbd65-e1fd-4322-92ca-dd3fd5274b5f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:06.027301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-28a8fa74-0386-411e-a69a-40c39b96b1c6 None None] MFA Rules not processed for user `8dfbc506e19a46b6b61b66ca1b5dcce6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:06.032209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28a8fa74-0386-411e-a69a-40c39b96b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:06.188546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:06.192587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:06.193051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:06.193727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:06.200256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:06.210605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:06.233782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:06.258307 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3749/7531] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 669 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:06.260398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:06.297413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c36a-0f2c-41be-b589-0bf178527e8b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:06.320479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:06.321754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:06.322182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:06.322611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] PATH_INFO: `/v3/projects/81083e57a9d44814b3f6d178b23ba3ce/users/9e47db6d6d544a9cb10dd7172c18eb4a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:06.328633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81083e57a9d44814b3f6d178b23ba3ce, user_id=9e47db6d6d544a9cb10dd7172c18eb4a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:06.341481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3783/7532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:06.343757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:06.401769 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3750/7533] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:06:06 2022] PUT /identity/v3/projects/81083e57a9d44814b3f6d178b23ba3ce/users/9e47db6d6d544a9cb10dd7172c18eb4a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:06:06.426377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385c66-8475-4d43-a436-b69121230784 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:06.427582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385c66-8475-4d43-a436-b69121230784 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:06.427582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385c66-8475-4d43-a436-b69121230784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:06.569112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d0385c66-8475-4d43-a436-b69121230784 None None] MFA Rules not processed for user `9e47db6d6d544a9cb10dd7172c18eb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:06.571527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d0385c66-8475-4d43-a436-b69121230784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:06.722614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:06.726212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:07.048280 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3784/7534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 620 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:07.056734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385c66-8475-4d43-a436-b69121230784 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:07.060989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d0385c66-8475-4d43-a436-b69121230784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:07.141787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5a92-3f2e-465d-b035-c89c187ee584 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:07.171152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:07.172358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:07.172849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:07.173373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:07.404682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385c66-8475-4d43-a436-b69121230784 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:07.438334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:07.442905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:07.443501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:07.444000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:07.460642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:07.509843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:07.512655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:07.546240 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3751/7535] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:06:08.004945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:08.010487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:08.059765 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3785/7536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1004 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:17.088093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:17.089778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:17.098155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:17.102102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:17.210746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f36c-db14-4eab-9abd-cbcc87276149 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:17.258622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:17.263955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:17.265077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:17.265817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:17.283601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:17.364742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:17.367916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:17.380720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0739a3-45d4-4c43-9243-e8388952a7ec service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:17.449618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3752/7537] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:17.595065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893931c-200f-4ce3-bf83-756684a0a438 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:17.625855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:17.626860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:17.632152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:17.633096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] PATH_INFO: `/v3/users/cfa926f35d6043068e7aa32873701df1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:17.635953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa926f35d6043068e7aa32873701df1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:17.642634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:18.068988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa926f35d6043068e7aa32873701df1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:18.073256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa926f35d6043068e7aa32873701df1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:18.207206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa926f35d6043068e7aa32873701df1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:18.280129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa926f35d6043068e7aa32873701df1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:18.320166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa926f35d6043068e7aa32873701df1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:18.351591 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3786/7538] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:06:17 2022] DELETE /identity/v3/users/cfa926f35d6043068e7aa32873701df1 => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:18.359993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:18.361654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:18.362566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:18.467415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:18.470805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:18.519118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:18.825516 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3753/7539] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:19.089810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:19.093918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:19.417185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d3cc-d32b-4aa6-bfa7-c45435a0b9ff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:19.439596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:19.441413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:19.442236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:19.447265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:19.494810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:19.498883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:19.526463 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3787/7540] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:21.803382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:21.806906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:21.861623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e31ed-e79f-4ff1-9297-371dc44f6e4b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:21.880359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:21.887622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:21.888475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:21.889203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] PATH_INFO: `/v3/projects/fea29c0c39584f28b297f628a73b7646` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:21.899477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea29c0c39584f28b297f628a73b7646)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:21.903918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:22.174520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea29c0c39584f28b297f628a73b7646', 'request_id': 'req-8f063d1a-5d10-45e3-97f1-4314db09d965'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:22.194603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea29c0c39584f28b297f628a73b7646', 'request_id': 'req-8f063d1a-5d10-45e3-97f1-4314db09d965'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:22.232457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea29c0c39584f28b297f628a73b7646', 'request_id': 'req-8f063d1a-5d10-45e3-97f1-4314db09d965'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:22.284677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:22.289542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:22.394208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] The token cache is being invalidate because project fea29c0c39584f28b297f628a73b7646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:06:22.407262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:22.415512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8f063d1a-5d10-45e3-97f1-4314db09d965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:06:22.415512 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3754/7541] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:06:21 2022] DELETE /identity/v3/projects/fea29c0c39584f28b297f628a73b7646 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:22.424451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a713-35eb-4e3c-a169-6c3f597b7c53 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:22.424451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a713-35eb-4e3c-a169-6c3f597b7c53 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:22.425121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657a713-35eb-4e3c-a169-6c3f597b7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:22.558290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0657a713-35eb-4e3c-a169-6c3f597b7c53 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:22.575317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0657a713-35eb-4e3c-a169-6c3f597b7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:22.578344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:22.627082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5277b-85f0-4549-9a43-db0e5f13e507 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:22.920818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:22.924982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:22.927753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:22.930846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:22.946327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3755/7542] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:22.950731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:22.951317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:22.951811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:22.958297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:23.032046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:23.034470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:23.069358 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3756/7543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:23.077079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:23.116256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ce2f-fbb4-482c-ba96-c0d05d75f581 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:23.139752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:23.146240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:23.146240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:23.146240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:23.146240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:06:23.146240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:23.152561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:23.218505 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3757/7544] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:06:23.233438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:23.247249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:23.258708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:23.289903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee44fa-e2f7-4beb-bf94-8c451dc0678f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:23.321384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3788/7545] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 1031 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:06:23.322346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:23.323727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:23.324707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:23.325353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:23.327926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:23.333378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:23.426104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:23.483227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:23.486878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:23.586768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3758/7546] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:06:23 2022] POST /identity/v3/projects => generated 361 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:23.593859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:23.945169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9794-416c-4951-9811-a837994e04ea service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:23.952843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c687-aebf-4e64-bd39-cd1628454514 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:23.986173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:23.987692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:23.988213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:23.988721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:23.989957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:24.007635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:24.179124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:24.274170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:24.275349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:24.275852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:24.276436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:24.289943 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3759/7547] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:06:23 2022] POST /identity/v3/users => generated 281 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:06:24.300605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:24.306027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:24.346293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b80c3-d177-4484-b1c2-b4b336128aa9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:24.370707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:24.375100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:24.406796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:24.411771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:24.412593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:24.413164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:24.414648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:24.428623 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3789/7548] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 948 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:24.430655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:24.503429 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3760/7549] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:24.508916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:24.542671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2e2b-dd47-4297-bc14-c04ccfbdc59e service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:24.567512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:24.568652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:24.569139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:24.569616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:24.571416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:24.578533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24905a-b03a-4d6c-b398-09c79d871b4c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:24.630983 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3790/7550] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:06:24.631941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:24.672871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62726fa-f97c-448b-9c75-0ab26e192b67 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:24.691073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:24.692495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:24.701561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:24.701561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] PATH_INFO: `/v3/projects/d2227c0bff3a4d24894ea6838f5ffe54/users/29b8f22dee774118a711ad3bde4e2910/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:24.761270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2227c0bff3a4d24894ea6838f5ffe54, user_id=29b8f22dee774118a711ad3bde4e2910, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:24.778160 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:24.959608 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3761/7551] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:06:24 2022] PUT /identity/v3/projects/d2227c0bff3a4d24894ea6838f5ffe54/users/29b8f22dee774118a711ad3bde4e2910/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:06:24.979653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c37f-c300-41da-81b5-9807531c6e11 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:24.979653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c37f-c300-41da-81b5-9807531c6e11 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:24.979653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c37f-c300-41da-81b5-9807531c6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:25.093450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eb07c37f-c300-41da-81b5-9807531c6e11 None None] MFA Rules not processed for user `29b8f22dee774118a711ad3bde4e2910`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:25.101179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb07c37f-c300-41da-81b5-9807531c6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:25.504712 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3791/7552] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:25.748457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:25.751574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:26.149224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb1dd-6590-4bfe-b422-42b0c9d1844f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:26.164600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:26.165711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:26.166178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:26.166856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:26.209416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:26.212306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0441e-db39-4258-93ee-9b29eccb36aa service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:26.286376 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3762/7553] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:27.072440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:27.077858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:27.079849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:27.199504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] MFA Rules not processed for user `8784a9c574a34c7dad4d96760dad1c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:06:27.211231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:27.469514 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3792/7554] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:06:30.293344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:30.295066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:30.299494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:06:30.333315 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:06:30.335416 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:06:30.344789 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3763/7555] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:06:30 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:06:36.248127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=72,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:37.453265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=73 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:41.605042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:42.025025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44a9b-7ae0-49e2-86db-3c379e5117b3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:42.039842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:42.039842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:42.039842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:42.046221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:42.046221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:42.084440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:42.086587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:42.115520 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3793/7556] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:06:52.098188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=34 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:57.755549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:06:57.759043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:58.153799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96154fdc-ee12-4961-abe8-40791b6ca6d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:06:58.184694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:06:58.185807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:06:58.186516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:06:58.187021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:06:58.196844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:06:58.271886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:06:58.286562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e4ba-a525-4108-a0d8-0b6fd5f50849 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:06:58.341702 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3764/7557] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:07:01.416655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:01.417817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:01.713263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8102d1-acc2-4167-b24d-68a6cfcddedb service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:01.740318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:01.741566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:01.742843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:01.743500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] PATH_INFO: `/v3/users/8784a9c574a34c7dad4d96760dad1c7f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:01.746888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8784a9c574a34c7dad4d96760dad1c7f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:01.754942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:02.202396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8784a9c574a34c7dad4d96760dad1c7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:02.207893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8784a9c574a34c7dad4d96760dad1c7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:02.400593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8784a9c574a34c7dad4d96760dad1c7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:02.459757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8784a9c574a34c7dad4d96760dad1c7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:02.491929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8784a9c574a34c7dad4d96760dad1c7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:02.527116 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3794/7558] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:01 2022] DELETE /identity/v3/users/8784a9c574a34c7dad4d96760dad1c7f => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:02.529701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:02.531227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:02.531984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:02.624043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:02.638073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:03.087727 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3765/7559] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:07:03.116343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:03.120264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:03.329875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925c13-6f22-4e03-8f8d-0f8a6176de07 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:03.378774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:03.379092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:03.379565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:03.379955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:03.427417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:03.434904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:03.507865 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3795/7560] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:07:06.910659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:06.916443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:06.990121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785402cd-90fe-4b56-b386-a023feb8a62e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:07.017879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:07.023597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:07.024816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:07.028226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] PATH_INFO: `/v3/projects/42290e303c56447082419baf9e037472` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:07.031627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42290e303c56447082419baf9e037472)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:07.038928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:07.352623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42290e303c56447082419baf9e037472', 'request_id': 'req-f5233e12-e6b3-4288-b841-ea7a9353e0e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:07.378724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42290e303c56447082419baf9e037472', 'request_id': 'req-f5233e12-e6b3-4288-b841-ea7a9353e0e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:07.412024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42290e303c56447082419baf9e037472', 'request_id': 'req-f5233e12-e6b3-4288-b841-ea7a9353e0e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:07.554132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] The token cache is being invalidate because project 42290e303c56447082419baf9e037472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:07.554701 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:07.559120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:07.565876 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3766/7561] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:06 2022] DELETE /identity/v3/projects/42290e303c56447082419baf9e037472 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:07.572012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:07.610663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96bcde-4ce2-449c-8481-0b0c2f58748e service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:07.738542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:08.031850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:08.033204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:08.033751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:08.034309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] PATH_INFO: `/v3/users/095c14a85e1e4b4482097b2e22ed3084` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:08.042787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095c14a85e1e4b4482097b2e22ed3084)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:08.047208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:08.437656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095c14a85e1e4b4482097b2e22ed3084'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:08.439612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095c14a85e1e4b4482097b2e22ed3084'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:08.551556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095c14a85e1e4b4482097b2e22ed3084'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:08.667423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095c14a85e1e4b4482097b2e22ed3084'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:08.736320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095c14a85e1e4b4482097b2e22ed3084'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:08.775224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3796/7562] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:07 2022] DELETE /identity/v3/users/095c14a85e1e4b4482097b2e22ed3084 => generated 0 bytes in 1204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:15.255601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:15.259573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:15.418642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:15.456045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5233e12-e6b3-4288-b841-ea7a9353e0e3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:16.165112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:16.165112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:16.165112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:16.171578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] PATH_INFO: `/v3/projects/b619d23cebba4f1aa0956ea4c1320ad5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:16.179827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b619d23cebba4f1aa0956ea4c1320ad5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:16.199628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:16.688993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b619d23cebba4f1aa0956ea4c1320ad5', 'request_id': 'req-830b1387-59d2-4ede-aec0-af21d8a1f271'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:16.743607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b619d23cebba4f1aa0956ea4c1320ad5', 'request_id': 'req-830b1387-59d2-4ede-aec0-af21d8a1f271'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:16.779308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b619d23cebba4f1aa0956ea4c1320ad5', 'request_id': 'req-830b1387-59d2-4ede-aec0-af21d8a1f271'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:16.950745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] The token cache is being invalidate because project b619d23cebba4f1aa0956ea4c1320ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:16.951813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:16.956942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-830b1387-59d2-4ede-aec0-af21d8a1f271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:16.967846 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3767/7563] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:15 2022] DELETE /identity/v3/projects/b619d23cebba4f1aa0956ea4c1320ad5 => generated 0 bytes in 1712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:16.976033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:16.978807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:17.128593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6c1b-f8d7-4dfa-b55a-0ccf82af5c29 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:17.528320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:17.532803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:17.533352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:17.533887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] PATH_INFO: `/v3/users/c61c2f0c892040d38e5acaad2a447266` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:17.540677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61c2f0c892040d38e5acaad2a447266)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:17.546299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:17.888594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:17.984395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61c2f0c892040d38e5acaad2a447266'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:17.988181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61c2f0c892040d38e5acaad2a447266'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:18.115566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61c2f0c892040d38e5acaad2a447266'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:18.203097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61c2f0c892040d38e5acaad2a447266'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:18.257329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61c2f0c892040d38e5acaad2a447266'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:18.295587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3797/7564] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:16 2022] DELETE /identity/v3/users/c61c2f0c892040d38e5acaad2a447266 => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:19.590061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:19.590776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:19.591034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:19.708905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] MFA Rules not processed for user `626d1f96e801458eba55b56ff8fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:19.719806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:19.985500 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3768/7565] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:20.031112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:20.038278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:20.460101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcf1c8-0658-488e-98d1-3f00b49f88df admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:20.507770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:20.510527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:20.516464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:20.520238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:20.531028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:20.631054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:20.650915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c165a2-7e6a-49c9-b1bf-382b09d3f3dc service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:20.746830 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3798/7566] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:07:21.540116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:21.543482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:21.766752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:21.893886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f2d70-15a1-4570-9644-21955f8ce998 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:21.913527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:21.916341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:21.918244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:21.918723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] PATH_INFO: `/v3/projects/258627764cb34450afd603e926d0b2e4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:21.925753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258627764cb34450afd603e926d0b2e4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:21.935641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:22.389065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258627764cb34450afd603e926d0b2e4', 'request_id': 'req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:22.424086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258627764cb34450afd603e926d0b2e4', 'request_id': 'req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:22.452101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258627764cb34450afd603e926d0b2e4', 'request_id': 'req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:22.605120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] The token cache is being invalidate because project 258627764cb34450afd603e926d0b2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:22.606200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:22.609155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:22.618381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3769/7567] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:21 2022] DELETE /identity/v3/projects/258627764cb34450afd603e926d0b2e4 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:23.363824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:23.365399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:23.366480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6d6138f2-73b5-4fcc-bbd7-a1a63497911b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:07:23.396647 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:07:23.398823 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:07:23.407290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3799/7568] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:07:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:07:30.688090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=50,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:32.590635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:43.208426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:43.212870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:43.655885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed086bf-3831-4cec-8ecb-19aa9d24ed67 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:43.700186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:43.708210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:43.708711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:43.709214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] PATH_INFO: `/v3/users/9ef9de1c9dbd4372a07b4d1e26463cc0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:43.730216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef9de1c9dbd4372a07b4d1e26463cc0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:43.745097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:44.227795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef9de1c9dbd4372a07b4d1e26463cc0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:44.369818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef9de1c9dbd4372a07b4d1e26463cc0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:44.403387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef9de1c9dbd4372a07b4d1e26463cc0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:44.469355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef9de1c9dbd4372a07b4d1e26463cc0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:44.477284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef9de1c9dbd4372a07b4d1e26463cc0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:44.517283 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3770/7569] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:43 2022] DELETE /identity/v3/users/9ef9de1c9dbd4372a07b4d1e26463cc0 => generated 0 bytes in 1306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:44.522249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:44.523053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:44.532865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:44.667783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:44.676040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:45.121596 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3800/7570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:45.168836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:45.171605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:45.570638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa55d-d906-4ba4-a556-b1b5f6948d94 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:45.597257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:45.600503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:45.607424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:45.608486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:45.656861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:45.675654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9341c7-ab0f-4807-b238-6d40587b4139 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:45.732489 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3771/7571] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:07:46.840667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:46.845819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:46.897705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632a0c6-f40b-4061-9b23-466e55c0b435 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:46.909630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:46.911368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:46.911878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:46.913052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] PATH_INFO: `/v3/users/626d1f96e801458eba55b56ff8fb3672` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:46.915007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] RBAC: Authorizing `identity:delete_user(user_id=626d1f96e801458eba55b56ff8fb3672)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:46.920732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:47.327949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626d1f96e801458eba55b56ff8fb3672'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:47.331941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626d1f96e801458eba55b56ff8fb3672'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:47.497558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626d1f96e801458eba55b56ff8fb3672'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:47.597835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626d1f96e801458eba55b56ff8fb3672'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:47.640259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626d1f96e801458eba55b56ff8fb3672'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:47.694112 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3801/7572] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:46 2022] DELETE /identity/v3/users/626d1f96e801458eba55b56ff8fb3672 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:47.703693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:47.705078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:47.705412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:47.818142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:47.821631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:47.899265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:48.073076 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3772/7573] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:48.223248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:48.226376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:48.499111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988b4aa-6b2e-4af8-950a-00bceca2825d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:48.506196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:48.508979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:48.508979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:48.508979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:48.537443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:48.540254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:48.568793 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3802/7574] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:07:49.160746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:49.164446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:49.240762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364a03-e573-4ac8-aefc-807d4ba4aff6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:49.253204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:49.255364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:49.256345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:49.257342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] PATH_INFO: `/v3/projects/3c8a8cc284ae4a0b97b013b0a871390c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:49.260867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8a8cc284ae4a0b97b013b0a871390c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:49.271975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:49.648669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8a8cc284ae4a0b97b013b0a871390c', 'request_id': 'req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:49.692506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8a8cc284ae4a0b97b013b0a871390c', 'request_id': 'req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:49.718038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8a8cc284ae4a0b97b013b0a871390c', 'request_id': 'req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:49.736950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:49.740656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:49.788708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae3681-e665-4dc2-8c71-bad4308b4fec service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:49.818648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:49.925903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] The token cache is being invalidate because project 3c8a8cc284ae4a0b97b013b0a871390c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:49.926551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:49.928187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:49.941909 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3773/7575] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:49 2022] DELETE /identity/v3/projects/3c8a8cc284ae4a0b97b013b0a871390c => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:07:49.946130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:49.952783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:50.028371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:50.029827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:50.032704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:50.046642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] PATH_INFO: `/v3/projects/2f27496d38be44c29c3cd5bc4ae008d8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:50.046642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f27496d38be44c29c3cd5bc4ae008d8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:50.046642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:50.267520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec91d-e6fe-4ad2-8ebc-dde8021a72a2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:50.292560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:50.292560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:50.295434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:50.298261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] PATH_INFO: `/v3/users/9e47db6d6d544a9cb10dd7172c18eb4a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:50.303163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e47db6d6d544a9cb10dd7172c18eb4a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:50.311558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:50.400146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f27496d38be44c29c3cd5bc4ae008d8', 'request_id': 'req-7438fbcd-0b12-49d9-acb6-053e9203016e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:50.745231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f27496d38be44c29c3cd5bc4ae008d8', 'request_id': 'req-7438fbcd-0b12-49d9-acb6-053e9203016e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:50.776287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f27496d38be44c29c3cd5bc4ae008d8', 'request_id': 'req-7438fbcd-0b12-49d9-acb6-053e9203016e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:50.891215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] The token cache is being invalidate because project 2f27496d38be44c29c3cd5bc4ae008d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:50.903432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:50.930192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:50.945549 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3803/7576] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:49 2022] DELETE /identity/v3/projects/2f27496d38be44c29c3cd5bc4ae008d8 => generated 0 bytes in 1210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:50.953232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:50.959589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:50.964605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:50.990294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e47db6d6d544a9cb10dd7172c18eb4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.223076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e47db6d6d544a9cb10dd7172c18eb4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.247721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e47db6d6d544a9cb10dd7172c18eb4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.275299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438fbcd-0b12-49d9-acb6-053e9203016e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:51.304686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e47db6d6d544a9cb10dd7172c18eb4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.308204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e47db6d6d544a9cb10dd7172c18eb4a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.308427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:51.308427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:51.308427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:51.308427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] PATH_INFO: `/v3/users/224fe404839f47d0b34d816d7c96d223` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:51.322594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224fe404839f47d0b34d816d7c96d223)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:51.331960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:51.332298 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3774/7577] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:49 2022] DELETE /identity/v3/users/9e47db6d6d544a9cb10dd7172c18eb4a => generated 0 bytes in 1389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:51.877974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224fe404839f47d0b34d816d7c96d223'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.879570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224fe404839f47d0b34d816d7c96d223'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:51.888274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:52.056321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224fe404839f47d0b34d816d7c96d223'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:52.127954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224fe404839f47d0b34d816d7c96d223'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:52.183256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ab65b7b7-470c-4386-8b82-4a390f0b8a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224fe404839f47d0b34d816d7c96d223'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:52.205661 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3804/7578] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:07:50 2022] DELETE /identity/v3/users/224fe404839f47d0b34d816d7c96d223 => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:52.887318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:52.887318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:53.095187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e9eae-0be5-4bed-b49f-329b6e353ecd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:53.315855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:53.317384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:53.317876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:53.318359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] PATH_INFO: `/v3/projects/81083e57a9d44814b3f6d178b23ba3ce` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:53.320817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81083e57a9d44814b3f6d178b23ba3ce)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:53.325655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:53.573830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81083e57a9d44814b3f6d178b23ba3ce', 'request_id': 'req-5964a625-3e78-4bcf-8843-c47eac338d7c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:53.606602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81083e57a9d44814b3f6d178b23ba3ce', 'request_id': 'req-5964a625-3e78-4bcf-8843-c47eac338d7c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:53.634014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81083e57a9d44814b3f6d178b23ba3ce', 'request_id': 'req-5964a625-3e78-4bcf-8843-c47eac338d7c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:53.640993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:53.831898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] The token cache is being invalidate because project 81083e57a9d44814b3f6d178b23ba3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:53.835804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:53.838947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:53.842102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3775/7579] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:52 2022] DELETE /identity/v3/projects/81083e57a9d44814b3f6d178b23ba3ce => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:53.851017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368751-a074-4fa3-af08-95b33d7a9e93 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:53.860046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368751-a074-4fa3-af08-95b33d7a9e93 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:53.860046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368751-a074-4fa3-af08-95b33d7a9e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:53.908144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69368751-a074-4fa3-af08-95b33d7a9e93 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:53.911364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69368751-a074-4fa3-af08-95b33d7a9e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:54.185356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:54.186284 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3805/7580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:54.189757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:54.192880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:54.195397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:54.196943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:54.264886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a625-3e78-4bcf-8843-c47eac338d7c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:54.282441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:54.283689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:54.285965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:54.296503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] PATH_INFO: `/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:54.302869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b33f33c0e92496ca5f6ca0cb55cafc6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:54.317000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:54.329869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:54.332751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:54.383906 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3806/7581] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:54.401757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:54.437586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8757-f3bb-42a2-85d2-b2ee6925dfed None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:54.447116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:54.449327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:54.449856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:54.450365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:54.451756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:07:54.452258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:54.455816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:54.495390 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3807/7582] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:07:54.497219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:54.538136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041896d3-be4b-476f-92f4-d1bd62d726fc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:54.574359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:54.575881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:54.584548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:54.584548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:54.584548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:54.605995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:54.772504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b33f33c0e92496ca5f6ca0cb55cafc6', 'request_id': 'req-74c777bb-aee4-48b5-bf1b-aff887916985'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:54.797566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b33f33c0e92496ca5f6ca0cb55cafc6', 'request_id': 'req-74c777bb-aee4-48b5-bf1b-aff887916985'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:54.845416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b33f33c0e92496ca5f6ca0cb55cafc6', 'request_id': 'req-74c777bb-aee4-48b5-bf1b-aff887916985'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:54.964708 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3808/7583] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:07:54 2022] POST /identity/v3/projects => generated 371 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:07:54.967972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:54.995523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] The token cache is being invalidate because project 0b33f33c0e92496ca5f6ca0cb55cafc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:07:54.996100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:54.999086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74c777bb-aee4-48b5-bf1b-aff887916985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:07:55.022977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3776/7584] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:07:54 2022] DELETE /identity/v3/projects/0b33f33c0e92496ca5f6ca0cb55cafc6 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:55.030080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b39cb-d77a-4fa0-85e5-d91b83e6a815 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:55.033425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b39cb-d77a-4fa0-85e5-d91b83e6a815 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:55.037563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b39cb-d77a-4fa0-85e5-d91b83e6a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:55.169340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-581b39cb-d77a-4fa0-85e5-d91b83e6a815 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:55.175411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-581b39cb-d77a-4fa0-85e5-d91b83e6a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:55.415873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ba9b7-d5de-4c30-9c5a-e1b95ed29fe1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:55.439222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:55.440949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:55.442710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:55.443576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:55.445360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:55.449661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:55.528420 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3777/7585] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:55.542819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:55.543814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:55.544576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:55.720193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:55.723550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:55.781953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3809/7586] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:07:54 2022] POST /identity/v3/users => generated 286 bytes in 817 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:07:55.793592 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3778/7587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:55.811627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:55.848573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:55.856966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:56.001556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6475-0b3b-43dc-87b8-8a8fe0fef33d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:56.040535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49f2d-8922-45c8-9cdb-d982f9b23fc4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:56.053612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:56.054681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.055185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.061778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:56.062969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:56.095999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:56.110770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:56.118864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.119358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.120176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:56.125751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:07:56.127422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:56.158645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:56.238423 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3779/7588] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:07:56.247854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:56.270564 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3810/7589] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:07:56.292439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:56.330540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aba01-fe7e-4cb0-941c-de9c2a78629f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:56.352056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:56.391296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7eec-b22e-43c3-b6e4-715f20c60a7e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:56.403968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:56.418416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.419073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.419534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:56.420752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:56.438472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:56.445558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:56.445558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.445558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.445558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:56.460573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:56.464513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:56.542711 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3811/7590] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:07:56.550050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:56.598197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2936-74c3-4bf7-b617-d6c43a8b8dab admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:56.625261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:56.626852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.628252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.628252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] PATH_INFO: `/v3/projects/c709d51ca1644fd088da2b983c59270f/users/24457d9efc564d55b1f5cc583d280881/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:56.699128 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3780/7591] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:07:56.702892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:56.714200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c709d51ca1644fd088da2b983c59270f, user_id=24457d9efc564d55b1f5cc583d280881, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:56.764016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ba75-e0d5-4d9d-9313-4eef318858e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:56.877426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:56.976553 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3812/7592] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:07:56 2022] PUT /identity/v3/projects/c709d51ca1644fd088da2b983c59270f/users/24457d9efc564d55b1f5cc583d280881/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:07:56.976553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:56.976553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:56.976553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:57.006743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef826f-0016-4d06-812b-1fc4c22f73b0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:57.081308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:57.083842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:57.338284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:57.344140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:57.345069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:57.345691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:57.347187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:57.358541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:57.389445 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3813/7593] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:07:57.450090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:57.452666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:57.649654 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3781/7594] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:07:56 2022] POST /identity/v3/users => generated 292 bytes in 950 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:07:57.654154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:57.702734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3af1d-c517-4d32-acba-93ff02f1bf59 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:57.739198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:57.740526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:57.741124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:57.741800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:57.743185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:57.757934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:57.808162 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3782/7595] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:07:57.808162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:57.811701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddbee9-e415-40ad-929a-e446f5597be4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:57.835340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:57.836514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:57.837035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:57.837601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:57.851891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9f51-d80b-41c3-b5f0-b52afc1e789a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:57.872759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:57.874177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:57.876926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:57.878345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:57.880717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:57.888741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:57.894234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:57.901141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7149-43d1-4148-9c06-d36c645c4eb4 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:57.942383 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3783/7596] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:07:57.951566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:57.951860 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3814/7597] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:07:57.998595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4e1b1-5459-41b9-909d-a9dfd42cd732 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:58.018370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:58.019620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:58.020444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:58.020853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] PATH_INFO: `/v3/projects/2e5de3cd23f54af491e3e2ee52f16035/users/1b2e783f973b4c0a88f2b8517041f8a7/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:58.103557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5de3cd23f54af491e3e2ee52f16035, user_id=1b2e783f973b4c0a88f2b8517041f8a7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:58.126177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:58.325716 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3784/7598] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:07:57 2022] PUT /identity/v3/projects/2e5de3cd23f54af491e3e2ee52f16035/users/1b2e783f973b4c0a88f2b8517041f8a7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:07:58.335788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66797a2-dc75-4ce7-826f-583cd23ed524 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:58.336637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66797a2-dc75-4ce7-826f-583cd23ed524 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:58.338168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66797a2-dc75-4ce7-826f-583cd23ed524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:58.453164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d66797a2-dc75-4ce7-826f-583cd23ed524 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:07:58.464105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d66797a2-dc75-4ce7-826f-583cd23ed524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:58.766468 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3815/7599] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:07:58.840489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:07:58.853482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:07:59.127219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46768-f247-48dc-ae2a-6b661e541b48 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:07:59.142148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:07:59.143479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:07:59.144366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:07:59.145414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:07:59.188480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:07:59.196849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:07:59.222396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3785/7600] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:08:06.327384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:06.327384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:06.327384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:06.486166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:06.512217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] MFA Rules not processed for user `24457d9efc564d55b1f5cc583d280881`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:06.523577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:06.895475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3816/7601] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:06.903595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:06.996569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf2a3-0ab0-4b9f-b81e-e47b02ed7471 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:07.007642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:07.009467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:07.010393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:07.011413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:07.014896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:07.023770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:07.266352 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3786/7602] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:08:06 2022] POST /identity/v3/projects => generated 373 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:07.267986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:07.309447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5856d-055a-4b2a-8f18-f27c889e7169 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:07.590469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:07.591664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:07.592197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:07.592731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:07.594653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:07.598780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:07.816271 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3817/7603] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:08:07 2022] POST /identity/v3/users => generated 293 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:08:07.818756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:07.927093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f415-e212-4390-abae-ef5258c26ebc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:07.955537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:07.957138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:07.958459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:07.989469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:07.990962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:07.994270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:07.997885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:08.043314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3787/7604] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:08:08.050867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:08.089948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56204-57b6-423d-a0b3-4c7a7875a361 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:08.118595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:08.119975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:08.120347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:08.120837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] PATH_INFO: `/v3/projects/344137dbfa264c3da4c122557dc3e5b9/users/e3763d8ad7384fb68b4d1abe655aa5fd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:08.191599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344137dbfa264c3da4c122557dc3e5b9, user_id=e3763d8ad7384fb68b4d1abe655aa5fd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:08.200080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:08.365671 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3818/7605] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:08 2022] PUT /identity/v3/projects/344137dbfa264c3da4c122557dc3e5b9/users/e3763d8ad7384fb68b4d1abe655aa5fd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:08.367549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:08.403984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac82e2a-c39d-4ab4-b869-50b4b04e5d3c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:08.731555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:08.735614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:08.736597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:08.740471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:08.742549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:08.750493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dd3e3-ff35-4a7c-86bf-6b3970075393 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:08.823215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3788/7606] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:08:08.831600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:08.867360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4092e48-f500-4b50-a044-a1bb110386f3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:08.888824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:08.890666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:08.893884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:08.894720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] PATH_INFO: `/v3/projects/344137dbfa264c3da4c122557dc3e5b9/users/e3763d8ad7384fb68b4d1abe655aa5fd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:08.906717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=344137dbfa264c3da4c122557dc3e5b9, user_id=e3763d8ad7384fb68b4d1abe655aa5fd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:08.927540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:08.998330 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3819/7607] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:08 2022] PUT /identity/v3/projects/344137dbfa264c3da4c122557dc3e5b9/users/e3763d8ad7384fb68b4d1abe655aa5fd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:17.007252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100e5-f81f-4e44-9c87-2409e3b1729e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:17.008725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100e5-f81f-4e44-9c87-2409e3b1729e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:17.009455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100e5-f81f-4e44-9c87-2409e3b1729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:17.186256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cfc100e5-f81f-4e44-9c87-2409e3b1729e None None] MFA Rules not processed for user `e3763d8ad7384fb68b4d1abe655aa5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:17.192360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cfc100e5-f81f-4e44-9c87-2409e3b1729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:17.263541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:17.270501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:17.445314 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3789/7608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:17.453871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88f60e-21c1-4fe1-8a9a-c8d85786841a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:17.454539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88f60e-21c1-4fe1-8a9a-c8d85786841a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:17.455166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88f60e-21c1-4fe1-8a9a-c8d85786841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:17.486211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:17.514985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7f88f60e-21c1-4fe1-8a9a-c8d85786841a None None] MFA Rules not processed for user `24457d9efc564d55b1f5cc583d280881`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:17.521199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7f88f60e-21c1-4fe1-8a9a-c8d85786841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:17.695033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91bc2-35ad-45cf-b233-22514411d70d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:17.711625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:17.714991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:17.717267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:17.718045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:17.724118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:17.759312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:17.764373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:17.800891 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3820/7609] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:08:17.892807 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3790/7610] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:17.966692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:17.966692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:18.415782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45b0b-f977-4700-b92d-f26af697b619 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:18.451519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:18.452856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:18.454492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:18.454959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:18.499047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:18.507408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:18.542171 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3821/7611] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:08:20.806642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573964-61dc-4c62-b972-386b44476c5d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:20.816729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573964-61dc-4c62-b972-386b44476c5d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:20.816729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573964-61dc-4c62-b972-386b44476c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-49573964-61dc-4c62-b972-386b44476c5d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:08:20.834480 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:08:20.836247 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:08:20.854396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3791/7612] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:08:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:08:27.848455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:28.332005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:28.333654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:28.711967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757438e-cd19-4363-ac00-ed5fea4bb444 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:28.727568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:28.728311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:28.728617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:28.733368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:28.787736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:28.794781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:28.840676 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3822/7613] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:08:29.583893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:29.585400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:29.586159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:29.707607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] MFA Rules not processed for user `1b2e783f973b4c0a88f2b8517041f8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:29.711232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:30.097285 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3792/7614] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:30.099395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:30.363572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:30.511965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9870-fefa-4f55-877c-f22dca8501b0 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:30.568733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:30.570141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:30.570460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:30.570972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:30.572373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:30.588959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:30.836882 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3823/7615] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:08:30 2022] POST /identity/v3/projects => generated 381 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:30.843503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:30.881359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13af8a-f5b4-4373-8d49-bc39b5fcc554 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:31.241652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:31.243459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:31.243459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:31.244042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:31.264103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:31.276799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:31.586845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3793/7616] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:08:30 2022] POST /identity/v3/users => generated 297 bytes in 745 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:31.594087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:31.641713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8ac42-02ac-4d1b-8242-07bd32cb192d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:31.675376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:31.677189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:31.677942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:31.678706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:31.680571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:31.688203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:31.746142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:31.767665 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3824/7617] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:08:31.808026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ce03-da84-4f5f-921d-bc412d76024e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:31.839757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:31.841022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:31.853896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:31.855540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] PATH_INFO: `/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a/users/73c8271087b542f68056a5af71fbf0d1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:31.970221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6737dcacaa4985bb6bc9e1bf6b1f0a, user_id=73c8271087b542f68056a5af71fbf0d1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:31.992910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:32.143692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3794/7618] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:31 2022] PUT /identity/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a/users/73c8271087b542f68056a5af71fbf0d1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:08:32.150949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:32.200142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083393-dc03-46b0-964d-7e091363e4fd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:32.689845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:32.693407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:32.694267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:32.695819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:32.697615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:32.702065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:32.749460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3825/7619] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 600 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:08:32.763187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:32.803630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48322-5851-4c7f-8283-8f414efb42b8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:32.822477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:32.825949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:32.825949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:32.825949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] PATH_INFO: `/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a/users/73c8271087b542f68056a5af71fbf0d1/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:32.847504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6737dcacaa4985bb6bc9e1bf6b1f0a, user_id=73c8271087b542f68056a5af71fbf0d1, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:32.854008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0270-3655-40b0-8846-cd3f4cc99d55 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:32.915376 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3795/7620] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:32 2022] PUT /identity/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a/users/73c8271087b542f68056a5af71fbf0d1/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:33.513675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:33.517580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:33.575247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62985d2a-4838-49da-b914-d1c5f982f9e6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:33.868818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:33.870453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:33.871259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:33.875624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] PATH_INFO: `/v3/users/dad067bd3a694ae1a67e14b7e83c804d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:33.884303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad067bd3a694ae1a67e14b7e83c804d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:33.894198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:34.391388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:34.399944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad067bd3a694ae1a67e14b7e83c804d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:34.405797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad067bd3a694ae1a67e14b7e83c804d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:34.601074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad067bd3a694ae1a67e14b7e83c804d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:34.676362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad067bd3a694ae1a67e14b7e83c804d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:34.715675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad067bd3a694ae1a67e14b7e83c804d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:34.755805 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3826/7621] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:08:33 2022] DELETE /identity/v3/users/dad067bd3a694ae1a67e14b7e83c804d => generated 0 bytes in 1244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:34.764801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:34.767486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:34.775284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:34.869307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:34.872041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:35.081804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:35.196697 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3796/7622] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:35.353279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:35.356221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:35.701649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93cca6-65d2-4be6-b6a9-1b1a8a7439e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:35.723526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:35.729366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:35.730201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:35.730847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:35.791549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:35.802080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:35.856961 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3827/7623] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:08:37.965102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:37.968862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:38.022857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15731d-2af0-48bb-83ac-d200ac4438a0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:38.058793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:38.060462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:38.061275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:38.065356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] PATH_INFO: `/v3/projects/c9d031eca7c04999aa55fbbda9e616c2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:38.073798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d031eca7c04999aa55fbbda9e616c2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:38.085731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:38.389006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d031eca7c04999aa55fbbda9e616c2', 'request_id': 'req-1b168ed6-21f0-4d4b-9228-960dab482b6f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:38.412971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d031eca7c04999aa55fbbda9e616c2', 'request_id': 'req-1b168ed6-21f0-4d4b-9228-960dab482b6f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:38.456838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d031eca7c04999aa55fbbda9e616c2', 'request_id': 'req-1b168ed6-21f0-4d4b-9228-960dab482b6f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:38.574055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] The token cache is being invalidate because project c9d031eca7c04999aa55fbbda9e616c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:08:38.574861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:38.579752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:38.591046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3797/7624] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:08:37 2022] DELETE /identity/v3/projects/c9d031eca7c04999aa55fbbda9e616c2 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:08:38.607203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:38.667966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff051-3bbb-4395-9f8e-382f5d1d3d50 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:38.981246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:38.986938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:39.007675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:39.009696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] PATH_INFO: `/v3/users/1e9672a374064f3990f022bdafc4000a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:39.019055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9672a374064f3990f022bdafc4000a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:39.042408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:39.574943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9672a374064f3990f022bdafc4000a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:39.581269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9672a374064f3990f022bdafc4000a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:39.757702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9672a374064f3990f022bdafc4000a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:39.824648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:39.863947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9672a374064f3990f022bdafc4000a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:39.920551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9672a374064f3990f022bdafc4000a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:39.966027 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3828/7625] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:08:38 2022] DELETE /identity/v3/users/1e9672a374064f3990f022bdafc4000a => generated 0 bytes in 1374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:44.658319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:44.660163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:44.728676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168ed6-21f0-4d4b-9228-960dab482b6f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:44.826267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:44.832537 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:45.019591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:45.020744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:45.021370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:45.022357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] PATH_INFO: `/v3/projects/8f0263a110c84f1db828d07032ad0e59` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:45.028075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0263a110c84f1db828d07032ad0e59)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:45.034370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:45.145451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecee1b-1696-4c2b-8bb9-3a82af086d59 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:45.171978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:45.173185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:45.173714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:45.174286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:45.185792 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:45.399783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0263a110c84f1db828d07032ad0e59', 'request_id': 'req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:45.418444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:45.421933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b3b5-e15d-4ae4-a240-128e5b372a43 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:45.428354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0263a110c84f1db828d07032ad0e59', 'request_id': 'req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:45.447670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0263a110c84f1db828d07032ad0e59', 'request_id': 'req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:45.460739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3829/7626] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:45.461143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:45.611443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] The token cache is being invalidate because project 8f0263a110c84f1db828d07032ad0e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:08:45.612467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:45.614841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-bfe3c7bd-72e0-4909-b545-424a2e7ab2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:45.626538 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3798/7627] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:08:44 2022] DELETE /identity/v3/projects/8f0263a110c84f1db828d07032ad0e59 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:45.632596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:45.633690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:45.644035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:45.710404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:45.712879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:46.030096 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3830/7628] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:46.032765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:46.033509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:46.034084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:46.132831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:46.142510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:46.193487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:46.194403 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3799/7629] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:46.222153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e16be-4fb1-4836-ad95-8caf18023abd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:46.244361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:46.245989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:46.254435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:46.255284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:46.256798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:08:46.257640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:46.261620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:46.316321 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3831/7630] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:08:46.323758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:46.359612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319293d-dacc-4a02-b97b-7ebced8ecbb0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:46.377933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:46.379643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:46.380871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:46.381911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:46.383919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:46.389380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:46.585560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3800/7631] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:08:46 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:46.588561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:46.601232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:46.627508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed373ea-e4db-448f-b04e-3e95eae859af admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:46.963526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:46.965212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:46.969812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:46.973367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:46.976837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:46.989831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:47.188949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3832/7632] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:08:46 2022] POST /identity/v3/users => generated 293 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:08:47.192184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:47.230484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea39f7-8f4b-4a3a-8616-2c3e5174992a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:47.260088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:47.260088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:47.265752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:47.266602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:47.273637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:47.284031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:47.338448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3801/7633] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:08:47.345018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:47.380364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf492ad-2756-4609-b3ca-e9a6285487ee admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:47.401089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:47.405260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:47.406044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:47.406367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:47.407793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:47.418430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2feb8-f6ac-49b5-a3e6-9510449a9cbf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:47.466107 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3833/7634] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:08:47.473056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:47.513114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873465d-5b6d-4b2d-b6a2-700a061541c3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:47.534558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:47.535943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:47.536624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:47.539574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] PATH_INFO: `/v3/projects/209ee57c86f14ae5987761bbe05b05a1/users/edd8a4e317a2421cab63b5a14c5f74e3/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:47.641517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209ee57c86f14ae5987761bbe05b05a1, user_id=edd8a4e317a2421cab63b5a14c5f74e3, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:47.654950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:47.839245 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3802/7635] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:47 2022] PUT /identity/v3/projects/209ee57c86f14ae5987761bbe05b05a1/users/edd8a4e317a2421cab63b5a14c5f74e3/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:08:47.851555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:47.852076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:47.852608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:47.973415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] MFA Rules not processed for user `edd8a4e317a2421cab63b5a14c5f74e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:47.976601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:48.234459 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3834/7636] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:48.241599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:48.612752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ded4f5-c4a0-4c73-a248-a5ac4e30a4c8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:48.638168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:48.639733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:48.647514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:48.650928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:48.652817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:48.662071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:48.889622 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3803/7637] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:08:48 2022] POST /identity/v3/projects => generated 385 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:48.897615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:49.003966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d320-0080-4ca1-85ec-dfbd4f670395 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:49.205036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:49.206392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:49.207711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:49.208677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:49.210597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:49.221995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:49.466825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:49.509485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3835/7638] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:08:48 2022] POST /identity/v3/users => generated 299 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:08:49.515114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:49.554072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aaf10-4664-404a-89b0-4eca676feb50 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:49.577412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:49.579126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:49.580051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:49.580785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:49.582374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:49.589939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:49.682221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:49.687604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3804/7639] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:08:49.750261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21560-6a45-43b6-8c04-113a48ec856b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:49.820398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:49.822218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:49.822734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:49.823473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] PATH_INFO: `/v3/projects/564604b8c57a40c1b124a7f69e5ea080/users/fbbb3eeb3de3409cb7bdc105bd108607/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:49.973163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=564604b8c57a40c1b124a7f69e5ea080, user_id=fbbb3eeb3de3409cb7bdc105bd108607, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:49.985992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:50.184841 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3836/7640] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:49 2022] PUT /identity/v3/projects/564604b8c57a40c1b124a7f69e5ea080/users/fbbb3eeb3de3409cb7bdc105bd108607/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:50.190992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:50.246392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407b85-f22a-4aa7-a7af-d3d9b188af85 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:50.648564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:50.652281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:50.652944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:50.653467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:50.659072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:50.661501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a268630-0439-4190-b0ec-be3fa5149ddb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:50.712556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3805/7641] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:08:50.716990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:50.764032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec144-af1c-4311-93d8-08722f9d19ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:50.788113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:50.789151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:50.789663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:50.790059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] PATH_INFO: `/v3/projects/564604b8c57a40c1b124a7f69e5ea080/users/fbbb3eeb3de3409cb7bdc105bd108607/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:50.800421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564604b8c57a40c1b124a7f69e5ea080, user_id=fbbb3eeb3de3409cb7bdc105bd108607, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:50.805198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:50.875304 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3837/7642] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:08:50 2022] PUT /identity/v3/projects/564604b8c57a40c1b124a7f69e5ea080/users/fbbb3eeb3de3409cb7bdc105bd108607/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:50.896991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:50.898167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:50.899025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:50.946716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:51.191934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] MFA Rules not processed for user `fbbb3eeb3de3409cb7bdc105bd108607`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:51.204788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:51.932396 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3806/7643] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 1038 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:51.972252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:51.979391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:52.385247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611e48e-b1e5-4b21-bc4d-0f1b23250dd5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:52.415520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:52.418859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:52.421915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:52.427836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:52.473854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:52.477527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f20e6-5982-4bf8-9210-f48e93d97247 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:52.503638 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3838/7644] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:08:52.747294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:53.058770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9159-c6fe-49ce-9007-486cad3d27b6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:53.076588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:53.077829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:53.078233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:53.078581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] PATH_INFO: `/v3/users/edd8a4e317a2421cab63b5a14c5f74e3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:53.088356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd8a4e317a2421cab63b5a14c5f74e3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:53.093776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:53.491852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd8a4e317a2421cab63b5a14c5f74e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:53.632158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd8a4e317a2421cab63b5a14c5f74e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:53.666549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd8a4e317a2421cab63b5a14c5f74e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:53.761056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd8a4e317a2421cab63b5a14c5f74e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:53.768156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd8a4e317a2421cab63b5a14c5f74e3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:08:53.815826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:53.816671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:53.816883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:53.824066 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3807/7645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:08:52 2022] DELETE /identity/v3/users/edd8a4e317a2421cab63b5a14c5f74e3 => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:08:53.901929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:08:53.904351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:54.200594 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3839/7646] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:08:54.321335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:54.328341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:54.388630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:54.650223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0940b6-ee90-42a1-bb8c-67134a6c1eb1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:54.663208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:54.664335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:54.664861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:54.665339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:54.715065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:54.719270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:08:54.758246 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3808/7647] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:08:59.684767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:08:59.689197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:08:59.737548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781de1b9-b953-4b6d-a5a3-20919305ca8a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:08:59.767921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:08:59.767921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:08:59.767921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:08:59.767921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] PATH_INFO: `/v3/projects/209ee57c86f14ae5987761bbe05b05a1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:08:59.770239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209ee57c86f14ae5987761bbe05b05a1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:08:59.781848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:00.180164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209ee57c86f14ae5987761bbe05b05a1', 'request_id': 'req-0577d9e7-68b5-410a-9bbf-4f4328f2b269'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:00.325652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209ee57c86f14ae5987761bbe05b05a1', 'request_id': 'req-0577d9e7-68b5-410a-9bbf-4f4328f2b269'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:00.360475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209ee57c86f14ae5987761bbe05b05a1', 'request_id': 'req-0577d9e7-68b5-410a-9bbf-4f4328f2b269'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:00.361845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:00.420524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] The token cache is being invalidate because project 209ee57c86f14ae5987761bbe05b05a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:00.421063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:00.424675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:00.426729 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3840/7648] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:08:59 2022] DELETE /identity/v3/projects/209ee57c86f14ae5987761bbe05b05a1 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:00.432533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:00.489279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84b03a-9e39-4fe8-8dbb-303da33010dd service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:00.827177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:00.829794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:00.833226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:00.834409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] PATH_INFO: `/v3/users/fbbb3eeb3de3409cb7bdc105bd108607` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:00.837395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbb3eeb3de3409cb7bdc105bd108607)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:00.850181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:01.385998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbb3eeb3de3409cb7bdc105bd108607'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:01.513461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbb3eeb3de3409cb7bdc105bd108607'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:01.561760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbb3eeb3de3409cb7bdc105bd108607'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:01.664392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbb3eeb3de3409cb7bdc105bd108607'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:01.667074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0c9c4e73-1f09-45fe-92fa-c6b712b37b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbb3eeb3de3409cb7bdc105bd108607'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:01.738639 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3809/7649] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:00 2022] DELETE /identity/v3/users/fbbb3eeb3de3409cb7bdc105bd108607 => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:05.362595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:05.366232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:05.437752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d9e7-68b5-410a-9bbf-4f4328f2b269 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:05.819246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:05.820818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:05.821301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:05.821822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] PATH_INFO: `/v3/projects/564604b8c57a40c1b124a7f69e5ea080` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:05.832654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564604b8c57a40c1b124a7f69e5ea080)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:05.836816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:06.185452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564604b8c57a40c1b124a7f69e5ea080', 'request_id': 'req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:06.283358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564604b8c57a40c1b124a7f69e5ea080', 'request_id': 'req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:06.323027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564604b8c57a40c1b124a7f69e5ea080', 'request_id': 'req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:06.391572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] The token cache is being invalidate because project 564604b8c57a40c1b124a7f69e5ea080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:06.391572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:06.391572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2eff57fc-3ea4-41b3-a699-8f383c75e9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:06.391572 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3841/7650] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:05 2022] DELETE /identity/v3/projects/564604b8c57a40c1b124a7f69e5ea080 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:06.399607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:06.400484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:06.400770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:06.464822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:06.468696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:06.574251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:06.765565 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3810/7651] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:06.771689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:06.771689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:06.771689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:06.854791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:06.857970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:06.917749 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3842/7652] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:06.919602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:06.951847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db067cf-1187-4728-bafe-fa6e2eab8545 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:06.978932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:06.980376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:06.981473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:06.981992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:06.982980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:09:06.984022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:06.995480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:07.043350 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3811/7653] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:09:07.050892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:07.084405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6800bd-6de1-4189-a42c-8ef7fd5d6303 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:07.112651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:07.113593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:07.119047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:07.120188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:07.122494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:07.128760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726b521-18a5-42df-8b7b-43d3c545960c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:07.421513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3843/7654] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:07 2022] POST /identity/v3/projects => generated 377 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:07.429195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:07.462108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219c6f9-9d46-4f48-b81a-f9b29659d40d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:07.713211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:07.721075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:07.721758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:07.722369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:07.723838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:07.727712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:07.785919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:07.786999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:07.787850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:07.950299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3812/7655] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:07 2022] POST /identity/v3/users => generated 289 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:07.957415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:07.994624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6722329-29c3-4a63-8dd0-12fd2bf40035 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:08.000287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] MFA Rules not processed for user `73c8271087b542f68056a5af71fbf0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:08.013185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:08.014324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:08.014868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:08.015416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:08.016708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:08.023791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:08.031204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:08.109869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3813/7656] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:09:08.125664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:08.179574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68cac-b819-4837-a0e1-a16f4883cb17 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:08.219845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:08.227572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:08.228155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:08.228904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:08.230170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:08.236897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:08.300785 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3814/7657] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:09:08.303072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:08.321119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:08.381403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d41a3-db5a-4f10-83fa-79d4b659b59c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:08.414195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:08.415487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:08.415988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:08.416477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] PATH_INFO: `/v3/projects/6a77fc44d32545aa88c7b79f62216791/users/5dc73ab8bdb04c86a0247291b74f8d3e/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:08.492497 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3844/7658] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 710 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:08.533727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:08.538340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:08.548939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a77fc44d32545aa88c7b79f62216791, user_id=5dc73ab8bdb04c86a0247291b74f8d3e, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:08.556818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd5e9-9189-4067-b3ca-9e2adb41fd9c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:08.758159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf07d1-b15b-480e-9789-1f68b5f18bd5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:08.766293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:08.767957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:08.769029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:08.772794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:08.774034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:08.786706 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3815/7659] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:08 2022] PUT /identity/v3/projects/6a77fc44d32545aa88c7b79f62216791/users/5dc73ab8bdb04c86a0247291b74f8d3e/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:08.805469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:08.807912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:08.808384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:08.930142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] MFA Rules not processed for user `5dc73ab8bdb04c86a0247291b74f8d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:08.934470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:09.057296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:09.063603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:09.111008 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3845/7660] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:09:09.168478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:09.281519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3816/7661] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:09.284012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:09.327206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a7035-3933-4509-9e30-bfcffd8ded9c service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:09.690677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:09.694589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:09.695114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:09.698617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:09.700222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:09.707544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:09.933691 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3846/7662] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:09 2022] POST /identity/v3/projects => generated 379 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:09.941413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:10.035785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd42a-c198-4eb8-8a7a-ea18e84f95e9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:10.360571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:10.362856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:10.370964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:10.374738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:10.384729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:10.389428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:10.577021 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3817/7663] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:09 2022] POST /identity/v3/users => generated 290 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:10.584373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:10.632633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938984a-26c1-4c7e-811b-f2d984cc43f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:10.672966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:10.674705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:10.676079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:10.677001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:10.678874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:10.682747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:10.758247 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3847/7664] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:10.767798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:10.826253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793c29c-dd7b-4610-8758-5145338986e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:10.855541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:10.863839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:10.864815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:10.868752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:10.870866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:10.881823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd592c1b-084c-4f04-8b9c-2a093c6b9243 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:10.961799 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3818/7665] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:10.970701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:10.992711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:11.005976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1f30-62cc-4427-aaec-e21c9629f08c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:11.042889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:11.044197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:11.044804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:11.045309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] PATH_INFO: `/v3/projects/ccd71b020c2c4acc9233636ce2106136/users/27443c2a7d2644839f728acfe0c20992/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:11.125992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd71b020c2c4acc9233636ce2106136, user_id=27443c2a7d2644839f728acfe0c20992, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:11.139751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:11.298413 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3848/7666] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:10 2022] PUT /identity/v3/projects/ccd71b020c2c4acc9233636ce2106136/users/27443c2a7d2644839f728acfe0c20992/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:11.316401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:11.317702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:11.318951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:11.499959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] MFA Rules not processed for user `27443c2a7d2644839f728acfe0c20992`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:11.502681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:11.908028 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3819/7667] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:11.917223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:12.248491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa290bd9-7dfc-4dac-b435-649d0d0f5cad admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:12.272835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:12.274467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:12.275286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:12.276272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:12.277981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:12.282193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:12.473984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3849/7668] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:11 2022] POST /identity/v3/projects => generated 379 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:09:12.481206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:12.541629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf044-fcb2-4a0d-8f57-977f647e78d3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:12.793867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:12.832059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:12.833205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:12.833689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:12.834424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:12.836066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:12.847669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:13.041627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:13.051266 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3820/7669] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:12 2022] POST /identity/v3/users => generated 296 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:13.115987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763654-6b36-4e81-9e45-65fcc4f30472 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:13.140885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:13.141647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:13.141930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:13.147640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:13.148739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:13.155996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:13.223994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3850/7670] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:13.231068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:13.287527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0594-6d93-42fb-9804-48c9fe51238b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:13.329902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:13.332367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:13.332924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:13.333213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] PATH_INFO: `/v3/projects/b1853cf218784584be1b64a70dcd2353/users/262548c4a87542958d33490164e967b7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:13.418525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1853cf218784584be1b64a70dcd2353, user_id=262548c4a87542958d33490164e967b7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:13.441885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:13.660120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3821/7671] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:13 2022] PUT /identity/v3/projects/b1853cf218784584be1b64a70dcd2353/users/262548c4a87542958d33490164e967b7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:13.662137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:13.712711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb61a0-df92-4566-ac8b-ad4c8170fa84 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:14.129722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:14.130892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:14.131473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:14.132007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:14.133365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:14.137153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015503bd-8fb2-4d8e-9642-533132989c07 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:14.185272 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3851/7672] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:09:14.192846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:14.241770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c3e8-5400-453d-af18-7aeaeb3415ae admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:14.270333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:14.271728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:14.272215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:14.272716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] PATH_INFO: `/v3/projects/b1853cf218784584be1b64a70dcd2353/users/262548c4a87542958d33490164e967b7/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:14.290480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1853cf218784584be1b64a70dcd2353, user_id=262548c4a87542958d33490164e967b7, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:14.299852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:14.353124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3822/7673] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:14 2022] PUT /identity/v3/projects/b1853cf218784584be1b64a70dcd2353/users/262548c4a87542958d33490164e967b7/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:14.374118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:14.374615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:14.375100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:14.526321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] MFA Rules not processed for user `262548c4a87542958d33490164e967b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:14.538150 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:14.836141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:15.163100 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3852/7674] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 791 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:15.193778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:15.198677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:15.527953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b5d0-46b6-48f7-b531-ceb034e618df admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:15.555717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:15.557098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:15.557840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:15.558506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:15.605768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:15.610824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:15.672725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3823/7675] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:09:15.988130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:16.002430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:16.054734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f123c-ede6-4463-a79f-3fbcd9602fd4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:16.068567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:16.070326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:16.071171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:16.072009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:16.291714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:16.295878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:16.339742 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3853/7676] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:19.034084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:19.038902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:19.533432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7e6cf-135b-4b44-aced-2d6988b60afa service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:19.566603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:19.571219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:19.571685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:19.572824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:19.585172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:19.628237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:19.632902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee0604-8582-439e-80de-15ba19b89f76 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:19.706281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3824/7677] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:09:26.338763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=39 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:29.663567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:32.562055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:32.564953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:33.303512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f41bb-aa39-4309-a233-fff48f32de7f service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:33.342591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:33.343710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:33.356991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:33.358962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] PATH_INFO: `/v3/users/29b8f22dee774118a711ad3bde4e2910` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:33.371189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b8f22dee774118a711ad3bde4e2910)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:33.376488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:33.847734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b8f22dee774118a711ad3bde4e2910'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:33.854879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b8f22dee774118a711ad3bde4e2910'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:34.042994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b8f22dee774118a711ad3bde4e2910'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:34.113075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b8f22dee774118a711ad3bde4e2910'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:34.155965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b8f22dee774118a711ad3bde4e2910'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:34.195862 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3854/7678] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:32 2022] DELETE /identity/v3/users/29b8f22dee774118a711ad3bde4e2910 => generated 0 bytes in 1629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:34.199462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:34.199462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:34.200463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:34.307456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:34.318601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:34.729869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:34.748015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:34.853545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3825/7679] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:34.870755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:34.873245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:35.321998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a1482-c0a9-447c-bc05-2d94332abf2a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:35.345791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:35.352533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:35.355840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:35.356892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:35.366749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565027-525c-44bd-afb4-b08b5b9aeb12 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:35.367946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:35.386404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:35.387624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:35.388104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:35.388512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:35.471332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:35.473807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:35.532162 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3826/7680] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:35.588569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:35.789415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:35.799497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355bf5e-4bc8-4900-8248-d15f755291cc service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:35.840322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3855/7681] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 1112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:37.697172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:37.697172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:37.772928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3f99-a16e-42dd-98ec-6fc084591403 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:37.798457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:37.800208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:37.803612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:37.804552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] PATH_INFO: `/v3/projects/d2227c0bff3a4d24894ea6838f5ffe54` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:37.809676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2227c0bff3a4d24894ea6838f5ffe54)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:37.814285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:38.291740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2227c0bff3a4d24894ea6838f5ffe54', 'request_id': 'req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:38.372847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2227c0bff3a4d24894ea6838f5ffe54', 'request_id': 'req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:38.456612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2227c0bff3a4d24894ea6838f5ffe54', 'request_id': 'req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:38.602879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] The token cache is being invalidate because project d2227c0bff3a4d24894ea6838f5ffe54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:38.603422 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:38.609475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e722c31b-a37f-4dfc-ba90-7dd1c9c120ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:38.628713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:38.629578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:38.629787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:38.638279 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3827/7682] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:37 2022] DELETE /identity/v3/projects/d2227c0bff3a4d24894ea6838f5ffe54 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:38.750037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:38.752545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:39.142597 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3856/7683] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:39.156693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:39.157534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:39.162503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:39.261199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:39.272084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:39.311678 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3828/7684] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:39.318923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:39.360749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074a991-31d2-4713-84b3-1a1f7d9fabf0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:39.393421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:39.393421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:39.393421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:39.394171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:39.395344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:09:39.397702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:39.400848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:39.486427 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3857/7685] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:09:39.493953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:39.543745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2662a-1eb3-44fd-aa4c-0d1c2c51d890 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:39.567176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:39.568246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:39.568685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:39.569153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:39.570345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:39.580556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:39.839720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:39.868608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:39.870551 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3829/7686] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:39 2022] POST /identity/v3/projects => generated 381 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:39.911421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6b78a-f6d1-4148-81cc-566312b07708 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:40.027389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:40.031982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:40.203093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:40.204586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:40.205100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:40.205970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:40.209672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:40.226957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:40.483180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3858/7687] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:39 2022] POST /identity/v3/users => generated 291 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:09:40.496156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:40.574926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883d70-c63e-4f01-a0e9-41c4db8781d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:40.589114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e0ffb-5da5-475d-96d2-d9c509d9f2ef admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:40.602917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:40.606957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:40.607567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:40.613420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:40.613420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:40.618928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:40.623664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:40.625030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:40.625543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:40.626070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] PATH_INFO: `/v3/users/5dc73ab8bdb04c86a0247291b74f8d3e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:40.637075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc73ab8bdb04c86a0247291b74f8d3e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:40.649546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:40.714389 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3859/7688] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:40.721854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:40.788146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46562a78-2aea-4085-80e4-3435856d46ed admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:40.851777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:40.852946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:40.853454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:40.863808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:40.878405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:40.900541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:41.017758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3860/7689] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:41.030949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:41.091004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ed1f-4b11-4cfd-8ace-49a125d53d45 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:41.140023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:41.141917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:41.151926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:41.155331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] PATH_INFO: `/v3/projects/33d541d013b340af99e4d79839f0fc14/users/52879ecc194c4e9985edc42e30d22f78/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:41.185562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc73ab8bdb04c86a0247291b74f8d3e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:41.221808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d541d013b340af99e4d79839f0fc14, user_id=52879ecc194c4e9985edc42e30d22f78, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:41.241718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1001c-4b2d-45d3-89bc-bd89655d68ad admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:41.421307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc73ab8bdb04c86a0247291b74f8d3e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:41.466262 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3861/7690] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:41 2022] PUT /identity/v3/projects/33d541d013b340af99e4d79839f0fc14/users/52879ecc194c4e9985edc42e30d22f78/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:41.466628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc73ab8bdb04c86a0247291b74f8d3e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:41.489115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:41.494403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:41.494403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:41.568636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:41.605685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc73ab8bdb04c86a0247291b74f8d3e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:41.620242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2920c2a4-1811-49e9-98f2-b38b410da7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc73ab8bdb04c86a0247291b74f8d3e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:41.656259 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3830/7691] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:40 2022] DELETE /identity/v3/users/5dc73ab8bdb04c86a0247291b74f8d3e => generated 0 bytes in 1630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:41.666009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:41.674054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:41.674839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:41.748924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] MFA Rules not processed for user `52879ecc194c4e9985edc42e30d22f78`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:41.762195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:41.833079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:41.844602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:42.180977 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3862/7692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 694 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:42.266550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3831/7693] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:42.277093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:42.280283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:42.383464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:42.403699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:42.538477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bd70-931d-4fc1-89d1-441bd81c2ba5 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:42.553629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:42.568219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:42.569441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:42.572325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:42.573003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:42.627579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:42.630695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:42.695732 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3863/7694] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:42.802428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:42.805327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:42.806885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2058-d25a-42a2-81ee-ca063f088a6e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:42.840073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:42.844810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:42.845281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:42.845754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:42.882387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99caef-2224-4830-bb16-4cf9eb752cda service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:42.919479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:42.921276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:42.921736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:42.922183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] PATH_INFO: `/v3/users/52879ecc194c4e9985edc42e30d22f78` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:42.930618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:42.932293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52879ecc194c4e9985edc42e30d22f78)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:42.935442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa15322-9f2a-468f-98bf-179b6192a677 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:42.936013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:43.016448 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3832/7695] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:43.391325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52879ecc194c4e9985edc42e30d22f78'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:43.400408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52879ecc194c4e9985edc42e30d22f78'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:43.535492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52879ecc194c4e9985edc42e30d22f78'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:43.608808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52879ecc194c4e9985edc42e30d22f78'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:43.643661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52879ecc194c4e9985edc42e30d22f78'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:43.675460 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3864/7696] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:42 2022] DELETE /identity/v3/users/52879ecc194c4e9985edc42e30d22f78 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:43.694461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:43.704230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:43.704230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:43.767505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:43.775080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:44.236481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3833/7697] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:44.324042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:44.330053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:44.397761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.636419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d68e7-26fa-4770-a5e5-cf873b4ac50d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:44.660098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:44.661270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:44.661807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:44.662294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:44.709752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:44.712868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:44.749023 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3865/7698] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:46.728519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:46.731681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:46.798983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb799-0bc8-4ecf-a232-c10a512d80f2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:46.822525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:46.826010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:46.827213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:46.833771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] PATH_INFO: `/v3/projects/6a77fc44d32545aa88c7b79f62216791` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:46.834593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a77fc44d32545aa88c7b79f62216791)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:46.844821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:47.182927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a77fc44d32545aa88c7b79f62216791', 'request_id': 'req-30d9bba3-295a-45bd-9665-88adf529ca50'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:47.227619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a77fc44d32545aa88c7b79f62216791', 'request_id': 'req-30d9bba3-295a-45bd-9665-88adf529ca50'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:47.258078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a77fc44d32545aa88c7b79f62216791', 'request_id': 'req-30d9bba3-295a-45bd-9665-88adf529ca50'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:47.449445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] The token cache is being invalidate because project 6a77fc44d32545aa88c7b79f62216791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:47.452342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:47.455044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:47.477679 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3834/7699] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:46 2022] DELETE /identity/v3/projects/6a77fc44d32545aa88c7b79f62216791 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:47.484697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:47.529730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e52581-e118-4a12-8e91-c231363238a8 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:48.009428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:48.010653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:48.020283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:48.034026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] PATH_INFO: `/v3/users/27443c2a7d2644839f728acfe0c20992` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:48.043328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27443c2a7d2644839f728acfe0c20992)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:48.052734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:48.567362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27443c2a7d2644839f728acfe0c20992'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:48.573610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27443c2a7d2644839f728acfe0c20992'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:48.746836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27443c2a7d2644839f728acfe0c20992'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:48.757897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:48.763807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:48.815732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27443c2a7d2644839f728acfe0c20992'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:48.827167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bba3-295a-45bd-9665-88adf529ca50 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:48.838675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:48.840408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:48.841292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:48.842537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] PATH_INFO: `/v3/projects/33d541d013b340af99e4d79839f0fc14` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:48.880656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d541d013b340af99e4d79839f0fc14)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:48.897424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:48.903952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-07810331-a0a6-4f55-8bcc-8f6a794c0d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27443c2a7d2644839f728acfe0c20992'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:48.973139 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3866/7700] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:47 2022] DELETE /identity/v3/users/27443c2a7d2644839f728acfe0c20992 => generated 0 bytes in 1485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:49.420468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:49.444075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d541d013b340af99e4d79839f0fc14', 'request_id': 'req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:49.471071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d541d013b340af99e4d79839f0fc14', 'request_id': 'req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:49.493751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d541d013b340af99e4d79839f0fc14', 'request_id': 'req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:49.725336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] The token cache is being invalidate because project 33d541d013b340af99e4d79839f0fc14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:49.725808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:49.728634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7b1a0a56-be5e-4c7c-85db-52afe4b083ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:49.738579 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3835/7701] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:48 2022] DELETE /identity/v3/projects/33d541d013b340af99e4d79839f0fc14 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:49.747508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:49.748662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:49.749001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:50.649901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:50.661815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:50.884158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:51.155841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:51.156838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:51.156838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:51.164573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3867/7702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 1418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:51.253103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:51.259930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:51.317688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:51.327903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3836/7703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:51.360893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:51.363932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:51.379780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db46f6f-fe71-473e-b369-6fccdc9434b9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:51.406338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:51.407275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:51.407666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:51.408164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:51.410476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:09:51.414114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:51.420757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953eba3-58f4-4cc4-9883-7ab4d7c916ff None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:51.438872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:51.446950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:51.449221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:51.449956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:51.450547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] PATH_INFO: `/v3/projects/ccd71b020c2c4acc9233636ce2106136` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:51.453233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd71b020c2c4acc9233636ce2106136)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:51.459735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:51.510096 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3868/7704] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:09:51.517954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:51.570127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79199-99c6-4628-81ba-60f753557dfe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:51.642211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:51.646513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:51.649533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:51.650121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:51.651458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:51.672067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:51.846936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd71b020c2c4acc9233636ce2106136', 'request_id': 'req-6629e50f-00c3-44d4-9ff2-657ca6b822d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:51.881655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd71b020c2c4acc9233636ce2106136', 'request_id': 'req-6629e50f-00c3-44d4-9ff2-657ca6b822d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:51.916132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd71b020c2c4acc9233636ce2106136', 'request_id': 'req-6629e50f-00c3-44d4-9ff2-657ca6b822d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:52.018443 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3869/7705] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:51 2022] POST /identity/v3/projects => generated 373 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:52.026274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:52.209091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] The token cache is being invalidate because project ccd71b020c2c4acc9233636ce2106136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:52.209962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:52.214489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:52.237539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3837/7706] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:51 2022] DELETE /identity/v3/projects/ccd71b020c2c4acc9233636ce2106136 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:52.246505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:52.263917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:52.394451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f314fc-0858-4700-9b23-fccd76173f04 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:52.421845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:52.423625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:52.424109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:52.426167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:52.431731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:52.442047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:52.611056 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3870/7707] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:52 2022] POST /identity/v3/users => generated 287 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:09:52.625800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:52.628369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e50f-00c3-44d4-9ff2-657ca6b822d2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:52.630228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:52.646773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:52.647992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:52.654963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:52.654963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] PATH_INFO: `/v3/users/262548c4a87542958d33490164e967b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:52.654963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=262548c4a87542958d33490164e967b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:52.658605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:52.696448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f189-7116-4ce0-8ba0-9b11737a55a8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:52.729764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:52.733901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:52.735390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:52.738134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:52.739869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:52.744425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:52.796520 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3871/7708] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:52.805007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:52.867968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f814c38-c2fb-4a25-aada-6f3f331c1197 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:52.900361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:52.906485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:52.907905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:52.913020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:52.916306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:52.932964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:53.008177 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3872/7709] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:09:53.030580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:53.065394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139d17-c1bc-4bdb-ae3b-7008296dccd6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:53.112438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:53.115570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:53.116075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:53.116534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] PATH_INFO: `/v3/projects/1722f6f84ba5452d99bb047ace7da15d/users/fda54166747f44bab1207fef57e977fc/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:53.142811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:53.152371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262548c4a87542958d33490164e967b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:53.204728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1722f6f84ba5452d99bb047ace7da15d, user_id=fda54166747f44bab1207fef57e977fc, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:53.218617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3c7ae-8bef-4266-9d08-83e376f7a983 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:53.313767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262548c4a87542958d33490164e967b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:53.345059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262548c4a87542958d33490164e967b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:53.424480 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3873/7710] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:09:53 2022] PUT /identity/v3/projects/1722f6f84ba5452d99bb047ace7da15d/users/fda54166747f44bab1207fef57e977fc/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:53.430338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262548c4a87542958d33490164e967b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:53.435239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262548c4a87542958d33490164e967b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:53.444844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:53.445890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:53.446586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:53.490097 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3838/7711] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:52 2022] DELETE /identity/v3/users/262548c4a87542958d33490164e967b7 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:53.586941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] MFA Rules not processed for user `fda54166747f44bab1207fef57e977fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:53.590329 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:53.749434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:53.924437 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3874/7712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:54.017953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:54.023013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:54.392832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040205-037b-4d11-853a-bf1e254b970e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:54.423491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:54.426658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:54.427052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:54.429358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:54.477330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:54.490296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1ddfb-c1fa-4a44-a832-2840e2e8090b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:54.535238 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3839/7713] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:09:54.626310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:54.636128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:54.912138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a881b1e-0a5b-4499-8060-d17e54543dcf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:54.929418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:54.930879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:54.931704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:54.932463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] PATH_INFO: `/v3/users/fda54166747f44bab1207fef57e977fc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:54.937088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda54166747f44bab1207fef57e977fc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:54.942191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:55.465406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda54166747f44bab1207fef57e977fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:55.472442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda54166747f44bab1207fef57e977fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:55.654967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda54166747f44bab1207fef57e977fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:55.738248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda54166747f44bab1207fef57e977fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:55.777752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda54166747f44bab1207fef57e977fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:55.793936 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3875/7714] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:09:54 2022] DELETE /identity/v3/users/fda54166747f44bab1207fef57e977fc => generated 0 bytes in 1169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:09:55.801636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:55.809324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:55.809324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:55.879405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:55.885655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:56.131702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:56.134987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:56.249511 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3840/7715] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:56.308615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:56.311229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:56.391608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:56.476471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01521-83a6-495f-86eb-045e1e7bc97b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:56.509489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:56.512836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:56.532953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:56.536554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] PATH_INFO: `/v3/projects/b1853cf218784584be1b64a70dcd2353` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:56.542561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1853cf218784584be1b64a70dcd2353)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:56.835903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:56.842321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff3e0-1419-42fd-94e4-602dc4883d93 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:56.842321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:56.842321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:56.842321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:56.845673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:56.845673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:56.845673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfef0-7fa6-4a3d-9c21-4ea0abf8be33 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:56.850940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3841/7716] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:09:58.268416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1853cf218784584be1b64a70dcd2353', 'request_id': 'req-9eb7d488-23c6-45c1-b76b-c6e043982ab0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:58.431019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1853cf218784584be1b64a70dcd2353', 'request_id': 'req-9eb7d488-23c6-45c1-b76b-c6e043982ab0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:58.452963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1853cf218784584be1b64a70dcd2353', 'request_id': 'req-9eb7d488-23c6-45c1-b76b-c6e043982ab0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:58.494382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] The token cache is being invalidate because project b1853cf218784584be1b64a70dcd2353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:09:58.495003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:58.500978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9eb7d488-23c6-45c1-b76b-c6e043982ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:58.518456 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3876/7717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:56 2022] DELETE /identity/v3/projects/b1853cf218784584be1b64a70dcd2353 => generated 0 bytes in 2378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:09:58.519183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:58.520356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:58.520356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:58.609392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:58.618320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:58.663020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:58.946840 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3842/7718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:09:58.959393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:58.960050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:58.961784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:59.054127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:09:59.056849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:59.115777 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3877/7719] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:09:59.116684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:59.143397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2c4d-d6ff-41e4-9b0f-074ea88f548d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:59.153414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:59.154556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:59.155162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:59.155720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:59.157637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:09:59.158098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:59.162212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:59.195305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3843/7720] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:09:59.199106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:59.218070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3878a-e8a2-40f8-80b1-4794e115b1ec None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:59.228384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:59.229693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:59.230090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:59.230651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:59.231869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:59.236931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:59.259426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:59.264872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:09:59.343590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc1105-7073-43da-895e-d37aa935e618 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:59.372531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:09:59.376082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:09:59.378272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:09:59.386810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] PATH_INFO: `/v3/projects/1722f6f84ba5452d99bb047ace7da15d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:09:59.395664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1722f6f84ba5452d99bb047ace7da15d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:09:59.415876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:09:59.525196 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3878/7721] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:09:59 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:09:59.533101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:09:59.848676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f2cf8-09b1-4358-b860-f9ae7a6ef748 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:09:59.861453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1722f6f84ba5452d99bb047ace7da15d', 'request_id': 'req-daffc8a0-c8d6-4ee0-96e6-340b2c854637'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:59.900354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1722f6f84ba5452d99bb047ace7da15d', 'request_id': 'req-daffc8a0-c8d6-4ee0-96e6-340b2c854637'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:09:59.937505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1722f6f84ba5452d99bb047ace7da15d', 'request_id': 'req-daffc8a0-c8d6-4ee0-96e6-340b2c854637'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:00.071612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] The token cache is being invalidate because project 1722f6f84ba5452d99bb047ace7da15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:00.072071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:00.078622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-daffc8a0-c8d6-4ee0-96e6-340b2c854637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:00.086063 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3844/7722] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:09:59 2022] DELETE /identity/v3/projects/1722f6f84ba5452d99bb047ace7da15d => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:00.095059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8bca-19d4-4214-b976-9d4e27014420 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.100250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8bca-19d4-4214-b976-9d4e27014420 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.100770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8bca-19d4-4214-b976-9d4e27014420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.109604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:00.123255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.127444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.127444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.127444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.127444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.128731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:00.179454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-45cc8bca-19d4-4214-b976-9d4e27014420 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:00.185626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45cc8bca-19d4-4214-b976-9d4e27014420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:00.232582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3845/7723] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:00.256606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.257162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.257670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.314905 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3879/7724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:09:59 2022] POST /identity/v3/users => generated 292 bytes in 784 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:10:00.321254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:00.329568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:00.390456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:00.397653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:00.418515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913d2f-39be-4974-9838-c8eb6ce77446 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:00.455304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.458002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.458940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.460290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.463468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.468383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:00.503761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3880/7726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:10:00.505858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:00.508357 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3846/7726] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:00.510588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:00.546570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc8af7-b89e-4ef8-9d9e-2f99eccfb775 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:00.569725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.575591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.577995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.579299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.581475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:00.583613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.587665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:00.590303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f34c-8dd5-4dfb-8b93-0285a1e4c952 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:00.616596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.618020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.618851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.619730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.627299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.630700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:00.677655 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3847/7727] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:00.690408 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3881/7728] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:00.690650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:00.695886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:00.737960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cef18d-3e78-4a2d-90e0-4897312bce9b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:00.756440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85db063-fe7f-4aa6-9e16-6f560d093a0d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:00.777102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.778142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.778908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.780061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.783497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.808270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:00.831481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:00.839415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:00.842923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:00.844839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] PATH_INFO: `/v3/projects/d744f9e8efd8419483c9040ad97d52b2/users/c4e6f020909d4472b32dafcfab37e7a7/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:00.961258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d744f9e8efd8419483c9040ad97d52b2, user_id=c4e6f020909d4472b32dafcfab37e7a7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:00.977212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:01.141868 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3882/7729] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:00 2022] POST /identity/v3/projects => generated 377 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:01.144062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:01.156166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:01.267126 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3848/7730] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:00 2022] PUT /identity/v3/projects/d744f9e8efd8419483c9040ad97d52b2/users/c4e6f020909d4472b32dafcfab37e7a7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:01.268877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:01.428992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:01.494337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca91-d2e9-49e8-a25c-40b09211e563 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:01.654901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111c710-209b-4f84-a6dc-762ac81f75f3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:01.697764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:01.699551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:01.700058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:01.700357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:01.701325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:01.704268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98738e0-2852-4b05-9d31-f6c7f0130cfa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:01.842242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:01.844541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:01.845366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:01.846207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] PATH_INFO: `/v3/users/24457d9efc564d55b1f5cc583d280881` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:01.849357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24457d9efc564d55b1f5cc583d280881)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:01.854699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:01.877256 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3849/7731] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:01 2022] POST /identity/v3/users => generated 289 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:01.887835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:01.888937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:01.889454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:02.009493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] MFA Rules not processed for user `c4e6f020909d4472b32dafcfab37e7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:02.011833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:02.226194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24457d9efc564d55b1f5cc583d280881'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:02.227552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24457d9efc564d55b1f5cc583d280881'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:02.238389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:02.294398 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3850/7732] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:02.294398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:02.354462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a542ab-83e6-4225-b8e8-5cf67f8c43d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:02.420616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:02.422377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:02.423579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:02.425076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:02.425773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:02.429196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:02.430225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24457d9efc564d55b1f5cc583d280881'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:02.455522 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3851/7733] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:02.457033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:02.485556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24457d9efc564d55b1f5cc583d280881'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:02.497468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4356-470f-4e10-b7f8-659ee77e1811 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:02.518341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24457d9efc564d55b1f5cc583d280881'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:02.539675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:02.541042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:02.541578 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3883/7734] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:01 2022] DELETE /identity/v3/users/24457d9efc564d55b1f5cc583d280881 => generated 0 bytes in 1399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:02.547351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:02.547351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:02.547351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:02.551873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:02.552322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:02.555499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:02.781733 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3852/7735] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:02 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:02.788689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:02.808217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:02.921225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fe0a7-4ce6-4add-bb90-96b75cfb793e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:03.063753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15306e50-d3e5-401a-8a08-7ecf79641aec admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:03.117371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:03.123022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.123735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.124419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.133792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:03.142904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:03.254589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:03.256002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.256648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.257356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.258827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:03.262272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:03.300647 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3884/7736] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 750 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:03.309640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:03.332933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf4b4-3040-4dae-b3a6-90a48ddf238b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:03.352611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:03.354455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.355516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.355979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] PATH_INFO: `/v3/projects/6dd02a08a4244a0e91744c1836682f7f/users/7dc9cb38840747e7932d5bef4be643e7/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.390085 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3853/7737] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:02 2022] POST /identity/v3/users => generated 298 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:03.392035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:03.448710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef7d12-0f10-43c1-96d4-cc88a9de3f7b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:03.470606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:03.472198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.472970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.473700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.474733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd02a08a4244a0e91744c1836682f7f, user_id=7dc9cb38840747e7932d5bef4be643e7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:03.475460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:03.485423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9833698-7299-4357-afaa-a0227f65786d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:03.486922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:03.490293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:03.526859 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3854/7738] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:03.533732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:03.562924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249419ee-d588-4880-815c-0c9d406026b9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:03.619730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:03.620973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.622494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.624049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] PATH_INFO: `/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05/users/ac5654beb3bf4d3da97fd577d7e55dff/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.718604 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3885/7739] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:03 2022] PUT /identity/v3/projects/6dd02a08a4244a0e91744c1836682f7f/users/7dc9cb38840747e7932d5bef4be643e7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:03.730959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=300f0d0cae2f4f12941efc9d1bfbee05, user_id=ac5654beb3bf4d3da97fd577d7e55dff, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:03.746502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:03.747515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:03.752497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:03.758079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:03.907765 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3855/7740] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:03 2022] PUT /identity/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05/users/ac5654beb3bf4d3da97fd577d7e55dff/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:03.914234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:04.010761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] MFA Rules not processed for user `7dc9cb38840747e7932d5bef4be643e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:04.023387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:04.312071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:04.334784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d71665-32fb-470e-865c-ae844a6ead5f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:04.375262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:04.376671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:04.377003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:04.380660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:04.389242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:04.412478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:04.483198 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3856/7741] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:04.489313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:04.498989 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3886/7742] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 757 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:04.523204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:04.524926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297367bc-72b6-445a-90b4-26d8059c1b28 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:04.526956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:04.543434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:04.544150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:04.545369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:04.545652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] PATH_INFO: `/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05/users/ac5654beb3bf4d3da97fd577d7e55dff/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:04.550637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=300f0d0cae2f4f12941efc9d1bfbee05, user_id=ac5654beb3bf4d3da97fd577d7e55dff, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:04.561974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b253c-7b12-4d08-ace7-fe40cfeacdef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:04.640892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3857/7743] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:04 2022] PUT /identity/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05/users/ac5654beb3bf4d3da97fd577d7e55dff/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:04.649800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:04.650757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:04.651568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:04.792035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] MFA Rules not processed for user `ac5654beb3bf4d3da97fd577d7e55dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:04.800696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:04.839888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c6bf-9aed-467a-9df5-b9bcb4c34c9d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:05.063334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:05.063334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:05.063334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:05.063334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:05.190184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3858/7744] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:05.192809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:05.203386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:05.244499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:05.244499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:05.270345 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3887/7745] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:10:05.273606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:05.281617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:05.441648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:05.450142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:05.558498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf08b-8977-4774-b62e-195ea04963e2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:05.558744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700b2-a6ce-4ed6-bb49-87010096001b service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:05.584829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:05.584829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:05.585867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:05.586673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] PATH_INFO: `/v3/projects/c709d51ca1644fd088da2b983c59270f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:05.587704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:05.593382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c709d51ca1644fd088da2b983c59270f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:05.605180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:05.612274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:05.628184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:05.636370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:05.716353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:05.721736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:05.801039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3888/7746] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:05.814742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:05.863716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bae67-26bd-4b70-9603-454c50e19169 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:05.981615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c709d51ca1644fd088da2b983c59270f', 'request_id': 'req-56bf2eda-260e-4913-a0e4-62960c606443'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.014239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c709d51ca1644fd088da2b983c59270f', 'request_id': 'req-56bf2eda-260e-4913-a0e4-62960c606443'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.038012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c709d51ca1644fd088da2b983c59270f', 'request_id': 'req-56bf2eda-260e-4913-a0e4-62960c606443'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.155205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:06.157591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:06.160236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:06.161564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] PATH_INFO: `/v3/users/7dc9cb38840747e7932d5bef4be643e7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:06.165199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc9cb38840747e7932d5bef4be643e7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:06.180358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:06.287019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] The token cache is being invalidate because project c709d51ca1644fd088da2b983c59270f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:06.287560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.296528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.308465 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3859/7747] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:05 2022] DELETE /identity/v3/projects/c709d51ca1644fd088da2b983c59270f => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:06.318145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:06.321783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:06.383887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2eda-260e-4913-a0e4-62960c606443 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:06.411243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:06.413082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:06.414173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:06.416398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] PATH_INFO: `/v3/users/e3763d8ad7384fb68b4d1abe655aa5fd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:06.418823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3763d8ad7384fb68b4d1abe655aa5fd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:06.425967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:06.598791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc9cb38840747e7932d5bef4be643e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.600637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc9cb38840747e7932d5bef4be643e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.843752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc9cb38840747e7932d5bef4be643e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:06.964398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc9cb38840747e7932d5bef4be643e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.006886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3763d8ad7384fb68b4d1abe655aa5fd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.036874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc9cb38840747e7932d5bef4be643e7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.069378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3889/7748] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:05 2022] DELETE /identity/v3/users/7dc9cb38840747e7932d5bef4be643e7 => generated 0 bytes in 1262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:07.071382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:07.075422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:07.231720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3763d8ad7384fb68b4d1abe655aa5fd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.252984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3763d8ad7384fb68b4d1abe655aa5fd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.286441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5c979-1775-4c86-ae27-5c7b09d980c2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:07.297142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:07.298673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:07.299312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:07.300099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:07.308548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3763d8ad7384fb68b4d1abe655aa5fd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.309819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c39c3ed9-59aa-4ce9-ad9a-cbcb5b70f147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3763d8ad7384fb68b4d1abe655aa5fd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:07.313148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:07.342287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3860/7749] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:06 2022] DELETE /identity/v3/users/e3763d8ad7384fb68b4d1abe655aa5fd => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:10:07.360929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:07.361503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:07.362190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:07.396001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:07.455386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:07.464756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:07.572561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:07.576247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:07.624415 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3890/7750] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:07.652023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:07.762058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3861/7751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:07.827784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:07.827784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:08.187017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f222-c50b-4f03-b375-d3e52d447187 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:08.482621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:08.483993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:08.484635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:08.485285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:08.544803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:08.549241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:08.583589 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3891/7752] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:09.253539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:09.256229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:09.292326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc32f-7b72-4b35-a93d-10324fd00d37 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:09.314183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:09.324598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:09.330420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:09.331428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] PATH_INFO: `/v3/users/c4e6f020909d4472b32dafcfab37e7a7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:09.334047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e6f020909d4472b32dafcfab37e7a7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:09.343251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:09.748284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:09.750854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:09.819778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b3750-5f0f-4380-8ab7-46936f5683c1 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:09.838870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:09.840512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:09.841806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:09.843846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] PATH_INFO: `/v3/projects/344137dbfa264c3da4c122557dc3e5b9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:09.850079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344137dbfa264c3da4c122557dc3e5b9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:09.859916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e6f020909d4472b32dafcfab37e7a7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:09.862257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:10.023598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e6f020909d4472b32dafcfab37e7a7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.047061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e6f020909d4472b32dafcfab37e7a7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.080496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e6f020909d4472b32dafcfab37e7a7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.081910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-533c6947-e7d8-4999-9a0b-844bb8af4a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e6f020909d4472b32dafcfab37e7a7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.102050 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3862/7753] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:09 2022] DELETE /identity/v3/users/c4e6f020909d4472b32dafcfab37e7a7 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:10.105461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.106149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.108430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.187423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:10.189479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:10.225990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344137dbfa264c3da4c122557dc3e5b9', 'request_id': 'req-bf1564cf-2efc-4007-b476-b661ab3f7e14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.370014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344137dbfa264c3da4c122557dc3e5b9', 'request_id': 'req-bf1564cf-2efc-4007-b476-b661ab3f7e14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.397070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344137dbfa264c3da4c122557dc3e5b9', 'request_id': 'req-bf1564cf-2efc-4007-b476-b661ab3f7e14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.454183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] The token cache is being invalidate because project 344137dbfa264c3da4c122557dc3e5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:10.459965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.464443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bf1564cf-2efc-4007-b476-b661ab3f7e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:10.469855 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3892/7754] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:09 2022] DELETE /identity/v3/projects/344137dbfa264c3da4c122557dc3e5b9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:10:10.479571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895ab5-40c0-41d9-8d9e-91ce3abde01b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.481201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895ab5-40c0-41d9-8d9e-91ce3abde01b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.482432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895ab5-40c0-41d9-8d9e-91ce3abde01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.523128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:10.534675 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3863/7755] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:10.573471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8e895ab5-40c0-41d9-8d9e-91ce3abde01b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:10.576383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8e895ab5-40c0-41d9-8d9e-91ce3abde01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:10.587040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:10.589953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:10.639433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3893/7756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:10.657557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.663773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.663773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.713484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:10.717005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:10.741617 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3894/7757] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:10.744765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:10.766842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac39ce-d953-40b4-9645-e1551dd4a7bd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:10.793514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:10.796228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.796754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.797247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.801667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:10.802208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:10.805558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:10.843782 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3895/7758] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:10.845361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:10.864716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:10.866430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fdb68-bcb4-4579-bf5e-8216354856ce None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:10.911880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c170f8-a546-4b83-8c14-3052504f2b0a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:10.919894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:10.922076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.923684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.924849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.937746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:10.942109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:10.944278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:10.945202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] PATH_INFO: `/v3/projects/6dd02a08a4244a0e91744c1836682f7f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:10.957362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd02a08a4244a0e91744c1836682f7f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:10.970871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:11.013589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:11.016056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:11.027426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:11.068860 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3864/7759] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:11.070962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:11.140317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda49c8-e594-455b-b6f4-0c9bc4a8bd62 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:11.151743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:11.154431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:11.154431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:11.155398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:11.157693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:11.160260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:11.356009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd02a08a4244a0e91744c1836682f7f', 'request_id': 'req-3018be22-25c7-4282-8a44-901ddae44cf5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:11.380460 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3865/7760] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:11 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:11.382840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:11.627916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf363a-2ead-45ca-af93-b86b35dfa4da admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:11.651737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:11.652823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:11.653370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:11.653988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:11.655405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:11.660497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:11.680843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd02a08a4244a0e91744c1836682f7f', 'request_id': 'req-3018be22-25c7-4282-8a44-901ddae44cf5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:11.728106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd02a08a4244a0e91744c1836682f7f', 'request_id': 'req-3018be22-25c7-4282-8a44-901ddae44cf5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:11.778764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] The token cache is being invalidate because project 6dd02a08a4244a0e91744c1836682f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:11.779883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:11.781009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3018be22-25c7-4282-8a44-901ddae44cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:11.788702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3896/7761] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:10 2022] DELETE /identity/v3/projects/6dd02a08a4244a0e91744c1836682f7f => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:11.798465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8f30-fbad-4b84-b04d-31e64a1eb954 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:11.798957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8f30-fbad-4b84-b04d-31e64a1eb954 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:11.799513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8f30-fbad-4b84-b04d-31e64a1eb954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:11.881677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0c9d8f30-fbad-4b84-b04d-31e64a1eb954 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:11.883665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0c9d8f30-fbad-4b84-b04d-31e64a1eb954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:11.897592 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3897/7762] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:11.943573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:11.947547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:11.948602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.013199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3866/7763] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:11 2022] POST /identity/v3/users => generated 286 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:12.014924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.028220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:12.075274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f2ef-b93e-4326-a34a-78f779d02e1c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:12.083746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:12.087168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:12.097444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:12.098919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.099602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.100189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.101649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:12.106279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:12.117291 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3898/7764] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:12.119855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.161636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37df86-78e4-44dc-960b-dae421e82efe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:12.163215 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3867/7765] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:12.170674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.198419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:12.201248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.202602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.203198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.217120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:12.218466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:12.223064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:12.228027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856ca5-f994-4a23-8904-a12984899038 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:12.261855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:12.262626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.262906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.263369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.264624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:12.267986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:12.297966 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3899/7766] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:12.299620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.319295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3868/7767] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:12.320975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.358707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccfe6f-9bf1-44ec-a78b-b9b3ca3c1506 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:12.360209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b3ef-cdc3-4241-bd67-85793ba6e3d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:12.378636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:12.380735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.385195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.386075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] PATH_INFO: `/v3/projects/7cb2191dcdac4efa82ae77913b14332b/users/28c9f2989ad74da49267e0b223dacaf8/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.394624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:12.399852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.400526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.401087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.403001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:12.410015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:12.456509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb2191dcdac4efa82ae77913b14332b, user_id=28c9f2989ad74da49267e0b223dacaf8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:12.465450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05bb1-99bc-4a27-89b6-dfbb69ea814d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:12.645430 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3869/7768] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:12 2022] PUT /identity/v3/projects/7cb2191dcdac4efa82ae77913b14332b/users/28c9f2989ad74da49267e0b223dacaf8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:12.657048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:12.657560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:12.660937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:12.727758 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3900/7769] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:12.729758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:12.773426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] MFA Rules not processed for user `28c9f2989ad74da49267e0b223dacaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:12.777598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:13.005618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b27f0-7219-4f82-90f2-ff8878656f43 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:13.035312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:13.036702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:13.038137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:13.038679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:13.040812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:13.068909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:13.206111 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3870/7770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:13.207723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:13.209487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:13.246084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:13.349245 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3901/7771] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:12 2022] POST /identity/v3/users => generated 290 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:13.349245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:13.360657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:13.383353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:13.475725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2359c36-6a90-4885-a042-2e5a7a045eb6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:13.495589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:13.497462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:13.498885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:13.501090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:13.505944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:13.545400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:13.549643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:13.621881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3871/7772] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:13.624013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:13.628019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad06e02-69c8-44a2-9b99-32fd5b8c8c28 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:13.644365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:13.646247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:13.647398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:13.648249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:13.688453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97a40-fab5-4841-96ca-528fd621c4b0 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:13.691349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:13.698582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:13.745384 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3902/7773] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:13.760743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:13.764585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:13.771284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:13.778077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:13.781659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:13.805904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:13.824515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:13.860384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b86e-da30-46b2-9628-06cc259109fb service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:13.883369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:13.884772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:13.885417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:13.886002 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3872/7774] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:13.887350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] PATH_INFO: `/v3/users/28c9f2989ad74da49267e0b223dacaf8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:13.892474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c9f2989ad74da49267e0b223dacaf8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:13.895831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:13.902193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:13.973478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c599-0514-46ed-b791-4c0c1e7b2988 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:14.040003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:14.044625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:14.045428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:14.048705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:14.050622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:14.077024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:14.182590 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3873/7775] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:14.182590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:14.189178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:14.262130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481fe18-a94b-4e91-8b4a-f4e48b88c4d4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:14.291820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:14.293014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:14.293529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:14.294037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] PATH_INFO: `/v3/projects/d744f9e8efd8419483c9040ad97d52b2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:14.300901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d744f9e8efd8419483c9040ad97d52b2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:14.305559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:14.404126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c9f2989ad74da49267e0b223dacaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.408886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c9f2989ad74da49267e0b223dacaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.568766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c9f2989ad74da49267e0b223dacaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.610397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c9f2989ad74da49267e0b223dacaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.628311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c9f2989ad74da49267e0b223dacaf8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.651267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3903/7776] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:13 2022] DELETE /identity/v3/users/28c9f2989ad74da49267e0b223dacaf8 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:14.654232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:14.657096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:14.755225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd744f9e8efd8419483c9040ad97d52b2', 'request_id': 'req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.841881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd744f9e8efd8419483c9040ad97d52b2', 'request_id': 'req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:14.879540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd744f9e8efd8419483c9040ad97d52b2', 'request_id': 'req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:15.047109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] The token cache is being invalidate because project d744f9e8efd8419483c9040ad97d52b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:15.047518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8795e-809d-495e-b539-b2841a41fc60 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:15.048944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:15.050244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5cd5923-a6a5-4269-97ae-67cff4ecdf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:15.061044 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3874/7777] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:14 2022] DELETE /identity/v3/projects/d744f9e8efd8419483c9040ad97d52b2 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:15.066168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed8aa-efeb-49dd-b2a6-10e4d8053f47 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:15.066640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed8aa-efeb-49dd-b2a6-10e4d8053f47 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:15.067333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed8aa-efeb-49dd-b2a6-10e4d8053f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:15.118002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:15.123198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-691ed8aa-efeb-49dd-b2a6-10e4d8053f47 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:15.128797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-691ed8aa-efeb-49dd-b2a6-10e4d8053f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:15.233658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:15.236474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:15.237487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:15.238470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] PATH_INFO: `/v3/projects/fd270530a4e94a9487b442782315e22b/users/b1831eee3edd4e5e978ff4d84f4ee282/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:15.279843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd270530a4e94a9487b442782315e22b, user_id=b1831eee3edd4e5e978ff4d84f4ee282, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:15.286678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:15.436686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:15.449652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3904/7778] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:14 2022] PUT /identity/v3/projects/fd270530a4e94a9487b442782315e22b/users/b1831eee3edd4e5e978ff4d84f4ee282/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:15.458303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:15.464540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:15.509118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3875/7779] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:15.511391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:15.511969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:15.512711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:15.663568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] MFA Rules not processed for user `b1831eee3edd4e5e978ff4d84f4ee282`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:15.666874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:15.931297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb926f-a208-4171-a2ec-eddfca46da4a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:15.955959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:15.957204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:15.957706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:15.959308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] PATH_INFO: `/v3/users/ac5654beb3bf4d3da97fd577d7e55dff` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:15.970274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5654beb3bf4d3da97fd577d7e55dff)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:15.983462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:16.064782 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3876/7780] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:16.069802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:16.073482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:16.305608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ba4c8-6eb3-4837-a99c-11336ae05861 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:16.322347 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:16.324667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:16.327518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:16.328477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:16.375933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:16.381056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:16.412046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3877/7781] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:16.413670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:16.416409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:16.451826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1dad-7577-4e27-8201-bec97d1c9094 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:16.462662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:16.463971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:16.464528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:16.465098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:16.467545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:16.477802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:16.516935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5654beb3bf4d3da97fd577d7e55dff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:16.518411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5654beb3bf4d3da97fd577d7e55dff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:16.620876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5654beb3bf4d3da97fd577d7e55dff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:16.718820 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3878/7782] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:16.721038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:16.724403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5654beb3bf4d3da97fd577d7e55dff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:16.765694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5654beb3bf4d3da97fd577d7e55dff'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:16.790637 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3905/7783] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:15 2022] DELETE /identity/v3/users/ac5654beb3bf4d3da97fd577d7e55dff => generated 0 bytes in 1340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:17.039546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b122f-34bd-47be-8a20-c8166987ba21 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:17.089285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:17.255728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:17.257352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:17.258316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:17.258828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:17.273376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:17.273376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:17.523531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3879/7784] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:16 2022] POST /identity/v3/users => generated 297 bytes in 804 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:17.529766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:17.532539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:17.583835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7018-2e7c-4b25-842e-68655dd71e56 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:17.604455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:17.606057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:17.608094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:17.608973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:17.610484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:17.620962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:17.663663 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3906/7785] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:17.664820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:17.713343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06445cf4-6f22-4d3c-8633-a4b3dfeadf88 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:17.728554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:17.729998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:17.730782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:17.731600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] PATH_INFO: `/v3/projects/108c28b1075f4b5595a1b88e64dd1306/users/66fd1209c0884a219152a676d376623a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:17.772593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108c28b1075f4b5595a1b88e64dd1306, user_id=66fd1209c0884a219152a676d376623a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:17.779334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:17.913676 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3880/7786] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:17 2022] PUT /identity/v3/projects/108c28b1075f4b5595a1b88e64dd1306/users/66fd1209c0884a219152a676d376623a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:10:17.921090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:17.945446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87340ba3-4581-417d-b554-0b87ae2bd8e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:18.010675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:18.095765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:18.099989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:18.190106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:18.191316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:18.191891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:18.192614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:18.194066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:18.198698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:18.240165 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3907/7787] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:18.275594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:18.340401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1087-df9d-4079-8364-ed3377e63290 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:18.375094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:18.376635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:18.377078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:18.378107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] PATH_INFO: `/v3/projects/108c28b1075f4b5595a1b88e64dd1306/users/66fd1209c0884a219152a676d376623a/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:18.389587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108c28b1075f4b5595a1b88e64dd1306, user_id=66fd1209c0884a219152a676d376623a, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:18.412657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8402d7c-a28e-448e-84ef-1ec5f7b564e3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:18.413385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52ccf-21a8-41ef-8a91-b0174ece4d24 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:18.425201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:18.425863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:18.427467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:18.427467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] PATH_INFO: `/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:18.429962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300f0d0cae2f4f12941efc9d1bfbee05)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:18.435156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:18.473955 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3908/7788] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:18 2022] PUT /identity/v3/projects/108c28b1075f4b5595a1b88e64dd1306/users/66fd1209c0884a219152a676d376623a/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:18.494435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:18.494727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:18.495125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:18.584666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] MFA Rules not processed for user `66fd1209c0884a219152a676d376623a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:18.589583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:18.865916 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3909/7789] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:18.868574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:18.893974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:18.946548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300f0d0cae2f4f12941efc9d1bfbee05', 'request_id': 'req-5e3a763c-ee8a-4bf7-8240-1044203d5f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:18.963831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300f0d0cae2f4f12941efc9d1bfbee05', 'request_id': 'req-5e3a763c-ee8a-4bf7-8240-1044203d5f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:18.988691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300f0d0cae2f4f12941efc9d1bfbee05', 'request_id': 'req-5e3a763c-ee8a-4bf7-8240-1044203d5f95'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:19.122207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] The token cache is being invalidate because project 300f0d0cae2f4f12941efc9d1bfbee05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:19.127292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:19.127292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:19.150118 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3881/7790] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:18 2022] DELETE /identity/v3/projects/300f0d0cae2f4f12941efc9d1bfbee05 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:19.168830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:19.178217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ff3cf-f51d-40b1-a9ad-a062ef7d206f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:19.192698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:19.258169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:19.508798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a763c-ee8a-4bf7-8240-1044203d5f95 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:19.515242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225faed5-e435-4d01-87de-726b646642af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:19.523794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225faed5-e435-4d01-87de-726b646642af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:19.523794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225faed5-e435-4d01-87de-726b646642af admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:19.524204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225faed5-e435-4d01-87de-726b646642af admin admin] PATH_INFO: `/v3/projects/7cb2191dcdac4efa82ae77913b14332b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:19.526501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:19.531109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:19.535399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:19.536486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225faed5-e435-4d01-87de-726b646642af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb2191dcdac4efa82ae77913b14332b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:19.537196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:19.540642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:19.548469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225faed5-e435-4d01-87de-726b646642af admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:19.558529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:19.878310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:19.881147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb2191dcdac4efa82ae77913b14332b', 'request_id': 'req-225faed5-e435-4d01-87de-726b646642af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:19.882032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a7e85-24c6-4b06-b0df-3c9d1c787d8c service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:19.906591 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3882/7791] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:19.909867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38e99-d3d0-4824-9bc0-04e4c649445e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:19.909867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38e99-d3d0-4824-9bc0-04e4c649445e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:19.910342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38e99-d3d0-4824-9bc0-04e4c649445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:19.963066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14c38e99-d3d0-4824-9bc0-04e4c649445e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:19.963066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14c38e99-d3d0-4824-9bc0-04e4c649445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:19.990655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb2191dcdac4efa82ae77913b14332b', 'request_id': 'req-225faed5-e435-4d01-87de-726b646642af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:20.024352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb2191dcdac4efa82ae77913b14332b', 'request_id': 'req-225faed5-e435-4d01-87de-726b646642af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:20.087221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] The token cache is being invalidate because project 7cb2191dcdac4efa82ae77913b14332b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:20.087706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:20.089388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-225faed5-e435-4d01-87de-726b646642af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:20.107338 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3910/7792] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:18 2022] DELETE /identity/v3/projects/7cb2191dcdac4efa82ae77913b14332b => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:20.126959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8581-6b4e-498b-8e1c-78709f9624c3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.127881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8581-6b4e-498b-8e1c-78709f9624c3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.128613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8581-6b4e-498b-8e1c-78709f9624c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.210806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3883/7793] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:20.219442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.219442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.219442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.297671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-26aa8581-6b4e-498b-8e1c-78709f9624c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:20.305233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-26aa8581-6b4e-498b-8e1c-78709f9624c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:20.334183 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3911/7794] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:20.350620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.357346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.357346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.357807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:20.357807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:20.413520 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3884/7795] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:20.427994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:20.442388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:20.445643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:20.463086 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3912/7796] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:20.470717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:20.504764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caa24d-a36e-4a5a-b6bc-01c892abdf96 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:20.534658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be58d0-26dd-42d1-9cac-703ec91ba534 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:20.563363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:20.565348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.565734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.569964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.579980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:20.579980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:20.585074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:20.585526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:20.631457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.632651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.633166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.648596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:20.657507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:20.658312 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3913/7797] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:20.662982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:20.665448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:20.679091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:20.709528 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3885/7798] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:20.711267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:20.750187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edbb0-cd94-49d1-984b-4f9804289e19 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:20.767458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:20.775712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.776899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.778271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.789583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:20.795261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:20.963401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e83fa-dddc-4cc7-b9ce-e0a3e4889b07 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:20.973407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:20.974357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:20.974829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:20.975352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:20.981156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:21.001197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3886/7799] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:20 2022] POST /identity/v3/projects => generated 361 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:21.005034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:21.117361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:21.240111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:21.298291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:21.323654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:21.359360 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3914/7800] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:21.359360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:21.384681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f2d8-152f-417d-940a-1cdc5b98d3c6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:21.403053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ad7c9-3220-4e95-a684-e3b042f717cc service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:21.405878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:21.407666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:21.408494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:21.409262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:21.410975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:21.422207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:21.424997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:21.431583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:21.431583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:21.431983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:21.432174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:21.432174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:21.719889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3915/7801] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:21 2022] POST /identity/v3/users => generated 281 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:21.758688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:21.764410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3887/7802] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:21 2022] POST /identity/v3/projects => generated 369 bytes in 761 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:21.771645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:21.792436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca83451-25ba-47c8-a665-3996aaecaa60 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:21.966221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:21.967812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:21.969955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:21.970711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:21.972759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:21.977618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:21.990525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f427ab-8b6c-4437-9416-9200a7b34e02 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.006848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.008383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.009282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.009928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.011690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.016478 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3916/7803] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:22.017454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:22.019029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:22.050039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b695e8-78e6-4d31-9032-978724e94c52 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.061800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.063320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.067394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.068198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.072424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.073931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:22.109312 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3917/7804] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:22.111045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:22.133713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce554-f210-4316-b7b3-ac73103526bd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.143126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.144513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.144892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.145507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] PATH_INFO: `/v3/projects/430280898887445cbb49578c05068491/users/c96b039b362e44c79c8fb30456d71398/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.198687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430280898887445cbb49578c05068491, user_id=c96b039b362e44c79c8fb30456d71398, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.205834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d0a3-9d9a-4ebe-a667-02f215eda5e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:22.231331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3888/7805] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:21 2022] POST /identity/v3/users => generated 285 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:22.238905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:22.270731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7316a-c56f-453a-81a1-844ae614f717 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.280538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.281866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.282504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.283098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.284499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.288045 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:22.316140 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3889/7806] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:22.318571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:22.353434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4122-d3ec-43d9-89f9-6708c953a538 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.364569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.369420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.369420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.369420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.369420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.373183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:22.420139 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3890/7807] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:22.428997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:22.433166 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3918/7808] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:22 2022] PUT /identity/v3/projects/430280898887445cbb49578c05068491/users/c96b039b362e44c79c8fb30456d71398/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:22.461235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.473176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.473176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.492705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621c858-cab7-40a3-8dc9-0e1a05ea4454 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:22.623754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] MFA Rules not processed for user `c96b039b362e44c79c8fb30456d71398`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:22.627369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:22.935767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:22.943346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:22.944637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:22.946426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] PATH_INFO: `/v3/projects/9181819ad614464a8696d62e4d0adae6/users/023b73321fc54009b1af2b103050a202/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:22.984467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9181819ad614464a8696d62e4d0adae6, user_id=023b73321fc54009b1af2b103050a202, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:22.990936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ebfa3-515d-4550-af50-d4e0eaa5e015 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:23.147682 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3919/7809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 690 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:23.211527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:23.241982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3891/7810] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:22 2022] PUT /identity/v3/projects/9181819ad614464a8696d62e4d0adae6/users/023b73321fc54009b1af2b103050a202/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:23.265245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:23.272614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:23.273284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:23.273726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:23.357300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:23.397477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] MFA Rules not processed for user `023b73321fc54009b1af2b103050a202`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:23.403880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:23.503067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404bda-5ea8-41fc-8d7b-2e4e5a3685ed None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:23.671932 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3892/7811] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:23.696237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:23.699421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:23.727176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:23.728811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:23.729652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:23.730398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:23.913602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6f89-7b89-43b9-8da5-a8d8b0d7439e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:23.937876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:23.937876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:23.937876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:23.943991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:23.964264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:23.966271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:23.970449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:23.977781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0fca-c8ad-4b37-9039-d04bf717a59f service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:24.014466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3893/7812] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:10:24.033569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3920/7813] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:24.079292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:24.461920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e48ef0-0eb4-4bb5-bbed-98b0ee4a38a2 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:24.489182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:24.497552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:24.498118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:24.498676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] PATH_INFO: `/v3/users/c96b039b362e44c79c8fb30456d71398` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:24.504430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96b039b362e44c79c8fb30456d71398)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:24.508647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:25.306726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:25.396927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96b039b362e44c79c8fb30456d71398'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:25.704150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96b039b362e44c79c8fb30456d71398'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:25.752257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96b039b362e44c79c8fb30456d71398'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:25.852399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96b039b362e44c79c8fb30456d71398'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:25.854157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96b039b362e44c79c8fb30456d71398'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:25.871479 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3894/7814] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:24 2022] DELETE /identity/v3/users/c96b039b362e44c79c8fb30456d71398 => generated 0 bytes in 1798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:25.879413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:25.880387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:25.880387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:25.923084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:25.926266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:26.106726 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3921/7815] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:26.131177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:26.134945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:26.406631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2dc8a-f9af-45ed-804c-8bca47cd19de admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:26.429761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:26.431043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:26.431575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:26.432064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:26.506907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:26.510270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e201-586d-4ba7-aaa5-bd932174717e service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:26.556660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3895/7816] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:28.293727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:28.298895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:28.409762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb07840-f05b-4820-896c-601a7de0ac4e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:28.450406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:28.451867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:28.454922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:28.455677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] PATH_INFO: `/v3/projects/430280898887445cbb49578c05068491` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:28.484870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] RBAC: Authorizing `identity:delete_project(project_id=430280898887445cbb49578c05068491)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:28.489062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:28.829618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:28.913123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430280898887445cbb49578c05068491', 'request_id': 'req-0a277bda-973c-48a6-8dfe-b6824433740c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:29.049046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430280898887445cbb49578c05068491', 'request_id': 'req-0a277bda-973c-48a6-8dfe-b6824433740c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:29.080092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430280898887445cbb49578c05068491', 'request_id': 'req-0a277bda-973c-48a6-8dfe-b6824433740c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:29.135072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] The token cache is being invalidate because project 430280898887445cbb49578c05068491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:29.136160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:29.141077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0a277bda-973c-48a6-8dfe-b6824433740c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:29.164290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3922/7817] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:28 2022] DELETE /identity/v3/projects/430280898887445cbb49578c05068491 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:29.171873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:29.172707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:29.172890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:29.264184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:29.266898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:29.727281 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3896/7818] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:29.739658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:29.740773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:29.741330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:29.793196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:29.799035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:29.831911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:29.843211 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3923/7819] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:29.859464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cdcf1-a8c1-4e6c-9c1c-66b3f97b7cfc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:29.878295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:29.879756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:29.880259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:29.880834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:29.882855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:29.883437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:29.888841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:29.972991 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3897/7820] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:29.974542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:30.073870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2bca6-af9b-46dc-8798-0d5bab617a20 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:30.141825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:30.143077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:30.143654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:30.144134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:30.149439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:30.165259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:30.462088 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3924/7821] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:29 2022] POST /identity/v3/projects => generated 375 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:30.469287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:30.539125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6a8d-e199-44c8-be98-36993fd2d577 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:30.763928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:30.925185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:30.926745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:30.927576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:30.928273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:30.929836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:30.939778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:31.230577 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3898/7822] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:30 2022] POST /identity/v3/users => generated 288 bytes in 758 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:10:31.232494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:31.329745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac2c-66f7-4fbb-ab00-230617e3f146 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:31.354740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:31.357075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:31.362404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:31.362404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:31.362404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:31.369810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:31.481655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:31.483892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3925/7823] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:10:31.560828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccf6cb-05ab-4f84-b69b-3ff13d4f3291 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:31.601900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:31.615974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:31.621213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:31.628479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:31.631269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:31.638757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d445cff-e170-48fb-a231-5f9b2c58b02f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:31.705616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3899/7824] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:31.712724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:31.767497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287abcc5-2951-456e-a574-ea542b9a9746 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:31.778947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:31.780628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:31.782087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:31.783757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] PATH_INFO: `/v3/projects/6a223df02fe9479887646ff547e066fb/users/79d1897795ed4116b169be9e731d1fe2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:31.859771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a223df02fe9479887646ff547e066fb, user_id=79d1897795ed4116b169be9e731d1fe2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:31.870594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:32.073005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3926/7825] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:31 2022] PUT /identity/v3/projects/6a223df02fe9479887646ff547e066fb/users/79d1897795ed4116b169be9e731d1fe2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:32.097873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:32.098266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:32.098556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:32.236021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] MFA Rules not processed for user `79d1897795ed4116b169be9e731d1fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:32.241321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:32.753957 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3900/7826] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 658 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:32.966365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:32.982452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:33.301248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed025-0c6b-42f5-880a-a90dc6454c5b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:33.317999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:33.319541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:33.320099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:33.320673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:33.365151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:33.372426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed79c-2c5c-4280-bce6-08bc7835d6e9 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:33.419233 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3927/7827] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:39.178839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:39.181296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:39.621084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9143240-64e6-4963-8831-c18785c50a7c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:39.661591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:39.663345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:39.664282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:39.665176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] PATH_INFO: `/v3/users/4c455d23998744ef80027ceddc797279` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:39.684837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c455d23998744ef80027ceddc797279)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:39.689997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:40.336355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c455d23998744ef80027ceddc797279'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:40.351616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:40.499266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c455d23998744ef80027ceddc797279'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:40.556114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c455d23998744ef80027ceddc797279'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:40.653782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c455d23998744ef80027ceddc797279'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:40.656532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c455d23998744ef80027ceddc797279'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:40.700187 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3901/7828] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:10:39 2022] DELETE /identity/v3/users/4c455d23998744ef80027ceddc797279 => generated 0 bytes in 1523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:40.707980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:40.708834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:40.718316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:40.796804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:40.799718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:41.086468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:41.126308 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3928/7829] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:41.147783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:41.150700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:41.341758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd43f-c6bf-4dd9-82af-2fda62e87e81 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:41.361006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:41.364893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:41.371004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:41.372891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:41.405381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:41.409375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eac07-91a3-44c0-82a0-7dad32e7b97d service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:41.446296 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3902/7830] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:10:42.126488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:42.129670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:42.191269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f50410-dc8f-4ed3-83fb-a2ec219a2c2b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:42.212671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:42.214325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:42.216366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:42.218408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] PATH_INFO: `/v3/projects/3e52093341534ca5a76295afd3cfd196` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:42.223099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e52093341534ca5a76295afd3cfd196)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:42.229820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:42.490897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e52093341534ca5a76295afd3cfd196', 'request_id': 'req-1cec6467-ded5-4e37-b797-ec67c8a37939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:42.597732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e52093341534ca5a76295afd3cfd196', 'request_id': 'req-1cec6467-ded5-4e37-b797-ec67c8a37939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:42.628901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e52093341534ca5a76295afd3cfd196', 'request_id': 'req-1cec6467-ded5-4e37-b797-ec67c8a37939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:42.690828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] The token cache is being invalidate because project 3e52093341534ca5a76295afd3cfd196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:10:42.691530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:42.692934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1cec6467-ded5-4e37-b797-ec67c8a37939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:10:42.701771 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3929/7831] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:10:42 2022] DELETE /identity/v3/projects/3e52093341534ca5a76295afd3cfd196 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:42.710818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:42.712847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:42.713718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:42.803475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:42.817625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:43.058074 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3903/7832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:10:43.064907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:43.065407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:43.065899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:43.145527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:43.149244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:43.214015 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3930/7833] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:43.222118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:43.250270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11683282-b845-46ae-9cd6-1368d7e1a38f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:43.260926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:43.263630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:43.264723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:43.265504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:43.267388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:10:43.268597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:43.296583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:43.340404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:43.345050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:43.350102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3904/7834] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:10:43.355248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:43.375277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3542-3c8b-45dd-9a87-4fa4d9ebf30c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:43.384484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:43.385782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:43.386403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:43.386875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:43.388757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:43.393594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:43.600306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07086582-d520-4a90-b89f-bfb379508bd3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:43.646812 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3905/7835] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:10:43 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:43.648658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:43.650000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:43.650490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:43.651004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:43.659654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:43.663469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:43.876518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:43.980704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:43.982265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54912-b388-4468-a2ac-ed71d3fc9a7f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:43.985127 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:43.994864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:43.998147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:43.998147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:43.998147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:43.999738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:44.004313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:44.010574 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3931/7836] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:44.255288 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3906/7837] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:10:43 2022] POST /identity/v3/users => generated 287 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:10:44.257309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:44.308785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0339ad-9c7f-4028-9f1a-7d42ce9726b0 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:44.336687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:44.338757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:44.343761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:44.343761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:44.343761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:44.358112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:44.420599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3932/7838] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:10:44.425751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:44.475932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eeef4-be2e-4c49-abf1-89c8fd55e85b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:44.530969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:44.532017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:44.532503 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:44.532990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:44.534582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:44.552729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8f534-29d5-418e-80f3-e2aa8f50fc27 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:44.660015 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3907/7839] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:10:44.671116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:44.711833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97b4e-b430-440a-8a67-35ef4ed3cc2c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:44.753935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:44.755319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:44.755933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:44.756559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] PATH_INFO: `/v3/projects/a34037cb630d41e494b57174b0726773/users/dfe5dc69fa534fc1922a54260a4292a2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:44.821301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:44.834120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34037cb630d41e494b57174b0726773, user_id=dfe5dc69fa534fc1922a54260a4292a2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:44.844525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:45.004903 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3933/7840] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:10:44 2022] PUT /identity/v3/projects/a34037cb630d41e494b57174b0726773/users/dfe5dc69fa534fc1922a54260a4292a2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:10:45.028767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:45.030628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:45.031221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:45.171054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] MFA Rules not processed for user `dfe5dc69fa534fc1922a54260a4292a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:10:45.176102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:45.566419 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3908/7841] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:10:45.618473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:10:45.622316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:10:45.936651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43575d-11f5-46e4-b19b-9ce916cfdb25 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:10:45.967528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:10:45.975852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:10:45.976382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:10:45.976837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:10:46.032791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:10:46.035624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:10:46.074685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3934/7842] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:10:55.533705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:56.054396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:05.365722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:05.368872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:05.792405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8e017-c666-4bc4-9bcb-a8a29fca5b4a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:05.826683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:05.829364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:05.831557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:05.833621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] PATH_INFO: `/v3/users/b1831eee3edd4e5e978ff4d84f4ee282` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:05.842627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1831eee3edd4e5e978ff4d84f4ee282)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:05.866932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:06.337442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1831eee3edd4e5e978ff4d84f4ee282'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:06.506309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1831eee3edd4e5e978ff4d84f4ee282'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:06.520099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:06.523657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:06.582056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1831eee3edd4e5e978ff4d84f4ee282'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:06.636202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee7ee-0299-4fe3-9316-098fc28fcbdc service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:06.664357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1831eee3edd4e5e978ff4d84f4ee282'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:06.666096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2c357ddf-7f1b-4fb7-8b92-26f73ecd3be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1831eee3edd4e5e978ff4d84f4ee282'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:06.689671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:06.693042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:06.694081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:06.694837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:06.698627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:06.709649 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3909/7843] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:11:05 2022] DELETE /identity/v3/users/b1831eee3edd4e5e978ff4d84f4ee282 => generated 0 bytes in 1346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:06.718244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:06.718244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:06.718688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:06.794128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:06.799000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:07.098107 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3910/7844] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:07.115377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:07.118192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:07.138701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:07.141810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:07.182976 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3935/7845] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:11:07.207302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.384074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5245440-baf0-4767-89d1-889ba3ca254d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:07.401052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:07.403162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:07.403973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:07.404770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:07.443830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:07.447197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:07.494262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3911/7846] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:11:11.680887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:11.698291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:11.797618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5529e-8fa6-46fd-99e7-628c068b0196 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:11.878681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:11.878681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:11.878681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:11.878681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] PATH_INFO: `/v3/projects/fd270530a4e94a9487b442782315e22b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:11.906232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd270530a4e94a9487b442782315e22b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:11.913158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:12.409781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd270530a4e94a9487b442782315e22b', 'request_id': 'req-5c7d0675-d197-40e7-bc13-164a141e25d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:12.560741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd270530a4e94a9487b442782315e22b', 'request_id': 'req-5c7d0675-d197-40e7-bc13-164a141e25d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:12.601107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd270530a4e94a9487b442782315e22b', 'request_id': 'req-5c7d0675-d197-40e7-bc13-164a141e25d2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:12.685012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] The token cache is being invalidate because project fd270530a4e94a9487b442782315e22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:11:12.686011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:12.689855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:12.720179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3936/7847] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:11 2022] DELETE /identity/v3/projects/fd270530a4e94a9487b442782315e22b => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:12.722270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:12.798780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c35c-9c38-476b-aace-05b5be3d8919 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:13.130563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:13.142430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:13.142430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:13.142430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] PATH_INFO: `/v3/users/66fd1209c0884a219152a676d376623a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:13.150977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fd1209c0884a219152a676d376623a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:13.161220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:13.666803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fd1209c0884a219152a676d376623a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:13.808618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fd1209c0884a219152a676d376623a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:13.856129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fd1209c0884a219152a676d376623a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:13.899065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fd1209c0884a219152a676d376623a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:13.900823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-86d15a80-0e54-402e-a625-deb997c82d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fd1209c0884a219152a676d376623a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:13.984915 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3912/7848] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:11:12 2022] DELETE /identity/v3/users/66fd1209c0884a219152a676d376623a => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:15.983389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:15.989399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:16.169761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0675-d197-40e7-bc13-164a141e25d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:16.544559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:16.552380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:16.554129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:16.556193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] PATH_INFO: `/v3/projects/108c28b1075f4b5595a1b88e64dd1306` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:16.571471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108c28b1075f4b5595a1b88e64dd1306)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:16.574540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:16.743548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:17.028164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108c28b1075f4b5595a1b88e64dd1306', 'request_id': 'req-492e060d-d687-4bfa-8669-df8dd8238fb7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:17.123331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108c28b1075f4b5595a1b88e64dd1306', 'request_id': 'req-492e060d-d687-4bfa-8669-df8dd8238fb7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:17.156502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108c28b1075f4b5595a1b88e64dd1306', 'request_id': 'req-492e060d-d687-4bfa-8669-df8dd8238fb7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:17.196571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] The token cache is being invalidate because project 108c28b1075f4b5595a1b88e64dd1306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:11:17.197717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:17.199726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-492e060d-d687-4bfa-8669-df8dd8238fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:17.214554 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3937/7849] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:15 2022] DELETE /identity/v3/projects/108c28b1075f4b5595a1b88e64dd1306 => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:17.216794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:17.218792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:17.219682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:17.311495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:17.317072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:17.639241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:17.784653 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3913/7850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:17.806577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:17.811924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:17.811924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:17.946618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:17.965674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:18.026314 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3938/7851] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:18.033620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:18.084654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758dfc8-be52-4989-b6a7-398e3695c6b8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:18.122935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:18.125367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:18.135984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:18.137612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:18.141977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:11:18.144379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:18.152893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:18.266939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:18.284758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3914/7852] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:11:18.297660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4288c-ddef-478f-898e-07dd234ea420 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:18.327741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:18.341459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:18.341459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:18.341459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:18.341459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:18.341459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:18.636878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3939/7853] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:18.643985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:18.725524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d135-9a7e-406c-930c-b28f26d9036e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:19.033195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:19.040297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:19.040953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:19.046932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:19.053956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:19.060600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:19.481656 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3915/7854] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:11:18 2022] POST /identity/v3/users => generated 287 bytes in 834 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:19.483856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:19.523386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5b6ac-d6b4-48cb-a78e-98e463fe0d67 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:19.554596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:19.556272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:19.563260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:19.573831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:19.573831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:19.583375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:19.587944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:19.592378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:19.650501 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3940/7855] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:19.671863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:19.724390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a1a1d-9b07-4045-8e80-600630e66677 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:19.746031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:19.747520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:19.748406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:19.749178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:19.750713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:19.755838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:19.793275 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3941/7856] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:19.796695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:19.850085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197b873-29cc-466c-9fe8-95057f8f67d3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:19.874399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:19.880406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:19.881172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:19.881701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] PATH_INFO: `/v3/projects/43cb06baa09b488cb469a222ee98f6eb/users/70e4816c9e0e44129f5f049ceb019490/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:19.975535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cb06baa09b488cb469a222ee98f6eb, user_id=70e4816c9e0e44129f5f049ceb019490, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:19.988683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d1c0-0d6e-42ec-b434-1e6d22824a69 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:20.077255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54163f70-132b-4a60-9a4d-4ee76d46be2e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:20.120323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:20.123584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:20.124274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:20.126037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:20.141177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:20.191061 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3942/7857] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:19 2022] PUT /identity/v3/projects/43cb06baa09b488cb469a222ee98f6eb/users/70e4816c9e0e44129f5f049ceb019490/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:20.224661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:20.225061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:20.225567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:20.361077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] MFA Rules not processed for user `70e4816c9e0e44129f5f049ceb019490`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:20.363071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:20.426878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:20.435381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:20.458605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:20.504694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3916/7858] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 918 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:20.864359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:20.867497 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3943/7859] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 644 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:20.946740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aadc57-a75c-4be4-8ada-e689bbfac1af service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:21.385841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:21.387662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:21.397611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:21.398126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:21.399471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:21.409143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:21.635547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3917/7860] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:11:20 2022] POST /identity/v3/projects => generated 373 bytes in 768 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:21.641653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:21.720741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07661e-1a53-4ede-9355-d838651b5a9e None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:21.943932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:22.181406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:22.182602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:22.204603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:22.218829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:22.218829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:22.221833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:22.435005 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3944/7861] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:11:21 2022] POST /identity/v3/users => generated 293 bytes in 787 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:22.435271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:22.502757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129128-cea3-4480-9d20-9f638f6bf05d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:22.527344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:22.529381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:22.538463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:22.538463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:22.538463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:22.557198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:22.633065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:22.634236 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3918/7862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:22.673413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60d83-f738-4df7-a2d3-638e5a69f06e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:22.727910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:22.731718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:22.731718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:22.732215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] PATH_INFO: `/v3/projects/789e4209fd3a4703aaac0c6409c8505d/users/2b2338206b8544009f652727744ab358/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:22.847260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=789e4209fd3a4703aaac0c6409c8505d, user_id=2b2338206b8544009f652727744ab358, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:22.868710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:23.069715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3945/7863] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:22 2022] PUT /identity/v3/projects/789e4209fd3a4703aaac0c6409c8505d/users/2b2338206b8544009f652727744ab358/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:23.077078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:23.129397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1de6cd-7a05-4b58-b2fd-7afefa7d501c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:23.593638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:23.601052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:23.601604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:23.609300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:23.611419 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:23.618662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7a348-ebb1-475c-bfed-fae59d697004 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:23.695647 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3919/7864] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 619 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:23.701616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:23.739332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c658-8675-4a2f-aaa5-bb9c73ecb5eb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:23.778444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:23.779625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:23.780115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:23.785427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] PATH_INFO: `/v3/projects/789e4209fd3a4703aaac0c6409c8505d/users/2b2338206b8544009f652727744ab358/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:23.796437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789e4209fd3a4703aaac0c6409c8505d, user_id=2b2338206b8544009f652727744ab358, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:23.817065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:23.896800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3946/7865] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:23 2022] PUT /identity/v3/projects/789e4209fd3a4703aaac0c6409c8505d/users/2b2338206b8544009f652727744ab358/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:11:23.917049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:23.921249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:23.922707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:24.155819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] MFA Rules not processed for user `2b2338206b8544009f652727744ab358`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:24.161234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:24.507620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:24.599488 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3920/7866] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 685 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:24.859363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:24.862750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:25.343015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281a05-1f3a-40b7-91fb-c660cc027363 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:25.403538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:25.406982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:25.413024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:25.413660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:25.491486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:25.510541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02ebc5-9745-4935-9e25-73d1121ad987 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:25.596346 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3947/7867] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:28.830456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:29.187611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f58f61-adec-4351-83b9-f9987ce03be5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:29.209168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:29.212944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:29.215929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:29.217527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] PATH_INFO: `/v3/users/70e4816c9e0e44129f5f049ceb019490` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:29.225296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e4816c9e0e44129f5f049ceb019490)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:29.237658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:29.666105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e4816c9e0e44129f5f049ceb019490'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:29.825781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e4816c9e0e44129f5f049ceb019490'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:29.855465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e4816c9e0e44129f5f049ceb019490'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:29.953558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e4816c9e0e44129f5f049ceb019490'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:29.956313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e4816c9e0e44129f5f049ceb019490'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:30.017395 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3921/7868] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:11:28 2022] DELETE /identity/v3/users/70e4816c9e0e44129f5f049ceb019490 => generated 0 bytes in 1187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:11:30.024770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:30.027366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:30.028858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:30.284889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:30.335317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:30.754323 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3948/7869] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 731 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:30.792212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:30.805054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:31.101388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2da7be-8884-4726-8ead-460206813608 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:31.132293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:31.137857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:31.138629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:31.139179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:31.197860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:31.201469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:31.256928 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3922/7870] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:33.363312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:33.368860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:33.536155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:33.797134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f38e-1ec3-40dd-8c96-47817aeddc60 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:33.828147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:33.829222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:33.829705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:33.830218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:33.854487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:34.302639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:34.305658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:34.331434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:34.333867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:34.425651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c5dc-34c9-462b-b62a-3d9004126c84 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:34.431790 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3949/7871] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 1071 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:34.451214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:34.452114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:34.452853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:34.453170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] PATH_INFO: `/v3/projects/43cb06baa09b488cb469a222ee98f6eb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:34.455641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cb06baa09b488cb469a222ee98f6eb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:34.470101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:34.571278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:34.899560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cb06baa09b488cb469a222ee98f6eb', 'request_id': 'req-ba989b40-2c58-48cb-bb57-81b260d6c4d8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:34.931515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cb06baa09b488cb469a222ee98f6eb', 'request_id': 'req-ba989b40-2c58-48cb-bb57-81b260d6c4d8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:34.958508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cb06baa09b488cb469a222ee98f6eb', 'request_id': 'req-ba989b40-2c58-48cb-bb57-81b260d6c4d8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:35.085241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] The token cache is being invalidate because project 43cb06baa09b488cb469a222ee98f6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:11:35.086144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:35.088010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:35.103577 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3923/7872] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:34 2022] DELETE /identity/v3/projects/43cb06baa09b488cb469a222ee98f6eb => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:11:35.110092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:35.166834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0025ab-2847-4e9c-b12b-66bb281383c3 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:35.640809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:35.645619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:35.648288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:35.656094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] PATH_INFO: `/v3/users/2b2338206b8544009f652727744ab358` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:35.657701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2338206b8544009f652727744ab358)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:35.666741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:36.429789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2338206b8544009f652727744ab358'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:36.435405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2338206b8544009f652727744ab358'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:36.563977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2338206b8544009f652727744ab358'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:36.623669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:36.690849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2338206b8544009f652727744ab358'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:36.724965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2dc1c300-7f26-4c98-9068-71c7a98eb52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2338206b8544009f652727744ab358'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:36.758019 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3950/7873] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:11:35 2022] DELETE /identity/v3/users/2b2338206b8544009f652727744ab358 => generated 0 bytes in 1643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:39.868998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:39.868998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:40.010152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989b40-2c58-48cb-bb57-81b260d6c4d8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:40.553078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:40.554270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:40.554794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:40.555535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] PATH_INFO: `/v3/projects/789e4209fd3a4703aaac0c6409c8505d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:40.559796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789e4209fd3a4703aaac0c6409c8505d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:40.564016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:41.022399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789e4209fd3a4703aaac0c6409c8505d', 'request_id': 'req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:41.069340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789e4209fd3a4703aaac0c6409c8505d', 'request_id': 'req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:41.114502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789e4209fd3a4703aaac0c6409c8505d', 'request_id': 'req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:41.295396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] The token cache is being invalidate because project 789e4209fd3a4703aaac0c6409c8505d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:11:41.295396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:41.298541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c4d8f41c-4b39-49b4-bf01-0eb4d53c7422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:11:41.329055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3924/7874] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:11:39 2022] DELETE /identity/v3/projects/789e4209fd3a4703aaac0c6409c8505d => generated 0 bytes in 1468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:41.336034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:41.337532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:41.338348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:41.457140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:41.468441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:41.836069 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3951/7875] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:41.852622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:41.852622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:41.852622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:42.019723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:42.025610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:42.069520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:42.071210 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3925/7876] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:42.125885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e2ef1-8b31-4434-beea-478eb4530dc1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:42.160102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:42.169902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:42.170615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:42.171301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:42.177039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:11:42.179460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:42.190317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:42.277151 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3952/7877] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:11:42.281728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:42.325149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8db03-fc2d-43cf-bf04-11439a29dd5b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:42.353381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:42.355501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:42.356227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:42.356963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:42.359031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:42.365672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:42.708958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3926/7878] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:42.711395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:42.734259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27257ee3-4f23-4e39-bb23-88d0e55bdcc9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:42.894348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:42.895403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:42.895933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:42.896463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:42.897970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:42.902366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:43.243824 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3953/7879] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:11:42 2022] POST /identity/v3/users => generated 284 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:43.251008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:43.287341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:43.306624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d13ba6-56a3-4bca-889c-f0b872a0a1eb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:43.341029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:43.342583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:43.343715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:43.344469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:43.351292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:43.363859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:43.405696 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3927/7880] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:43.412569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:43.444153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539484f-d86c-43f1-ba64-b499e9d9e051 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:43.477158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:43.479004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:43.480302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:43.481066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:43.482937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:43.487945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ea68-7feb-4453-88a0-b88e8851ee3d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:43.535670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:43.536565 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3954/7881] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:43.565685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054737-5d55-496c-bb98-f72a94734924 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:43.591804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:43.593570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:43.599272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:43.600229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] PATH_INFO: `/v3/projects/47cf882e978849a3aee16a0349ef07bd/users/92eca19eb87e4a45b1b197523a66836d/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:43.681963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cf882e978849a3aee16a0349ef07bd, user_id=92eca19eb87e4a45b1b197523a66836d, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:43.698933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:43.975990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3928/7882] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:43 2022] PUT /identity/v3/projects/47cf882e978849a3aee16a0349ef07bd/users/92eca19eb87e4a45b1b197523a66836d/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:43.992642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:43.995778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:43.996577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:44.195929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] MFA Rules not processed for user `92eca19eb87e4a45b1b197523a66836d`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:44.202543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:44.375517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:44.579620 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3955/7883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:11:44.586482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:44.891560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47168-a827-4ae3-b2cb-8beb963773f6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:44.919575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:44.920677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:44.921548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:44.921869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:44.923268 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:44.933865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:45.216734 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3929/7884] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:11:44 2022] POST /identity/v3/projects => generated 365 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:11:45.222592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:45.276533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d065d-ca45-4f1a-be3e-e69101f17764 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:45.751675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:45.752850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:45.753404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:45.753971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:45.767255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:45.774660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:46.048662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3956/7885] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:11:45 2022] POST /identity/v3/users => generated 289 bytes in 826 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:11:46.061718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:46.102509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04e92-b528-4b9a-a508-fa3942e60cd4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:46.124951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:46.126390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:46.128605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:46.129856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:46.136504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:46.140041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:46.263875 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3930/7886] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:46.266444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:46.304631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759523-0511-450a-bf3d-484c813c40e5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:46.325937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:46.332226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:46.332794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:46.333318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] PATH_INFO: `/v3/projects/f34863a2ee3847b2828adf3d8d9808db/users/ab2196d4657047e6a87ed292f79fdb35/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:46.407985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34863a2ee3847b2828adf3d8d9808db, user_id=ab2196d4657047e6a87ed292f79fdb35, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:46.420298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:46.635324 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3957/7887] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:46 2022] PUT /identity/v3/projects/f34863a2ee3847b2828adf3d8d9808db/users/ab2196d4657047e6a87ed292f79fdb35/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:46.648860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:46.684658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d157-f378-4105-81bd-edd2fc6bc1a7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:46.957575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:46.958732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:46.959427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:46.959937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:46.961216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:46.971642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79dedc-420b-4760-95fd-2a0be0e877d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:47.031707 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3931/7888] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:11:47.040209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:47.092858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa509-6000-40d2-ad42-88ea526b0eba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:47.139071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:47.140610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:47.144801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:47.145479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] PATH_INFO: `/v3/projects/f34863a2ee3847b2828adf3d8d9808db/users/ab2196d4657047e6a87ed292f79fdb35/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:47.196057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34863a2ee3847b2828adf3d8d9808db, user_id=ab2196d4657047e6a87ed292f79fdb35, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:47.224110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:47.264878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3958/7889] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:11:47 2022] PUT /identity/v3/projects/f34863a2ee3847b2828adf3d8d9808db/users/ab2196d4657047e6a87ed292f79fdb35/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:11:47.292814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:47.295577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:47.297401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:47.424629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] MFA Rules not processed for user `ab2196d4657047e6a87ed292f79fdb35`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:11:47.427687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:47.569016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:47.835740 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3932/7890] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:11:48.093416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:48.098877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:48.377361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a660-3f85-4700-a899-088ccfd4a2f7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:48.398028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:48.403909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:48.407806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:48.408625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:48.466546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:48.470754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:48.522289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3959/7891] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:49.220978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:49.269473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee68d7-7335-4ca1-9694-aaaa26a4adeb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:49.296058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:49.297641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:49.298533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:49.299188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:49.626489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:49.633175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:49.675830 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3933/7892] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:58.365177 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:58.369294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:58.548350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:58.678827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b70f-9833-449b-9169-2e11967be698 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:58.697235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:58.700775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:58.701721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:58.702542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:58.710323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:59.157295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:59.159886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:59.241162 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3960/7893] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 877 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:11:59.296899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:11:59.301096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:59.766462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc79e-b36c-4472-acd4-982c7cfd7184 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:11:59.809220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:11:59.810856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:11:59.815361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:11:59.816517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:11:59.831521 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:11:59.924982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:11:59.929220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:11:59.998646 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3934/7894] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:00.735123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:00.739486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:00.805011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883337ec-cd1f-4b94-8632-18f5280db49f service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:00.829114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:00.830364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:00.831605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:00.832256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:00.849568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:00.991805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:01.021801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:01.137671 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3961/7895] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:02.088052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:02.358109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:02.362842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:02.521560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:02.716535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142723-a5ce-4468-b580-0189d58aadd9 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:02.749614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:02.752368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:02.752368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:02.754003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] PATH_INFO: `/v3/users/92eca19eb87e4a45b1b197523a66836d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:02.759587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92eca19eb87e4a45b1b197523a66836d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:02.770590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:02.793522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a83-4b7e-423f-8add-fd0e17578723 service nova] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:02.804519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:02.805893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:02.806567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:02.807774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] PATH_INFO: `/v3/users/dfe5dc69fa534fc1922a54260a4292a2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:02.811513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe5dc69fa534fc1922a54260a4292a2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:02.815563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:03.465489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92eca19eb87e4a45b1b197523a66836d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.498776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe5dc69fa534fc1922a54260a4292a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.500063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe5dc69fa534fc1922a54260a4292a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.647817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92eca19eb87e4a45b1b197523a66836d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.716251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92eca19eb87e4a45b1b197523a66836d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.746516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92eca19eb87e4a45b1b197523a66836d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.760029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10be5bf2-9890-437e-baf1-342fb30257f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92eca19eb87e4a45b1b197523a66836d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.765583 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3935/7896] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:02 2022] DELETE /identity/v3/users/92eca19eb87e4a45b1b197523a66836d => generated 0 bytes in 1678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:03.776601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:03.777406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:03.777406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:03.807427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:03.808947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:03.818033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe5dc69fa534fc1922a54260a4292a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.822337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:03.875627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe5dc69fa534fc1922a54260a4292a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.917016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bab5ede6-c39d-4b4f-a5d0-eff29c97074c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe5dc69fa534fc1922a54260a4292a2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:03.955984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3962/7897] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:02 2022] DELETE /identity/v3/users/dfe5dc69fa534fc1922a54260a4292a2 => generated 0 bytes in 1595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:03.960618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:03.962675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:03.963920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:04.016797 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3936/7898] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:04.036697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:04.040284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:04.086675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:04.093427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:04.538940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf497d0-419f-4fef-8be3-493b4f990d13 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:04.569477 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3963/7899] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:04.602365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:04.780827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:04.936237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:04.942506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:04.943025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:04.943812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:05.014130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef4a7-efb6-45e4-a078-de9d1f2520fa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:05.030848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:05.031762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:05.031975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:05.032144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:05.032456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:05.048550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:05.082604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:05.101531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:05.151613 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3937/7900] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:05.165420 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3964/7901] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:06.804904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:06.808344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:06.915207 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0027-1efb-4636-9cdd-bab1500ebf1c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:06.952350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:06.953558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:06.954634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:06.960690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] PATH_INFO: `/v3/projects/a34037cb630d41e494b57174b0726773` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:06.964835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34037cb630d41e494b57174b0726773)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:06.977945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:07.420783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34037cb630d41e494b57174b0726773', 'request_id': 'req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:07.477462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34037cb630d41e494b57174b0726773', 'request_id': 'req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:07.536847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34037cb630d41e494b57174b0726773', 'request_id': 'req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:07.807762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:07.810348 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:07.832027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] The token cache is being invalidate because project a34037cb630d41e494b57174b0726773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:07.836617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:07.840811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2e0afe14-9ea0-4072-b2c2-0d7c226f126c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:07.866940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3938/7902] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:06 2022] DELETE /identity/v3/projects/a34037cb630d41e494b57174b0726773 => generated 0 bytes in 1058 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:07.875513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec592b0c-f3f8-4c2b-b91f-c7628da85c06 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:07.876424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec592b0c-f3f8-4c2b-b91f-c7628da85c06 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:07.877621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec592b0c-f3f8-4c2b-b91f-c7628da85c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:07.969863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51fbe7-adf8-42e4-b57d-3523be7dfed6 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:08.038934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ec592b0c-f3f8-4c2b-b91f-c7628da85c06 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:08.042815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ec592b0c-f3f8-4c2b-b91f-c7628da85c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:08.399262 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3939/7903] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:08.427821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:08.428438 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:08.428794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:08.554848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:08.557902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:08.642165 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3940/7904] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:08.649942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:08.662305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:08.663515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:08.664003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:08.664505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] PATH_INFO: `/v3/projects/47cf882e978849a3aee16a0349ef07bd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:08.698872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cf882e978849a3aee16a0349ef07bd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:08.718933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:08.722550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bd5b-d2cc-4e78-a429-1952f0f6fb90 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:08.757678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:08.759168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:08.759668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:08.760192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:08.761389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:08.761933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:08.772311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:08.860158 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3941/7905] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:08.872374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:08.950514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121170c-e30a-49cc-81d2-cf275721d229 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:08.959712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:09.003184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:09.005157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:09.005607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:09.006067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:09.014831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:09.031553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:09.281872 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3942/7906] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:08 2022] POST /identity/v3/projects => generated 375 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:09.289238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:09.300946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cf882e978849a3aee16a0349ef07bd', 'request_id': 'req-4028649a-3b35-42d3-9e0a-afdf4a068519'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:09.429376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:09.469492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cf882e978849a3aee16a0349ef07bd', 'request_id': 'req-4028649a-3b35-42d3-9e0a-afdf4a068519'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:09.513658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cf882e978849a3aee16a0349ef07bd', 'request_id': 'req-4028649a-3b35-42d3-9e0a-afdf4a068519'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:09.616618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] The token cache is being invalidate because project 47cf882e978849a3aee16a0349ef07bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:09.618292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:09.750059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:09.750059 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3965/7907] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:07 2022] DELETE /identity/v3/projects/47cf882e978849a3aee16a0349ef07bd => generated 0 bytes in 1835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:09.754881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:09.759596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:09.831219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a193-2aba-449f-99b5-a6bd3a334173 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:09.916092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:09.923043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:09.923547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:09.924038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:09.934984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:09.975780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:10.051625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028649a-3b35-42d3-9e0a-afdf4a068519 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:10.074948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:10.081044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:10.090131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:10.092294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] PATH_INFO: `/v3/users/ab2196d4657047e6a87ed292f79fdb35` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:10.102926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2196d4657047e6a87ed292f79fdb35)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:10.115546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:10.577243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3943/7908] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:09 2022] POST /identity/v3/users => generated 288 bytes in 1288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:10.583875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:10.598793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:10.723280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c556e5-6da2-4421-a154-e58a4bec6d50 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:10.789964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:10.790820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:10.792195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:10.792788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:10.793764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:10.802210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:10.903831 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3944/7909] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:10.910206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:10.943819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2196d4657047e6a87ed292f79fdb35'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:10.946599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2196d4657047e6a87ed292f79fdb35'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:11.005561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81eda-d227-4fd7-b46d-dba477ffc9f4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:11.033893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:11.036058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:11.036532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:11.037454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:11.039204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:11.043128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:11.099457 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3945/7910] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:11.106337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:11.156503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2196d4657047e6a87ed292f79fdb35'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:11.188112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23583f0-d8a6-419d-a1cf-426a02cbe9bb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:11.208719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:11.210494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:11.211339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:11.212076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] PATH_INFO: `/v3/projects/0779e5b76c44430e911be565c4fea829/users/a39a4b04a5224a779474cad78213b8b8/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:11.228000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2196d4657047e6a87ed292f79fdb35'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:11.288938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0779e5b76c44430e911be565c4fea829, user_id=a39a4b04a5224a779474cad78213b8b8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:11.296720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:11.308564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-80017b5f-e721-4e23-a996-b25a53d492bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2196d4657047e6a87ed292f79fdb35'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:11.367538 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3966/7911] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:09 2022] DELETE /identity/v3/users/ab2196d4657047e6a87ed292f79fdb35 => generated 0 bytes in 1618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:11.551795 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3946/7912] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:11 2022] PUT /identity/v3/projects/0779e5b76c44430e911be565c4fea829/users/a39a4b04a5224a779474cad78213b8b8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:11.575957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:11.576662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:11.578634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:11.712950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] MFA Rules not processed for user `a39a4b04a5224a779474cad78213b8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:11.719468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:11.796134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:12.194937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3967/7913] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 615 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:12.271197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:12.274870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:12.594729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a65de3-1600-4f65-a49d-b5328b5b4c32 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:12.615849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:12.617494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:12.621779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:12.628216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:12.696674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:12.700737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1849115-b60d-4719-bc1c-1c983919a5a0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:12.743586 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3947/7914] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:13.422452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:13.426279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:14.002492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dec92-c67f-466d-8152-5d6fb311e0d3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:14.044406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:14.047053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:14.047969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:14.048706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] PATH_INFO: `/v3/projects/f34863a2ee3847b2828adf3d8d9808db` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:14.061411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34863a2ee3847b2828adf3d8d9808db)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:14.066287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:14.365157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34863a2ee3847b2828adf3d8d9808db', 'request_id': 'req-450a6764-3d73-4494-bef5-3b35b6f5d941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:14.482407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34863a2ee3847b2828adf3d8d9808db', 'request_id': 'req-450a6764-3d73-4494-bef5-3b35b6f5d941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:14.509793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34863a2ee3847b2828adf3d8d9808db', 'request_id': 'req-450a6764-3d73-4494-bef5-3b35b6f5d941'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:14.577317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] The token cache is being invalidate because project f34863a2ee3847b2828adf3d8d9808db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:14.578299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:14.582529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-450a6764-3d73-4494-bef5-3b35b6f5d941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:14.590757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3968/7915] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:13 2022] DELETE /identity/v3/projects/f34863a2ee3847b2828adf3d8d9808db => generated 0 bytes in 1170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:14.600096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:14.603060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:14.604613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:14.716351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:14.718761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:14.900319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:14.936925 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3948/7916] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:14.953761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:14.959075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:14.959075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:15.170723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:15.188673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:15.261714 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3969/7917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:15.274564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:15.332113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9fb5-92cd-45fb-8825-d449ad88a5e4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:15.377988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:15.379014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:15.391569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:15.392251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:15.393669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:15.394430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:15.414018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:15.535573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3949/7918] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:15.538571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:15.592108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417d93-5f91-4f37-ac3e-fa5db5271aa8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:15.626973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:15.631261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:15.634301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:15.636894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:15.643054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:15.656868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:15.918631 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3970/7919] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:15 2022] POST /identity/v3/projects => generated 387 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:15.925883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:15.971401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180ba3-6f75-42ca-897c-fb3c5f3d6ba5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:16.360054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:16.361405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:16.361847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:16.362399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:16.363703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:16.381884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:16.548652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:16.552134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:16.590126 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3950/7920] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:15 2022] POST /identity/v3/users => generated 294 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:16.599872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:16.649538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1725-1481-4f7f-b9cb-dd85d091f0ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:16.658550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97e68-95e0-44c9-8967-f98cb6e052fd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:16.688479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:16.691619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:16.693079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:16.699354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:16.700172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:16.700390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:16.701241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] PATH_INFO: `/v3/users/a39a4b04a5224a779474cad78213b8b8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:16.701922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:16.704814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:16.708135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:16.715744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39a4b04a5224a779474cad78213b8b8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:16.766331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3951/7921] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:16.768523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:16.768856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:16.807914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c17ec-a2e9-42a6-9645-67c927d982f3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:16.825821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:16.829085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:16.830917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:16.832579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:16.834750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:16.838859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:16.846770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:16.903805 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3952/7922] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:16.906197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:16.939657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9854c-da6d-4926-b31f-b47f65613944 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:16.968476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:16.970376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:16.971323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:16.972143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] PATH_INFO: `/v3/projects/ee32caa86031417cb83d28b3143274f6/users/05690813b5dc402b8511e0bc9acf2c96/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:17.040310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee32caa86031417cb83d28b3143274f6, user_id=05690813b5dc402b8511e0bc9acf2c96, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:17.046956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad693-26d6-4bcc-b367-e9f95e134edb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:17.209666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39a4b04a5224a779474cad78213b8b8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:17.211077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39a4b04a5224a779474cad78213b8b8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:17.215791 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3953/7923] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:16 2022] PUT /identity/v3/projects/ee32caa86031417cb83d28b3143274f6/users/05690813b5dc402b8511e0bc9acf2c96/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:17.241876 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:17.242741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:17.243518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:17.384828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] MFA Rules not processed for user `05690813b5dc402b8511e0bc9acf2c96`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:17.387091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:17.419289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39a4b04a5224a779474cad78213b8b8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:17.489949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39a4b04a5224a779474cad78213b8b8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:17.540083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9f1bb51f-47a7-447e-93d9-541921fefbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39a4b04a5224a779474cad78213b8b8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:17.620426 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3971/7924] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:16 2022] DELETE /identity/v3/users/a39a4b04a5224a779474cad78213b8b8 => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:17.635331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:17.636210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:17.639455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:17.728061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:17.733246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:17.770773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3954/7925] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:17.778303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:17.789918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:17.867785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:18.026414 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3972/7926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:18.049058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:18.051807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:18.090203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4520ed0-8f9c-4fbd-9d17-10a658bb580e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:18.125132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:18.128705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:18.129306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:18.129756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:18.137320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:18.154846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:18.293341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3578da5-67d2-4fa4-94bb-9d8b7ba1c008 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:18.304028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:18.305674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:18.307434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:18.308203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:18.330396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:18.334473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:18.361586 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3973/7927] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:18.444612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:18.451694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3955/7928] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:17 2022] POST /identity/v3/projects => generated 385 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:18.511688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae1d4-96d4-4cf3-8aed-44276696fea4 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:18.719781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:18.932884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:18.939377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:18.945446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:18.946315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:18.950983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:18.966818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:19.252273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3974/7929] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:18 2022] POST /identity/v3/users => generated 299 bytes in 815 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:12:19.271672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:19.327908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10c36d-3f95-4fa6-818d-3d124a4c012f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:19.377435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:19.387018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:19.387641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:19.398358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:19.398358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:19.406265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:19.462466 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3956/7930] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:19.474224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:19.535098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9986c-af38-478d-ac8e-528c1180b955 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:19.609003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:19.611407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:19.616034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:19.619615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] PATH_INFO: `/v3/projects/10de91ae41b24aeeb79c61c2c06be38c/users/93339db084e64d4cb745870fb3d820fb/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:19.696779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10de91ae41b24aeeb79c61c2c06be38c, user_id=93339db084e64d4cb745870fb3d820fb, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:19.712172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:19.893143 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3975/7931] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:19 2022] PUT /identity/v3/projects/10de91ae41b24aeeb79c61c2c06be38c/users/93339db084e64d4cb745870fb3d820fb/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:19.900312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:19.977915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:19.982946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:19.992584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53dd56-94f9-47e0-a75d-44cc576fe61f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:20.357249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760397-4af3-4744-bc2e-d0ef0429cd4e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:20.421008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:20.422552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:20.423862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:20.423862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] PATH_INFO: `/v3/projects/0779e5b76c44430e911be565c4fea829` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:20.426431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0779e5b76c44430e911be565c4fea829)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:20.434014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:20.578814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:20.585102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:20.585696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:20.586209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:20.600610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:20.620746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:20.717817 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3957/7932] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 819 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:20.719804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:20.776142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582703e8-ac7b-46a5-bd02-d3e70c87b89d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:20.802765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:20.804248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:20.804712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:20.805100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] PATH_INFO: `/v3/projects/10de91ae41b24aeeb79c61c2c06be38c/users/93339db084e64d4cb745870fb3d820fb/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:20.839748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10de91ae41b24aeeb79c61c2c06be38c, user_id=93339db084e64d4cb745870fb3d820fb, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:20.856800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e850a-8344-4689-94d0-8448dd7ce16f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:20.947558 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3958/7933] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:20 2022] PUT /identity/v3/projects/10de91ae41b24aeeb79c61c2c06be38c/users/93339db084e64d4cb745870fb3d820fb/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:20.966717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44d09-74b5-412c-b208-e23c11ef29b1 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:20.967304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44d09-74b5-412c-b208-e23c11ef29b1 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:20.967826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44d09-74b5-412c-b208-e23c11ef29b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:20.995946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0779e5b76c44430e911be565c4fea829', 'request_id': 'req-901568a1-18a5-4e09-992f-b2457e749f12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:21.082380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0779e5b76c44430e911be565c4fea829', 'request_id': 'req-901568a1-18a5-4e09-992f-b2457e749f12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:21.103371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0779e5b76c44430e911be565c4fea829', 'request_id': 'req-901568a1-18a5-4e09-992f-b2457e749f12'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:21.150096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eec44d09-74b5-412c-b208-e23c11ef29b1 None None] MFA Rules not processed for user `93339db084e64d4cb745870fb3d820fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:21.161100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eec44d09-74b5-412c-b208-e23c11ef29b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:21.163192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] The token cache is being invalidate because project 0779e5b76c44430e911be565c4fea829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:21.163685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:21.170099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-901568a1-18a5-4e09-992f-b2457e749f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:21.182946 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3976/7934] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:19 2022] DELETE /identity/v3/projects/0779e5b76c44430e911be565c4fea829 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:21.192205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:21.193114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:21.194151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:21.350308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:21.357061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:21.620657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:21.777520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:21.812918 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3959/7935] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 846 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:21.961585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3977/7936] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 772 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:21.980796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:21.983283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:21.984681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:22.101044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:22.112011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:22.126239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:22.129666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:22.229446 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3960/7937] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:22.238010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:22.315376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27407-4c25-48ff-824b-0602f82206f3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:22.359712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:22.371363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:22.383380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:22.383964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:22.396516 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:22.397464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:22.408249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:22.556891 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3961/7938] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:22.561779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:22.589027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a14bbe-1fd9-4f6a-96f5-694c58faa42d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:22.615765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:22.616909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:22.617386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:22.617852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:22.620655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa8f1-513e-4703-81cd-8b1e4729713b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:22.643527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:22.645834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:22.648761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:22.651654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:22.655320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:22.656585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:22.659929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:22.669007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:22.759475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3978/7939] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:22.894550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3962/7940] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:22 2022] POST /identity/v3/projects => generated 381 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:22.902100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:22.948738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9d90-6d0b-423f-86e6-7fac72068934 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:23.387222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:23.387222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:23.387222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:23.387222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:23.389098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:23.391341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:23.612379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:23.622683 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3979/7941] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:22 2022] POST /identity/v3/users => generated 291 bytes in 722 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:23.676206 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0d91-7a35-4ce7-b301-c6cb1ee3c2c1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:23.743342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:23.756513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:23.757110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:23.757613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:23.758878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:23.783796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:23.884184 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3963/7942] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:23.890869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:23.943591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def959a-88d0-478b-a0f2-1622593f5311 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:23.972944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:23.975301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:23.976266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:23.977512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:23.985257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:24.026050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:24.103210 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3980/7943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:24.110241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:24.140251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44626323-995c-4c17-8bdd-81724539e936 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:24.171845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:24.176021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:24.183431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:24.184234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] PATH_INFO: `/v3/projects/757e296cd90844d6b44566881bb3c83b/users/308c685daba4470dad50a437a9052257/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:24.287646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757e296cd90844d6b44566881bb3c83b, user_id=308c685daba4470dad50a437a9052257, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:24.295296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:24.298974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:24.324013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f229a-6889-429a-9fd0-a962b1356ca7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:24.372519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c965-704d-4c0a-96cd-3e7207a03a14 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:24.403185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:24.403185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:24.403185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:24.403185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] PATH_INFO: `/v3/users/05690813b5dc402b8511e0bc9acf2c96` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:24.409317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05690813b5dc402b8511e0bc9acf2c96)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:24.421928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:24.460804 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3964/7944] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:24 2022] PUT /identity/v3/projects/757e296cd90844d6b44566881bb3c83b/users/308c685daba4470dad50a437a9052257/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:24.482951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306888-710f-4e14-8329-34e03be5adda None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:24.494871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306888-710f-4e14-8329-34e03be5adda None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:24.494871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41306888-710f-4e14-8329-34e03be5adda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:24.726667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-41306888-710f-4e14-8329-34e03be5adda None None] MFA Rules not processed for user `308c685daba4470dad50a437a9052257`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:24.746152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41306888-710f-4e14-8329-34e03be5adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:25.082319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:25.090310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05690813b5dc402b8511e0bc9acf2c96'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:25.091841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05690813b5dc402b8511e0bc9acf2c96'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:25.224814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05690813b5dc402b8511e0bc9acf2c96'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:25.268625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3965/7945] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 788 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:25.277881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41306888-710f-4e14-8329-34e03be5adda None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:25.296324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05690813b5dc402b8511e0bc9acf2c96'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:25.370705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-19e40bc1-1a18-44c5-aacf-f7574e78a105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05690813b5dc402b8511e0bc9acf2c96'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:25.400156 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3981/7946] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:24 2022] DELETE /identity/v3/users/05690813b5dc402b8511e0bc9acf2c96 => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:25.402837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:25.403374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:25.404696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:25.537900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:25.547658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:25.575939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41306888-710f-4e14-8329-34e03be5adda None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:25.701912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:26.073398 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3982/7947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:26.091788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:26.093585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:26.094401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:26.095220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:26.101512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:26.108089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:26.118445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:26.118628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:26.397073 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3966/7948] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:25 2022] POST /identity/v3/projects => generated 381 bytes in 1123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:12:26.408703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:26.412233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:26.455731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379fb13-d1ac-41d7-8cf8-20fee9b2997b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:26.753896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:26.760100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:26.761357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:26.765746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:26.771774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72f71-2b3f-4536-9cb0-4139993c3f43 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:26.798912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:26.800087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:26.800591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:26.801093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:26.802582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:26.807301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:26.830807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:26.840945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:26.918328 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3983/7949] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:27.120771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3967/7950] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:26 2022] POST /identity/v3/users => generated 297 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:27.121081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:27.186326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806d49a-5bd9-4541-b62c-ffd9ce89c045 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:27.234654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:27.242955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:27.247676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:27.250582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:27.261715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:27.279579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:27.351625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3984/7951] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:12:27.358255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:27.386209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c1e7c-97b7-4ddd-91b7-edfc96b5a170 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:27.421793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:27.423116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:27.423678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:27.424166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] PATH_INFO: `/v3/projects/b62f32c726df43ea992937358a5f09ae/users/dcc05f712bff45ffa8b9c9c7d19f3cca/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:27.527480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62f32c726df43ea992937358a5f09ae, user_id=dcc05f712bff45ffa8b9c9c7d19f3cca, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:27.534614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:27.977737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3968/7952] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:27 2022] PUT /identity/v3/projects/b62f32c726df43ea992937358a5f09ae/users/dcc05f712bff45ffa8b9c9c7d19f3cca/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:27.984735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:28.027896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e19e9-db62-44da-83d4-bba1bd6319ba admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:28.062152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:28.351831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:28.353480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:28.353995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:28.354504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:28.364409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:28.367718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f52c9-a80a-415c-ba9e-142b578f04be admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:28.434333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:28.442567 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3985/7953] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:28.468436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3bb9-c81b-4814-9b13-e19243ba162e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:28.497143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:28.498364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:28.498770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:28.499317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] PATH_INFO: `/v3/projects/b62f32c726df43ea992937358a5f09ae/users/dcc05f712bff45ffa8b9c9c7d19f3cca/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:28.503494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62f32c726df43ea992937358a5f09ae, user_id=dcc05f712bff45ffa8b9c9c7d19f3cca, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:28.515579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:28.577064 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3969/7954] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:28 2022] PUT /identity/v3/projects/b62f32c726df43ea992937358a5f09ae/users/dcc05f712bff45ffa8b9c9c7d19f3cca/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:28.597700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:28.598016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:28.598323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:28.736555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] MFA Rules not processed for user `dcc05f712bff45ffa8b9c9c7d19f3cca`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:28.743389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:29.096951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3986/7955] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:29.122796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:29.126480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:29.365708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:29.368445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:29.384284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c105596-ed60-42db-b9b9-7179320e59ed admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:29.408293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:29.409294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:29.409757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:29.410214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:29.455505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:29.466252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:29.498442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:29.526848 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3970/7956] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:29.946455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14e18-5e10-4d36-9ef8-16096e620072 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:29.974262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:29.976661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:29.977505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:29.981501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] PATH_INFO: `/v3/projects/ee32caa86031417cb83d28b3143274f6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:29.998199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee32caa86031417cb83d28b3143274f6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:30.022559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:30.419788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:30.464607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee32caa86031417cb83d28b3143274f6', 'request_id': 'req-3ad21afd-72dc-4983-8027-9e40000d1054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:30.682660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee32caa86031417cb83d28b3143274f6', 'request_id': 'req-3ad21afd-72dc-4983-8027-9e40000d1054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:30.710336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee32caa86031417cb83d28b3143274f6', 'request_id': 'req-3ad21afd-72dc-4983-8027-9e40000d1054'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:30.768529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] The token cache is being invalidate because project ee32caa86031417cb83d28b3143274f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:30.769693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:30.771756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:30.776475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3987/7957] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:29 2022] DELETE /identity/v3/projects/ee32caa86031417cb83d28b3143274f6 => generated 0 bytes in 1422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:30.784140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:30.829120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d43-7c3c-4a28-ab2b-5185f7f7d644 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:31.159409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:31.159409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:31.159409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:31.159409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] PATH_INFO: `/v3/users/93339db084e64d4cb745870fb3d820fb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:31.168253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93339db084e64d4cb745870fb3d820fb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:31.183467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:31.765427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93339db084e64d4cb745870fb3d820fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:31.967891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93339db084e64d4cb745870fb3d820fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:32.034811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93339db084e64d4cb745870fb3d820fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:32.185973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93339db084e64d4cb745870fb3d820fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:32.190846 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93339db084e64d4cb745870fb3d820fb'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:32.238317 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3971/7958] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:30 2022] DELETE /identity/v3/users/93339db084e64d4cb745870fb3d820fb => generated 0 bytes in 1455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:32.699758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:32.706914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:33.059712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21afd-72dc-4983-8027-9e40000d1054 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:33.370216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc05f712bff45ffa8b9c9c7d19f3cca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b62f32c726df43ea992937358a5f09ae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:33.375872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:33.378117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:33.380376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:33.391424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:33.391424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:33.396986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:33.542443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:33.551243 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3988/7959] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 848 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:33.552421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:33.650595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27338e-972a-48a5-b730-d894820346fb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:33.693358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc05f712bff45ffa8b9c9c7d19f3cca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b62f32c726df43ea992937358a5f09ae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:33.695432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:33.711585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:33.711585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:33.719595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:33.727327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:34.037555 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3972/7960] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:33 2022] POST /identity/v3/projects => generated 355 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:12:34.042011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:34.116255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9f582-11df-4633-8487-e4fadcc370db tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:34.576952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:34.581783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:34.582122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc05f712bff45ffa8b9c9c7d19f3cca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b62f32c726df43ea992937358a5f09ae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:34.588795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:34.589677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:34.590202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:34.597366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:34.598169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:34.612247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:34.681804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.726092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3989/7961] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 681 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:12:34.943795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:35.002692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806820-827f-4e3b-875f-236557ac7b87 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:35.049112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc05f712bff45ffa8b9c9c7d19f3cca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b62f32c726df43ea992937358a5f09ae', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:35.051539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:35.052392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:35.057723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] PATH_INFO: `/v3/projects/69acb9a8b5c4421b996e682ee566be77` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:35.061063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69acb9a8b5c4421b996e682ee566be77)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:35.074043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:35.194781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:35.214540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6e9bb-3c4c-4393-9dac-95d8a0c82d71 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:35.225633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:35.233968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:35.234950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:35.235738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] PATH_INFO: `/v3/projects/10de91ae41b24aeeb79c61c2c06be38c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:35.238335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=10de91ae41b24aeeb79c61c2c06be38c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:35.250754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:35.601391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69acb9a8b5c4421b996e682ee566be77', 'request_id': 'req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.699187 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10de91ae41b24aeeb79c61c2c06be38c', 'request_id': 'req-e5d900cb-f0cc-4ade-b210-d3df900678ba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.744719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10de91ae41b24aeeb79c61c2c06be38c', 'request_id': 'req-e5d900cb-f0cc-4ade-b210-d3df900678ba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.767770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10de91ae41b24aeeb79c61c2c06be38c', 'request_id': 'req-e5d900cb-f0cc-4ade-b210-d3df900678ba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.844013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69acb9a8b5c4421b996e682ee566be77', 'request_id': 'req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.880107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69acb9a8b5c4421b996e682ee566be77', 'request_id': 'req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.963249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] The token cache is being invalidate because project 69acb9a8b5c4421b996e682ee566be77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:35.964250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.973020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d55066d3-0f4b-4a09-9e9e-350ed6fadfc6 tempest-VolumeQuotaClassesTest-1567483431 tempest-VolumeQuotaClassesTest-1567483431-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:35.980745 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3990/7962] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:34 2022] DELETE /identity/v3/projects/69acb9a8b5c4421b996e682ee566be77 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:36.094561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] The token cache is being invalidate because project 10de91ae41b24aeeb79c61c2c06be38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:36.095576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:36.096928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e5d900cb-f0cc-4ade-b210-d3df900678ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:36.101882 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3973/7963] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:34 2022] DELETE /identity/v3/projects/10de91ae41b24aeeb79c61c2c06be38c => generated 0 bytes in 1526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:36.109598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:36.111178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:36.111984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:36.278894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:36.281997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:36.697184 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3991/7964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:36.716490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:36.720882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:36.722002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:36.872706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:36.887687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:36.936428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3974/7965] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:36.955001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:37.030471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758d96c-c71d-4855-8e3f-1fd4ba3c7ca8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:37.062169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:37.063285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:37.064043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:37.064562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:37.065890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:37.069945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:37.078497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:37.206880 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3992/7966] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:37.212625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:37.302156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034308-d819-4ebd-9533-1ac13d6208a6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:37.356313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:37.357732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:37.358146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:37.358727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:37.360073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:37.385173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:37.719200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:37.731944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:37.744027 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3975/7967] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:37 2022] POST /identity/v3/projects => generated 389 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:37.751984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:37.792230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f892-e3fd-49fc-9ddd-c8b31740c90d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:38.183359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15010e-d4a1-4c4c-ad46-f4137f4efde8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:38.214313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:38.217763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:38.221015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:38.222188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:38.225112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:38.241068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:38.303511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:38.309181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:38.314259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:38.314259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] PATH_INFO: `/v3/users/308c685daba4470dad50a437a9052257` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:38.325508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308c685daba4470dad50a437a9052257)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:38.355846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:38.428884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:38.490271 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3976/7968] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:37 2022] POST /identity/v3/users => generated 295 bytes in 740 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:38.506094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:38.580858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3e0b-438a-4f40-bddf-06739f20fb53 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:38.597604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:38.601950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:38.603565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:38.605024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:38.607036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:38.612307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:38.695208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3977/7969] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:38.702339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:38.735593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6560c13-7e8c-484a-8935-3316c2c1112f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:38.763404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:38.766082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:38.767040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:38.768165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:38.771616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:38.782380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:38.848278 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3978/7970] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:12:38.853929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:38.895619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eac338-2f7c-49d8-863e-ab51624d5886 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:38.919723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:38.923726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:38.924705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:38.932529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] PATH_INFO: `/v3/projects/3368bcc2a4714a3d821f7406d6db02fd/users/4625b3d623f8490a996cc65807aec9a4/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:39.006387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3368bcc2a4714a3d821f7406d6db02fd, user_id=4625b3d623f8490a996cc65807aec9a4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:39.017562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d4230-93d7-4fd1-8b49-ff340f2c2e54 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:39.024257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308c685daba4470dad50a437a9052257'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:39.028542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308c685daba4470dad50a437a9052257'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:39.161406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3979/7971] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:38 2022] PUT /identity/v3/projects/3368bcc2a4714a3d821f7406d6db02fd/users/4625b3d623f8490a996cc65807aec9a4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:39.179853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489fe2-4757-4803-be30-570e72738907 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:39.181427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489fe2-4757-4803-be30-570e72738907 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:39.182290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489fe2-4757-4803-be30-570e72738907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:39.184477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308c685daba4470dad50a437a9052257'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:39.244759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:39.298872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308c685daba4470dad50a437a9052257'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:39.358827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6473c328-99e5-4d4c-9ad6-c71b34b04924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308c685daba4470dad50a437a9052257'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:39.393052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-db489fe2-4757-4803-be30-570e72738907 None None] MFA Rules not processed for user `4625b3d623f8490a996cc65807aec9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:39.409289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db489fe2-4757-4803-be30-570e72738907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:39.413780 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3993/7972] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:37 2022] DELETE /identity/v3/users/308c685daba4470dad50a437a9052257 => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:39.430547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:39.433849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:39.440103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:39.579176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:39.591916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:39.854167 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3980/7973] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 676 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:39.861116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489fe2-4757-4803-be30-570e72738907 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:39.867461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db489fe2-4757-4803-be30-570e72738907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:40.041101 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3994/7974] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:40.060952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:40.068781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:40.405060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489fe2-4757-4803-be30-570e72738907 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:40.456200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:40.456891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:40.457468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:40.458298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:40.460453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:40.467917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:40.509295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff520867-d301-4cf8-96de-bb14c85e2fb6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:40.527353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:40.529179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:40.529747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:40.530606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:40.573076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:40.582479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:40.611612 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3995/7975] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:40.711668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3981/7976] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:39 2022] POST /identity/v3/projects => generated 393 bytes in 857 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:40.715777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:40.815384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ce9a-195d-474b-a274-cb91480db82b service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:40.979386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:41.099783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:41.109741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:41.115421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:41.115421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:41.115421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:41.117164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:41.404543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3996/7977] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:40 2022] POST /identity/v3/users => generated 303 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:41.405972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:41.473828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8a93-f588-4563-aee5-1e03b8d0f783 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:41.498620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:41.501996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:41.508329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:41.509622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:41.517724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:41.526918 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:41.576098 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3982/7978] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:41.583314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:41.634824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebed60b-0bf2-4db3-bab4-21ceea3de555 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:41.688882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:41.690996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:41.691862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:41.693078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] PATH_INFO: `/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc/users/df186bfe199340dbb714965565951d89/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:41.838627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fb6ec2d9524a8f8d558e1f8a9de5cc, user_id=df186bfe199340dbb714965565951d89, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:41.845296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:42.034039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3997/7979] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:41 2022] PUT /identity/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc/users/df186bfe199340dbb714965565951d89/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:42.045692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:42.077120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999a61f-9219-4ab2-87a4-8a81b02dda33 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:42.480370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:42.486094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:42.487088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:42.489398 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:42.494265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:42.502497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:42.548610 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3983/7980] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:42.557414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:42.622236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769aa1-3f8c-4536-bb69-85213ddbbfa6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:42.628917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:42.632170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:42.634690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:42.637624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] PATH_INFO: `/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc/users/df186bfe199340dbb714965565951d89/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:42.646440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fb6ec2d9524a8f8d558e1f8a9de5cc, user_id=df186bfe199340dbb714965565951d89, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:42.656543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccf516-d426-45dd-b1f8-45bfd37c1fca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:42.707274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:42.710338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:42.742912 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3998/7981] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:42 2022] PUT /identity/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc/users/df186bfe199340dbb714965565951d89/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:42.760013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:42.769983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:42.771350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:42.772166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:42.801577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e924a3-c6b3-4655-828a-ee6c8ae93f44 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:43.449188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] MFA Rules not processed for user `df186bfe199340dbb714965565951d89`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:43.449188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:43.454121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:43.454121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:43.454121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:43.454121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] PATH_INFO: `/v3/projects/757e296cd90844d6b44566881bb3c83b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:43.463682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=757e296cd90844d6b44566881bb3c83b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:43.463682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:43.469293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 3999/7982] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 701 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:43.526580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:43.532701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:43.713957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757e296cd90844d6b44566881bb3c83b', 'request_id': 'req-816040be-a746-4eb8-82dc-7e711940c5aa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:43.766536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757e296cd90844d6b44566881bb3c83b', 'request_id': 'req-816040be-a746-4eb8-82dc-7e711940c5aa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:43.820875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757e296cd90844d6b44566881bb3c83b', 'request_id': 'req-816040be-a746-4eb8-82dc-7e711940c5aa'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:43.958203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adeb38-afed-4e3b-ab0a-88692049d02c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:44.027655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:44.170910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:44.171902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] The token cache is being invalidate because project 757e296cd90844d6b44566881bb3c83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:44.172139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:44.172592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:44.174168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:44.174421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:44.178445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:44.191477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3984/7983] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:42 2022] DELETE /identity/v3/projects/757e296cd90844d6b44566881bb3c83b => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:44.194340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:44.200452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:44.498469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:44.512920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:44.583289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4000/7984] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 1068 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:44.660258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816040be-a746-4eb8-82dc-7e711940c5aa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:44.687099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:44.692330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:44.693326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:44.698385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] PATH_INFO: `/v3/users/dcc05f712bff45ffa8b9c9c7d19f3cca` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:44.701326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc05f712bff45ffa8b9c9c7d19f3cca)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:44.710556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:44.960740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:44.965548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:45.043256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6c3d-1714-407f-86b8-6c76e9bb5cf0 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:45.083297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:45.084577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:45.085152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:45.085579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:45.095191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:45.303885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:45.402267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc05f712bff45ffa8b9c9c7d19f3cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:45.561669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:45.598083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc05f712bff45ffa8b9c9c7d19f3cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:45.614814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:45.642011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc05f712bff45ffa8b9c9c7d19f3cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:45.716086 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4001/7985] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:45.731680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc05f712bff45ffa8b9c9c7d19f3cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:45.738834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-96216cd5-5ce5-4e27-bf1f-82081f8956a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc05f712bff45ffa8b9c9c7d19f3cca'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:45.807611 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3985/7986] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:44 2022] DELETE /identity/v3/users/dcc05f712bff45ffa8b9c9c7d19f3cca => generated 0 bytes in 1591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:45.970609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:45.973357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:46.065210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584c1c-fc9b-4c71-95ef-a48d297db89f service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:46.411739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:46.413664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:46.414187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:46.423820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] PATH_INFO: `/v3/users/79d1897795ed4116b169be9e731d1fe2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:46.427230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d1897795ed4116b169be9e731d1fe2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:46.432020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:46.492310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:47.080079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d1897795ed4116b169be9e731d1fe2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:47.091234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d1897795ed4116b169be9e731d1fe2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:47.290207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d1897795ed4116b169be9e731d1fe2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:47.421817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d1897795ed4116b169be9e731d1fe2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:47.458747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d1897795ed4116b169be9e731d1fe2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:47.478569 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4002/7987] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:12:45 2022] DELETE /identity/v3/users/79d1897795ed4116b169be9e731d1fe2 => generated 0 bytes in 1509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:47.486496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:47.488711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:47.490308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:47.546809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:47.550657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:47.917125 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3986/7988] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:47.967923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:47.971309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:48.337719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9022-fa90-4330-811c-b023d7e63614 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:48.347219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:48.354093 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:48.354647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:48.355187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:48.443241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:48.446838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ac7a1-26c7-41fd-a01c-143df1d23e59 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:48.481784 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4003/7989] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:12:48.982441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:48.985149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:49.048158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6e36-008d-45a9-8e59-e6a6d6186a5d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:49.082634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:49.083764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:49.084282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:49.085644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] PATH_INFO: `/v3/projects/b62f32c726df43ea992937358a5f09ae` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:49.100953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62f32c726df43ea992937358a5f09ae)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:49.112764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:49.552593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62f32c726df43ea992937358a5f09ae', 'request_id': 'req-1245bdef-d4fd-4ca3-907a-44825f8d60f7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:49.630999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62f32c726df43ea992937358a5f09ae', 'request_id': 'req-1245bdef-d4fd-4ca3-907a-44825f8d60f7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:49.746247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62f32c726df43ea992937358a5f09ae', 'request_id': 'req-1245bdef-d4fd-4ca3-907a-44825f8d60f7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:50.039695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] The token cache is being invalidate because project b62f32c726df43ea992937358a5f09ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:50.040754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:50.053041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1245bdef-d4fd-4ca3-907a-44825f8d60f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:50.070359 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3987/7990] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:48 2022] DELETE /identity/v3/projects/b62f32c726df43ea992937358a5f09ae => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:50.097387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:50.098468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:50.099501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:50.234752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:50.238530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:50.693685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:50.693685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:50.694061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:50.699803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4004/7991] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:50.806786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:50.809225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:50.849234 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3988/7992] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:50.859862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:50.872306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:50.901096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:50.930248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebbd45-8670-4a5a-bfee-4a08c62b6aeb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:50.977843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:50.979457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:50.979949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:50.980594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:50.981825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:50.982441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:50.985830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:50.999455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb406f3-6c18-484a-88ea-0009373de00e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:51.045154 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4005/7993] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:51.053144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:51.066969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:51.070935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:51.072083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:51.089621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3f555-79e7-4802-b81b-85fa484e65ec admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:51.094972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] PATH_INFO: `/v3/projects/6a223df02fe9479887646ff547e066fb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:51.119951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a223df02fe9479887646ff547e066fb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:51.120214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:51.120214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:51.120214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:51.120214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:51.121265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:51.121404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:51.122527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:51.269452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:51.425795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:51.486169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4006/7994] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:51 2022] POST /identity/v3/projects => generated 401 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:51.503556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:51.584050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a223df02fe9479887646ff547e066fb', 'request_id': 'req-f4d935e5-73f2-4f4a-805d-da085fd8523b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:51.617853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a223df02fe9479887646ff547e066fb', 'request_id': 'req-f4d935e5-73f2-4f4a-805d-da085fd8523b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:51.651868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a223df02fe9479887646ff547e066fb', 'request_id': 'req-f4d935e5-73f2-4f4a-805d-da085fd8523b'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:51.816377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] The token cache is being invalidate because project 6a223df02fe9479887646ff547e066fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:12:51.826071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:51.842032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f4d935e5-73f2-4f4a-805d-da085fd8523b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:12:51.848666 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3989/7995] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:12:50 2022] DELETE /identity/v3/projects/6a223df02fe9479887646ff547e066fb => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:51.868145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098047ec-cb91-43cc-b05b-8c6d89fcd63f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:51.868649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098047ec-cb91-43cc-b05b-8c6d89fcd63f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:51.869147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098047ec-cb91-43cc-b05b-8c6d89fcd63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:51.993961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386825f-a42b-497c-bdbe-ca8f0d434133 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.020909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.027496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.028148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.029960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.031276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.042986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:52.085680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-098047ec-cb91-43cc-b05b-8c6d89fcd63f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:52.102969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-098047ec-cb91-43cc-b05b-8c6d89fcd63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:52.170275 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3990/7996] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:52.184173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.185035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.189532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.306726 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4007/7997] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:51 2022] POST /identity/v3/users => generated 301 bytes in 805 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:12:52.317341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:52.345965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:52.355519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:52.355519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:52.450445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78b20-03ed-42e8-9c00-4935b95bbdea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.455574 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3991/7998] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:52.457395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:52.515224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.516249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.519678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.520167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.527643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.532640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826013-394c-4850-bef9-4ef5af8ffe3a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.535250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:52.555483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.556803 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.557535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.557965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.560163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:12:52.564310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.568775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:52.584899 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4008/7999] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:52.588657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:52.629574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be83-1481-4f83-bc78-4b47be1c72e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.647394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.647965 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3992/8000] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:12:52.649838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.650478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.650979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.652532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.655594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:52.666589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:52.715289 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4009/8001] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:52.717114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:52.747722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f306-514a-4710-b70f-59e6d9a6ebbc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.773065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8e3dc-9984-4151-966b-687fc2e3a326 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:52.784189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.787440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.787440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.788214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.789411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.806754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:52.808007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:52.808510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:52.809038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] PATH_INFO: `/v3/projects/cf03409e7f6e478d9f9fa1839612319a/users/cf64644548d74ab98b93dbc5a6c89707/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:52.816132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:52.888454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf03409e7f6e478d9f9fa1839612319a, user_id=cf64644548d74ab98b93dbc5a6c89707, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:52.893702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a1df1-e6bc-4076-8823-687fcabcb603 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:53.049851 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4010/8002] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:52 2022] PUT /identity/v3/projects/cf03409e7f6e478d9f9fa1839612319a/users/cf64644548d74ab98b93dbc5a6c89707/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:53.067588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:53.067588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:53.067588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:53.101839 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3993/8003] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:52 2022] POST /identity/v3/projects => generated 377 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:53.115524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:53.203782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] MFA Rules not processed for user `cf64644548d74ab98b93dbc5a6c89707`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:53.206950 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:53.460831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522295f2-7acf-4b68-a74d-174f6975dcfa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:53.496258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:53.498178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:53.499955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:53.502858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:53.507352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:53.513953 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4011/8004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:53.519403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:53.521468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:53.548269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c3a0b-61b2-4181-923b-2a5ab04a19bd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:53.559466 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:53.561109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:53.561807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:53.566191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:53.566191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:53.571561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:54.424923 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4012/8005] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:53 2022] POST /identity/v3/projects => generated 399 bytes in 899 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:54.426587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:54.433375 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3994/8006] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:53 2022] POST /identity/v3/users => generated 289 bytes in 1319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:54.441713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:54.507608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441e63-89ac-4fe5-b435-e06a517387f5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:54.509232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:54.835185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665f74-0f5e-4c3c-9b35-e0c2c043281b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:54.867772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:54.874416 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:54.881935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:54.882803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:54.884915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:54.894031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.006762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:55.029633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:55.030738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.031257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.031751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.033062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:55.036490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.064163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3995/8007] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 619 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:55.068635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:55.122150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d124-5ce5-4b3c-bab9-bc07cce8cc47 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:55.162087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4013/8008] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:54 2022] POST /identity/v3/users => generated 306 bytes in 736 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:55.167182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:55.184606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:55.185611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.186105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.195905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.198391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:55.206234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97582d0e-5c54-4144-be1b-03f99de8f4d2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:55.213870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.272926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:55.282720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.284908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.285549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.290265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:55.295522 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3996/8009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:55.298512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.303941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:55.372655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7ac95-4257-49e4-b2d7-f9351717673c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:55.401672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:55.401672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.401672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.404640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] PATH_INFO: `/v3/projects/11e614e41f5a42029bfc2e743633a5c1/users/aaedfb0a060144d4af113f41f96cff41/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.406300 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4014/8010] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:55.414409 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:55.442526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa654-d700-49e6-a184-14cae2de4e55 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:55.487684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e614e41f5a42029bfc2e743633a5c1, user_id=aaedfb0a060144d4af113f41f96cff41, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:55.500466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323ddd-d6d7-4f21-90bc-11fb7080f0bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.561937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:55.562913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.563441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.563957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] PATH_INFO: `/v3/projects/7763314f58e943eeb53b82721057f4d3/users/af888fb6359440618300909a86e3dcea/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.657359 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7763314f58e943eeb53b82721057f4d3, user_id=af888fb6359440618300909a86e3dcea, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:55.664244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:55.699220 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3997/8011] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:55 2022] PUT /identity/v3/projects/11e614e41f5a42029bfc2e743633a5c1/users/aaedfb0a060144d4af113f41f96cff41/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:55.738423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:55.739886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:55.740225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:55.833247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] MFA Rules not processed for user `aaedfb0a060144d4af113f41f96cff41`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:55.835552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:55.882266 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4015/8012] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:55 2022] PUT /identity/v3/projects/7763314f58e943eeb53b82721057f4d3/users/af888fb6359440618300909a86e3dcea/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:12:55.901473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:56.287758 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3998/8013] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:12:56.287758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:56.320374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86f25-ea00-4eee-93ae-13733f2dce99 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:56.348394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:56.349292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:56.349756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:56.350140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:56.350841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:56.360939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:56.425760 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4016/8014] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:56.427709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:56.488791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55ceb-f2f3-4dda-86b1-0215967beb3b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:56.516061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:56.536365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:56.537345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:56.538247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] PATH_INFO: `/v3/projects/7763314f58e943eeb53b82721057f4d3/users/af888fb6359440618300909a86e3dcea/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:56.556222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7763314f58e943eeb53b82721057f4d3, user_id=af888fb6359440618300909a86e3dcea, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:56.570867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854899e-ec95-4727-9eee-48534fdd2be7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:56.659322 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4017/8015] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:56 2022] PUT /identity/v3/projects/7763314f58e943eeb53b82721057f4d3/users/af888fb6359440618300909a86e3dcea/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:56.692298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:56.693043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:56.695048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:56.863880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] MFA Rules not processed for user `af888fb6359440618300909a86e3dcea`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:56.872581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:56.895645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45b6c-dea5-4a6d-8297-feaa1486db8b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:57.031617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.122822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.168833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:57.169948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:57.170442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:57.170940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:57.172203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:57.185016 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4018/8016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:57.186825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:57.206876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:57.209803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:57.462311 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 3999/8017] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 1209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:12:57.470126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:57.636314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9f6a-96b4-4980-ba25-9d66018e2a44 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:57.827670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f67b45-5dd3-4575-8e7a-8c3587ee3a33 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:57.863089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:57.863089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:57.863089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:57.863089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:57.865640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:57.874216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:57.948586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:57.963051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:57.965411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:57.965674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:58.088057 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4000/8018] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:12:57 2022] POST /identity/v3/users => generated 288 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:12:58.094460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:58.138060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f6e1-580c-4d3f-8d4c-ced0ab1e020f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:58.158908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:58.160367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:58.161143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:58.161692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:58.163037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:58.170465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:58.217265 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4001/8019] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:58.223969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:58.264526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2581-fecd-4a5d-a259-ced3c17bb5cf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:58.284375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:58.286037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:58.286651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:58.287289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:58.288692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:58.302667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:58.354624 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4002/8020] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:12:58.361005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:58.402748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2c35c-075b-43d5-89a6-e52011e0b479 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:58.423715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:58.425044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:58.425699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:58.427087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] PATH_INFO: `/v3/projects/fb91725cb54047ed97fe4b0384c40383/users/9df5d59bf02e42f89975be7eb721341a/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:58.460544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:58.467503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab60eb-f3f4-4c2c-9f43-af863708689c service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:58.516861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb91725cb54047ed97fe4b0384c40383, user_id=9df5d59bf02e42f89975be7eb721341a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:58.529148 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4019/8021] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 1324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:12:58.564913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:58.767102 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4003/8022] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:12:58 2022] PUT /identity/v3/projects/fb91725cb54047ed97fe4b0384c40383/users/9df5d59bf02e42f89975be7eb721341a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:12:58.983988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:58.984385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:58.985589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:59.166789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:59.222764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] MFA Rules not processed for user `9df5d59bf02e42f89975be7eb721341a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:12:59.229562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:12:59.444432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:59.481024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7acb6-8488-4a3a-bc59-11bafa2d8b4c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:12:59.507506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:12:59.508462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:12:59.508875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:12:59.516308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:12:59.780651 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4020/8023] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 799 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:12:59.784006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:59.785908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:12:59.891888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:12:59.895860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:12:59.919939 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4004/8024] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:13:00.205635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7255a72-cb49-415b-a9de-268190a72c97 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:00.241234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:00.241919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:00.242431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:00.250611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:00.254092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:00.278611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:00.553558 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4021/8025] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:12:59 2022] POST /identity/v3/projects => generated 375 bytes in 772 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:00.561312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:00.612543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1d13e-2799-4549-9108-7138e3e3b7e3 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:00.895089 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:00.897111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:00.898081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:00.900324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:00.902005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:00.906971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:01.083845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:01.086997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4005/8026] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:00 2022] POST /identity/v3/users => generated 294 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:01.140452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe6dd2-aa47-496f-8004-6e34697c64f0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:01.184212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:01.189355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:01.196958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:01.205090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:01.214201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:01.230366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:01.272377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:01.285424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4022/8027] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:13:01.310376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0951e1-878b-413c-9108-94887f4d09c4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:01.353200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:01.355903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:01.358003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:01.358321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] PATH_INFO: `/v3/projects/71d0f60619554cd7939befd4b8364590/users/67726322485c4005aac68212b6632365/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:01.532002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d0f60619554cd7939befd4b8364590, user_id=67726322485c4005aac68212b6632365, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:01.549636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:01.704694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4006/8028] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:01 2022] PUT /identity/v3/projects/71d0f60619554cd7939befd4b8364590/users/67726322485c4005aac68212b6632365/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:01.717138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:01.768562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e812f-764d-4045-875e-5eac31c516b5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:02.031566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:02.034930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:02.037277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:02.041210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:02.041210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:02.045582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe0c2-5405-4938-a94a-0ac5bbe4709d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:02.092974 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4023/8029] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:02.094264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:02.138789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94f4a3-cb14-45d5-b741-72cc6236c9d0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:02.183969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:02.183969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:02.183969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:02.183969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] PATH_INFO: `/v3/projects/71d0f60619554cd7939befd4b8364590/users/67726322485c4005aac68212b6632365/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:02.195451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d0f60619554cd7939befd4b8364590, user_id=67726322485c4005aac68212b6632365, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:02.217073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:02.332495 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4007/8030] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:02 2022] PUT /identity/v3/projects/71d0f60619554cd7939befd4b8364590/users/67726322485c4005aac68212b6632365/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:02.352683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:02.353735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:02.355172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:02.531274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] MFA Rules not processed for user `67726322485c4005aac68212b6632365`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:02.535825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:02.672650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:02.840390 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4024/8031] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:02.861374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:03.267991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d7cf-4457-4265-8d08-3ae3e221edac admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:03.282286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:03.285415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:03.286105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:03.286620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:03.532492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:03.610455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:03.624063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:03.692033 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4008/8032] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:13.122700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=16 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:13.438749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:13.443266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:13.469548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:13.472028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:13.557981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd8d17-7249-439e-84df-ff661ca604be service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:13.596017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:13.596017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:13.596017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:13.599289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:13.915546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03c26c-f901-4a87-a280-7c57a711b80a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:13.943611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:13.947900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:13.951802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:13.965968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] PATH_INFO: `/v3/users/4625b3d623f8490a996cc65807aec9a4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:13.966407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4625b3d623f8490a996cc65807aec9a4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:13.982018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:14.035439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:14.040118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d63be4-e56c-414f-92f2-da0b9b748508 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:14.092747 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4009/8033] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:13:14.547962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4625b3d623f8490a996cc65807aec9a4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:14.553653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4625b3d623f8490a996cc65807aec9a4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:14.739003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4625b3d623f8490a996cc65807aec9a4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:14.839942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4625b3d623f8490a996cc65807aec9a4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:14.891126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4625b3d623f8490a996cc65807aec9a4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:14.925513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4025/8034] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:13 2022] DELETE /identity/v3/users/4625b3d623f8490a996cc65807aec9a4 => generated 0 bytes in 1488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:14.937910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:14.938657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:14.939111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:15.037212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:15.042386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:15.454885 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4010/8035] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:15.485190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:15.488182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:15.933560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173b1d-371f-4eff-b7ca-53e6e91c188c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:15.957368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:15.970990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:15.971871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:15.974966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:16.034256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:16.098036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:16.150455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4026/8036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:17.997705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:18.000951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:18.078282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91954e71-1777-4b19-97b1-d4317207a4f9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:18.115423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:18.116633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:18.117087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:18.124617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] PATH_INFO: `/v3/projects/3368bcc2a4714a3d821f7406d6db02fd` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:18.128797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3368bcc2a4714a3d821f7406d6db02fd)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:18.133961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:18.574897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3368bcc2a4714a3d821f7406d6db02fd', 'request_id': 'req-00400a8a-4cae-4cf0-8258-a4106a724db1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:18.626380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3368bcc2a4714a3d821f7406d6db02fd', 'request_id': 'req-00400a8a-4cae-4cf0-8258-a4106a724db1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:18.656580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3368bcc2a4714a3d821f7406d6db02fd', 'request_id': 'req-00400a8a-4cae-4cf0-8258-a4106a724db1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:18.861871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] The token cache is being invalidate because project 3368bcc2a4714a3d821f7406d6db02fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:18.868995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:18.875870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:18.889704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4011/8037] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:17 2022] DELETE /identity/v3/projects/3368bcc2a4714a3d821f7406d6db02fd => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:18.896166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:18.940010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1da62d-f275-4a97-915f-76e0be963ad0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:19.003018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:19.007068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:19.040393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:19.052694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:19.230169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:19.231292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:19.231753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:19.232204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] PATH_INFO: `/v3/users/df186bfe199340dbb714965565951d89` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:19.241209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df186bfe199340dbb714965565951d89)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:19.244770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:19.348813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400a8a-4cae-4cf0-8258-a4106a724db1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:19.372945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:19.374041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:19.374531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:19.375005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:19.390607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:19.793796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df186bfe199340dbb714965565951d89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:19.798738 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df186bfe199340dbb714965565951d89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:19.850842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:19.859589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:19.916640 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4012/8038] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:20.032304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df186bfe199340dbb714965565951d89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:20.086443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df186bfe199340dbb714965565951d89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:20.150343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df186bfe199340dbb714965565951d89'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:20.202014 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4027/8039] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:18 2022] DELETE /identity/v3/users/df186bfe199340dbb714965565951d89 => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:22.223252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:22.230744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:22.350870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f8ecd-2f83-40cb-a92c-de72c4f5830c service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:22.760259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:22.763770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:22.766696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:22.769217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] PATH_INFO: `/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:22.777638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fb6ec2d9524a8f8d558e1f8a9de5cc)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:22.784265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:23.152723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fb6ec2d9524a8f8d558e1f8a9de5cc', 'request_id': 'req-b04cb07c-24c4-4937-9198-ed78a21eb6b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:23.160612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:23.164540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:23.192687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fb6ec2d9524a8f8d558e1f8a9de5cc', 'request_id': 'req-b04cb07c-24c4-4937-9198-ed78a21eb6b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:23.200061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:23.224264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fb6ec2d9524a8f8d558e1f8a9de5cc', 'request_id': 'req-b04cb07c-24c4-4937-9198-ed78a21eb6b6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:23.256974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99c33d-593d-4d74-9ddd-6aa6237b85e5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:23.404400 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] The token cache is being invalidate because project 20fb6ec2d9524a8f8d558e1f8a9de5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:23.424872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:23.437570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b04cb07c-24c4-4937-9198-ed78a21eb6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:23.454903 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4013/8040] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:22 2022] DELETE /identity/v3/projects/20fb6ec2d9524a8f8d558e1f8a9de5cc => generated 0 bytes in 1233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:23.480086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4339-f06c-412c-b18a-fcc0492e2c03 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:23.480638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4339-f06c-412c-b18a-fcc0492e2c03 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:23.481130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e4339-f06c-412c-b18a-fcc0492e2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:23.671674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-859e4339-f06c-412c-b18a-fcc0492e2c03 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:23.674713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-859e4339-f06c-412c-b18a-fcc0492e2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:23.733884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:23.762354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:23.764098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:23.772624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] PATH_INFO: `/v3/users/cf64644548d74ab98b93dbc5a6c89707` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:23.783956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf64644548d74ab98b93dbc5a6c89707)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:23.815418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:24.142592 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4014/8041] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 679 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:24.156538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:24.157200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:24.157859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:24.228774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:24.241206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf64644548d74ab98b93dbc5a6c89707'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:24.247175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf64644548d74ab98b93dbc5a6c89707'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:24.285525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:24.293498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:24.344179 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf64644548d74ab98b93dbc5a6c89707'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:24.368381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4015/8042] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:24.373358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:24.419448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf64644548d74ab98b93dbc5a6c89707'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:24.435209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ee409-f0a7-4ccf-ba68-2e5b7f4846de None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:24.444903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:24.447847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:24.451627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:24.452425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:24.456423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:13:24.457460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:24.465799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:24.482712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e3a30b28-f2d7-4238-b6d4-d50d4de4810a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf64644548d74ab98b93dbc5a6c89707'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:24.538160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4016/8043] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:13:24.541466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:24.544686 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4028/8044] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:23 2022] DELETE /identity/v3/users/cf64644548d74ab98b93dbc5a6c89707 => generated 0 bytes in 1385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:24.547013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:24.553193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:24.563741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:24.564712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:24.610777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd16e8-9781-4657-a447-3c07795dbba4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:24.672869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:24.678323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:25.056408 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4029/8045] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:25.076063 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:25.079312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:25.121833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:25.128113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:25.128791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:25.129260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:25.130534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:25.141558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:25.338381 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4017/8046] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:24 2022] POST /identity/v3/projects => generated 387 bytes in 799 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:25.346345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:25.471586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b000724-d7a4-4e41-9f92-289503f9534c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:25.683221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:25.740537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6717-50c4-4ed1-8dec-801963c285cc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:25.761869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:25.766070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:25.770015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:25.770880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:25.771074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:25.771822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:25.772486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:25.772830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:25.778357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:25.785154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:25.833955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:25.844740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:25.919794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4030/8047] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:13:26.015380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:26.020297 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4018/8048] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:25 2022] POST /identity/v3/users => generated 294 bytes in 675 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:26.061027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f313fd-73a7-43c7-ad89-deb80b505529 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:26.121850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:26.127418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:26.129129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:26.133574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:26.148178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:26.153836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:26.234805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:26.235695 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4031/8049] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:13:26.300711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b6e1a-e411-4dda-b548-29d0c6fe8881 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:26.349395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:26.350569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:26.351363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:26.352449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:26.353656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:26.356733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939ed85-6d58-4d73-82f6-79337e56b2c2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:26.471795 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4019/8050] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:26.474516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:26.534992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9f34-5aaf-44d3-8399-e58599248f6a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:26.570741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:26.573253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:26.576604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:26.586586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] PATH_INFO: `/v3/projects/0eebe6c328a240e982b4f13e15753713/users/006c721020654bf29b411703c5860975/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:26.593753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:26.654071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eebe6c328a240e982b4f13e15753713, user_id=006c721020654bf29b411703c5860975, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:26.660702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:26.816852 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4032/8051] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:26 2022] PUT /identity/v3/projects/0eebe6c328a240e982b4f13e15753713/users/006c721020654bf29b411703c5860975/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:26.842354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:26.842845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:26.843613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:26.998755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] MFA Rules not processed for user `006c721020654bf29b411703c5860975`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:27.002272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:27.359072 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4020/8052] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:27.367068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:27.615928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0617b60-8f6d-471d-b430-8d7441321f86 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:27.659676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:27.660866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:27.661808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:27.668425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:27.677675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:27.677675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:27.918074 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4033/8053] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:27 2022] POST /identity/v3/projects => generated 385 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:27.924174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:27.943947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:27.950072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:27.981360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755dd85-63ad-4cd1-b5af-e34ae572ddc8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:28.253376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:28.256968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:28.257869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:28.258593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:28.261691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:28.271229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:28.283835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ee621-cc25-4c7b-8c0f-6abcf8732388 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:28.304013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:28.308612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:28.309480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:28.310282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] PATH_INFO: `/v3/projects/cf03409e7f6e478d9f9fa1839612319a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:28.315414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf03409e7f6e478d9f9fa1839612319a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:28.322442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:28.462759 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4021/8054] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:27 2022] POST /identity/v3/users => generated 299 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:13:28.476406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:28.536793 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd4ab-50ae-4ede-a3f3-445c28c2fc0a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:28.564881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:28.572439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:28.572439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:28.573901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:28.577978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:28.585964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:28.672078 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4022/8055] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:28.673439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf03409e7f6e478d9f9fa1839612319a', 'request_id': 'req-8df4a9ec-7696-4ff5-a0d3-dde57081df05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:28.678895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:28.739815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a704ce-0692-46b9-9489-4b96591b800c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:28.858564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf03409e7f6e478d9f9fa1839612319a', 'request_id': 'req-8df4a9ec-7696-4ff5-a0d3-dde57081df05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:28.922287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf03409e7f6e478d9f9fa1839612319a', 'request_id': 'req-8df4a9ec-7696-4ff5-a0d3-dde57081df05'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:28.989204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:28.990616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:29.019303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] The token cache is being invalidate because project cf03409e7f6e478d9f9fa1839612319a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:29.024265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:29.033254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:29.045680 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4034/8056] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:27 2022] DELETE /identity/v3/projects/cf03409e7f6e478d9f9fa1839612319a => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:29.053028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:29.062728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:29.147840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:29.154446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:29.155036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:29.162505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] PATH_INFO: `/v3/projects/faace00ae60e4e5bb577e2f26d2f025d/users/262ee66705384c2f9ec8d5274e309d7b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:29.257357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faace00ae60e4e5bb577e2f26d2f025d, user_id=262ee66705384c2f9ec8d5274e309d7b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:29.277637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:29.441161 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4023/8057] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:28 2022] PUT /identity/v3/projects/faace00ae60e4e5bb577e2f26d2f025d/users/262ee66705384c2f9ec8d5274e309d7b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:29.452102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:29.467070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:29.495399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4a9ec-7696-4ff5-a0d3-dde57081df05 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:29.875949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:29.878498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:29.879012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:29.879741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] PATH_INFO: `/v3/users/af888fb6359440618300909a86e3dcea` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:29.882938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af888fb6359440618300909a86e3dcea)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:29.902559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:29.903082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903bae-fdb4-4e5d-922b-0cc9a80a4826 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:29.938908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:29.940141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:29.940671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:29.941155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:29.942482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:29.956372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:30.012042 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4024/8058] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:30.018734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:30.070804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb934e-911a-4446-98fa-1967f54f3daf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:30.100519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:30.102141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:30.109049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:30.114524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] PATH_INFO: `/v3/projects/faace00ae60e4e5bb577e2f26d2f025d/users/262ee66705384c2f9ec8d5274e309d7b/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:30.115396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=faace00ae60e4e5bb577e2f26d2f025d, user_id=262ee66705384c2f9ec8d5274e309d7b, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:30.122711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f559-c90d-4818-b76e-d03ffacc94fa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:30.159561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4025/8059] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:30 2022] PUT /identity/v3/projects/faace00ae60e4e5bb577e2f26d2f025d/users/262ee66705384c2f9ec8d5274e309d7b/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:30.181291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:30.181853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:30.182394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:30.211969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af888fb6359440618300909a86e3dcea'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:30.213598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af888fb6359440618300909a86e3dcea'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:30.344026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af888fb6359440618300909a86e3dcea'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:30.416479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af888fb6359440618300909a86e3dcea'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:30.425383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] MFA Rules not processed for user `262ee66705384c2f9ec8d5274e309d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:30.436000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:30.462531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af888fb6359440618300909a86e3dcea'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:30.498956 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4035/8060] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:29 2022] DELETE /identity/v3/users/af888fb6359440618300909a86e3dcea => generated 0 bytes in 1447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:30.859960 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4026/8061] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 682 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:30.901477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:30.904715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:31.168183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:31.317147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a326-e7d8-4a58-b845-5abfcad4d629 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:31.332457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:31.333776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:31.334070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:31.334569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:31.644757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:31.648070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5523-7833-49f0-9bb3-ac59e34b192a service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:31.717935 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4036/8062] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:33.099590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:33.111300 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:33.350194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:33.673274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875327-719c-400b-ae1f-7673eb568fa3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:34.117573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:34.120306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:34.121167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:34.122238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] PATH_INFO: `/v3/projects/7763314f58e943eeb53b82721057f4d3` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:34.126292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7763314f58e943eeb53b82721057f4d3)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:34.131677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:34.586149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7763314f58e943eeb53b82721057f4d3', 'request_id': 'req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:34.632967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7763314f58e943eeb53b82721057f4d3', 'request_id': 'req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:34.672103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7763314f58e943eeb53b82721057f4d3', 'request_id': 'req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:34.817142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] The token cache is being invalidate because project 7763314f58e943eeb53b82721057f4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:34.817618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:34.821051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27a1fecb-c9af-4e67-b082-73ecc9a64a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:34.829983 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4027/8063] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:33 2022] DELETE /identity/v3/projects/7763314f58e943eeb53b82721057f4d3 => generated 0 bytes in 1731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:34.839069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:34.839841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:34.840396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:34.978695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:34.987078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:35.421499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4037/8064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:35.430167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:35.431072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:35.431573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:35.564417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:35.569657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:35.646477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:35.646985 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4028/8065] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:35.718512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137eef-c66b-4c21-91ad-1881b38bddff None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:35.776845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:35.778748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:35.779184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:35.779702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:35.781173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:13:35.781728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:35.811662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:35.897937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4038/8066] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:13:35.907927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:35.969352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa615-1349-41b8-b93b-c9c3946ecd1f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:36.024349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:36.025627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:36.029775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:36.030836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:36.032239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:36.050108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:36.320790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:36.321425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4029/8067] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:35 2022] POST /identity/v3/projects => generated 387 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:36.374225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3c22-75a0-4ad5-a0aa-9dd6cd8010a5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:36.758401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:36.762566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:36.763106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:36.765280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:36.765280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:36.773727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:36.812074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:36.831986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:36.839666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:37.064402 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4039/8068] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:36 2022] POST /identity/v3/users => generated 294 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:13:37.067438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:37.086259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ea81-6c93-4f80-9215-f2e5ed963a6b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:37.137901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:37.140284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:37.143879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:37.144837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] PATH_INFO: `/v3/users/006c721020654bf29b411703c5860975` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:37.153795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb432-94ec-484e-ad9a-d848691f8866 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:37.157124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=006c721020654bf29b411703c5860975)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:37.166390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:37.188047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:37.192133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:37.193534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:37.197787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:37.202296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:37.215338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:37.305909 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4040/8069] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:37.320387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:37.412112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410a77-6377-42f8-ae84-27f05017d3f1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:37.469128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:37.477094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:37.484696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:37.485943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:37.497458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:37.512918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:37.618694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:37.683345 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4041/8070] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:37.687190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:37.695720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006c721020654bf29b411703c5860975'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:37.760917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87753b9-1a0d-45d7-bdcf-0be584515076 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:37.794461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:37.795029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:37.801425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:37.801967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] PATH_INFO: `/v3/projects/99c247ded414499f88ef363075a4ed74/users/379493877c58403ea3168b9deb302841/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:37.913866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c247ded414499f88ef363075a4ed74, user_id=379493877c58403ea3168b9deb302841, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:37.931189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f30a-4dfd-4cbb-aabb-3dd1276980f8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:37.944382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006c721020654bf29b411703c5860975'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:37.985839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006c721020654bf29b411703c5860975'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:38.085156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006c721020654bf29b411703c5860975'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:38.109007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-cd879a85-de98-43a1-bc68-cff7baf31faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006c721020654bf29b411703c5860975'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:38.113318 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4030/8071] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:36 2022] DELETE /identity/v3/users/006c721020654bf29b411703c5860975 => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:38.125235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:38.125763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:38.126287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:38.214543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:38.216672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:38.352950 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4042/8072] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:37 2022] PUT /identity/v3/projects/99c247ded414499f88ef363075a4ed74/users/379493877c58403ea3168b9deb302841/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:38.383530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:38.384378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:38.385075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:38.505779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] MFA Rules not processed for user `379493877c58403ea3168b9deb302841`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:38.511463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:38.670455 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4031/8073] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:13:38.749799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:38.753014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:39.097447 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4043/8074] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 716 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:13:39.108207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:39.129303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:39.208664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a617-6125-4c09-9219-a50da2c5d647 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:39.506670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b701-38e6-43a2-837c-b11b0de613a7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:39.527054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:39.528380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:39.529951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:39.530372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:39.531340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:39.532229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:39.534889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:39.535995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:39.536288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:39.552796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:39.589807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:39.612109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:39.752650 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4032/8075] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1012 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:39.896294 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4044/8076] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:39 2022] POST /identity/v3/projects => generated 389 bytes in 789 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:39.901363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:39.948055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb382e-eb4e-4f1a-aa3e-3c69c4d7cbf5 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:39.983967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:40.514115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:40.515233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:40.515687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:40.516203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:40.517449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:40.546638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:40.785573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:40.787547 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4033/8077] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:39 2022] POST /identity/v3/users => generated 301 bytes in 887 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:40.826366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267932f-5d99-4198-9eb1-9044058ea4ca admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:40.877648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:40.879499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:40.880502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:40.892645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:40.909867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:40.927545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:40.993547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4045/8078] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:13:41.005586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:41.052773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd6c4-32eb-4af9-a826-d1da0ab30190 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:41.115906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:41.136269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:41.136787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:41.139766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] PATH_INFO: `/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5/users/0a2490d6f4544eeea3b5e61b69882479/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:41.250018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d649ddcf8c48fea9947b0dd8765ae5, user_id=0a2490d6f4544eeea3b5e61b69882479, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:41.256651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:41.463674 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4034/8079] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:40 2022] PUT /identity/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5/users/0a2490d6f4544eeea3b5e61b69882479/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:41.474201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:41.549913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44558dd1-b4e7-49a5-b306-e0a2d102652f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:41.659112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:42.082716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:42.090174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:42.091167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:42.091982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:42.094969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:42.106399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee258b-2ec4-4092-8597-1cecfc6a0ba9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:42.186625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:42.187385 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4046/8080] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 715 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:42.241360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3905-9538-4d46-8854-f1b8f02caf20 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:42.285912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:42.294060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:42.296201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:42.300245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] PATH_INFO: `/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5/users/0a2490d6f4544eeea3b5e61b69882479/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:42.320752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d649ddcf8c48fea9947b0dd8765ae5, user_id=0a2490d6f4544eeea3b5e61b69882479, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:42.328719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:42.366285 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4035/8081] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:42 2022] PUT /identity/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5/users/0a2490d6f4544eeea3b5e61b69882479/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:42.386566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:42.388230 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:42.390451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:42.518546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:42.525739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:42.546581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] MFA Rules not processed for user `0a2490d6f4544eeea3b5e61b69882479`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:42.551991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:42.920842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdd6cc-e48f-4c09-b8af-9bd31faa473f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:42.960909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:42.962337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:42.962826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:42.971450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] PATH_INFO: `/v3/projects/0eebe6c328a240e982b4f13e15753713` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:42.971450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eebe6c328a240e982b4f13e15753713)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:42.971450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:43.014224 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4047/8082] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:43.041574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:43.052732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:43.366274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491846b0-ed98-44fb-b8cf-37a38dc9b559 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:43.411710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:43.420567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:43.428217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:43.430262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:43.454697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:43.458285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:43.458751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eebe6c328a240e982b4f13e15753713', 'request_id': 'req-32ce1522-a267-46c3-b6d9-e0feab3aacfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:43.490481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eebe6c328a240e982b4f13e15753713', 'request_id': 'req-32ce1522-a267-46c3-b6d9-e0feab3aacfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:43.507492 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4048/8083] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:13:43.535091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:43.545392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eebe6c328a240e982b4f13e15753713', 'request_id': 'req-32ce1522-a267-46c3-b6d9-e0feab3aacfd'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:43.740152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] The token cache is being invalidate because project 0eebe6c328a240e982b4f13e15753713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:43.743011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:43.744543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:43.759690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4036/8084] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:42 2022] DELETE /identity/v3/projects/0eebe6c328a240e982b4f13e15753713 => generated 0 bytes in 1243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:43.766327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:43.801028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2f3a-42d4-4669-8b65-dd17f8d32642 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:44.093245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:44.266559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:44.280864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:44.496607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:44.496607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:44.496607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:44.496607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] PATH_INFO: `/v3/users/262ee66705384c2f9ec8d5274e309d7b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:44.497550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262ee66705384c2f9ec8d5274e309d7b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:44.497550 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:44.682019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce1522-a267-46c3-b6d9-e0feab3aacfd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:44.714813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:44.716130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:44.716749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:44.717420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] PATH_INFO: `/v3/users/379493877c58403ea3168b9deb302841` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:44.720267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379493877c58403ea3168b9deb302841)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:44.723945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:45.324756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262ee66705384c2f9ec8d5274e309d7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.339553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262ee66705384c2f9ec8d5274e309d7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.381534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379493877c58403ea3168b9deb302841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.496296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262ee66705384c2f9ec8d5274e309d7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.579066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262ee66705384c2f9ec8d5274e309d7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.619298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-62235498-fa0e-4872-abe4-183ac756fed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262ee66705384c2f9ec8d5274e309d7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.639210 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4049/8085] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:43 2022] DELETE /identity/v3/users/262ee66705384c2f9ec8d5274e309d7b => generated 0 bytes in 1874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:45.652953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379493877c58403ea3168b9deb302841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.698088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379493877c58403ea3168b9deb302841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.809568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379493877c58403ea3168b9deb302841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.810811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379493877c58403ea3168b9deb302841'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:45.848268 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4037/8086] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:44 2022] DELETE /identity/v3/users/379493877c58403ea3168b9deb302841 => generated 0 bytes in 1583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:45.856544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:45.857042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:45.857653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:45.968504 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:45.979381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:46.336670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4050/8087] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:46.365355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:46.367631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:46.595715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d04d98-4ae4-4097-8398-891361827008 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:46.612447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:46.614214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:46.614214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:46.614214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:46.678563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:46.678563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ff7df-1a36-40dd-a6ff-eee547f45f54 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:46.703284 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4038/8088] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:47.717786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:47.735284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:47.893221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e79b-ebf9-4244-90e7-cb547b84bd1f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:47.925787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:47.958959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:47.967927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:47.973040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] PATH_INFO: `/v3/projects/faace00ae60e4e5bb577e2f26d2f025d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:47.984775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faace00ae60e4e5bb577e2f26d2f025d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:48.008831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:48.441439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faace00ae60e4e5bb577e2f26d2f025d', 'request_id': 'req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:48.442731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:48.609169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faace00ae60e4e5bb577e2f26d2f025d', 'request_id': 'req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:48.627052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faace00ae60e4e5bb577e2f26d2f025d', 'request_id': 'req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:48.677294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] The token cache is being invalidate because project faace00ae60e4e5bb577e2f26d2f025d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:48.679420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:48.680385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:48.707433 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4051/8089] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:47 2022] DELETE /identity/v3/projects/faace00ae60e4e5bb577e2f26d2f025d => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:48.708914 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec50e4-8a10-4675-ba0a-cd3baec32091 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:48.709663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec50e4-8a10-4675-ba0a-cd3baec32091 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:48.709836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec50e4-8a10-4675-ba0a-cd3baec32091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:48.824947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-daec50e4-8a10-4675-ba0a-cd3baec32091 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:48.827668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-daec50e4-8a10-4675-ba0a-cd3baec32091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:48.843321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:48.927713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:48.933999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:49.059243 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4039/8090] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:13:49.067309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:49.072525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:49.074818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:49.162667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:49.166940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:49.196569 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4040/8091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:49.198305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:49.224784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b1cff-b06e-4bc4-a34c-5aafa10010e5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:49.230316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:49.231461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:49.232057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:49.232550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:49.233823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:13:49.237465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:49.241099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:49.302753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068551fe-4a79-4b9a-b6c8-aa90f6b45a14 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:49.323796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4041/8092] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:13:49.332801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:49.336481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:49.337478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:49.338095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:49.348021 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] PATH_INFO: `/v3/projects/99c247ded414499f88ef363075a4ed74` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:49.353378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c247ded414499f88ef363075a4ed74)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:49.364836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:49.404706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438d3c-e800-40e8-b602-31b91a22e2c3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:49.427644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:49.427644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:49.427644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:49.427644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:49.448244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:49.465967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:49.838789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c247ded414499f88ef363075a4ed74', 'request_id': 'req-260bf562-defc-416b-b205-328c5e3e7296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:49.865777 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4042/8093] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:49 2022] POST /identity/v3/projects => generated 385 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:49.884995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:50.091622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74667f-f1a4-4d32-8791-98d18acafbb7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:50.099817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:50.102287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:50.102287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:50.102287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:50.103356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:50.105809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:50.182754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c247ded414499f88ef363075a4ed74', 'request_id': 'req-260bf562-defc-416b-b205-328c5e3e7296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:50.210398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c247ded414499f88ef363075a4ed74', 'request_id': 'req-260bf562-defc-416b-b205-328c5e3e7296'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:50.249363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] The token cache is being invalidate because project 99c247ded414499f88ef363075a4ed74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:50.250221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:50.252547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:50.256121 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4052/8094] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:48 2022] DELETE /identity/v3/projects/99c247ded414499f88ef363075a4ed74 => generated 0 bytes in 1330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:50.268514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:50.272096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:50.361433 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4043/8095] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:49 2022] POST /identity/v3/users => generated 293 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:50.363877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:50.368152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:50.415517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f5987-1cb9-4da7-9c29-cf3d5409411d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:50.440385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:50.441559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:50.442088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:50.442564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:50.444020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:50.446852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:50.495498 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4044/8096] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:50.497928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:50.561798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb96f6-48c1-4302-a8fa-02fef1380635 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:50.609505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:50.610730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:50.611350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:50.611838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:50.613101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:50.617290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:50.639758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf562-defc-416b-b205-328c5e3e7296 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:50.664428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4045/8097] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:13:50.671868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:50.704559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:50.705758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:50.706290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:50.706807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] PATH_INFO: `/v3/users/0a2490d6f4544eeea3b5e61b69882479` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:50.711110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d063-e90f-4ddd-b6db-27ad2acf1140 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:50.716298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2490d6f4544eeea3b5e61b69882479)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:50.721444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:50.738954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:50.740714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:50.741962 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:50.742553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] PATH_INFO: `/v3/projects/fb9c3f2a2bc8423d9669aac6555edc11/users/0dc18bb32655484d86f02ca8d9e00782/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:50.746925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:50.799218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9c3f2a2bc8423d9669aac6555edc11, user_id=0dc18bb32655484d86f02ca8d9e00782, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:50.808351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5fa6f-45c2-4a83-814a-5469ea4356a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:51.058247 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4046/8098] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:50 2022] PUT /identity/v3/projects/fb9c3f2a2bc8423d9669aac6555edc11/users/0dc18bb32655484d86f02ca8d9e00782/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:51.072254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:51.073926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:51.074685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:51.156494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:51.171404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] MFA Rules not processed for user `0dc18bb32655484d86f02ca8d9e00782`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:51.180910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:51.318885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2490d6f4544eeea3b5e61b69882479'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:51.339058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2490d6f4544eeea3b5e61b69882479'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:51.525079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2490d6f4544eeea3b5e61b69882479'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:51.580442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2490d6f4544eeea3b5e61b69882479'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:51.609323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2490d6f4544eeea3b5e61b69882479'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:51.629599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4047/8099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:13:51.657788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4053/8100] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:50 2022] DELETE /identity/v3/users/0a2490d6f4544eeea3b5e61b69882479 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:51.661750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:51.664906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:52.036113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0820e8-ab56-44f1-8a55-4804b979e104 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:52.126453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:52.130711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:52.295973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:52.297692 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:52.298970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:52.299880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:52.311999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:52.629644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c885c5-de71-4924-8e37-3580380b5c4d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:52.669394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:52.670684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:52.671085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:52.671529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] PATH_INFO: `/v3/users/aaedfb0a060144d4af113f41f96cff41` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:52.674587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaedfb0a060144d4af113f41f96cff41)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:52.687626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:52.741519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:52.747258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:52.809915 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4048/8101] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 1145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:53.292811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:53.298544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:53.381455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711137-6f9a-49c1-93a5-dc016e81caa6 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:53.408282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaedfb0a060144d4af113f41f96cff41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.410863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaedfb0a060144d4af113f41f96cff41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.411720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:53.415484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:53.416869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:53.419740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] PATH_INFO: `/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:53.426436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d649ddcf8c48fea9947b0dd8765ae5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:53.433681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:53.456998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:53.666645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaedfb0a060144d4af113f41f96cff41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.770469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaedfb0a060144d4af113f41f96cff41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.819860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d649ddcf8c48fea9947b0dd8765ae5', 'request_id': 'req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.852072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9a3a0ed-c502-4296-847d-2341c9943a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaedfb0a060144d4af113f41f96cff41'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.873432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d649ddcf8c48fea9947b0dd8765ae5', 'request_id': 'req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.889090 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4054/8102] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:52 2022] DELETE /identity/v3/users/aaedfb0a060144d4af113f41f96cff41 => generated 0 bytes in 1763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:53.896804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:53.900280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:53.900280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:53.907395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d649ddcf8c48fea9947b0dd8765ae5', 'request_id': 'req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:53.942493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:53.959482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:53.962772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:54.107639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] The token cache is being invalidate because project f8d649ddcf8c48fea9947b0dd8765ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:54.109379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:54.115889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c5e6dac2-0e89-479d-8cdf-9c57c68fcba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:54.133996 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4049/8103] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:53 2022] DELETE /identity/v3/projects/f8d649ddcf8c48fea9947b0dd8765ae5 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:54.145605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755102-3153-4add-8080-1be6e155f34e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:54.146296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755102-3153-4add-8080-1be6e155f34e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:54.146936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755102-3153-4add-8080-1be6e155f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:54.221812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4f755102-3153-4add-8080-1be6e155f34e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:54.224324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4f755102-3153-4add-8080-1be6e155f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:54.289513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4055/8104] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:54.315419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:54.315419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:54.480424 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4050/8105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:54.495432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:54.496052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:54.498879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:54.647858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:54.656321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312413e6-01cc-490b-9150-3fe731d5e301 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:54.683885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:54.689347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:54.690431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:54.690997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:54.691529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:54.736532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4051/8106] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:54.743796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:54.782570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280fb60-8be4-4c94-a30b-a4aa5dc4970b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:54.784337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:54.803001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:54.808357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:54.808875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:54.809424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:54.810549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:13:54.811349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:54.823564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:54.833203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:54.888037 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4052/8107] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:13:54.894904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:54.940375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4056/8108] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:13:54.948623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c171aa-683b-4fb8-b29d-d53128134cf1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:54.968873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:54.970147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:54.993209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:55.003529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:55.005196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:55.013535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:55.334710 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4053/8109] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:54 2022] POST /identity/v3/projects => generated 409 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:13:55.346413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:55.393972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f91989-026c-4b8f-a1fd-a61ca7d8febe service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:55.621391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:55.622594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:55.623090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:55.623811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:55.625268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:55.630151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:55.923291 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4057/8110] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:55 2022] POST /identity/v3/users => generated 305 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:55.930956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:55.955383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400ac4a-1e86-4c89-9fdc-037cc0161b1a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:55.966092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:55.967829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:55.979497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:55.979497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:55.984348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:55.989666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:56.065509 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4054/8111] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:13:56.069080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:56.112675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c1cc6-56fb-4fbc-811d-7aeb38c43c15 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:56.210525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:56.227818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:56.234976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:56.237824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:56.249322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:56.252808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb44c-b668-42a9-abff-bb6339703978 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:56.289983 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4058/8112] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:56.298756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:56.371760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce5923-079e-4e0b-8bb2-425f390cb6db admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:56.387435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:56.388722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:56.389195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:56.389686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] PATH_INFO: `/v3/projects/5e695faf4d0a456586faba99f09b03a0/users/1720ba1a9ac4424fa517dfe4303df604/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:56.470066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e695faf4d0a456586faba99f09b03a0, user_id=1720ba1a9ac4424fa517dfe4303df604, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:56.477241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:56.670899 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4055/8113] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:56 2022] PUT /identity/v3/projects/5e695faf4d0a456586faba99f09b03a0/users/1720ba1a9ac4424fa517dfe4303df604/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:56.697859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:56.698318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:56.698811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:56.851921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] MFA Rules not processed for user `1720ba1a9ac4424fa517dfe4303df604`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:56.857852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:56.911367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:57.051385 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4059/8114] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:57.055569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:57.112548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:57.257325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:57.259366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670bd8-fb4a-4e87-b9d7-cd0c0b76a4bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:57.268566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:57.303915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:57.305433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:57.306221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:57.307740 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:57.310755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:57.315747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:57.456825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a8368-d369-48b2-b795-25b4728519a6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:57.491806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:57.493564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:57.494544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:57.495035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] PATH_INFO: `/v3/projects/11e614e41f5a42029bfc2e743633a5c1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:57.501620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e614e41f5a42029bfc2e743633a5c1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:57.517271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:57.620994 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4056/8115] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:13:57 2022] POST /identity/v3/projects => generated 409 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:57.625005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:57.853547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e614e41f5a42029bfc2e743633a5c1', 'request_id': 'req-28fa8522-99f4-4faf-9082-b44af4a1f08e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:57.884177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ba19-9034-4b3d-a7db-1609bc5048c8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:58.000768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e614e41f5a42029bfc2e743633a5c1', 'request_id': 'req-28fa8522-99f4-4faf-9082-b44af4a1f08e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.020749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e614e41f5a42029bfc2e743633a5c1', 'request_id': 'req-28fa8522-99f4-4faf-9082-b44af4a1f08e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.056964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:58.059798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:58.060789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:58.061790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:58.063472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:58.066566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] The token cache is being invalidate because project 11e614e41f5a42029bfc2e743633a5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:13:58.067354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.068645 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.069947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:58.074552 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4060/8116] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:13:57 2022] DELETE /identity/v3/projects/11e614e41f5a42029bfc2e743633a5c1 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:58.083793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:58.088729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:58.140143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8522-99f4-4faf-9082-b44af4a1f08e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:58.161280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:58.162458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:58.163772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:58.164219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] PATH_INFO: `/v3/users/9df5d59bf02e42f89975be7eb721341a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:58.171937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df5d59bf02e42f89975be7eb721341a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:58.176207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:58.218496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4057/8117] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:13:57 2022] POST /identity/v3/users => generated 311 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:13:58.220649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:58.231002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:58.297849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95b68-51c4-4c89-911d-2d0378bee52e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:58.308469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:58.309614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:58.310641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:58.310641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:58.311968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:58.315280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:58.381444 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4058/8118] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:58.398303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:58.452464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d955c-d4f6-4caf-bf0c-4b66d35dfdc1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:58.468049 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:58.471238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:58.472290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:58.472928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] PATH_INFO: `/v3/projects/dd518ce4d3ed4999b30853e26de37f4b/users/7f91be89e7234814a5610b1985735d44/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:58.532775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd518ce4d3ed4999b30853e26de37f4b, user_id=7f91be89e7234814a5610b1985735d44, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:58.542875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:58.631213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df5d59bf02e42f89975be7eb721341a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.633243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df5d59bf02e42f89975be7eb721341a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.635810 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4059/8119] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:58 2022] PUT /identity/v3/projects/dd518ce4d3ed4999b30853e26de37f4b/users/7f91be89e7234814a5610b1985735d44/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:58.643985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:58.694170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:58.761193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df5d59bf02e42f89975be7eb721341a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.819857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df5d59bf02e42f89975be7eb721341a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.884718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df5d59bf02e42f89975be7eb721341a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:13:58.914944 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4061/8120] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:13:58 2022] DELETE /identity/v3/users/9df5d59bf02e42f89975be7eb721341a => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:13:58.993468 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6338f-727c-407a-a03e-633451de934b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:59.140229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:59.141841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:59.142378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:59.142990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:59.144840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:59.150061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f561-9e7b-44d6-af28-e6a18a9674e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:59.175327 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4060/8121] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:13:59.181779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:59.187736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:59.229800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28789fe-0149-4a4c-8e3c-38c95f7969a0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:59.240369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:13:59.241918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:59.242468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:59.242971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] PATH_INFO: `/v3/projects/dd518ce4d3ed4999b30853e26de37f4b/users/7f91be89e7234814a5610b1985735d44/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:59.248475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd518ce4d3ed4999b30853e26de37f4b, user_id=7f91be89e7234814a5610b1985735d44, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:13:59.255317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:13:59.269226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:59.280747 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4062/8122] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:13:59 2022] PUT /identity/v3/projects/dd518ce4d3ed4999b30853e26de37f4b/users/7f91be89e7234814a5610b1985735d44/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:13:59.302726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:13:59.304131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:13:59.304761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:13:59.421880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] MFA Rules not processed for user `7f91be89e7234814a5610b1985735d44`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:13:59.427161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:59.700309 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4061/8123] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:13:59.720468 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:13:59.736739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:13:59.985373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caafb7-cb0a-4daf-bf1c-96fd6fd93187 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:13:59.996202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:00.000444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:00.000959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:00.001990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:00.046582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:00.053310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:00.104650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4063/8124] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:00.305226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:00.309265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:00.511749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:00.638894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae3311-ee4c-4465-81bd-6ea647d41b6b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:00.673593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:00.681787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:00.682443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:00.687321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] PATH_INFO: `/v3/projects/fb91725cb54047ed97fe4b0384c40383` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:00.721854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb91725cb54047ed97fe4b0384c40383)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:00.739124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:01.077172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb91725cb54047ed97fe4b0384c40383', 'request_id': 'req-999d8c52-55ea-49af-b370-6ecc609c7dee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:01.110817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb91725cb54047ed97fe4b0384c40383', 'request_id': 'req-999d8c52-55ea-49af-b370-6ecc609c7dee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:01.160791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb91725cb54047ed97fe4b0384c40383', 'request_id': 'req-999d8c52-55ea-49af-b370-6ecc609c7dee'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:01.297256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] The token cache is being invalidate because project fb91725cb54047ed97fe4b0384c40383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:01.297693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:01.299011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:01.305209 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4062/8125] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:00 2022] DELETE /identity/v3/projects/fb91725cb54047ed97fe4b0384c40383 => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:01.311785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:01.355460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47a7d9-3e71-41bc-9256-4cdb1b6b922f service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:01.656212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:01.658651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:01.671959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:01.671959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:01.671959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:01.672263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] PATH_INFO: `/v3/users/67726322485c4005aac68212b6632365` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:01.679261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67726322485c4005aac68212b6632365)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:01.690901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:01.933609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d8c52-55ea-49af-b370-6ecc609c7dee admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:01.951945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:01.953800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:01.954363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:01.954911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:01.959879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:02.117978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67726322485c4005aac68212b6632365'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:02.123218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67726322485c4005aac68212b6632365'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:02.193236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:02.193722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:02.226780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67726322485c4005aac68212b6632365'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:02.245743 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4063/8126] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:02.309888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67726322485c4005aac68212b6632365'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:02.367053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67726322485c4005aac68212b6632365'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:02.404573 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4064/8127] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:01 2022] DELETE /identity/v3/users/67726322485c4005aac68212b6632365 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:02.571051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:02.575077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:02.729295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:02.738520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:02.789564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:02.947772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:03.127916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb80a08-cc20-444d-b985-b361f4bc3616 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:03.173141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb458edc-cb89-4728-ab6d-ed983610c599 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:03.185543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:03.187380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:03.188054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:03.188599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] PATH_INFO: `/v3/users/8dfbc506e19a46b6b61b66ca1b5dcce6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:03.191256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfbc506e19a46b6b61b66ca1b5dcce6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:03.198777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:03.462134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:03.465372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:03.467768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:03.468622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:03.475626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:03.550223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfbc506e19a46b6b61b66ca1b5dcce6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:03.554616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfbc506e19a46b6b61b66ca1b5dcce6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:03.557840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:03.570461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dc804-1be0-48dc-8a37-ddcbafaee075 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:03.644417 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4064/8128] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 1075 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:03.757196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfbc506e19a46b6b61b66ca1b5dcce6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:03.798973 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfbc506e19a46b6b61b66ca1b5dcce6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:03.814581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfbc506e19a46b6b61b66ca1b5dcce6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:03.848625 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4065/8129] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:02 2022] DELETE /identity/v3/users/8dfbc506e19a46b6b61b66ca1b5dcce6 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:03.854953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:03.855947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:03.856826 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:03.898984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:03.901861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:04.035097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:04.055234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:04.125460 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4065/8130] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:04.164134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:04.164134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:04.323972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2af6-6d24-49d3-aafd-5b4eb99f6f2e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:04.352356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:04.356497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:04.357926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:04.360961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] PATH_INFO: `/v3/projects/71d0f60619554cd7939befd4b8364590` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:04.373126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d0f60619554cd7939befd4b8364590)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:04.377700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:04.560007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d1cd3-552b-4d9f-8b29-cc6ff2123dc9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:04.571527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:04.574351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:04.574351 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:04.574697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:04.622281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:04.632289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:04.641388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3e10-a80f-4d58-bfc6-b35983ad42f1 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:04.663765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:04.700709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d0f60619554cd7939befd4b8364590', 'request_id': 'req-955c0bd4-cfd8-43f0-a819-06a2004ce40f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:04.708372 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4066/8131] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:04.878954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d0f60619554cd7939befd4b8364590', 'request_id': 'req-955c0bd4-cfd8-43f0-a819-06a2004ce40f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:04.909579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d0f60619554cd7939befd4b8364590', 'request_id': 'req-955c0bd4-cfd8-43f0-a819-06a2004ce40f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:04.965655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] The token cache is being invalidate because project 71d0f60619554cd7939befd4b8364590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:04.968830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:04.973947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-955c0bd4-cfd8-43f0-a819-06a2004ce40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:04.981588 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4066/8132] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:04 2022] DELETE /identity/v3/projects/71d0f60619554cd7939befd4b8364590 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:04.991751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:04.992621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:04.993951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:05.070940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:05.095572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:05.469420 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4067/8133] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:05.492198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:05.493154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:05.499675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:05.636223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:05.641577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:05.688481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4067/8134] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:05.697189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:05.762544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43bc0-8c30-49b9-9dd3-d87a0f0bc276 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:05.790791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:05.792148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:05.792895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:05.793506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:05.794726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:14:05.799262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:05.807225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:05.890407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4068/8135] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:14:05.897625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:05.943641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d106c-c94c-41e4-94eb-28f6810b9b65 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:05.985028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:05.989470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:05.990864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:05.999208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:06.001188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:06.017490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:06.329562 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4068/8136] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:05 2022] POST /identity/v3/projects => generated 381 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:06.337108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:06.360880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd33f24-5c2b-4114-8ff6-7b91a4b7dff4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:06.501047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:06.504558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:06.671659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:06.672725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:06.673232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:06.684357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:06.686104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:06.689762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:07.077783 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4069/8137] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:06 2022] POST /identity/v3/users => generated 291 bytes in 742 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:07.085601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:07.138865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d43d-4300-40f0-83b0-0f60a1c14f9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:07.157352 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6cc6-b6b6-4c62-ad78-66b726388579 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:07.169103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:07.176578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.184519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.185423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] PATH_INFO: `/v3/projects/f31334bc846b471aace4cb8b5f10ff51` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.191490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31334bc846b471aace4cb8b5f10ff51)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:07.194571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:07.196225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.197019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.199086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.200785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:07.206036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:07.206746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:07.244908 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4070/8138] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:07.260236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:07.294752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c85b-ff80-486b-b5cd-6243b22f9f10 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:07.318499 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:07.320248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.320743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.322288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.323769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:07.332470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:07.382097 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4071/8139] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:07.385878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:07.411594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d4082-b534-4df2-8f4c-e6e929ba4308 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:07.426783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:07.426783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.426783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.426783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] PATH_INFO: `/v3/projects/6214daf08cc94e838091c822b344d70e/users/b4ad5f385e5749b291852db06e1e8896/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.462983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6214daf08cc94e838091c822b344d70e, user_id=b4ad5f385e5749b291852db06e1e8896, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:07.474619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f1c5-c820-404f-81b5-e6b02dd409d8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:07.538417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31334bc846b471aace4cb8b5f10ff51', 'request_id': 'req-ec95ffe6-c7bd-4457-bc23-e94b2f102238'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:07.705587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4072/8140] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:07 2022] PUT /identity/v3/projects/6214daf08cc94e838091c822b344d70e/users/b4ad5f385e5749b291852db06e1e8896/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:07.714848 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.719673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.726566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.726843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31334bc846b471aace4cb8b5f10ff51', 'request_id': 'req-ec95ffe6-c7bd-4457-bc23-e94b2f102238'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:07.777097 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31334bc846b471aace4cb8b5f10ff51', 'request_id': 'req-ec95ffe6-c7bd-4457-bc23-e94b2f102238'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:07.834232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:07.836472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:07.868797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] The token cache is being invalidate because project f31334bc846b471aace4cb8b5f10ff51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:07.869323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:07.870646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ec95ffe6-c7bd-4457-bc23-e94b2f102238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:07.877685 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4069/8141] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:06 2022] DELETE /identity/v3/projects/f31334bc846b471aace4cb8b5f10ff51 => generated 0 bytes in 1376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:07.891041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6cb-7602-4244-a2ee-a23d1714e2e5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:07.891699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6cb-7602-4244-a2ee-a23d1714e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:07.892255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6cb-7602-4244-a2ee-a23d1714e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:07.934828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:08.012244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-381ec6cb-7602-4244-a2ee-a23d1714e2e5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:08.017374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-381ec6cb-7602-4244-a2ee-a23d1714e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:08.080507 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4073/8142] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:08.104608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:08.108439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:08.147694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:08.250218 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4070/8143] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:14:08.258250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:08.258744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:08.260334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:08.314525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9800c4-6512-407a-934b-f7042fc65918 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:08.316670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:08.319223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:08.323847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:08.325478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:08.326180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:08.326865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:08.383093 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4071/8144] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:08.385690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:08.388001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:08.397609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:08.491560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515db3-8c75-4327-a9a2-4bd00ec426f4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:08.507538 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4074/8145] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:08.531517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:08.532851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:08.533309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:08.533802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:08.535102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:14:08.535695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:08.549624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:08.622997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:08.627761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:08.628068 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4072/8146] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:14:08.637114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:08.670155 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d08a-17e5-42bf-b203-48d10bc57ee2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:08.685350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:08.686923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:08.690278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:08.691242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:08.697305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:08.706297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:08.924703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e86c1-1435-4248-82a2-69e7aece8475 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:08.938737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:08.940013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:08.940528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:08.941278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:08.946080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:08.982220 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4073/8147] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:08 2022] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:08.989696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:09.128307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:09.133417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:09.166600 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4075/8148] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:09.231657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec250-70b8-4f72-8f6a-92f0df6820fa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:09.290885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:09.295376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:09.297461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:09.298753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:09.304982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:09.312955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:09.526835 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4074/8149] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:08 2022] POST /identity/v3/users => generated 290 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:09.529725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:09.581325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7594a-b65e-44a5-9410-ea74c65ded3c service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:09.607387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:09.612786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:09.614111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:09.617018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:09.621241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:09.635215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:09.693516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:09.695257 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4076/8150] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:09.745190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21e0d4-f99b-495e-a094-d3d6ceb9a568 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:09.785654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:09.789842 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:09.798488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:09.800004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:09.802657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:09.819532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec8946-b7c6-4926-af9c-8d0e9503a814 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:09.901248 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4075/8151] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:14:09.915399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:09.968576 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975077e-4851-420a-84ef-3c66986acbd4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:09.993309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:09.994620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:09.995050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:09.995507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] PATH_INFO: `/v3/projects/2b36621ba6fe4c39a1efe91e510935ae/users/d263609e1c3149cba68ba8e6d59e517f/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:10.053572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:10.077145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b36621ba6fe4c39a1efe91e510935ae, user_id=d263609e1c3149cba68ba8e6d59e517f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:10.090899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:10.277829 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4077/8152] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:09 2022] PUT /identity/v3/projects/2b36621ba6fe4c39a1efe91e510935ae/users/d263609e1c3149cba68ba8e6d59e517f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:10.301318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:10.302206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:10.302580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:10.383837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] MFA Rules not processed for user `d263609e1c3149cba68ba8e6d59e517f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:10.392269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:10.764251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:10.814892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:10.817579 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4076/8153] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:11.103420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67551f7-4ddb-4b7b-90be-5dd9315831a8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:11.134159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:11.138075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:11.146703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:11.147246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:11.180983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:11.184934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:11.211977 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4078/8154] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:21.200631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:23.969592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:23.972452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:24.453178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026b7f7-2b78-4352-aa12-125c8307ca32 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:24.468573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:24.469646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:24.470148 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:24.470636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:24.480970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:24.627050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:24.647986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f75f-02ad-451c-a882-b7e0263b5278 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:24.759378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4077/8155] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:32.645465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:32.648973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:33.229707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742220-7da1-4c69-9be7-520756cfca6a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:33.291093 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:33.292193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:33.292668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:33.293151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] PATH_INFO: `/v3/users/0dc18bb32655484d86f02ca8d9e00782` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:33.298982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc18bb32655484d86f02ca8d9e00782)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:33.321638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:33.824979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc18bb32655484d86f02ca8d9e00782'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:34.012455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc18bb32655484d86f02ca8d9e00782'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:34.061314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc18bb32655484d86f02ca8d9e00782'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:34.191906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc18bb32655484d86f02ca8d9e00782'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:34.194069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc18bb32655484d86f02ca8d9e00782'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:34.231425 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4079/8156] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:32 2022] DELETE /identity/v3/users/0dc18bb32655484d86f02ca8d9e00782 => generated 0 bytes in 1587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:34.238750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:34.240115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:34.240976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:34.288309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:34.290712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:34.357532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:34.361509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:34.855096 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4078/8157] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:14:34.874141 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:34.876778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:34.958260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75241-d980-4986-a0be-e094fad679a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:35.006871 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:35.016418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:35.020684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:35.028289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:35.053252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:35.154582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:35.398383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687223d-fd7d-45bc-8fde-5b2c26e29a34 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:35.450901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:35.452939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:35.457507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:35.458366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:35.552874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:35.555567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:35.639022 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4079/8158] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:35.691322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:35.695731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12dfa-bfcd-48b2-a5b4-5ded06cb7304 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:35.779750 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4080/8159] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:14:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 1492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 21:14:37.894494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:37.900983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:37.962433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966525a-86b9-455e-b505-964aae1b3c8b service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:38.012502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:38.020332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:38.021815 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:38.022616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] PATH_INFO: `/v3/projects/fb9c3f2a2bc8423d9669aac6555edc11` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:38.038000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9c3f2a2bc8423d9669aac6555edc11)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:38.041245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:38.358702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:38.501488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9c3f2a2bc8423d9669aac6555edc11', 'request_id': 'req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:38.702450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9c3f2a2bc8423d9669aac6555edc11', 'request_id': 'req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:38.736830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9c3f2a2bc8423d9669aac6555edc11', 'request_id': 'req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:38.778472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:38.790342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:38.790342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:38.861139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] The token cache is being invalidate because project fb9c3f2a2bc8423d9669aac6555edc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:38.864543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:38.871585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46d686c7-58d3-4c7e-bcaa-f03edd64e74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:38.888471 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4080/8160] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:37 2022] DELETE /identity/v3/projects/fb9c3f2a2bc8423d9669aac6555edc11 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:38.907681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8577bf-6499-4fef-bd61-fe50d6a87383 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:38.931830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8577bf-6499-4fef-bd61-fe50d6a87383 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:38.931830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8577bf-6499-4fef-bd61-fe50d6a87383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:38.990817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] MFA Rules not processed for user `b4ad5f385e5749b291852db06e1e8896`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:38.993102 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:39.063003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4f8577bf-6499-4fef-bd61-fe50d6a87383 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:39.072546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4f8577bf-6499-4fef-bd61-fe50d6a87383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:39.472797 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4081/8161] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 695 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:39.483270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:39.488849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:39.533806 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4081/8162] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:39.543951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:39.544826 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:39.545439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:39.576718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293479d-dabd-44a5-8129-18073b1e0e84 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:39.612091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:39.619945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:39.620769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:39.621624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:39.627218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:39.636512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:39.694872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:39.702647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:39.746504 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4082/8163] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:39.748480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:39.785811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d61f32-4ad5-4e27-9fa6-40451ec92fb6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:39.796477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4082/8164] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:39 2022] POST /identity/v3/projects => generated 381 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:39.804834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:39.815410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:39.816244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:39.816749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:39.825519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:39.825519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:14:39.826598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:39.829757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:39.881941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4083/8165] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:14:39.888768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:39.936924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c988f8-a283-498c-bab2-b107d5d2c46b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:40.332274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:40.334275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:40.335279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:40.336008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:40.337618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:40.341673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:40.374575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4af8b-aeba-4924-ac02-a0ef610e50d9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:40.409711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:40.412825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:40.413326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:40.423812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:40.428403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:40.432113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:40.589280 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4084/8166] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:14:40.590693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:40.619534 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4083/8167] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:39 2022] POST /identity/v3/users => generated 297 bytes in 812 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:40.625541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:40.748538 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda46bb-55b0-42df-9a74-8d38de0b535d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:40.774236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:40.805110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:41.027510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:41.028718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:41.029299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:41.029813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:41.031193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:41.037242 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:41.069550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4084/8168] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:41.077630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:41.085585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620546d-a446-40ed-afea-10eef9cb36b8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:41.113450 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:41.116518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:41.117509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:41.118246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:41.120008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:41.127047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894fe4-8e95-4726-a8fc-5b8e998e7765 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:41.129381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:41.151029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:41.155599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:41.156212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:41.156742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] PATH_INFO: `/v3/projects/25824f446a4344c18bafe3afb8dde28f/users/eaf66dfd6d034c05973bc1e1c291932c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:41.252124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25824f446a4344c18bafe3afb8dde28f, user_id=eaf66dfd6d034c05973bc1e1c291932c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:41.259230 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:41.341025 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4085/8169] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:40 2022] POST /identity/v3/users => generated 287 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:41.348352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:41.418939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f91f9-e0ad-4a4e-8ac8-8eb740271268 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:41.477130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:41.478323 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4085/8170] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:41 2022] PUT /identity/v3/projects/25824f446a4344c18bafe3afb8dde28f/users/eaf66dfd6d034c05973bc1e1c291932c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:41.483383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:41.486124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:41.487589 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:41.488132 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:41.489463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:41.500954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:41.622429 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4086/8171] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:41.627565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:41.712712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35125d-d527-40ab-ac70-9832b29fd34c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:41.921736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d02d7-4ced-4665-94fd-3d5b6dddd7d6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:41.991612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:42.017933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:42.023187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:42.023964 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:42.024608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:42.026486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:42.027635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:42.028305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:42.028706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:42.029835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:42.039819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:42.052723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:42.085375 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4087/8172] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:42.087221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:42.133923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4153f1-ccbe-4c6e-8f80-4d6b4c58d596 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:42.153055 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4086/8173] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 667 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:42.155090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:42.162286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:42.165882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:42.166507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:42.166968 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] PATH_INFO: `/v3/projects/4ac6391a68054025ac8780b280c2a371/users/20ea249bc011499eb7c8d8318eda51d4/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:42.226346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b8b8-8715-4acc-81e9-278d36a824c7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:42.248706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac6391a68054025ac8780b280c2a371, user_id=20ea249bc011499eb7c8d8318eda51d4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:42.260731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:42.265472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:42.267365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:42.268257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:42.269136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] PATH_INFO: `/v3/projects/25824f446a4344c18bafe3afb8dde28f/users/eaf66dfd6d034c05973bc1e1c291932c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:42.275050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25824f446a4344c18bafe3afb8dde28f, user_id=eaf66dfd6d034c05973bc1e1c291932c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:42.283312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3eb2-574f-4253-9ac1-9708f2a1ce51 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:42.315367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4087/8174] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:42 2022] PUT /identity/v3/projects/25824f446a4344c18bafe3afb8dde28f/users/eaf66dfd6d034c05973bc1e1c291932c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:42.371941 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4088/8175] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:42 2022] PUT /identity/v3/projects/4ac6391a68054025ac8780b280c2a371/users/20ea249bc011499eb7c8d8318eda51d4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:42.592535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:42.592960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:42.593939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:42.794684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] MFA Rules not processed for user `20ea249bc011499eb7c8d8318eda51d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:42.804447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:43.088722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:43.164430 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4088/8176] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:43.257351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:43.262042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:43.691939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21699fb9-bfd4-4aae-9eba-66f80536a75e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:43.726651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:43.728496 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:43.736531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:43.740930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:43.843913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:43.851111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13fc32-9c91-414b-bdc4-2dcdf50f3b27 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:43.875975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:43.878430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:43.934362 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4089/8177] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:44.371694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf416b-93b1-4182-bb79-1e0cf94d04ac None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:44.405537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:44.406421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:44.406892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:44.407403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] PATH_INFO: `/v3/users/1720ba1a9ac4424fa517dfe4303df604` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:44.414316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1720ba1a9ac4424fa517dfe4303df604)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:44.424600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:44.916135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1720ba1a9ac4424fa517dfe4303df604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:45.069002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1720ba1a9ac4424fa517dfe4303df604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:45.094648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1720ba1a9ac4424fa517dfe4303df604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:45.180458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1720ba1a9ac4424fa517dfe4303df604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:45.181766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1720ba1a9ac4424fa517dfe4303df604'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:45.218172 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4089/8178] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:43 2022] DELETE /identity/v3/users/1720ba1a9ac4424fa517dfe4303df604 => generated 0 bytes in 1339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:45.221382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:45.222192 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:45.222346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:45.358655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:45.369277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:45.428677 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:45.431301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:45.462124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:45.757680 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4090/8179] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:45.772461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dde475-578c-400f-9d2b-d1a1735bf41f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:45.775419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:45.777878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:45.795878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:45.800501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:45.800501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:45.803227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] PATH_INFO: `/v3/users/023b73321fc54009b1af2b103050a202` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:45.813047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=023b73321fc54009b1af2b103050a202)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:45.822659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:45.903124 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:46.103205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742e190-d22b-435c-a6c1-322d8ef0a8e9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:46.120187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:46.128814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:46.129559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:46.130599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:46.199583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:46.212614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca9925-050c-42c8-9ed0-5678f989b44e service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:46.284714 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4091/8180] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:14:46.303526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023b73321fc54009b1af2b103050a202'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:46.464135 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023b73321fc54009b1af2b103050a202'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:46.511062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023b73321fc54009b1af2b103050a202'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:46.589151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023b73321fc54009b1af2b103050a202'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:46.600525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023b73321fc54009b1af2b103050a202'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:46.635732 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4090/8181] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:45 2022] DELETE /identity/v3/users/023b73321fc54009b1af2b103050a202 => generated 0 bytes in 1204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:46.638636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:46.638803 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:46.641044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:46.719029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:46.723077 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:47.141874 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4092/8182] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:47.163819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:47.166403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:47.438691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbf8e1-8636-44bd-90ce-885d3d48078b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:47.466854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:47.471328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:47.471328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:47.471936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:47.524958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:47.531504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:47.597343 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4091/8183] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:47.689506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:47.692204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:47.798026 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104711f-0070-4a8d-b580-6e2f85a44a26 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:47.848913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:47.855942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:47.856752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:47.857333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] PATH_INFO: `/v3/projects/5e695faf4d0a456586faba99f09b03a0` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:47.865378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e695faf4d0a456586faba99f09b03a0)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:47.876152 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:48.162118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e695faf4d0a456586faba99f09b03a0', 'request_id': 'req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:48.176693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:48.292040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e695faf4d0a456586faba99f09b03a0', 'request_id': 'req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:48.328083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e695faf4d0a456586faba99f09b03a0', 'request_id': 'req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:48.404724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] The token cache is being invalidate because project 5e695faf4d0a456586faba99f09b03a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:48.406090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:48.412233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:48.421193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4093/8184] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:47 2022] DELETE /identity/v3/projects/5e695faf4d0a456586faba99f09b03a0 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:48.427636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:48.469565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7536-9cfe-41a4-9c6e-376b0a942523 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:48.778653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:48.780278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:48.780769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:48.783733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] PATH_INFO: `/v3/users/7f91be89e7234814a5610b1985735d44` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:48.792214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f91be89e7234814a5610b1985735d44)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:48.799795 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:49.196000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:49.233061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f91be89e7234814a5610b1985735d44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:49.348229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f91be89e7234814a5610b1985735d44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:49.379534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f91be89e7234814a5610b1985735d44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:49.422562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f91be89e7234814a5610b1985735d44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:49.427837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6c05fac4-885b-4baf-acce-75658f276585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f91be89e7234814a5610b1985735d44'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:49.476642 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4092/8185] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:14:48 2022] DELETE /identity/v3/users/7f91be89e7234814a5610b1985735d44 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:50.520249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:50.520249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:50.557610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2a0f-50d7-42e7-9d07-fa91aeec6b77 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:50.834175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:50.835393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:50.835938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:50.836713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] PATH_INFO: `/v3/projects/9181819ad614464a8696d62e4d0adae6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:50.839340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9181819ad614464a8696d62e4d0adae6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:50.843524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:51.281854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9181819ad614464a8696d62e4d0adae6', 'request_id': 'req-8812e886-194d-4b84-88a0-3f960a4660e0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:51.397411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9181819ad614464a8696d62e4d0adae6', 'request_id': 'req-8812e886-194d-4b84-88a0-3f960a4660e0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:51.439502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9181819ad614464a8696d62e4d0adae6', 'request_id': 'req-8812e886-194d-4b84-88a0-3f960a4660e0'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:51.507392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] The token cache is being invalidate because project 9181819ad614464a8696d62e4d0adae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:51.510944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:51.513243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:51.517475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4094/8186] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:50 2022] DELETE /identity/v3/projects/9181819ad614464a8696d62e4d0adae6 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:51.526480 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb208-91c5-4b72-9b1a-f0a3632b9055 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:51.533771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb208-91c5-4b72-9b1a-f0a3632b9055 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:51.533771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb208-91c5-4b72-9b1a-f0a3632b9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:51.589188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-64cfb208-91c5-4b72-9b1a-f0a3632b9055 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:51.600913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-64cfb208-91c5-4b72-9b1a-f0a3632b9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:51.856514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:51.859411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:52.071234 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4093/8187] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:52.094372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:52.095274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:52.095903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:52.213043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:52.213292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e886-194d-4b84-88a0-3f960a4660e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:52.222655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:52.250294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:52.250294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:52.250294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:52.250294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] PATH_INFO: `/v3/projects/dd518ce4d3ed4999b30853e26de37f4b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:52.264785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd518ce4d3ed4999b30853e26de37f4b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:52.287981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:52.297874 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4094/8188] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:52.307651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:52.322331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386ae33-a376-4525-9169-3c969b08f87e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:52.348474 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:52.351790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:52.353753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:52.355944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:52.387291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:52.388144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:14:52.443842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:52.454342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:52.532704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4095/8189] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:14:52.534666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:52.576446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a9f8f-284a-455c-b496-7d7bf7bcd71c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:52.621198 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:52.624321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:52.624321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:52.624321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:52.627916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:52.633167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:52.713110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd518ce4d3ed4999b30853e26de37f4b', 'request_id': 'req-1215acb1-4669-4a40-83e6-eccac53f4ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:52.811904 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4096/8190] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:52 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:52.823481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd518ce4d3ed4999b30853e26de37f4b', 'request_id': 'req-1215acb1-4669-4a40-83e6-eccac53f4ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:52.843947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:52.868462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd518ce4d3ed4999b30853e26de37f4b', 'request_id': 'req-1215acb1-4669-4a40-83e6-eccac53f4ba1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:52.968375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] The token cache is being invalidate because project dd518ce4d3ed4999b30853e26de37f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:14:52.969836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:52.972275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1215acb1-4669-4a40-83e6-eccac53f4ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:14:52.977687 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4095/8191] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:14:51 2022] DELETE /identity/v3/projects/dd518ce4d3ed4999b30853e26de37f4b => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:52.988258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d3fe-5c71-4408-94ee-2f550f855ed0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:52.993165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d3fe-5c71-4408-94ee-2f550f855ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:52.993165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d3fe-5c71-4408-94ee-2f550f855ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.060942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7532d3fe-5c71-4408-94ee-2f550f855ed0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:53.061497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7532d3fe-5c71-4408-94ee-2f550f855ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:53.171605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f65d-81f8-4f76-8e30-b48fcff319ae admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:53.240635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:53.243755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.244336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.245284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.247277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:53.253814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:53.343761 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4096/8192] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:14:53.351035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.351588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.352071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.466985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:53.471469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:53.522337 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4097/8193] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:53.528643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:53.566977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26ae8b-dc9a-4477-9f37-b538a169ee9f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:53.600622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:53.601464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.601982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.602481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.625277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:14:53.625277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:53.628288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:53.688705 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4097/8194] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:52 2022] POST /identity/v3/users => generated 291 bytes in 831 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:53.694078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:53.695735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:53.705739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4098/8195] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:14:53.714993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:53.751054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5060ba-3f1b-4fe1-a56b-4d2fafdafc49 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:53.762887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:53.774139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:53.775867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.783789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.784888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.786836 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:53.797025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caab4d-2454-4771-8270-c2030b0c7a73 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:53.810343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:53.825699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:53.827534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.828163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.828673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.830470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:53.836306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:53.881005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4098/8196] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:53.892611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:53.937850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c501af0-56dd-41ea-9fa3-5249978d9847 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:53.952806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:53.955261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:53.955907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:53.956385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:53.957597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:53.968265 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:54.039963 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4099/8197] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:54.044032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:54.096094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb6c51-9c1c-4bc3-9a71-5a2109c9a0cf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:54.119485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:54.120219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:54.123891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:54.124850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] PATH_INFO: `/v3/projects/29cc12a5031642a7bd08a7d1a549c11f/users/ed2ce0fb2d484f6dafa9b29a7759a2af/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:54.151262 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4099/8198] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:53 2022] POST /identity/v3/projects => generated 381 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:54.155246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:54.180433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cc12a5031642a7bd08a7d1a549c11f, user_id=ed2ce0fb2d484f6dafa9b29a7759a2af, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:54.190870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39df3-0b32-47b8-926f-ea8bf8582bc7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:54.375305 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4100/8199] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:54 2022] PUT /identity/v3/projects/29cc12a5031642a7bd08a7d1a549c11f/users/ed2ce0fb2d484f6dafa9b29a7759a2af/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:14:54.403001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:54.403497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:54.407204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:54.553910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07ced-4813-48c2-b94b-13cce43bb0dd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:54.574614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] MFA Rules not processed for user `ed2ce0fb2d484f6dafa9b29a7759a2af`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:54.582156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:54.604295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:54.850713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:54.852389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:54.853100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:54.853801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:54.855327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:54.859926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:54.956484 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4101/8200] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:54.979982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:54.983203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:55.070673 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4100/8201] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:54 2022] POST /identity/v3/users => generated 291 bytes in 917 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:14:55.235622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:55.247811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86f77-b1ea-40d8-9532-dcb559a506b4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:55.269823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:55.273612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:55.273848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625fc0-bab1-493e-a972-6e5ff8224b8f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:55.274015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:55.274015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:55.302217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:55.303238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:55.303889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:55.308377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:55.308377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:55.312669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:55.315414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:55.316137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:55.352857 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4102/8202] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:14:55.418802 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4101/8203] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:14:55.425920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:55.480717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cad14-a7e9-40f8-9686-36236cce21c8 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:55.499165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:55.500788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:55.501052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:55.501483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:55.502827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:55.506839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7862d99-cff0-4923-866c-21121da35685 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:55.587628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:55.597668 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4103/8204] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:55.615609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da313a-852d-4f41-8d2b-7d5015cfbbe6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:55.637941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:55.639751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:55.640347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:55.641016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] PATH_INFO: `/v3/projects/a8395ec0f4534f788ed56dca21bd9b2d/users/848cfcbbcf20496b9f53c8b360442ff2/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:55.735267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8395ec0f4534f788ed56dca21bd9b2d, user_id=848cfcbbcf20496b9f53c8b360442ff2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:55.742075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:56.578434 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4102/8205] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:55 2022] PUT /identity/v3/projects/a8395ec0f4534f788ed56dca21bd9b2d/users/848cfcbbcf20496b9f53c8b360442ff2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:14:56.608919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:56.610148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:56.611245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:56.917858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] MFA Rules not processed for user `848cfcbbcf20496b9f53c8b360442ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:14:56.922162 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:14:57.121396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:57.391907 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4104/8206] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 789 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:14:57.392863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:58.024729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2b285-7b3f-4f8a-a256-c040b96e7cec admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:58.124330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:58.125291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:58.125714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:58.126139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:58.150793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:58.174264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:58.447257 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4103/8207] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:14:57 2022] POST /identity/v3/projects => generated 381 bytes in 1055 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:14:58.452750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:58.545167 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a451-df62-4ed8-9fe1-a7dd974b7f4d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:58.982068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:58.983276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:58.983809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:58.984326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:58.985715 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:58.999275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:59.185303 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4105/8208] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:14:58 2022] POST /identity/v3/users => generated 297 bytes in 734 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:14:59.189263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:59.269945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f338b96-fc18-4c64-84bd-bd4e557b486b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:59.294480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:59.298507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:59.305696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:59.308733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:59.314007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:59.325389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:14:59.426524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4104/8209] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:14:59.426799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:14:59.515912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457973-6bd8-4d5d-8372-650b6ccdf6e5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:14:59.588184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:14:59.589815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:14:59.590723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:14:59.599209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] PATH_INFO: `/v3/projects/855118acb64644a6bb287c861cbc5f87/users/7c26b24af5254671bfe3f66a351082fc/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:14:59.750320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855118acb64644a6bb287c861cbc5f87, user_id=7c26b24af5254671bfe3f66a351082fc, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:14:59.766433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:00.083565 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4106/8210] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:14:59 2022] PUT /identity/v3/projects/855118acb64644a6bb287c861cbc5f87/users/7c26b24af5254671bfe3f66a351082fc/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:15:00.089830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:00.157351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed44a-b834-4b8c-89e6-22f6fb22885a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:00.377795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:00.511657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:00.517896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:00.522931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:00.524134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:00.532539 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:00.542451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92fd0-e86d-4a0c-be37-565c6ae9a846 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:00.637246 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4105/8211] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:15:00.643100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:00.757492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24a82-9950-412e-bc0a-58f8fc592eb6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:00.831316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:00.832571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:00.843592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:00.855252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] PATH_INFO: `/v3/projects/855118acb64644a6bb287c861cbc5f87/users/7c26b24af5254671bfe3f66a351082fc/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:00.865012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=855118acb64644a6bb287c861cbc5f87, user_id=7c26b24af5254671bfe3f66a351082fc, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:00.887345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:01.127944 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4107/8212] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:15:00 2022] PUT /identity/v3/projects/855118acb64644a6bb287c861cbc5f87/users/7c26b24af5254671bfe3f66a351082fc/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:15:01.150780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc256f-971f-47c5-ba42-92ee0417cdaf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:01.151533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc256f-971f-47c5-ba42-92ee0417cdaf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:01.152858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc256f-971f-47c5-ba42-92ee0417cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:01.453059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-dcfc256f-971f-47c5-ba42-92ee0417cdaf None None] MFA Rules not processed for user `7c26b24af5254671bfe3f66a351082fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:01.457131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dcfc256f-971f-47c5-ba42-92ee0417cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:01.945438 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4106/8213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 798 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:02.056118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:02.060523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:02.319483 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcd05b-6c93-4809-a43a-0ffdb184b02e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:02.348885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:02.350217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:02.368944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:02.370607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:02.449152 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:02.860648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:02.867767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:02.960564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4108/8214] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 905 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:09.269224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:09.270008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:09.270740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:09.442462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] MFA Rules not processed for user `eaf66dfd6d034c05973bc1e1c291932c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:09.453375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:10.131399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4107/8215] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 861 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:10.191943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:10.194812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:10.763696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800827-2a9d-441d-aa14-d191381c5135 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:10.783302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:10.801996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:10.802805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:10.803435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:10.875565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:10.875565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:10.934689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4109/8216] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:12.518547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:12.524170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:12.621642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:12.996674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f1db-c58c-4a8b-aaa3-c9492c6eace3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:13.012128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:13.013595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:13.014880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:13.021207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:13.038969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:13.125481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:13.129066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:13.177255 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4108/8217] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:15.191274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:15.191274 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:15.275210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda3ce-00c7-45a4-baf7-d03c517f99e2 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:15.326884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:15.328122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:15.328642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:15.329245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:15.337165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:15.419321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:15.428140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be80c7-75e9-45e5-a132-9488061707c3 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:15.484152 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4110/8218] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:16.332247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:16.912048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1ed0-e30a-4fc4-beef-c1c538c0b6a6 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:16.940453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:16.947434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:16.948389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:16.949100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] PATH_INFO: `/v3/users/ed2ce0fb2d484f6dafa9b29a7759a2af` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:16.952342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2ce0fb2d484f6dafa9b29a7759a2af)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:16.976456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:17.526228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2ce0fb2d484f6dafa9b29a7759a2af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:17.526228 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2ce0fb2d484f6dafa9b29a7759a2af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:17.697713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2ce0fb2d484f6dafa9b29a7759a2af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:17.783193 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2ce0fb2d484f6dafa9b29a7759a2af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:17.821364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2ce0fb2d484f6dafa9b29a7759a2af'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:17.857855 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4109/8219] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:16 2022] DELETE /identity/v3/users/ed2ce0fb2d484f6dafa9b29a7759a2af => generated 0 bytes in 1527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:17.864892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:17.867263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:17.868048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:18.099341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:18.101134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:18.103768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:18.108243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:18.183755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:18.438697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:18.492932 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4111/8220] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:18.526875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f3ed-1f2e-4f56-8747-4b65feda8e07 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:18.563640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:18.564845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:18.565351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:18.565865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:18.588693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:18.672724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:18.680998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:18.768399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4110/8221] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:19.153704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:19.156728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:19.711860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da393d-4814-4769-819f-4b5d61339df7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:19.736841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:19.737971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:19.738507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:19.739183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:19.868802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:19.870889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe62380-07a3-4024-8294-986f00d82b7b service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:19.953634 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4112/8222] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:24.641872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:24.644788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:24.709118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02ef8c-fa9c-453f-81b9-8b23304db949 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:24.732593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:24.736245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:24.736932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:24.737758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] PATH_INFO: `/v3/projects/29cc12a5031642a7bd08a7d1a549c11f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:24.743595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cc12a5031642a7bd08a7d1a549c11f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:24.747889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:25.149804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cc12a5031642a7bd08a7d1a549c11f', 'request_id': 'req-27b56c44-bb3e-4fbe-8669-0831f366802c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:25.297353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cc12a5031642a7bd08a7d1a549c11f', 'request_id': 'req-27b56c44-bb3e-4fbe-8669-0831f366802c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:25.322963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cc12a5031642a7bd08a7d1a549c11f', 'request_id': 'req-27b56c44-bb3e-4fbe-8669-0831f366802c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:25.406723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] The token cache is being invalidate because project 29cc12a5031642a7bd08a7d1a549c11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:15:25.407497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:25.411699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-27b56c44-bb3e-4fbe-8669-0831f366802c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:25.420560 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4111/8223] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:24 2022] DELETE /identity/v3/projects/29cc12a5031642a7bd08a7d1a549c11f => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:25.429144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:25.429900 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:25.430558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:25.718969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:25.722346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:26.094428 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4113/8224] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:26.098699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60007-5fea-4872-93b0-31404798c10d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:26.100311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60007-5fea-4872-93b0-31404798c10d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:26.101118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60007-5fea-4872-93b0-31404798c10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:26.214747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-78e60007-5fea-4872-93b0-31404798c10d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:26.221082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-78e60007-5fea-4872-93b0-31404798c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:26.347124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4112/8225] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:26.347624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:26.390433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9884-da91-45ce-b735-5696da111a9e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:26.433549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:26.438409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:26.439383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:26.440219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:26.443106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:15:26.447555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:26.452952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:26.540877 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4114/8226] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:15:26.542813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60007-5fea-4872-93b0-31404798c10d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:26.602726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60007-5fea-4872-93b0-31404798c10d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:26.643839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:26.645925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:26.648557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:26.651810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:26.653939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:26.659188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:27.053071 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4113/8227] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:15:26 2022] POST /identity/v3/projects => generated 371 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:15:27.053469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:27.079788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cb067-0e08-4a04-b266-53afc0a48c8a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:27.414433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:27.501009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:27.502026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:27.502509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:27.502939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:27.504137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:27.516619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:27.757289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:27.773263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4115/8228] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:15:27 2022] POST /identity/v3/users => generated 286 bytes in 721 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:15:27.790978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2c6b9-168a-43e8-88ca-5fecf5248397 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:27.847570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:27.859488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:27.860010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:27.862284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:27.867310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:27.897195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:27.961145 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4114/8229] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:15:27.966959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:28.008518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7ee-31a1-468a-b73d-548be9490168 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:28.045466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:28.049822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:28.050335 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:28.051035 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:28.054815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:28.061466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966d700-b622-4e46-b9f5-03531bf62fe9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:28.143871 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4116/8230] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:15:28.151845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:28.180597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e353-cb8d-4314-a31a-dae5db9b31dd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:28.203366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:28.208544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:28.209425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:28.209975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] PATH_INFO: `/v3/projects/37fa097514df496299798b78eb3f4d66/users/609145c64b294fcea2f5228c272d7b7c/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:28.290227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fa097514df496299798b78eb3f4d66, user_id=609145c64b294fcea2f5228c272d7b7c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:28.305024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:28.509106 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4115/8231] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:15:28 2022] PUT /identity/v3/projects/37fa097514df496299798b78eb3f4d66/users/609145c64b294fcea2f5228c272d7b7c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:28.530700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:28.531638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:28.532336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:28.672934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] MFA Rules not processed for user `609145c64b294fcea2f5228c272d7b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:28.677192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:28.929519 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4117/8232] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:28.976991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:28.980289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:29.073832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:29.373486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7eb5fc-e3b8-411f-80d1-29101c946a46 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:29.387510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:29.392075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:29.392075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:29.392075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:29.421214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:29.433783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb4a13-2b19-4833-8c36-eb32933ed7b6 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:29.475614 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4116/8233] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:38.039809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:38.042819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:38.493091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd960e-a324-48a2-9667-9fe8e4df31b3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:38.512240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:38.513562 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:38.520219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:38.522956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] PATH_INFO: `/v3/users/d263609e1c3149cba68ba8e6d59e517f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:38.526955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d263609e1c3149cba68ba8e6d59e517f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:38.547414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:38.955175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd263609e1c3149cba68ba8e6d59e517f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:39.074420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd263609e1c3149cba68ba8e6d59e517f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:39.093457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:39.100234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd263609e1c3149cba68ba8e6d59e517f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:39.151819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd263609e1c3149cba68ba8e6d59e517f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:39.153123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd263609e1c3149cba68ba8e6d59e517f'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:39.178627 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4118/8234] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:38 2022] DELETE /identity/v3/users/d263609e1c3149cba68ba8e6d59e517f => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:39.185376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:39.186129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:39.186297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:39.287627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:39.287627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:39.612494 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4117/8235] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:39.628275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:39.631502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:39.937193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc165f0-f678-4b63-82e4-f76e260d7ad8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:39.958636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:39.959785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:39.964654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:39.965258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:40.021897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:40.028023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444701e-358e-4340-81e7-878e51673429 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:40.077433 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4119/8236] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:40.892040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:40.895890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:40.981585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9728-4450-48ac-b028-08a4796aa5cc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:41.011058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:41.017029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:41.017575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:41.018107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] PATH_INFO: `/v3/projects/2b36621ba6fe4c39a1efe91e510935ae` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:41.034724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b36621ba6fe4c39a1efe91e510935ae)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:41.038791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:41.372581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b36621ba6fe4c39a1efe91e510935ae', 'request_id': 'req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:41.544621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b36621ba6fe4c39a1efe91e510935ae', 'request_id': 'req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:41.567864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b36621ba6fe4c39a1efe91e510935ae', 'request_id': 'req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:41.626056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] The token cache is being invalidate because project 2b36621ba6fe4c39a1efe91e510935ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:15:41.626728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:41.636748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-eca9418b-3b8f-4a7a-bb42-c07d04eb5a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:41.640172 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4118/8237] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:40 2022] DELETE /identity/v3/projects/2b36621ba6fe4c39a1efe91e510935ae => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:41.648504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:41.649302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:41.649515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:41.717537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:41.720363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:42.085728 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4120/8238] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:42.088328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:42.089052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:42.089052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:42.190866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:42.198030 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:42.255764 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4119/8239] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:42.258262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:42.338299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45e3c8-b8b2-4b3f-a66a-5c5eb101666d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:42.386971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:42.388457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:42.393648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:42.395455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:42.401612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:15:42.402711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:42.412631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:42.495866 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4121/8240] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:15:42.502952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:42.544931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ae6a6-bdda-4144-98bf-0847a2bd52bb None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:42.570269 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:42.571944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:42.574806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:42.576544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:42.582080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:42.589519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:42.667872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:42.859185 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4120/8241] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:15:42 2022] POST /identity/v3/projects => generated 363 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:15:42.861561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:42.909216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae190-9940-43a2-9041-2b1e4b76cfa4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:43.238601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:43.289331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:43.292944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:43.292944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:43.292944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:43.294334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:43.298684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:43.517806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4122/8242] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:15:42 2022] POST /identity/v3/users => generated 282 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:15:43.525289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:43.590801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:43.595022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:43.602774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdeb82-cfcb-4faa-b36d-abf701b54868 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:43.673483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:43.678432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:43.681894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:43.682765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:43.694958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:43.706138 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:43.807125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4121/8243] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:15:43.810406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:43.886432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce753a-a3a7-4827-868c-b8613f84e0bc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:43.922194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:43.927421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:43.928046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:43.928549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:43.929874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:43.949341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:44.034075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2268-b2e0-46dd-9c54-a0dd934c64fc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:44.056870 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4122/8244] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:15:44.057350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:44.057350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:44.057350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:44.057350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:44.063235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:44.069577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:44.109649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9ce-5668-460c-bb75-48f4f4217d65 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:44.140825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:44.142551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:44.143344 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:44.144104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] PATH_INFO: `/v3/projects/6a072dc148e441259946cb3b757b2645/users/0b7e2c05272d41ae9ef70c71992a0aa7/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:44.214326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a072dc148e441259946cb3b757b2645, user_id=0b7e2c05272d41ae9ef70c71992a0aa7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:44.219895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897350c-e3e1-4a18-8375-d3e5116a9e1b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:44.380533 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4123/8245] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:15:44 2022] PUT /identity/v3/projects/6a072dc148e441259946cb3b757b2645/users/0b7e2c05272d41ae9ef70c71992a0aa7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:44.389757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:44.390264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:44.390845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:44.609168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] MFA Rules not processed for user `0b7e2c05272d41ae9ef70c71992a0aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:44.615483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:44.702963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:44.715872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:44.873680 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4123/8246] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 1284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:45.019791 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4124/8247] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:45.025542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:45.092920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8f0e0-34bb-49c6-bf27-3837b04bebe2 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:45.500486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:45.506091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:45.506558 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:45.507068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:45.518235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:45.533476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:45.812873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:45.865616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4124/8248] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:15:45 2022] POST /identity/v3/projects => generated 363 bytes in 841 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:15:45.872473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:45.936608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f62a9-2c4c-4441-9fc9-052030fb8ed7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:46.328684 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:46.334902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:46.354746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:46.356854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:46.366089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:46.369603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:46.638658 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4125/8249] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:15:45 2022] POST /identity/v3/users => generated 288 bytes in 768 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:15:46.646598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:46.689840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7019ea-e2f5-4dee-8bb5-ec2910cbc6d4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:46.719954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:46.720778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:46.721182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:46.721631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:46.723316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:46.750470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:46.818481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4125/8250] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:15:46.824732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:46.883350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631315d-ee65-40c2-8d86-fd08587deb67 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:46.927323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:46.928750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:46.932883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:46.933631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] PATH_INFO: `/v3/projects/e48041db84ea40ce97188699ecbcc533/users/c377897d6f3e435582e3aa420ad934a6/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:47.016460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48041db84ea40ce97188699ecbcc533, user_id=c377897d6f3e435582e3aa420ad934a6, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:47.030016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:47.188547 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4126/8251] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:15:46 2022] PUT /identity/v3/projects/e48041db84ea40ce97188699ecbcc533/users/c377897d6f3e435582e3aa420ad934a6/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:47.191113 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:47.230027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699d97-0243-40a9-9f39-6fa67b583133 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:47.686159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:47.688973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:47.688973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:47.690939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:47.692591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:47.696075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44822486-cb8b-4fd3-b6e2-793c7c5efd84 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:47.755331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:47.756157 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4126/8252] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:15:47.796725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:47.830422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea74a18-02e0-4536-83bd-462d9cf3f8cd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:47.885495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:47.887929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:47.892241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:47.892874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] PATH_INFO: `/v3/projects/e48041db84ea40ce97188699ecbcc533/users/c377897d6f3e435582e3aa420ad934a6/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:47.903240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48041db84ea40ce97188699ecbcc533, user_id=c377897d6f3e435582e3aa420ad934a6, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:47.913196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:47.982650 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4127/8253] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:15:47 2022] PUT /identity/v3/projects/e48041db84ea40ce97188699ecbcc533/users/c377897d6f3e435582e3aa420ad934a6/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:48.009373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:48.010023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:48.011373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:48.165820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] MFA Rules not processed for user `c377897d6f3e435582e3aa420ad934a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:48.169990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:48.672504 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4127/8254] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 665 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:48.689861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:48.696922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:48.704244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:48.708987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:49.004622 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40743464-c7ee-415c-b094-91e65013cd1f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:49.022702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:49.024584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:49.025404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:49.026114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:49.084034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:49.086716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:49.138117 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4128/8255] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:49.186651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29af93-a579-469f-a2b0-a07694a402dc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:49.231737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:49.234385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:49.234894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:49.235456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:49.254389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:49.634327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:49.638395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:49.694218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:49.705169 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4128/8256] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 1018 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:49.731329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef0b0-7dba-401b-a6f4-5746b9f479fb service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:49.745364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:49.746827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:49.748348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:49.750513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:49.790145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:50.068554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:50.072224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:50.150400 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4129/8257] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:52.397706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:52.400257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:53.014025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231a7b-7633-4610-973b-169a4ac947c0 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:53.042611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:53.044045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:53.044555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:53.045051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] PATH_INFO: `/v3/users/20ea249bc011499eb7c8d8318eda51d4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:53.052848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ea249bc011499eb7c8d8318eda51d4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:53.084946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:53.460286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:53.502170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ea249bc011499eb7c8d8318eda51d4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:53.504424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ea249bc011499eb7c8d8318eda51d4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:53.698436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:53.710451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ea249bc011499eb7c8d8318eda51d4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:53.716257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:53.827196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3783e8-77b3-425e-a1bd-e9b2b17eb517 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:53.850225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:53.851760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:53.851928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:53.852291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] PATH_INFO: `/v3/users/b4ad5f385e5749b291852db06e1e8896` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:53.855847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ad5f385e5749b291852db06e1e8896)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:53.861030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:53.863395 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ea249bc011499eb7c8d8318eda51d4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:53.945944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ee388c7d-4ea8-4b05-aa62-a07537de913d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ea249bc011499eb7c8d8318eda51d4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:53.999818 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4129/8258] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:52 2022] DELETE /identity/v3/users/20ea249bc011499eb7c8d8318eda51d4 => generated 0 bytes in 1603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:15:54.007706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:54.008489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:54.010976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:54.163655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:54.165318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:54.435056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ad5f385e5749b291852db06e1e8896'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:54.443168 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4130/8259] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:54.462946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:54.469171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:54.576675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ad5f385e5749b291852db06e1e8896'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:54.664707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ad5f385e5749b291852db06e1e8896'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:54.786449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ad5f385e5749b291852db06e1e8896'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:54.789655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116151c7-3f7c-45ad-bc97-4ba37992b91a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:54.790656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ad5f385e5749b291852db06e1e8896'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:54.824688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:54.829335 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4130/8260] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:53 2022] DELETE /identity/v3/users/b4ad5f385e5749b291852db06e1e8896 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:54.831262 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:54.832829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:54.833526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:54.862036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:54.951994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:54.955104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:55.009529 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4131/8261] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:15:55.690212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:55.694945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:56.120854 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28ff2-35cd-49d8-b825-499a7926991c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:56.147217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:56.153010 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:56.154128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:56.154881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] PATH_INFO: `/v3/projects/6214daf08cc94e838091c822b344d70e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:56.160086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6214daf08cc94e838091c822b344d70e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:56.180820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:56.289789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:56.502211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6214daf08cc94e838091c822b344d70e', 'request_id': 'req-8473183f-2926-4468-bb7c-c55d924c0480'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:56.540273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6214daf08cc94e838091c822b344d70e', 'request_id': 'req-8473183f-2926-4468-bb7c-c55d924c0480'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:56.561896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:56.570285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:56.579666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6214daf08cc94e838091c822b344d70e', 'request_id': 'req-8473183f-2926-4468-bb7c-c55d924c0480'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:56.652078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695c0b-dbb2-4833-891d-15b4d1fb31cd service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:56.792186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] The token cache is being invalidate because project 6214daf08cc94e838091c822b344d70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:15:56.792762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:56.796355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:56.809398 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4131/8262] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:55 2022] DELETE /identity/v3/projects/6214daf08cc94e838091c822b344d70e => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:56.816415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:56.820512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:56.825257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:56.850412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283877-784a-441f-a771-901126c8074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:56.851896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283877-784a-441f-a771-901126c8074a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:56.853223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283877-784a-441f-a771-901126c8074a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:56.854162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283877-784a-441f-a771-901126c8074a admin admin] PATH_INFO: `/v3/projects/4ac6391a68054025ac8780b280c2a371` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:56.863756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283877-784a-441f-a771-901126c8074a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac6391a68054025ac8780b280c2a371)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:56.871578 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283877-784a-441f-a771-901126c8074a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:57.133914 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac6391a68054025ac8780b280c2a371', 'request_id': 'req-6b283877-784a-441f-a771-901126c8074a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:57.162101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473183f-2926-4468-bb7c-c55d924c0480 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:57.250988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac6391a68054025ac8780b280c2a371', 'request_id': 'req-6b283877-784a-441f-a771-901126c8074a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:57.273112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac6391a68054025ac8780b280c2a371', 'request_id': 'req-6b283877-784a-441f-a771-901126c8074a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:57.329709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] The token cache is being invalidate because project 4ac6391a68054025ac8780b280c2a371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:15:57.330463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:57.351671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:57.355377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4132/8263] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:56 2022] DELETE /identity/v3/projects/4ac6391a68054025ac8780b280c2a371 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:57.356678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:57.362058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:57.480596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:57.481746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:57.482240 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:57.482722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] PATH_INFO: `/v3/users/0b7e2c05272d41ae9ef70c71992a0aa7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:57.499602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7e2c05272d41ae9ef70c71992a0aa7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:57.506256 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:57.650283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283877-784a-441f-a771-901126c8074a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:57.687292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:57.689485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:57.690200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:57.691569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] PATH_INFO: `/v3/users/eaf66dfd6d034c05973bc1e1c291932c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:57.702955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf66dfd6d034c05973bc1e1c291932c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:57.708559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:58.039874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7e2c05272d41ae9ef70c71992a0aa7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.193890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7e2c05272d41ae9ef70c71992a0aa7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.213609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:58.239759 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7e2c05272d41ae9ef70c71992a0aa7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.287838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf66dfd6d034c05973bc1e1c291932c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.301122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf66dfd6d034c05973bc1e1c291932c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.346430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7e2c05272d41ae9ef70c71992a0aa7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.348662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46f917cc-ebae-4cf5-bef5-f1a44499d9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7e2c05272d41ae9ef70c71992a0aa7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.391580 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4132/8264] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:56 2022] DELETE /identity/v3/users/0b7e2c05272d41ae9ef70c71992a0aa7 => generated 0 bytes in 1581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:58.394319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c359-4e51-4086-9b53-994dbd860c92 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:58.394807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c359-4e51-4086-9b53-994dbd860c92 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:58.395413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c359-4e51-4086-9b53-994dbd860c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:58.399041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf66dfd6d034c05973bc1e1c291932c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.448678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf66dfd6d034c05973bc1e1c291932c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.477369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c458c359-4e51-4086-9b53-994dbd860c92 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:58.483347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-1d048bf1-b717-499f-ae61-0265256cde43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf66dfd6d034c05973bc1e1c291932c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:15:58.488601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c458c359-4e51-4086-9b53-994dbd860c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:58.502420 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4133/8265] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:15:57 2022] DELETE /identity/v3/users/eaf66dfd6d034c05973bc1e1c291932c => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:15:58.502420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:58.502420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:58.502420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:58.527731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:58.570784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:58.579363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:58.753926 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4133/8266] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:58.771712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:58.772407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:58.773281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:58.844868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:15:58.847906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:58.887689 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4134/8267] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:58.891211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:58.902441 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4134/8268] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:15:58.924533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:58.928860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:58.939339 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a9531-e3a8-4fe4-afd9-d92311419d03 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:58.992919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:58.994041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:58.999972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:59.007902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:59.012695 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:15:59.013599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:59.017375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:59.101531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4135/8269] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:15:59.103712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:59.159751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b121d1-cc6c-470b-8ac3-f90ae8baaf60 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:59.220648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:59.260301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:59.260301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:59.260301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:59.260301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:59.260301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:59.352287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990f24-27fa-43a0-bce7-4423e0d929b7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:59.375213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:59.376387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:59.378621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:59.378621 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:59.441263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:59.448974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:15:59.484781 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4135/8270] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:15:59.533855 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4136/8271] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:15:59 2022] POST /identity/v3/projects => generated 379 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:15:59.540526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:59.571927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037f4f-fc0d-401e-9a80-bdadb5c1bce0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:15:59.684247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:15:59.693844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:15:59.984678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:15:59.985864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:15:59.985864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:15:59.986418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:15:59.988768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:15:59.992884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:00.083153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851136-0eae-48d3-81dd-1d9a4d44c5f2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:00.102077 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:00.102792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:00.103095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:00.103420 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] PATH_INFO: `/v3/projects/25824f446a4344c18bafe3afb8dde28f` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:00.109925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=25824f446a4344c18bafe3afb8dde28f)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:00.115323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:00.126302 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4136/8272] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:15:59 2022] POST /identity/v3/users => generated 290 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:16:00.128157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:00.166691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d736-f4b2-4dd9-8058-f8659bad5e78 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:00.192827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:00.192827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:00.192827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:00.192827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:00.193862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:00.204522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:00.265119 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4137/8273] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:00.266979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:00.314166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c97a8-a63d-4fb7-aad8-82c8dabb06ff admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:00.333942 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:00.345597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:00.348616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:00.349627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:00.352564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:00.356602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:00.378668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:00.425399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25824f446a4344c18bafe3afb8dde28f', 'request_id': 'req-023803a3-5d14-423b-b025-dbc367a037ae'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:00.446116 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4138/8274] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:00.448903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:00.500398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97b31c-621d-4767-b4cd-f2fc7f506a3c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:00.521609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25824f446a4344c18bafe3afb8dde28f', 'request_id': 'req-023803a3-5d14-423b-b025-dbc367a037ae'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:00.551329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25824f446a4344c18bafe3afb8dde28f', 'request_id': 'req-023803a3-5d14-423b-b025-dbc367a037ae'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:00.642013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:00.689368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] The token cache is being invalidate because project 25824f446a4344c18bafe3afb8dde28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:00.691933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:00.698470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-023803a3-5d14-423b-b025-dbc367a037ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:00.708667 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4137/8275] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:15:59 2022] DELETE /identity/v3/projects/25824f446a4344c18bafe3afb8dde28f => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:00.717417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:00.742374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:00.742985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:00.906440 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:00.913699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:01.011806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:01.018441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:01.018441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:01.018441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] PATH_INFO: `/v3/projects/06b106a291b44599bb30d5040d82a3cb/users/586e44616297471eaf68e3eee955f48a/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:01.088612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b106a291b44599bb30d5040d82a3cb, user_id=586e44616297471eaf68e3eee955f48a, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:01.096591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca216-9a71-41ac-9212-78bb309deb08 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:01.215000 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4138/8276] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:01.217310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:01.220071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:01.273299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460132-28cc-463e-a5c6-b310755354dd None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:01.287015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:01.289561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:01.290824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:01.292119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] PATH_INFO: `/v3/projects/6a072dc148e441259946cb3b757b2645` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:01.295301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a072dc148e441259946cb3b757b2645)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:01.303704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:01.307339 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4139/8277] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:00 2022] PUT /identity/v3/projects/06b106a291b44599bb30d5040d82a3cb/users/586e44616297471eaf68e3eee955f48a/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:01.309785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608f8-c915-4362-956a-bf0e0b1aceef None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:01.310296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608f8-c915-4362-956a-bf0e0b1aceef None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:01.312039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608f8-c915-4362-956a-bf0e0b1aceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:01.412072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-26d608f8-c915-4362-956a-bf0e0b1aceef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:01.436184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-26d608f8-c915-4362-956a-bf0e0b1aceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:01.609722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a072dc148e441259946cb3b757b2645', 'request_id': 'req-46053033-cf5e-492a-a379-2d6d73d75bba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:01.647910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a072dc148e441259946cb3b757b2645', 'request_id': 'req-46053033-cf5e-492a-a379-2d6d73d75bba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:01.662062 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a072dc148e441259946cb3b757b2645', 'request_id': 'req-46053033-cf5e-492a-a379-2d6d73d75bba'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:01.799421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4140/8278] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:01.803033 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:01.804076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:01.804870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:01.850814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:01.854723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:01.892282 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] The token cache is being invalidate because project 6a072dc148e441259946cb3b757b2645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:01.892747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:01.894906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:01.899056 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4139/8279] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:01 2022] DELETE /identity/v3/projects/6a072dc148e441259946cb3b757b2645 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:01.901244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:01.905832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:02.057835 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4141/8280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:02.061540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:02.064562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:02.089290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65dd5-dd4d-44b9-a615-b434d8d43537 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:02.103636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:02.111273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:02.113265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:02.113783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:02.114302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] PATH_INFO: `/v3/users/c377897d6f3e435582e3aa420ad934a6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:02.117552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c377897d6f3e435582e3aa420ad934a6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:02.138197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:02.140120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053033-cf5e-492a-a379-2d6d73d75bba admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:02.156563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:02.157805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:02.158338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:02.159418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:02.162383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:16:02.162383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:02.166742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:02.226419 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4140/8281] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:16:02.234505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:02.241137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:02.471117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:02.496747 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd10d6-3328-4636-be05-8d3b9c8865fe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:02.507090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:02.507828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:02.508109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:02.508405 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:02.526779 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c377897d6f3e435582e3aa420ad934a6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:02.534866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c377897d6f3e435582e3aa420ad934a6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:02.535205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:02.547236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:02.617193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4141/8282] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:02.620671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:02.672165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c5abe-7882-4c89-b2be-42409b74b4b0 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:02.704321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c377897d6f3e435582e3aa420ad934a6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:02.719775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:02.721602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:02.722543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:02.723404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:02.725324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:02.745470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:02.794765 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c377897d6f3e435582e3aa420ad934a6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:02.860952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c377897d6f3e435582e3aa420ad934a6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:02.899095 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4142/8283] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:02 2022] DELETE /identity/v3/users/c377897d6f3e435582e3aa420ad934a6 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:03.018132 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4142/8284] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:02 2022] POST /identity/v3/projects => generated 379 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:03.023563 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:03.026671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:03.346285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2cf5-a48a-4af8-8a8b-c320c2760805 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:03.603114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:03.603114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:03.603622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:03.606306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:03.612420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:03.620523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:03.890954 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4143/8285] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:03 2022] POST /identity/v3/users => generated 290 bytes in 868 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:03.892884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:03.932878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b75c0-ddfe-4ba6-8d4f-bc38d3b21ef9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:03.975647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:03.977773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:03.978764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:03.990946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:03.993746 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:04.004391 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:04.061145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:04.065622 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4143/8286] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:04.134601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe59e3-d3d9-48aa-9c55-4df1fd0120fa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:04.203678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:04.209104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:04.214051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:04.214940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:04.222958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:04.226944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:04.324440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4144/8287] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:16:04.333238 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:04.375645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5926d-0d6d-478b-8ade-822a3b3bc632 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:04.408915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:04.425012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:04.444104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:04.445003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] PATH_INFO: `/v3/projects/cad18cb30abe49648a8eb22002663311/users/bd86d19e5c794a81ae9639c3de3e79a1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:04.527819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad18cb30abe49648a8eb22002663311, user_id=bd86d19e5c794a81ae9639c3de3e79a1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:04.533911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ecc74-6dca-4a14-8a83-dde0d09e37e3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:04.906602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:04.910728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:04.932804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06766228-c060-4943-910e-c7439ce85cb5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:04.941014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:04.942081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:04.942566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:04.943346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] PATH_INFO: `/v3/projects/e48041db84ea40ce97188699ecbcc533` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:04.945844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48041db84ea40ce97188699ecbcc533)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:04.949609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:04.993059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4144/8288] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:04 2022] PUT /identity/v3/projects/cad18cb30abe49648a8eb22002663311/users/bd86d19e5c794a81ae9639c3de3e79a1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:05.006041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:05.006494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:05.007250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:05.042756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:05.045098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:05.158436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:05.253237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48041db84ea40ce97188699ecbcc533', 'request_id': 'req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:05.621541 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4145/8289] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:05.621541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:05.621541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:05.623659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48041db84ea40ce97188699ecbcc533', 'request_id': 'req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:05.623659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48041db84ea40ce97188699ecbcc533', 'request_id': 'req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:05.623659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] The token cache is being invalidate because project e48041db84ea40ce97188699ecbcc533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:05.623659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:05.625167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-59dbcf6a-99a5-4155-8c4a-119d5ae87eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:05.625167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4145/8290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:04 2022] DELETE /identity/v3/projects/e48041db84ea40ce97188699ecbcc533 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:05.625167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f1c7-6655-4c20-ae60-398e6be46292 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:05.625167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f1c7-6655-4c20-ae60-398e6be46292 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:05.625167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95f1c7-6655-4c20-ae60-398e6be46292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:05.631345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:05.695997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1e95f1c7-6655-4c20-ae60-398e6be46292 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:05.699408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1e95f1c7-6655-4c20-ae60-398e6be46292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:05.762350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831018c-24b3-41f5-9070-003617e0df9c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:05.934242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4146/8291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:05.959083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:05.968258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:05.968258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:05.992257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:05.993149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:05.993924 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:05.994181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:06.001053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:06.006587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:06.010119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:06.028253 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4147/8292] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:06.035495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:06.035785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:06.039640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:06.079108 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4146/8293] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:16:06.083455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d336c-0d68-4b60-a177-01da769dd874 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:06.108327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:06.109881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:06.112954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:06.114017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:06.117677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:16:06.118733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:06.124019 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:06.155438 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4148/8294] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:16:06.162978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:06.215217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29956c9-89d8-4ea6-985a-6e46aaa94a0c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:06.226732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:06.227797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:06.283036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:06.283036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:06.283036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:06.283036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:06.545046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4147/8295] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:06 2022] POST /identity/v3/projects => generated 367 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:06.547555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:06.586257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d460-c5da-434c-9391-dcfb4ff931b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:06.872115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:06.875386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:06.875850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:06.877858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:06.880459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:06.888922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:07.089964 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4149/8296] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:06 2022] POST /identity/v3/users => generated 284 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:07.098221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:07.133039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c16ee-40ab-4fd5-aaf1-cee214b6394c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:07.140181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:07.141568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:07.142226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:07.142885 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:07.144636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:07.147495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:07.171830 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4148/8297] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:07.175764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:07.231710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a07129-bbe7-41bf-8036-73a848ba125e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:07.267872 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:07.269061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:07.271448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:07.272278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:07.285890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:07.294285 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6aa70-6eff-4b8d-9830-5dc1f9e2f0db admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:07.414535 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4150/8298] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:07.421021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:07.463099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7aa3f-6a68-46d7-be49-6594f109b26c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:07.492755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:07.493833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:07.494412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:07.494933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] PATH_INFO: `/v3/projects/8cd5a64573904e89a50e866af17958f9/users/37a8a18f3f6349b8b7fd52c2cd56a1a5/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:07.619897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd5a64573904e89a50e866af17958f9, user_id=37a8a18f3f6349b8b7fd52c2cd56a1a5, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:07.641449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:07.839373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4149/8299] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:07 2022] PUT /identity/v3/projects/8cd5a64573904e89a50e866af17958f9/users/37a8a18f3f6349b8b7fd52c2cd56a1a5/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:16:07.857978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:07.858481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:07.859817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:07.967941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] MFA Rules not processed for user `37a8a18f3f6349b8b7fd52c2cd56a1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:07.972910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:08.030493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:08.327992 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4151/8300] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:08.333984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:08.741025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa19c-3373-4b9b-925e-ba707d5ce2af admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:08.758161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:08.759497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:08.760117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:08.760847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:08.772492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:08.778530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:09.004880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:09.005748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4150/8301] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:08 2022] POST /identity/v3/projects => generated 367 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:09.052743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6452d7-35d4-4c54-9c95-56b110bac3db None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:09.275596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:09.277786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:09.289733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:09.291159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:09.292560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:09.320162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:09.570577 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4152/8302] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:09 2022] POST /identity/v3/users => generated 290 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:09.579168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:09.653378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00add595-ad0a-4bb2-b3ce-06fd60d17e2a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:09.725057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:09.725608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:09.734082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:09.734644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:09.735995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:09.755807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:09.794445 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4151/8303] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:09.801565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:09.845222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f630b7-40a8-4d91-87e1-e18d7b23b21b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:09.877186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:09.878397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:09.878906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:09.879691 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] PATH_INFO: `/v3/projects/890ae8abc38a484090b53e511c8ffb6d/users/cbe423a5d67944e4ad560dc08c4a2e57/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:10.016601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890ae8abc38a484090b53e511c8ffb6d, user_id=cbe423a5d67944e4ad560dc08c4a2e57, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:10.025087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc263c-b740-4ce8-818e-1cc3c1295b06 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:10.208040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4153/8304] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:09 2022] PUT /identity/v3/projects/890ae8abc38a484090b53e511c8ffb6d/users/cbe423a5d67944e4ad560dc08c4a2e57/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:10.220127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:10.258550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36626d-0b35-4ebd-8780-b8c638a06869 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:10.308319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:10.323461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:10.325277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:10.325277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:10.446368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] MFA Rules not processed for user `bd86d19e5c794a81ae9639c3de3e79a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:10.451318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:10.845340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:10.849402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:10.851318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:10.852090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:10.854602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:10.865196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:10.935532 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4152/8305] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 718 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:10.964720 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:11.050741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df5fd7-2270-4a72-9572-5122b9a25323 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:11.090500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:11.097312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:11.098423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:11.099713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] PATH_INFO: `/v3/projects/890ae8abc38a484090b53e511c8ffb6d/users/cbe423a5d67944e4ad560dc08c4a2e57/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:11.108907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890ae8abc38a484090b53e511c8ffb6d, user_id=cbe423a5d67944e4ad560dc08c4a2e57, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:11.117778 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4154/8306] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 791 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:11.120622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:11.135512 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902a0c5-fb81-405f-97a7-0800d62a7db7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:11.139083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:11.187502 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4153/8307] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:10 2022] PUT /identity/v3/projects/890ae8abc38a484090b53e511c8ffb6d/users/cbe423a5d67944e4ad560dc08c4a2e57/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:16:11.211682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:11.212270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:11.213029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:11.249743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:11.314492 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d31d9-ebfd-4de2-a5c7-eaaaeec1d713 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:11.378163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] MFA Rules not processed for user `cbe423a5d67944e4ad560dc08c4a2e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:11.393466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:11.748035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:11.749328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:11.751551 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:11.754429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:11.756008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:11.765786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:11.896556 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4154/8308] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 684 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:16:11.918314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:11.922127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:12.027386 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4155/8309] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:11 2022] POST /identity/v3/projects => generated 379 bytes in 904 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:12.048512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:12.306585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d750c5-5e1d-4734-8d09-b696ba4295d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:12.442016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.472302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0be3a-661d-4669-be86-86684f683922 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:12.494481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:12.496096 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:12.496879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:12.497606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:12.500486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:12.507613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:12.600506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:12.602172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:12.603633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:12.604707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:12.687705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4156/8310] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:12 2022] POST /identity/v3/users => generated 296 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:12.689664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:12.746677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a57be-1f54-4548-9433-88fd948e2c5f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:12.782316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:12.783685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:12.784593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:12.785351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:12.787463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:12.799814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:12.882112 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4157/8311] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:12.885517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:12.934945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593022f8-4531-40b2-b919-b3e3a0b6fc16 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:12.954516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:12.956311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:12.958025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:12.958579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] PATH_INFO: `/v3/projects/23237033e5284cb5b658c9eca5554894/users/7e7f0939485541928b4cc74337e11c51/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:13.040687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23237033e5284cb5b658c9eca5554894, user_id=7e7f0939485541928b4cc74337e11c51, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:13.040952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:13.043497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:13.052820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:13.136572 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4155/8312] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 1222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:16:13.228176 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4158/8313] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:12 2022] PUT /identity/v3/projects/23237033e5284cb5b658c9eca5554894/users/7e7f0939485541928b4cc74337e11c51/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:13.234305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:13.307302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16a991-b5fc-481c-a509-3afffcb5e5a6 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:13.671303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:13.672249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:13.672684 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:13.673105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:13.680787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:13.707217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b251d9d-ff05-4835-a9d6-8fa9f5860692 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:13.798854 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4156/8314] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:13.804533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:13.866048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf545f0-2e8f-4abe-a341-ef781991f9e5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:13.892811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:13.895508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:13.896440 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:13.897185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] PATH_INFO: `/v3/projects/23237033e5284cb5b658c9eca5554894/users/7e7f0939485541928b4cc74337e11c51/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:13.903646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23237033e5284cb5b658c9eca5554894, user_id=7e7f0939485541928b4cc74337e11c51, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:13.910312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3bc6c-30c4-4f52-ad54-fcd1ca168701 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:13.940934 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4159/8315] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:13 2022] PUT /identity/v3/projects/23237033e5284cb5b658c9eca5554894/users/7e7f0939485541928b4cc74337e11c51/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:19.320671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:19.327287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:19.327287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:19.466034 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] MFA Rules not processed for user `7e7f0939485541928b4cc74337e11c51`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:19.479026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:19.804809 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4157/8316] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:16:19.827080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:19.827782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:19.828133 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:19.937998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] MFA Rules not processed for user `bd86d19e5c794a81ae9639c3de3e79a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:19.942545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:20.106035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:20.223468 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4160/8317] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:20.257056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:20.259064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:20.274557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:20.331699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:20.334149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:20.600777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3793f-8599-465a-957b-601371fb66f8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:20.675424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:20.675765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:20.676719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:20.676719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:20.706812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:20.717263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561edb-d409-4359-87a7-c4219093c80f service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:20.744444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac94b5-d3df-4f9f-86d0-b081b2b6d7b7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:20.760656 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4158/8318] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:16:20.783069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:20.789746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:20.790338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:20.790888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:20.797902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:21.250995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:21.260947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:21.306157 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4161/8319] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:16:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 975 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 21:16:22.488616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2933-854f-479e-81d7-d1853176a7a2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:22.491927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2933-854f-479e-81d7-d1853176a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:22.492852 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2933-854f-479e-81d7-d1853176a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b9cd2933-854f-479e-81d7-d1853176a7a2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:16:22.526990 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:16:22.534748 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:16:22.544545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4159/8320] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:16:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:16:22.839656 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:23.260752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb8d4-9008-48a0-9ec4-2a0acad6e844 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:23.270489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:23.272142 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:23.273070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:23.273705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] PATH_INFO: `/v3/users/37a8a18f3f6349b8b7fd52c2cd56a1a5` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:23.281754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a8a18f3f6349b8b7fd52c2cd56a1a5)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:23.281754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:23.375251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:23.690737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a8a18f3f6349b8b7fd52c2cd56a1a5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:23.694798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a8a18f3f6349b8b7fd52c2cd56a1a5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:23.913982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a8a18f3f6349b8b7fd52c2cd56a1a5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:23.972852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a8a18f3f6349b8b7fd52c2cd56a1a5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:24.000451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a8a18f3f6349b8b7fd52c2cd56a1a5'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:24.017670 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4162/8321] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:22 2022] DELETE /identity/v3/users/37a8a18f3f6349b8b7fd52c2cd56a1a5 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:24.026350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27241854-5a25-4542-b776-e428c687d307 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:24.027397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27241854-5a25-4542-b776-e428c687d307 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:24.027775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27241854-5a25-4542-b776-e428c687d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:24.131470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-27241854-5a25-4542-b776-e428c687d307 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:24.150476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-27241854-5a25-4542-b776-e428c687d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:24.494544 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4160/8322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:24.562126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:24.567367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:25.061241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa425e-983d-461c-be55-76eaf0ef23fa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:25.113047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:25.114480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:25.114971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:25.115528 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:25.192136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:25.211408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:25.244353 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4163/8323] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:26.946417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:26.948201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:26.948988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:27.097678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:27.109246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:27.326565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:27.330031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:27.337902 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4161/8324] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:27.386235 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985b6f8-49f8-47d0-81a8-5e90ed1e8830 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:27.415100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:27.419839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:27.420473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:27.421300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:27.425479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:27.432552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:27.638124 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4164/8325] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:27 2022] POST /identity/v3/projects => generated 379 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:16:27.644827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:27.748554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d82d89-109d-4bae-9593-d464f3f7c3d3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:27.878581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:27.951018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:27.960125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:28.255281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:28.256630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:28.257121 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:28.257655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:28.263052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:28.274592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:28.369175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c1499-130a-4a2e-bb7b-79cb80ddfb14 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:28.410199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:28.417256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:28.419194 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:28.419812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] PATH_INFO: `/v3/users/bd86d19e5c794a81ae9639c3de3e79a1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:28.430322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd86d19e5c794a81ae9639c3de3e79a1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:28.439936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:28.454135 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4162/8326] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:27 2022] POST /identity/v3/users => generated 296 bytes in 810 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:16:28.458732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:28.467386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:28.541549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242ddf-3ec9-4c13-b980-cf1ba2aafdbd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:28.552658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:28.563478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:28.565771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:28.566454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:28.567417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] PATH_INFO: `/v3/projects/8cd5a64573904e89a50e866af17958f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:28.570315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd5a64573904e89a50e866af17958f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:28.589114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:28.896275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd86d19e5c794a81ae9639c3de3e79a1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:28.897508 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd86d19e5c794a81ae9639c3de3e79a1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:28.993919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd86d19e5c794a81ae9639c3de3e79a1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.057759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd86d19e5c794a81ae9639c3de3e79a1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.071470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd5a64573904e89a50e866af17958f9', 'request_id': 'req-b7b7a839-7214-4eef-8485-44b8038dc208'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.102908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd5a64573904e89a50e866af17958f9', 'request_id': 'req-b7b7a839-7214-4eef-8485-44b8038dc208'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.104337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd86d19e5c794a81ae9639c3de3e79a1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.124621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd5a64573904e89a50e866af17958f9', 'request_id': 'req-b7b7a839-7214-4eef-8485-44b8038dc208'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.158007 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4165/8327] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:27 2022] DELETE /identity/v3/users/bd86d19e5c794a81ae9639c3de3e79a1 => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:29.160429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:29.168114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:29.272486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] The token cache is being invalidate because project 8cd5a64573904e89a50e866af17958f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:29.273530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.276048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:29.293716 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4163/8328] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:28 2022] DELETE /identity/v3/projects/8cd5a64573904e89a50e866af17958f9 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:29.295901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:29.304825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:29.538165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603d1b-c7b8-40e0-952b-aec7f7307d43 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:29.568789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:29.579352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:29.580312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:29.581041 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:29.582514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:29.586103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:29.664486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a839-7214-4eef-8485-44b8038dc208 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:29.676220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:29.677856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:29.678361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:29.678850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] PATH_INFO: `/v3/users/cbe423a5d67944e4ad560dc08c4a2e57` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:29.682297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe423a5d67944e4ad560dc08c4a2e57)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:29.684993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:29.705485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4166/8329] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:29.712512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:29.718587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:29.766180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23057b-6672-481a-8890-4faa5a9c68c7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:29.777001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:29.778222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:29.778750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:29.779305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] PATH_INFO: `/v3/projects/6f35d354850f457d84b23ae003a92e9c/users/2acccf7e8abc4831af1efef1b9631723/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:29.825515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f35d354850f457d84b23ae003a92e9c, user_id=2acccf7e8abc4831af1efef1b9631723, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:29.832715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:29.994127 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4167/8330] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:29 2022] PUT /identity/v3/projects/6f35d354850f457d84b23ae003a92e9c/users/2acccf7e8abc4831af1efef1b9631723/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:30.001584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:30.015830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:30.061510 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe423a5d67944e4ad560dc08c4a2e57'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:30.193399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe423a5d67944e4ad560dc08c4a2e57'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:30.229858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe423a5d67944e4ad560dc08c4a2e57'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:30.294210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe423a5d67944e4ad560dc08c4a2e57'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:30.297655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe423a5d67944e4ad560dc08c4a2e57'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:30.306845 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14e04-56f1-4050-a938-20d412e071e7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:30.318010 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4164/8331] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:29 2022] DELETE /identity/v3/users/cbe423a5d67944e4ad560dc08c4a2e57 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:30.319875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:30.325358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:30.325663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:30.327283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:30.328244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:30.329072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:30.331853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:30.336841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:30.386044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4168/8332] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:30.397182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:30.410952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:30.482987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:30.531967 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee29595-4904-48d7-a3a5-1c4db179b55e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:30.732518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ad7b-1858-41dc-a692-ae7bf57aa65d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:30.787302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:30.787976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:30.798112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:30.801016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] PATH_INFO: `/v3/projects/cad18cb30abe49648a8eb22002663311` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:30.806835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad18cb30abe49648a8eb22002663311)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:30.810259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:30.827399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:30.828617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:30.829108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:30.829622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] PATH_INFO: `/v3/projects/6f35d354850f457d84b23ae003a92e9c/users/2acccf7e8abc4831af1efef1b9631723/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:30.849689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f35d354850f457d84b23ae003a92e9c, user_id=2acccf7e8abc4831af1efef1b9631723, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:30.862452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:30.912455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4169/8333] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:30 2022] PUT /identity/v3/projects/6f35d354850f457d84b23ae003a92e9c/users/2acccf7e8abc4831af1efef1b9631723/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:31.149119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad18cb30abe49648a8eb22002663311', 'request_id': 'req-3a2e54e7-af22-4455-a957-51ff7e058cd3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:31.178435 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad18cb30abe49648a8eb22002663311', 'request_id': 'req-3a2e54e7-af22-4455-a957-51ff7e058cd3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:31.200353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad18cb30abe49648a8eb22002663311', 'request_id': 'req-3a2e54e7-af22-4455-a957-51ff7e058cd3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:31.333309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] The token cache is being invalidate because project cad18cb30abe49648a8eb22002663311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:31.340276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:31.344423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:31.358919 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4165/8334] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:30 2022] DELETE /identity/v3/projects/cad18cb30abe49648a8eb22002663311 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:31.365573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:31.368615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:31.906675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd7c1-dc95-4d0c-8409-3f1db71f7ea5 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:32.172853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:32.175303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:32.176207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:32.177121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] PATH_INFO: `/v3/users/7e7f0939485541928b4cc74337e11c51` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:32.180052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7f0939485541928b4cc74337e11c51)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:32.184357 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:32.250477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:32.253778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:32.317467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e54e7-af22-4455-a957-51ff7e058cd3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:32.347836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:32.351253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:32.352130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:32.352949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] PATH_INFO: `/v3/projects/890ae8abc38a484090b53e511c8ffb6d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:32.356981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=890ae8abc38a484090b53e511c8ffb6d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:32.365205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:32.524634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7f0939485541928b4cc74337e11c51'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.530382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7f0939485541928b4cc74337e11c51'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.550701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:32.591630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:32.640125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890ae8abc38a484090b53e511c8ffb6d', 'request_id': 'req-e26d1efd-1b2e-47e0-babe-26950e69fc9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.664680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890ae8abc38a484090b53e511c8ffb6d', 'request_id': 'req-e26d1efd-1b2e-47e0-babe-26950e69fc9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.711702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890ae8abc38a484090b53e511c8ffb6d', 'request_id': 'req-e26d1efd-1b2e-47e0-babe-26950e69fc9a'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.737794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7f0939485541928b4cc74337e11c51'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.864014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7f0939485541928b4cc74337e11c51'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.904378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-130d22ff-c9a2-4c34-b319-9dd9b92ff284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7f0939485541928b4cc74337e11c51'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.925542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] The token cache is being invalidate because project 890ae8abc38a484090b53e511c8ffb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:32.928085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.931907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e26d1efd-1b2e-47e0-babe-26950e69fc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:32.943074 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4170/8335] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:31 2022] DELETE /identity/v3/users/7e7f0939485541928b4cc74337e11c51 => generated 0 bytes in 1573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:16:32.963224 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4166/8336] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:32 2022] DELETE /identity/v3/projects/890ae8abc38a484090b53e511c8ffb6d => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:32.968726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:32.969249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:32.969737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:33.081869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:33.092679 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:33.407805 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4171/8337] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:33.421504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:33.422983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:33.424533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:33.551539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:33.568358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:33.634864 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4167/8338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:33.641328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:33.706716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d55841-28bb-4815-b519-fca0d7e77407 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:33.763979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:33.769156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:33.780238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:33.787763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:33.789672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:16:33.794326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:33.814985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:33.908737 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4172/8339] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:16:33.909015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:33.942306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea214393-ab24-47c0-ac91-ca97b0571e85 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:33.968539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:33.969943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:33.970502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:33.971529 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:33.972789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:33.977736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:34.019670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:34.024123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:34.096625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d359-c70d-47d0-ba79-91a8d3b488ce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:34.144623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:34.150397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:34.151505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:34.152512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] PATH_INFO: `/v3/projects/23237033e5284cb5b658c9eca5554894` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:34.164635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23237033e5284cb5b658c9eca5554894)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:34.168927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:34.235302 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4168/8340] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:33 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:34.247716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:34.524969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23237033e5284cb5b658c9eca5554894', 'request_id': 'req-9af881f8-56ea-4100-9496-6516774eadb3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:34.657090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23237033e5284cb5b658c9eca5554894', 'request_id': 'req-9af881f8-56ea-4100-9496-6516774eadb3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:34.670657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27147675-0870-4f9f-acb3-8024776a3bbc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:34.683854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23237033e5284cb5b658c9eca5554894', 'request_id': 'req-9af881f8-56ea-4100-9496-6516774eadb3'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:34.785812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] The token cache is being invalidate because project 23237033e5284cb5b658c9eca5554894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:34.786837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:34.789650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-9af881f8-56ea-4100-9496-6516774eadb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:34.805116 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4173/8341] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:34 2022] DELETE /identity/v3/projects/23237033e5284cb5b658c9eca5554894 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:34.808049 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893d3d-1994-49f9-a242-8ea858a9eca2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:34.809915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893d3d-1994-49f9-a242-8ea858a9eca2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:34.815178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23893d3d-1994-49f9-a242-8ea858a9eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:34.957527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-23893d3d-1994-49f9-a242-8ea858a9eca2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:34.964652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:34.969004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:34.971755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-23893d3d-1994-49f9-a242-8ea858a9eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:34.972082 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:34.974629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:34.975607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:34.985046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:35.019820 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4174/8342] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:35.023443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:35.027883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:35.028690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:35.125086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:35.127853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:35.170892 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4175/8343] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:35.176540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.195661 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4169/8344] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:34 2022] POST /identity/v3/users => generated 293 bytes in 952 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:35.197328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.212534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:35.245392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d102f6-34d8-457e-b399-d7835a5d6fab None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:35.275851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:35.277811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:35.283296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:35.284197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:35.287339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:16:35.288587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:35.296890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:35.313905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fd623-4a00-4047-9b41-418ce5d8a818 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:35.349384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:35.350881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:35.359678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:35.359678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:35.359678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:35.369060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:35.371713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4176/8345] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:16:35.380107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.427372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefc70-5939-4951-9abf-c3da01867556 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:35.431302 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4170/8346] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:35.433033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.469045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:35.473463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:35.477139 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:35.479525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:35.486241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:35.496830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:35.535068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddc4da-514c-4148-9836-71f434106faa admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:35.546249 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:35.624967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:35.626123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:35.634812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:35.634812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:35.635606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:35.638763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:35.740152 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4171/8347] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:35.748176 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.849455 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4177/8348] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:35 2022] POST /identity/v3/projects => generated 375 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:16:35.860006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:35.860202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a20ece-9648-419a-b185-e1ab0732d0d2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:35.904757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:36.283894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:36.285476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:36.286220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:36.287205 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] PATH_INFO: `/v3/projects/824703a4dab1425ab7a8436561ce221a/users/3decc71926b94abd9b7599a0126a5b8c/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:36.323874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b377b62-1a28-4125-b840-da3ed545829c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:36.346184 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:36.347717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:36.348773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:36.349381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:36.361625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:36.361625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:36.368524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824703a4dab1425ab7a8436561ce221a, user_id=3decc71926b94abd9b7599a0126a5b8c, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:36.375197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc4756-f048-48bf-ae4c-41a140398eb3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:36.518490 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4172/8349] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:35 2022] PUT /identity/v3/projects/824703a4dab1425ab7a8436561ce221a/users/3decc71926b94abd9b7599a0126a5b8c/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:36.540087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:36.540951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:36.541703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:36.600445 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4178/8350] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:35 2022] POST /identity/v3/users => generated 288 bytes in 749 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:36.608451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:36.756476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a18f-807c-49e2-9c90-a08fefa7ea2d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:36.871775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] MFA Rules not processed for user `3decc71926b94abd9b7599a0126a5b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:36.877936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:37.143367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4173/8351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 604 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:16:37.173128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:37.177337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:37.185664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:37.189823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:37.190206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:37.194946 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:37.196835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:37.203696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:37.268961 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4179/8352] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 663 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:37.287810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:37.362643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4fe4-ae55-445d-89a7-64d34bc198e2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:37.404741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:37.405986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:37.411258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:37.412036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:37.413469 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:37.425354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:37.534634 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4180/8353] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:16:37.543274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:37.632415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c194c-a5e9-47f3-b611-3fa221727a40 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:37.686990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:37.697284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:37.702847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:37.703101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] PATH_INFO: `/v3/projects/7e2c855e54d84571bcba4b358dd867f0/users/2b1ee6913d074f2c9ecdb2ee8adf6f7f/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:37.726707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9138c-41d5-441a-85d7-e1951372492e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:37.777349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:37.778505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:37.778883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:37.779640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:37.806225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2c855e54d84571bcba4b358dd867f0, user_id=2b1ee6913d074f2c9ecdb2ee8adf6f7f, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:37.828104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:37.877909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:37.890002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1e37d-01af-4c67-93d5-20fca7721e8b service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:38.007104 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4174/8354] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:16:38.060240 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4181/8355] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:37 2022] PUT /identity/v3/projects/7e2c855e54d84571bcba4b358dd867f0/users/2b1ee6913d074f2c9ecdb2ee8adf6f7f/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:16:38.069745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:38.070610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:38.076671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:38.098984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:38.175020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:38.176906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:38.366888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:38.421672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:38.516510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c222eb-b245-4d00-bf5e-b5ee682ee8d9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:38.573001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:38.576983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:38.577487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:38.578014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] PATH_INFO: `/v3/users/3decc71926b94abd9b7599a0126a5b8c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:38.581999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3decc71926b94abd9b7599a0126a5b8c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:38.618554 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:38.757501 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4175/8356] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 690 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:16:38.761939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:38.768809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:39.179948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dca65-4700-48ba-bb8c-87981380e7cf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:39.209808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:39.210999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:39.211493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:39.211971 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:39.281092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:39.286470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa98c1-1fbd-4842-b42d-f2db28a779ed service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:39.319605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3decc71926b94abd9b7599a0126a5b8c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:39.319605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3decc71926b94abd9b7599a0126a5b8c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:39.395004 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4176/8357] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:39.521100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3decc71926b94abd9b7599a0126a5b8c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:39.612051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3decc71926b94abd9b7599a0126a5b8c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:39.660594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3decc71926b94abd9b7599a0126a5b8c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:39.712146 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4182/8358] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:16:38 2022] DELETE /identity/v3/users/3decc71926b94abd9b7599a0126a5b8c => generated 0 bytes in 1610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:39.714699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:39.715470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:39.716397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:39.786463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:39.790642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:40.122173 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4177/8359] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:40.290407 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:40.292931 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:40.528429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc8f3-8798-4c7a-a30d-e1812f6c4bbe admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:40.541522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:40.542747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:40.543749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:40.544974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:40.566105 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:40.572854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b37af-e2c0-4d61-806c-56bed3381ecf service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:40.621114 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4183/8360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:42.618348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:42.621028 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:42.699724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f9ae0-1e0e-4ba0-9174-4b21552f8861 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:42.734643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:42.736522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:42.736522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:42.737241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] PATH_INFO: `/v3/projects/824703a4dab1425ab7a8436561ce221a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:42.740059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824703a4dab1425ab7a8436561ce221a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:42.748862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:43.175674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824703a4dab1425ab7a8436561ce221a', 'request_id': 'req-28a1fe2a-3753-4590-95e9-ef953e7b7d55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:43.203585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824703a4dab1425ab7a8436561ce221a', 'request_id': 'req-28a1fe2a-3753-4590-95e9-ef953e7b7d55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:43.227592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824703a4dab1425ab7a8436561ce221a', 'request_id': 'req-28a1fe2a-3753-4590-95e9-ef953e7b7d55'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:43.232779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:43.373672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] The token cache is being invalidate because project 824703a4dab1425ab7a8436561ce221a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:16:43.374269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:43.388889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-28a1fe2a-3753-4590-95e9-ef953e7b7d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:16:43.399299 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4178/8361] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:16:42 2022] DELETE /identity/v3/projects/824703a4dab1425ab7a8436561ce221a => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:16:43.412520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:43.413347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:43.413347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:43.547074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:43.554265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:43.892839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:43.921649 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4184/8362] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:43.937485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:43.939457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:43.940221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:44.042660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:44.054417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:44.074625 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4179/8363] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:44.081206 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:44.108080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896cb3a-568c-49c4-b3ef-142f283e3314 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:44.115582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:44.116884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:44.117703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:44.118298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:44.119981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:16:44.120542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:44.123678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:44.176485 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4185/8364] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:16:44.188283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:44.206052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe56b0a-f80b-42ea-8e01-4e8a38ec9b5c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:44.214342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:44.215667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:44.215916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:44.216179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:44.217904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:44.229488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:44.593806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4180/8365] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:16:44 2022] POST /identity/v3/projects => generated 377 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:44.631258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:44.724161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f99f-dbe8-4842-ae2d-e555be13a8b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:44.991465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:45.005757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:45.006848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:45.008373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:45.011453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:45.016014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:45.216836 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4186/8366] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:16:44 2022] POST /identity/v3/users => generated 289 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:16:45.225071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:45.267495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a1dc-a6f8-4c46-b419-13377948f234 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:45.304293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:45.305659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:45.318060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:45.318060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:45.318060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:45.318060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:45.335007 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4181/8367] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:16:45.341006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:45.390696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e6084-e6a1-43d7-8d24-84411e784fd6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:45.443210 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:45.445671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:45.462372 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:45.463473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:45.466869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:45.487014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc410a0-c73d-4b77-9627-c31e136efd54 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:45.572743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4187/8368] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:16:45.584712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:45.651875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374c22-1259-4ce2-9521-2735a5a8ebe7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:45.696253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:45.697985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:45.699011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:45.700175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] PATH_INFO: `/v3/projects/8d4a31bb6c7643468bed969b45c7c562/users/6ff45185c20147938c5b02d7531cb583/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:45.778585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4a31bb6c7643468bed969b45c7c562, user_id=6ff45185c20147938c5b02d7531cb583, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:45.815980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:46.161155 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4182/8369] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:16:45 2022] PUT /identity/v3/projects/8d4a31bb6c7643468bed969b45c7c562/users/6ff45185c20147938c5b02d7531cb583/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:16:46.185754 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeae8e-f15c-405e-b889-c4792d69b820 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:46.186894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeae8e-f15c-405e-b889-c4792d69b820 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:46.187805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeae8e-f15c-405e-b889-c4792d69b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:46.325244 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aebeae8e-f15c-405e-b889-c4792d69b820 None None] MFA Rules not processed for user `6ff45185c20147938c5b02d7531cb583`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:46.333224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aebeae8e-f15c-405e-b889-c4792d69b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:46.779772 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4188/8370] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:46.793809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:46.799348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:47.193769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289456b-628b-4fab-80a3-646acbc63f38 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:47.209661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:47.210783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:47.211324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:47.211930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:47.253122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:47.260505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:47.299999 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4183/8371] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:55.006107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:55.007882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:55.009662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:55.154078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] MFA Rules not processed for user `2acccf7e8abc4831af1efef1b9631723`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:16:55.179548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:55.508720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:55.725620 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4189/8372] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 722 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:16:55.763466 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:55.764449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:56.151888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b4ceb-0119-4309-9fc6-b66da8bdbadb service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:56.169411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:56.171635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:56.172436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:56.173691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:56.254742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:56.258291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa117-4b48-4d1a-9dc0-ffcbf409e31d service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:56.305324 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4184/8373] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:16:56.980075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:16:56.982701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:57.073587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15df2e-7ee2-4d11-a15c-911f525e5e2c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:16:57.117160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:16:57.120760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:16:57.121214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:16:57.121663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:16:57.145321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:16:57.362484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:16:57.369197 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec9ec3-584d-43c0-b63b-176aec17e688 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:16:57.419777 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4190/8374] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:16:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:17:06.292200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=81 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:07.061736 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:07.062708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:07.065626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:07.107322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:07.108191 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:07.108422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:07.297059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] MFA Rules not processed for user `2b1ee6913d074f2c9ecdb2ee8adf6f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:07.301033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:07.386267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:07.395913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:07.457980 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4191/8375] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:07.706923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:07.791632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21561d9-96bd-45cb-885c-437d7d091788 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:07.833318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:07.836785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:07.837705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:07.838220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:07.851490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:07.893222 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4185/8376] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 835 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:07.901411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:07.910910 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:08.436693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:08.443490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:08.481173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd66ab-dd63-46e9-8218-407b85758f03 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:08.509632 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4192/8377] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:17:08.511231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:08.512640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:08.517026 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:08.517781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:08.521057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:08.552604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:08.905545 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4186/8378] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:17:07 2022] POST /identity/v3/projects => generated 373 bytes in 1007 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:17:08.912632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:08.990405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbbb69-01bb-46c7-b453-51d08379abfe service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:09.418658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:09.443635 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:09.444745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:09.445342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:09.445928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:09.448135 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:09.466583 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fdfd2-8a65-40c5-b798-7a389cae68f0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:09.656894 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4193/8379] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:17:08 2022] POST /identity/v3/users => generated 293 bytes in 741 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:17:09.658798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:09.684938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:09.686904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:09.687458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:09.715809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89d2a-c7a2-4d9d-8a90-a21b7e26c3b3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:17:09.725784 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:09.727720 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:17:09.729872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4194/8380] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:17:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:17:09.772292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:09.772292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:09.772292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:09.772292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:09.783714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:09.783714 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:09.895788 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4187/8381] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:17:09.898927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:09.975305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc00a71-f7e0-430f-ad59-367ebad97fbf None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:09.990959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:09.993488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:10.001701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:10.002593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] PATH_INFO: `/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf/users/632426a265d34946baa4e6e7daf50991/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:10.070690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=897a1e4fc0a84a1b96300ca5991a7ccf, user_id=632426a265d34946baa4e6e7daf50991, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:10.103686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:10.325642 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4195/8382] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:17:09 2022] PUT /identity/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf/users/632426a265d34946baa4e6e7daf50991/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:17:10.326653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:10.442226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a07ba-fce8-4750-9722-08a413a42ccd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:10.941867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:10.947743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:10.948472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:10.949597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:10.955423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:10.965342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707fee3-7bd1-4c3d-803b-c84cee8213ee admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:10.983884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:10.998043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4188/8383] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 673 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:17:11.004875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:11.091361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f14097-55f7-433c-959b-cc57379e1e5b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:11.119454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:11.121439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:11.122606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:11.127772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] PATH_INFO: `/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf/users/632426a265d34946baa4e6e7daf50991/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:11.136947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897a1e4fc0a84a1b96300ca5991a7ccf, user_id=632426a265d34946baa4e6e7daf50991, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:11.151304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:11.187355 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4196/8384] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:17:11 2022] PUT /identity/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf/users/632426a265d34946baa4e6e7daf50991/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:17:21.168346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=18,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:33.049294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b32eb-69da-4be1-9532-9e354a147410 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:33.050122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b32eb-69da-4be1-9532-9e354a147410 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:33.050326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b32eb-69da-4be1-9532-9e354a147410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:33.162796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ee1b32eb-69da-4be1-9532-9e354a147410 None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:33.164796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee1b32eb-69da-4be1-9532-9e354a147410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:33.640062 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4189/8385] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 593 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:33.861706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:34.287229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1a108-d2e6-477c-9474-3159345a88d4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:34.320399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:34.321488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:34.322017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:34.322519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:34.356630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:34.886029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:34.913612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0312e-6b94-45ee-8a91-85b186e50af8 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:35.067377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4197/8386] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 1198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:17:36.564071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:36.566229 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:36.568145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:17:36.593082 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:36.595278 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:17:36.634664 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4190/8387] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:17:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:17:38.218962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4349e-02f7-4540-9bf6-95d589afc011 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:38.219794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4349e-02f7-4540-9bf6-95d589afc011 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:38.219984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4349e-02f7-4540-9bf6-95d589afc011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:38.400399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-53e4349e-02f7-4540-9bf6-95d589afc011 None None] MFA Rules not processed for user `632426a265d34946baa4e6e7daf50991`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:38.408934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-53e4349e-02f7-4540-9bf6-95d589afc011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:38.955165 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4198/8388] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 739 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:39.036800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:17:39.046147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:39.221306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db929c11-a16e-49e6-ad8d-644d8835f396 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:17:39.267358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:17:39.270087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:39.285001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:39.292231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:39.425564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:17:39.436842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21de81a-241d-4843-b9a0-73baa4d5d502 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:17:39.548952 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4191/8389] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:17:39.986379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9ca-314c-41b1-8cd9-3d02ecd8793a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:39.988032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9ca-314c-41b1-8cd9-3d02ecd8793a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:39.988802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750c9ca-314c-41b1-8cd9-3d02ecd8793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:40.097365 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c750c9ca-314c-41b1-8cd9-3d02ecd8793a None None] MFA Rules not processed for user `2b1ee6913d074f2c9ecdb2ee8adf6f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:40.101117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c750c9ca-314c-41b1-8cd9-3d02ecd8793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:40.243995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:40.430178 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4199/8390] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:42.248253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97455-be28-4839-a718-716ebc90b22a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:42.249037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97455-be28-4839-a718-716ebc90b22a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:42.249203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97455-be28-4839-a718-716ebc90b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-30f97455-be28-4839-a718-716ebc90b22a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:17:42.293108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:42.295108 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:17:42.299208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4192/8391] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:17:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:17:48.229901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:48.230806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:48.235219 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:48.430887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] MFA Rules not processed for user `1b2e783f973b4c0a88f2b8517041f8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:17:48.433126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:17:48.792769 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4200/8392] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:17:49.516777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=31 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:50.624779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddc68-e1cc-4d65-9515-661c9e5daab9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:17:50.624779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddc68-e1cc-4d65-9515-661c9e5daab9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:17:50.624779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddc68-e1cc-4d65-9515-661c9e5daab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-183ddc68-e1cc-4d65-9515-661c9e5daab9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:17:50.658255 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:17:50.659989 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:17:50.669503 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4193/8393] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:17:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:17:58.772420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=38 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:13.597788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:13.600698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:14.066988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdf6d-769b-4b72-8961-e89586aecbc9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:14.167933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:14.169610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:14.189494 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:14.189956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] PATH_INFO: `/v3/users/609145c64b294fcea2f5228c272d7b7c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:14.229011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609145c64b294fcea2f5228c272d7b7c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:14.249355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:14.923886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:14.924745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:14.925094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:14.981632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609145c64b294fcea2f5228c272d7b7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:14.983658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609145c64b294fcea2f5228c272d7b7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:15.201231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:15.209502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:15.484155 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4194/8394] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 4 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:15.494000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:15.511639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ceb57-e862-4581-8436-6a3d7d1d1b61 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:15.520974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:15.522496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:15.523286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:15.523623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:15.529186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:15.614448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:15.620492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e5770-53ce-4250-a6d0-0e294b1f35df service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:15.640295 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4195/8395] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:15.901657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609145c64b294fcea2f5228c272d7b7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:15.975917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609145c64b294fcea2f5228c272d7b7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:16.011295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-0ec45674-19a7-4030-8c7d-834f5c674f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609145c64b294fcea2f5228c272d7b7c'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:16.036273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4201/8396] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:13 2022] DELETE /identity/v3/users/609145c64b294fcea2f5228c272d7b7c => generated 0 bytes in 2440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:16.044650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:16.048317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:16.049285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:16.194519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:16.197992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:16.718454 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4196/8397] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 676 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:16.782775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:16.782775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:16.782775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:16.867750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] MFA Rules not processed for user `e67b4e16c695421890649a036fada64c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:16.869827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:17.227314 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4202/8398] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 4 21:18:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:17.300840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:17.366847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200669c-98e2-4c44-9487-477f2a5a0a3f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:17.403756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:17.408698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:17.409582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:17.418553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:17.485309 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:17.496078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731d20-a83f-478d-aaa1-0254f88b333c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:17.584403 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4197/8399] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:18:20.122343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:20.137470 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:20.314482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3d23f-bf38-4453-8cf0-6786c1494d54 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:20.362660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:20.363770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:20.364303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:20.364745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] PATH_INFO: `/v3/projects/37fa097514df496299798b78eb3f4d66` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:20.380406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fa097514df496299798b78eb3f4d66)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:20.390370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:20.453293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:20.706719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fa097514df496299798b78eb3f4d66', 'request_id': 'req-974b956c-2930-4420-8564-f1d4fb8be594'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:20.847379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fa097514df496299798b78eb3f4d66', 'request_id': 'req-974b956c-2930-4420-8564-f1d4fb8be594'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:20.879767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fa097514df496299798b78eb3f4d66', 'request_id': 'req-974b956c-2930-4420-8564-f1d4fb8be594'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:20.916562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] The token cache is being invalidate because project 37fa097514df496299798b78eb3f4d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:20.917447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:20.921145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-974b956c-2930-4420-8564-f1d4fb8be594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:20.928293 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4203/8400] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:20 2022] DELETE /identity/v3/projects/37fa097514df496299798b78eb3f4d66 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:20.936301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:20.937153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:20.937321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:21.064244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:21.072025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:21.316996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:21.350783 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4198/8401] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:21.358963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:21.360818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:21.361324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:21.432780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:21.442429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:21.485839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:21.491234 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4204/8402] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:21.555302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9162ee-e3d2-402c-a0d9-7980bb87736a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:21.580111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:21.585426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:21.586908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:21.587838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:21.591444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:18:21.595394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:21.604284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:21.683789 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4199/8403] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:18:21.687066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:21.770809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278fb8-a7f1-44e9-8e83-65745f8e4539 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:21.798266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:21.799436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:21.804546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:21.805187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:21.808999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:21.817715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:22.053361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:22.056778 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4205/8404] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:18:21 2022] POST /identity/v3/projects => generated 383 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:18:22.059769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:22.070952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:22.406991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4bc1-f077-4769-a926-0f349548d5f1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:22.419392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:22.422924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:22.423966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:22.424712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:22.426649 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:22.434275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:22.571395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b536-75f9-4394-93ca-2c1aa144491c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:22.668072 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4206/8405] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:18:22 2022] POST /identity/v3/users => generated 292 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:18:22.679823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:22.749305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2fbf-996a-4c11-9adb-8ced984928a7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:22.758404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:22.759553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:22.764565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:22.764565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:22.764565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:22.767677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:22.798229 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4207/8406] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:18:22.801476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:22.838891 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94032cc2-478e-4c8a-8117-6cbba7365a74 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:22.882607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:22.882607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:22.886461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:22.889510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:22.893540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:22.901616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:22.907327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:22.909819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:22.910315 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:22.911668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:22.924164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:22.967010 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4208/8407] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:18:22.973166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:22.999407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:23.008032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55211db-e38f-415b-9aa9-4578346d4c70 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:23.037273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9672fa-2e5d-4c59-87c4-d000528cb2b8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:23.058642 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:23.059877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:23.062126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:23.062599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] PATH_INFO: `/v3/projects/407a5520d21e46e8bcaddabf536fadcd/users/9d9040fc0de14e1583a9f614c47096f6/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:23.068869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4200/8408] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 1017 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:23.143296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=407a5520d21e46e8bcaddabf536fadcd, user_id=9d9040fc0de14e1583a9f614c47096f6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:23.160455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:23.282091 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4209/8409] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:18:22 2022] PUT /identity/v3/projects/407a5520d21e46e8bcaddabf536fadcd/users/9d9040fc0de14e1583a9f614c47096f6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:18:23.289865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:23.291199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:23.292050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:23.338636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:23.342782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:23.415255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:23.417367 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:23.434410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:23.715371 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4201/8410] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:18:23.741405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdb815-fc47-4c60-95a2-653a2ca66c9e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:23.745616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:23.750984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:23.780716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:23.781246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:23.781731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:23.784037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] PATH_INFO: `/v3/users/2b1ee6913d074f2c9ecdb2ee8adf6f7f` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:23.785066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:23.787553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1ee6913d074f2c9ecdb2ee8adf6f7f)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:23.798059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:23.978990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56de41-9d29-4b1c-99bc-af98e4333270 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:24.014975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:24.014975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:24.014975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:24.014975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:24.084731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:24.097977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:24.160223 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4202/8411] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:24.219519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1ee6913d074f2c9ecdb2ee8adf6f7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:24.222160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1ee6913d074f2c9ecdb2ee8adf6f7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:24.383848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1ee6913d074f2c9ecdb2ee8adf6f7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:24.427308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1ee6913d074f2c9ecdb2ee8adf6f7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:24.466332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1ee6913d074f2c9ecdb2ee8adf6f7f'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:24.501193 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4210/8412] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:23 2022] DELETE /identity/v3/users/2b1ee6913d074f2c9ecdb2ee8adf6f7f => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:25.956537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:26.000605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311aa02-da4b-416f-8f6b-d2b72df00b71 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:26.350554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:26.354451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:26.355916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:26.361751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] PATH_INFO: `/v3/projects/7e2c855e54d84571bcba4b358dd867f0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:26.365802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2c855e54d84571bcba4b358dd867f0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:26.376845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:26.931805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2c855e54d84571bcba4b358dd867f0', 'request_id': 'req-78e726ff-fcaf-49f9-9385-c8641df761a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:26.959936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2c855e54d84571bcba4b358dd867f0', 'request_id': 'req-78e726ff-fcaf-49f9-9385-c8641df761a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:26.985415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2c855e54d84571bcba4b358dd867f0', 'request_id': 'req-78e726ff-fcaf-49f9-9385-c8641df761a8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:27.117778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] The token cache is being invalidate because project 7e2c855e54d84571bcba4b358dd867f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:27.119479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:27.125970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:27.144386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:27.149680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:27.155377 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4203/8413] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:25 2022] DELETE /identity/v3/projects/7e2c855e54d84571bcba4b358dd867f0 => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:27.225941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3bb60-9af5-495c-869c-082ecd8a64a4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:27.363393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:27.366382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:27.585036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:27.636271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:27.638209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:27.638209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:27.643245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] PATH_INFO: `/v3/users/632426a265d34946baa4e6e7daf50991` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:27.651502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632426a265d34946baa4e6e7daf50991)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:27.660901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:27.670546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e726ff-fcaf-49f9-9385-c8641df761a8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:27.690571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:27.690571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:27.692542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:27.693201 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:27.701878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:27.978626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:27.982213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e63df-4b89-4ad6-8980-8cad15ae9cdc service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:28.020579 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4204/8414] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:18:28.054267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:28.090421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632426a265d34946baa4e6e7daf50991'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:28.095692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632426a265d34946baa4e6e7daf50991'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:28.220960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632426a265d34946baa4e6e7daf50991'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:28.359223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632426a265d34946baa4e6e7daf50991'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:28.401702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632426a265d34946baa4e6e7daf50991'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:28.443632 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4211/8415] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:27 2022] DELETE /identity/v3/users/632426a265d34946baa4e6e7daf50991 => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:28.502661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:28.504985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:28.505763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:28.675066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] MFA Rules not processed for user `9d9040fc0de14e1583a9f614c47096f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:28.678025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:29.120071 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4205/8416] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:29.273744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:29.277736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:29.649527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:29.657277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:29.804341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72d73e-d7b4-469a-bd5b-3de47d820710 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:29.819773 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:29.824452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:29.824734 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:29.827719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:29.883115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:29.894511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:29.941238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4212/8417] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:30.010007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a42a83-f7a8-4bdf-b47e-5c9f13ea32a6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:30.030362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:30.033804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:30.034678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:30.035571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] PATH_INFO: `/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:30.039961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897a1e4fc0a84a1b96300ca5991a7ccf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:30.046413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:30.110263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:30.283059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897a1e4fc0a84a1b96300ca5991a7ccf', 'request_id': 'req-b52dd58d-7e7b-4c76-a943-cf766a21c770'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:30.303040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897a1e4fc0a84a1b96300ca5991a7ccf', 'request_id': 'req-b52dd58d-7e7b-4c76-a943-cf766a21c770'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:30.333555 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897a1e4fc0a84a1b96300ca5991a7ccf', 'request_id': 'req-b52dd58d-7e7b-4c76-a943-cf766a21c770'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:30.464850 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] The token cache is being invalidate because project 897a1e4fc0a84a1b96300ca5991a7ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:30.470754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:30.474560 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-b52dd58d-7e7b-4c76-a943-cf766a21c770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:30.484603 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4206/8418] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:29 2022] DELETE /identity/v3/projects/897a1e4fc0a84a1b96300ca5991a7ccf => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:32.864242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:32.868434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:32.953597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e41617-3f25-460a-b540-d903f8fb1866 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:33.417636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:33.419181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:33.419736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:33.424926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] PATH_INFO: `/v3/users/6ff45185c20147938c5b02d7531cb583` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:33.425855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff45185c20147938c5b02d7531cb583)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:33.436489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:33.868882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:33.896308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff45185c20147938c5b02d7531cb583'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:33.904112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff45185c20147938c5b02d7531cb583'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:34.021108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff45185c20147938c5b02d7531cb583'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:34.105880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff45185c20147938c5b02d7531cb583'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:34.157165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff45185c20147938c5b02d7531cb583'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:34.207666 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4213/8419] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:32 2022] DELETE /identity/v3/users/6ff45185c20147938c5b02d7531cb583 => generated 0 bytes in 1344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:18:34.215406 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:34.216173 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:34.216892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:34.285388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:34.288556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:34.664073 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4207/8420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:18:34.684163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:34.694988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:35.054160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf4a7-5749-45f3-96fa-ea703eea32ab admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:35.074552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:35.075631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:35.076858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:35.077672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:35.125461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:35.129073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067c8e6-c245-45ee-9ecf-0e0db6b7770d service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:35.167602 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4214/8421] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:36.666945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:36.669869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:36.769403 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ba681-8dd9-40f3-af0f-99d91ea364c5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:36.841524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:36.853584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:36.853584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:36.853584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] PATH_INFO: `/v3/projects/8d4a31bb6c7643468bed969b45c7c562` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:36.853584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4a31bb6c7643468bed969b45c7c562)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:36.865384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:37.267209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4a31bb6c7643468bed969b45c7c562', 'request_id': 'req-dc11c1e8-03cf-4148-af29-8ed122d54044'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:37.301118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4a31bb6c7643468bed969b45c7c562', 'request_id': 'req-dc11c1e8-03cf-4148-af29-8ed122d54044'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:37.328396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4a31bb6c7643468bed969b45c7c562', 'request_id': 'req-dc11c1e8-03cf-4148-af29-8ed122d54044'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:37.483561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] The token cache is being invalidate because project 8d4a31bb6c7643468bed969b45c7c562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:37.484109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:37.486086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dc11c1e8-03cf-4148-af29-8ed122d54044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:37.501368 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4208/8422] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:36 2022] DELETE /identity/v3/projects/8d4a31bb6c7643468bed969b45c7c562 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:37.504341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:37.505134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:37.505317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:37.622620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:37.631231 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:38.022869 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4215/8423] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:38.025905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:38.026675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:38.027583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:38.080402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:38.083170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:38.121358 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4209/8424] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:38.123552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:38.173657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec250b9-34ae-41a5-aae6-9162011f3be2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:38.195046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:38.196305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:38.196818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:38.197319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:38.198609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:18:38.203481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:38.206735 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:38.270470 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4216/8425] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:18:38.279892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:38.302800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a055a99-0506-4d5d-bd05-7fe340e170f6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:38.319341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:38.320653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:38.321149 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:38.321653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:38.329520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:38.351261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:38.609148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4210/8426] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:18:38 2022] POST /identity/v3/projects => generated 371 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:18:38.611911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:38.675454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47092f43-ad63-4729-8c25-effee8d2d965 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:38.861356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:38.905370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:38.908802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:38.909759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:38.911213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:38.913879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:38.920050 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:39.119994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:39.136788 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4217/8427] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:18:38 2022] POST /identity/v3/users => generated 286 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:18:39.139489 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:39.168481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922b6f-c19a-4140-a4a3-6a30dfbf6731 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:39.191689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:39.194769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:39.197325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:39.199765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:39.201784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:39.209180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:39.273796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:39.284847 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4211/8428] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:18:39.310122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10175a-e1be-40f9-b0d3-8657b2c69a7f admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:39.330775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:39.331963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:39.333745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:39.335633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:39.336996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:39.343299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255f2d8-a9f5-4ac4-9337-10a2794da2b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:39.403263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4218/8429] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:18:39.406418 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:39.439802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db253-81f2-4f3a-ad29-93e498dc2cc9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:39.463175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:39.465017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:39.467833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:39.469063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] PATH_INFO: `/v3/projects/d3fac9b31f4a46eaae79ae4e7dfc1b9c/users/27d950f664e5445b81b8135876754702/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:39.517313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fac9b31f4a46eaae79ae4e7dfc1b9c, user_id=27d950f664e5445b81b8135876754702, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:39.538768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:39.685699 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4212/8430] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:18:39 2022] PUT /identity/v3/projects/d3fac9b31f4a46eaae79ae4e7dfc1b9c/users/27d950f664e5445b81b8135876754702/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:39.690611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96ad4-82f7-4093-815b-c9d11835b772 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:39.690611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96ad4-82f7-4093-815b-c9d11835b772 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:39.690611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96ad4-82f7-4093-815b-c9d11835b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:39.798690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-51a96ad4-82f7-4093-815b-c9d11835b772 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:39.816042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-51a96ad4-82f7-4093-815b-c9d11835b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:40.214739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4219/8431] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:40.227119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:40.233090 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:40.521878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065bf1a-7a8a-4b5e-9532-2e4fccfe1c9f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:40.534397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:40.535926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:40.537789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:40.537789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:40.556302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:40.559551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:40.583772 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4213/8432] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:18:44.694574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:44.695483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:44.697214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:44.831555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] MFA Rules not processed for user `27d950f664e5445b81b8135876754702`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:44.838227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:45.160714 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4220/8433] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:45.182416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:45.186174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:45.431357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7552d9-52de-4356-8ffc-9e1e26fb5322 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:45.451032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:45.451969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:45.452451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:45.452953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:45.475891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:45.480383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:45.506120 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4214/8434] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:18:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:18:46.509477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:46.517637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:46.553697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fef292-e223-46b5-a678-da219c0e9ffa None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:46.564397 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:46.566189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:46.567075 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:46.567921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] PATH_INFO: `/v3/users/1b2e783f973b4c0a88f2b8517041f8a7` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:46.643709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2e783f973b4c0a88f2b8517041f8a7)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:46.647553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:47.096811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:47.115057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2e783f973b4c0a88f2b8517041f8a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:47.120965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2e783f973b4c0a88f2b8517041f8a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:47.306897 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2e783f973b4c0a88f2b8517041f8a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:47.346588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2e783f973b4c0a88f2b8517041f8a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:47.397818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2e783f973b4c0a88f2b8517041f8a7'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:47.452619 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4221/8435] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:46 2022] DELETE /identity/v3/users/1b2e783f973b4c0a88f2b8517041f8a7 => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:48.036000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:48.101273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb1cf0-e0fc-46c1-9910-9b799db19fc1 service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:48.331283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:48.332550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:48.333123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:48.333783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] PATH_INFO: `/v3/projects/2e5de3cd23f54af491e3e2ee52f16035` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:48.363797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5de3cd23f54af491e3e2ee52f16035)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:48.391568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:48.413534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:48.656287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5de3cd23f54af491e3e2ee52f16035', 'request_id': 'req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:48.674289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5de3cd23f54af491e3e2ee52f16035', 'request_id': 'req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:48.692099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5de3cd23f54af491e3e2ee52f16035', 'request_id': 'req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:48.857580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] The token cache is being invalidate because project 2e5de3cd23f54af491e3e2ee52f16035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:48.858836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:48.861072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:48.869858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4215/8436] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:48 2022] DELETE /identity/v3/projects/2e5de3cd23f54af491e3e2ee52f16035 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:18:48.877687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:48.882521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:48.971916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf30ec-b64e-46eb-8307-11cbe379e881 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:49.244726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:49.246575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:49.250785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:49.251678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] PATH_INFO: `/v3/users/73c8271087b542f68056a5af71fbf0d1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:49.306279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c8271087b542f68056a5af71fbf0d1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:49.311945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:49.630752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c8271087b542f68056a5af71fbf0d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:49.632116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c8271087b542f68056a5af71fbf0d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:49.782426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c8271087b542f68056a5af71fbf0d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:49.851945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c8271087b542f68056a5af71fbf0d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:49.881004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-89c4152c-bc5f-4c59-866a-e5fbe9973335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c8271087b542f68056a5af71fbf0d1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:49.920274 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4222/8437] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:18:48 2022] DELETE /identity/v3/users/73c8271087b542f68056a5af71fbf0d1 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:50.768032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:50.769070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99f3f-8dfa-4e85-a067-6c50c40c3fd4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:50.769821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99f3f-8dfa-4e85-a067-6c50c40c3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:50.770381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99f3f-8dfa-4e85-a067-6c50c40c3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:50.771575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:50.808572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc9c9-8f67-4baf-8b83-e7e38e4cefa0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:50.885995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6fe99f3f-8dfa-4e85-a067-6c50c40c3fd4 None None] MFA Rules not processed for user `27d950f664e5445b81b8135876754702`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:50.888478 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6fe99f3f-8dfa-4e85-a067-6c50c40c3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:50.987119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:51.025547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:51.027058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:51.027815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:51.029088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] PATH_INFO: `/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:51.066447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6737dcacaa4985bb6bc9e1bf6b1f0a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:51.071717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:51.157198 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4223/8438] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:51.362329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6737dcacaa4985bb6bc9e1bf6b1f0a', 'request_id': 'req-0f0dd338-1ee2-4709-a60f-a33f31421ad4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:51.390543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6737dcacaa4985bb6bc9e1bf6b1f0a', 'request_id': 'req-0f0dd338-1ee2-4709-a60f-a33f31421ad4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:51.407954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6737dcacaa4985bb6bc9e1bf6b1f0a', 'request_id': 'req-0f0dd338-1ee2-4709-a60f-a33f31421ad4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:51.552461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] The token cache is being invalidate because project be6737dcacaa4985bb6bc9e1bf6b1f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:18:51.554711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:51.558566 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-0f0dd338-1ee2-4709-a60f-a33f31421ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:18:51.568263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4216/8439] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:18:50 2022] DELETE /identity/v3/projects/be6737dcacaa4985bb6bc9e1bf6b1f0a => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:18:52.533568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd46f-ced7-437d-8313-e9382a5aaea3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:52.534936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd46f-ced7-437d-8313-e9382a5aaea3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:52.535688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd46f-ced7-437d-8313-e9382a5aaea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-44afd46f-ced7-437d-8313-e9382a5aaea3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:18:52.549975 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:18:52.551866 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:18:52.556768 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4224/8440] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:18:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:18:52.643787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0dd9-70a8-4770-92db-8b02ee0492a5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:52.644526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0dd9-70a8-4770-92db-8b02ee0492a5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:52.644767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0dd9-70a8-4770-92db-8b02ee0492a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:52.704704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f58c0dd9-70a8-4770-92db-8b02ee0492a5 None None] MFA Rules not processed for user `27d950f664e5445b81b8135876754702`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:52.707870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f58c0dd9-70a8-4770-92db-8b02ee0492a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:52.743898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:52.895560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4217/8441] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:53.483844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:53.484900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:53.485521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:18:53.508611 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:18:53.510194 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:18:53.512085 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4225/8442] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:18:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:18:58.025151 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783817cd-de3f-4343-a771-21db12dd19e9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:58.027544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783817cd-de3f-4343-a771-21db12dd19e9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:58.029048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783817cd-de3f-4343-a771-21db12dd19e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:58.159574 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-783817cd-de3f-4343-a771-21db12dd19e9 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:18:58.161838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-783817cd-de3f-4343-a771-21db12dd19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:58.347316 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4218/8443] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:18:58.714433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:18:58.721980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:18:59.066580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82e15c-57ec-4d10-be8d-2158f5f118c4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:18:59.073791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:18:59.074456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:18:59.075024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:18:59.075410 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:18:59.087009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:18:59.089143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f74d77-ea01-4cb5-a199-69deb9e2d051 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:18:59.102969 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4226/8444] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:18:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:08.346017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=58 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:09.104454 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=50 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:14.841364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:14.842296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:14.842296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:14.908341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:19:14.910308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:15.196693 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4219/8445] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:19:16.270617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d8c8-73a5-4b65-827c-1cf16419e982 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:16.271576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d8c8-73a5-4b65-827c-1cf16419e982 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:16.274037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d8c8-73a5-4b65-827c-1cf16419e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-cda4d8c8-73a5-4b65-827c-1cf16419e982 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:19:16.299491 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:19:16.301151 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:19:16.305996 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4227/8446] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:19:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:19:25.167038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=25 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:30.901141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:19:30.906458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:31.313611 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb8f48-c9a8-4760-ad0b-12b0346475ba None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:19:31.323197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:19:31.324374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:31.324875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:31.325366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:31.328614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:31.364199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:19:31.369782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:19:31.434237 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4220/8447] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:19:34.171086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:34.172012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:34.172012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:34.340862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] MFA Rules not processed for user `18d4e38ee31a4ab3a21e998803226465`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:19:34.351928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:34.372937 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4228/8448] 10.222.0.78 () {58 vars in 1040 bytes} [Tue Oct 4 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:19:34.390344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:19:34.444616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bc556-4b6e-40e8-a29e-b312bd07d3de service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:19:34.471157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:19:34.477220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:34.491376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:34.492344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:34.496597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:34.797617 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:19:34.806136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:19:34.897828 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4221/8449] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:35.244758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:19:35.294476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55f4b4-85b0-47af-ad98-b8fd2e81f425 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:19:35.318341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:19:35.349712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:19:35.349712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:19:35.349712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:19:35.349712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:19:35.509920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:19:35.513029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26fb73-47d6-43d0-a28e-d892283b3243 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:19:35.534028 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4229/8450] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:44.863758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=65 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:45.522857 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=37 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:02.263372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:02.283806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a899527-b775-400a-a790-ea9b894c771d service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:02.295987 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:02.297537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:02.298960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:02.300058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:02.313024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:02.505844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:02.513570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:02.536450 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4222/8451] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 21:20:02.834726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347aa5-756e-4a52-88b7-fece668ba242 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:02.835811 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347aa5-756e-4a52-88b7-fece668ba242 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:02.835976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347aa5-756e-4a52-88b7-fece668ba242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:02.893311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-bb347aa5-756e-4a52-88b7-fece668ba242 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:02.900869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bb347aa5-756e-4a52-88b7-fece668ba242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:02.922681 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4230/8452] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:20:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:02.960313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:03.001103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c01edf-a676-46b3-8cd1-b6e7f3b983a5 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:03.043332 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:03.044590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:03.045069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:03.045536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:03.085651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:03.090132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:03.121561 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4223/8453] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:03.340147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:03.340602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:03.363693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:03.423371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] MFA Rules not processed for user `a554eb26060549b48a431c579659ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:03.426168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:03.546721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4231/8454] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 4 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:03.564548 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:03.621043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62bf2-28c1-4993-9021-603ebc164d6e service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:03.630798 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:03.632030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:03.632820 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:03.633585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:03.638762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:03.872056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:03.885103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:03.921135 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4224/8455] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:20:13.529239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=32 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:13.900640 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=64 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:13.998459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:14.061778 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b026-6fea-4e73-8dfa-14b65ef0a77a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:14.079752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:14.081291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:14.082008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:14.082725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:14.087943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:14.121119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:14.123014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:14.161992 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4232/8456] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:20:14.353043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:14.356641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:14.579407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1237c-7f01-4c6b-b0c8-412d062caf1d service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:14.602104 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:14.602878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:14.603189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:14.604126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] PATH_INFO: `/v3/users/27d950f664e5445b81b8135876754702` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:14.607678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d950f664e5445b81b8135876754702)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:14.613643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:15.040817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d950f664e5445b81b8135876754702'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:15.174165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d950f664e5445b81b8135876754702'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:15.198303 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d950f664e5445b81b8135876754702'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:15.228333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d950f664e5445b81b8135876754702'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:15.229536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-214311c9-0ece-4ba2-b4a5-e45de3e3ab87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d950f664e5445b81b8135876754702'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:15.248149 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4225/8457] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:20:14 2022] DELETE /identity/v3/users/27d950f664e5445b81b8135876754702 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:20:15.859125 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:15.894241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c742f-30c8-4a94-afb9-68632b2fd31c service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:16.156721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:16.158332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:16.158843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:16.159383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] PATH_INFO: `/v3/projects/d3fac9b31f4a46eaae79ae4e7dfc1b9c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:16.161711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fac9b31f4a46eaae79ae4e7dfc1b9c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:16.165970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:16.450392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fac9b31f4a46eaae79ae4e7dfc1b9c', 'request_id': 'req-f247be95-129b-4889-b838-72fee0aeb00b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:16.568282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fac9b31f4a46eaae79ae4e7dfc1b9c', 'request_id': 'req-f247be95-129b-4889-b838-72fee0aeb00b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:16.581358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fac9b31f4a46eaae79ae4e7dfc1b9c', 'request_id': 'req-f247be95-129b-4889-b838-72fee0aeb00b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:16.608352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] The token cache is being invalidate because project d3fac9b31f4a46eaae79ae4e7dfc1b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:20:16.609208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:16.610780 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f247be95-129b-4889-b838-72fee0aeb00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:20:16.616633 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4233/8458] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:20:15 2022] DELETE /identity/v3/projects/d3fac9b31f4a46eaae79ae4e7dfc1b9c => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:20:16.627575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862b1c-9742-4f14-926e-0350506af201 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:16.628544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862b1c-9742-4f14-926e-0350506af201 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:16.628940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862b1c-9742-4f14-926e-0350506af201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:16.664799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22862b1c-9742-4f14-926e-0350506af201 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:16.668394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22862b1c-9742-4f14-926e-0350506af201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:16.832575 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4226/8459] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:16.850159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:16.854727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:16.856463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:16.918306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:16.920925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:16.933062 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4234/8460] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:16.940215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862b1c-9742-4f14-926e-0350506af201 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:17.013024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862b1c-9742-4f14-926e-0350506af201 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:17.019812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:17.026882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:17.028079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:17.029132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:17.030904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:20:17.032142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:17.035976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:17.070881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4227/8461] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:20:17.072070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:17.095709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e551-4f36-4f17-a397-bc0160b72f51 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:17.108298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:17.110086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:17.111247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:17.128701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:17.130997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:17.147208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:17.384327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:17.386797 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4235/8462] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:20:17 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:20:17.410859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd511-57db-4898-84a5-59c8cdf17f8f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:17.416597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:17.570448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:17.571657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:17.572196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:17.573225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:17.574409 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:17.578708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:17.894694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:17.896290 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4228/8463] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:20:17 2022] POST /identity/v3/users => generated 287 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:20:17.920195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc9ce-59a1-464c-bea5-f96190a933c9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:17.929307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:17.930777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:17.932185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:17.932990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:17.935258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:17.939541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:17.957034 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4236/8464] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:20:17.962381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:17.980213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd42161-b788-49bf-8eb6-2cabaff1d7b5 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:17.985789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:17.986524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:17.986796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:17.987081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:17.988114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:17.995869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7733f-b542-4c80-8c8a-f41e1a4462e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:18.015367 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4229/8465] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:20:18.022418 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:18.041476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144dd79-4259-45e0-a649-65e61dc38acd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:18.051103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:18.052702 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:18.053253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:18.053879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] PATH_INFO: `/v3/projects/be36678756d4429b91d971abf8fdcdd1/users/dc367e6de31d47e4aa924b4da0d826c8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:18.090487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be36678756d4429b91d971abf8fdcdd1, user_id=dc367e6de31d47e4aa924b4da0d826c8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:18.097502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:18.220796 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4237/8466] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:20:18 2022] PUT /identity/v3/projects/be36678756d4429b91d971abf8fdcdd1/users/dc367e6de31d47e4aa924b4da0d826c8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:20:18.234016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:18.234345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:18.234726 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:18.283294 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] MFA Rules not processed for user `dc367e6de31d47e4aa924b4da0d826c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:18.285184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:18.469111 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4230/8467] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:18.476182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:18.521566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:18.646264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031fcfa-1f92-4b37-99bb-45eb99dd4595 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:18.655940 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:18.656988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:18.657375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:18.657660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:18.659271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:18.665286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:18.882412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4238/8468] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:20:18 2022] POST /identity/v3/projects => generated 373 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:20:18.889967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:18.910392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64164769-5efd-4312-9616-0ffa669b13a5 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:19.032997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:19.034076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.034415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.034693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.035754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:19.039533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:19.253808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4231/8469] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:20:18 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:20:19.262538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:19.289253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909ef2-6871-429a-bd07-42028f11e6b3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:19.321427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:19.322913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.323398 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.323821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.324794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:19.327820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:19.345412 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4239/8470] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:20:19.356145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:19.387487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:19.396628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fac7fb-9832-414a-9c9c-78d1d78771a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:19.406963 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:19.415734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.415734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.415734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] PATH_INFO: `/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b/users/1e25046f68c4486eac7f93171b7b4831/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.453450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e9e9bef414db09c9f2b38bfcbfa3b, user_id=1e25046f68c4486eac7f93171b7b4831, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:19.460266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:19.625348 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4232/8471] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:20:19 2022] PUT /identity/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b/users/1e25046f68c4486eac7f93171b7b4831/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:20:19.644052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:19.663079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d9e3-1548-4b1c-8812-46d8e74bfcc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:19.789688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:19.790699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.791807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.792317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.793657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:19.796848 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee422c6e-1185-4cd7-85f3-1f7d74bd6c6b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:19.823444 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4240/8472] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:20:19.825358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:19.839946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59180b6b-0f93-4f6d-90f5-6f0bc1b8c948 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:19.846844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:19.847605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.847889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.848190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] PATH_INFO: `/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b/users/1e25046f68c4486eac7f93171b7b4831/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.850557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e9e9bef414db09c9f2b38bfcbfa3b, user_id=1e25046f68c4486eac7f93171b7b4831, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:19.853835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:19.871833 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4233/8473] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:20:19 2022] PUT /identity/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b/users/1e25046f68c4486eac7f93171b7b4831/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:20:19.893080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:19.893643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:19.894154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:19.955387 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] MFA Rules not processed for user `1e25046f68c4486eac7f93171b7b4831`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:19.957066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:20.110563 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4241/8474] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:20.130131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:20.132915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:20.319864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e561-a503-46c9-8734-fe121995cb28 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:20.327691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:20.328805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:20.330120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:20.330120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:20.463931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:20.466215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:20.480531 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4234/8475] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:20:22.102288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:22.108902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:22.135972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:22.274371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff058-46f9-446f-876d-d5c95b234c36 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:22.285369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:22.287431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:22.287431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:22.287797 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:22.290796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:22.321295 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:22.325406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af7228-417c-4760-b658-8e1045aa4cbd service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:22.379202 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4242/8476] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:20:26.499966 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:26.503879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:26.530912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ffd0b-13a1-443d-9c89-388825884dc5 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:26.538604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:26.539694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:26.540144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:26.541621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:26.568190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:26.570324 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0a0f2-e9fd-4047-a31a-24af31f1b990 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:26.610462 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4235/8477] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:20:27.767503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:27.768317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:27.768713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:27.844794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:27.850695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:28.008213 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4243/8478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:20:28.795927 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7af1-e41c-4ce3-9922-9b513c555f45 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:28.797952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7af1-e41c-4ce3-9922-9b513c555f45 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:28.798916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7af1-e41c-4ce3-9922-9b513c555f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-f96d7af1-e41c-4ce3-9922-9b513c555f45 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:20:28.872529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:20:28.874773 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:20:28.878618 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4236/8479] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:20:28 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:20:36.603232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=67,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:37.994901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=53 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:44.671896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:44.677082 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:44.896986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9739c3-10ee-4bd1-a213-4c4466d6e151 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:44.908992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:44.910699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:44.911498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:44.912246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:44.916614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:45.230072 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:45.234715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e424c81-c0f9-4a7c-a7db-df9f6afc2e10 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:45.265052 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4244/8480] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:20:45.605903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:45.606635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:45.606842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:45.698486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] MFA Rules not processed for user `dc367e6de31d47e4aa924b4da0d826c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:20:45.702179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:45.747539 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4237/8481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:20:46.583091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:46.584614 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:46.585602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-35c0c0d2-cc56-4350-bd40-c7b1e0ea282b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:20:46.600404 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:20:46.602147 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:20:46.604559 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4245/8482] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:20:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:20:55.253406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=48 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:55.672643 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:56.438390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:20:56.440712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:56.631078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc673-0940-4a25-8eeb-09d38e46d154 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:20:56.644595 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:20:56.646222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:20:56.646743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:20:56.647284 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:20:56.651642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:20:56.797996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:20:56.801283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b1d8-4f20-4ce9-8af3-36acad51dbf9 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:20:56.825059 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4238/8483] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:06.815305 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=54 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:20.323120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:20.324081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:20.324081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:20.362984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] MFA Rules not processed for user `dc367e6de31d47e4aa924b4da0d826c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:20.366817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:20.382253 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4246/8484] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:21.429614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3788b-409a-4a5d-bb4d-754faded396e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:21.431257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3788b-409a-4a5d-bb4d-754faded396e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:21.431257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3788b-409a-4a5d-bb4d-754faded396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-5cd3788b-409a-4a5d-bb4d-754faded396e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:21:21.444705 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:21:21.447265 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:21:21.451435 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4239/8485] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:21:21 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:21:30.351292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:31.711981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:31.910911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa18ef-c3df-4d3e-91de-30bd878a4f80 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:31.919027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:31.920974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:31.921686 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:31.922282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] PATH_INFO: `/v3/users/dc367e6de31d47e4aa924b4da0d826c8` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:31.924899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc367e6de31d47e4aa924b4da0d826c8)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:31.927565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:32.347906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc367e6de31d47e4aa924b4da0d826c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:32.349315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc367e6de31d47e4aa924b4da0d826c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:32.521932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc367e6de31d47e4aa924b4da0d826c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:32.549926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc367e6de31d47e4aa924b4da0d826c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:32.578562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc367e6de31d47e4aa924b4da0d826c8'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:32.606807 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4247/8486] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:21:31 2022] DELETE /identity/v3/users/dc367e6de31d47e4aa924b4da0d826c8 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:32.609067 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:32.610445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:32.613384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:32.643011 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:32.644843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:32.808514 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4240/8487] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:21:32.823390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:32.826106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:33.029989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eac17-0d2b-4174-ac77-8c5c305a253c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:33.040180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:33.040978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:33.041510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:33.042130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:33.063601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:33.067375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:33.090094 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4248/8488] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:21:33.706580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:33.710907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:33.743008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f84e1-9b99-457a-b405-aae5cd8cc534 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:33.758597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:33.761231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:33.763905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:33.765557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] PATH_INFO: `/v3/projects/be36678756d4429b91d971abf8fdcdd1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:33.769619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be36678756d4429b91d971abf8fdcdd1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:33.775959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:34.090723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be36678756d4429b91d971abf8fdcdd1', 'request_id': 'req-dbd5f308-f109-48ac-a3c8-98f981d0fe35'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:34.109506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be36678756d4429b91d971abf8fdcdd1', 'request_id': 'req-dbd5f308-f109-48ac-a3c8-98f981d0fe35'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:34.130098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be36678756d4429b91d971abf8fdcdd1', 'request_id': 'req-dbd5f308-f109-48ac-a3c8-98f981d0fe35'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:34.500705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] The token cache is being invalidate because project be36678756d4429b91d971abf8fdcdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:21:34.501261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:34.503055 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:34.506146 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4241/8489] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:21:33 2022] DELETE /identity/v3/projects/be36678756d4429b91d971abf8fdcdd1 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:34.514324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:34.536917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ef755-1d4c-422d-837d-252a83b629ac service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:34.644976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:34.788419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:34.790176 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:34.792342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:34.796817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] PATH_INFO: `/v3/users/1e25046f68c4486eac7f93171b7b4831` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:34.814341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e25046f68c4486eac7f93171b7b4831)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:34.819074 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:35.213003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e25046f68c4486eac7f93171b7b4831'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:35.214701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e25046f68c4486eac7f93171b7b4831'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:35.379171 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e25046f68c4486eac7f93171b7b4831'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:35.420664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e25046f68c4486eac7f93171b7b4831'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:35.447276 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-560de5a1-83eb-4a02-84b3-4e6ed4952a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e25046f68c4486eac7f93171b7b4831'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:35.469278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4249/8490] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:21:34 2022] DELETE /identity/v3/users/1e25046f68c4486eac7f93171b7b4831 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:36.756232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:36.759522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:36.822219 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f308-f109-48ac-a3c8-98f981d0fe35 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:36.978735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:36.979968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:36.980478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:36.981019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] PATH_INFO: `/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:36.982810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831e9e9bef414db09c9f2b38bfcbfa3b)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:37.018992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:37.300625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:37.353142 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831e9e9bef414db09c9f2b38bfcbfa3b', 'request_id': 'req-fc1376f9-9461-4baf-ab11-945e31448b38'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:37.366930 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831e9e9bef414db09c9f2b38bfcbfa3b', 'request_id': 'req-fc1376f9-9461-4baf-ab11-945e31448b38'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:37.378804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831e9e9bef414db09c9f2b38bfcbfa3b', 'request_id': 'req-fc1376f9-9461-4baf-ab11-945e31448b38'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:37.546444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] The token cache is being invalidate because project 831e9e9bef414db09c9f2b38bfcbfa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:21:37.546757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:37.547669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-fc1376f9-9461-4baf-ab11-945e31448b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:37.549916 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4242/8491] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:21:36 2022] DELETE /identity/v3/projects/831e9e9bef414db09c9f2b38bfcbfa3b => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:37.557832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:37.558736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:37.558736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:37.601137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:37.603707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:37.758466 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4250/8492] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:37.761642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:37.762437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:37.762857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:37.842985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:37.846799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:37.875667 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:37.880978 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4243/8493] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:37.902918 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ddc19-d3a1-485b-9e50-19942c048d1b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:37.916362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:37.917452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:37.918078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:37.918711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:37.920430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:21:37.921001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:37.926207 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:37.960618 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4251/8494] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:21:37.962542 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:37.988830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b12e2-cb6c-4a06-a832-78a613fa08c7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:37.991880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:37.993072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:37.993500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:37.995970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:37.997375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:38.001289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:38.186937 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4244/8495] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:21:37 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:21:38.189363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:38.212301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae7517-2cc3-49c3-80e8-eface9800df3 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:38.282438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:38.350655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:38.351841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:38.352256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:38.352665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:38.353830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:38.357251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:38.615548 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4252/8496] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:21:38 2022] POST /identity/v3/users => generated 293 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:21:38.617773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:38.641988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6064-8994-4bd5-a106-96e343d851e4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:38.652318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:38.653519 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:38.654012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:38.654526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:38.656204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:38.659581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:38.699382 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4245/8497] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:21:38.702032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:38.739167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803603e0-08a3-476d-9e19-9052de4ea168 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:38.758593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:38.760510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:38.761446 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:38.763064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:38.765678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:38.771926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee885-ed81-422d-a3dd-077c9ad5da08 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:38.809671 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4253/8498] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:21:38.816158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:38.836013 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4e17-ed87-4747-8431-2b68907f501f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:38.845602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:38.847454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:38.847757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:38.848428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] PATH_INFO: `/v3/projects/816a2b9f85df4a9fa34ad2b165f109e4/users/b44a53bcdef7416186b9811d64ee08d2/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:38.881029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816a2b9f85df4a9fa34ad2b165f109e4, user_id=b44a53bcdef7416186b9811d64ee08d2, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:38.887779 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:39.016859 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4246/8499] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:21:38 2022] PUT /identity/v3/projects/816a2b9f85df4a9fa34ad2b165f109e4/users/b44a53bcdef7416186b9811d64ee08d2/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:39.040558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:39.041309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:39.042060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:39.103516 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] MFA Rules not processed for user `b44a53bcdef7416186b9811d64ee08d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:39.105714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:39.251970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4254/8500] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:39.266157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:39.472127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9cb8-82db-4872-beac-1093461bd008 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:39.480541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:39.481464 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:39.481880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:39.482290 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:39.483396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:39.486787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:39.699198 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4247/8501] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:21:39.706009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:39.745406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c64e4-36a6-4995-82ac-1ee8489a86f0 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:39.894998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:39.896665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:39.899085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:39.899085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:39.899085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:39.903932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:40.094932 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4255/8502] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:21:39 2022] POST /identity/v3/users => generated 299 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:21:40.103669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:40.160209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd61b-f3bf-4cfb-8e51-2848b168e993 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:40.170155 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:40.171500 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:40.172313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:40.172897 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:40.174593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:40.181001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0a2c3-db64-460f-9290-8b8ab5007ccb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:40.209768 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4248/8503] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:21:40.217092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:40.252004 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373551c5-2dc3-42de-9c27-b03bfaf72a0e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:40.272243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:40.274944 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:40.275855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:40.276351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] PATH_INFO: `/v3/projects/8d6f31ddd2734877ac46792941645dd5/users/96e121f0ff13443c868ef463279e3f38/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:40.333831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6f31ddd2734877ac46792941645dd5, user_id=96e121f0ff13443c868ef463279e3f38, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:40.342271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:40.526733 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4256/8504] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:21:40 2022] PUT /identity/v3/projects/8d6f31ddd2734877ac46792941645dd5/users/96e121f0ff13443c868ef463279e3f38/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:21:40.554344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a88b2-f1b6-428a-a14c-8168f8eec83c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:40.555079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a88b2-f1b6-428a-a14c-8168f8eec83c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:40.555694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a88b2-f1b6-428a-a14c-8168f8eec83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:40.617770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-974a88b2-f1b6-428a-a14c-8168f8eec83c None None] MFA Rules not processed for user `96e121f0ff13443c868ef463279e3f38`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:40.620221 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-974a88b2-f1b6-428a-a14c-8168f8eec83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:40.646823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:40.799778 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4249/8505] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:40.888752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:40.892025 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:40.902966 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:41.061510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0fab-e7fc-44fa-9050-c914335578bf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:41.070641 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:41.071433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:41.071759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:41.072789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:41.101250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:41.104740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500ec2-f033-46e6-b7ce-78b8abfc5724 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:41.141999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4257/8506] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 676 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:42.925453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:42.926350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:42.928399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:42.980488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] MFA Rules not processed for user `586e44616297471eaf68e3eee955f48a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:42.982807 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:43.133950 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4250/8507] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:43.841378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fac5-95d5-454e-91a7-de74bca17e42 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:43.842300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fac5-95d5-454e-91a7-de74bca17e42 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:43.842541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fac5-95d5-454e-91a7-de74bca17e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f1f9fac5-95d5-454e-91a7-de74bca17e42 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:21:43.853572 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:21:43.855555 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:21:43.857628 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4258/8508] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:21:43 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:21:47.801437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:47.931209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3d42-8f52-47b0-b2f3-eac96cc78a71 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:47.938508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:47.939784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:47.940183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:47.940838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] PATH_INFO: `/v3/users/b44a53bcdef7416186b9811d64ee08d2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:47.942794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44a53bcdef7416186b9811d64ee08d2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:47.945949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:48.281139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44a53bcdef7416186b9811d64ee08d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:48.389839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44a53bcdef7416186b9811d64ee08d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:48.412117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:48.416505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44a53bcdef7416186b9811d64ee08d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:48.448770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44a53bcdef7416186b9811d64ee08d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:48.450033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44a53bcdef7416186b9811d64ee08d2'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:48.468656 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4251/8509] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:21:47 2022] DELETE /identity/v3/users/b44a53bcdef7416186b9811d64ee08d2 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:48.475023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:48.475834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:48.476458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:48.516116 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:48.517582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:48.668576 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4259/8510] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:48.712989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:48.716286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:48.984639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be032a8-4e2f-41a4-84c8-fd62c6993066 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:48.993674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:48.995024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:48.995577 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:48.996081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:49.016995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:49.019870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:49.041587 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4252/8511] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:21:49.656880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:49.683896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfb0e5-ddc5-49b0-89de-73ed0f88af6b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:49.701584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:49.701584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:49.701584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:49.701584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:49.702476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:49.747091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:49.748818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:49.771890 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4260/8512] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:21:49.926625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:49.930258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:49.988208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668b67-82cf-48c4-9425-85cc2cee9d71 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:50.022837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:50.023620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:50.024257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:50.024703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] PATH_INFO: `/v3/projects/816a2b9f85df4a9fa34ad2b165f109e4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:50.032493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816a2b9f85df4a9fa34ad2b165f109e4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:50.035958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:50.335537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816a2b9f85df4a9fa34ad2b165f109e4', 'request_id': 'req-3314b392-810f-40d9-95aa-adadcae95e54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:50.349874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816a2b9f85df4a9fa34ad2b165f109e4', 'request_id': 'req-3314b392-810f-40d9-95aa-adadcae95e54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:50.364592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816a2b9f85df4a9fa34ad2b165f109e4', 'request_id': 'req-3314b392-810f-40d9-95aa-adadcae95e54'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:50.476604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] The token cache is being invalidate because project 816a2b9f85df4a9fa34ad2b165f109e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:21:50.476604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:50.476604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:50.476604 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4253/8513] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:21:49 2022] DELETE /identity/v3/projects/816a2b9f85df4a9fa34ad2b165f109e4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:50.480832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:50.499853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cc517-8e83-4f2e-828b-6ab770f1cad0 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:50.688137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:50.693005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:50.693662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:50.694737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] PATH_INFO: `/v3/users/96e121f0ff13443c868ef463279e3f38` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:50.697399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e121f0ff13443c868ef463279e3f38)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:50.702529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:50.747592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:51.073739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e121f0ff13443c868ef463279e3f38'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:51.074756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e121f0ff13443c868ef463279e3f38'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:51.265572 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e121f0ff13443c868ef463279e3f38'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:51.309521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e121f0ff13443c868ef463279e3f38'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:51.324869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-cd79c810-094f-4e98-b4dd-606737605ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e121f0ff13443c868ef463279e3f38'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:51.336354 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4261/8514] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:21:50 2022] DELETE /identity/v3/users/96e121f0ff13443c868ef463279e3f38 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:52.286487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:52.292223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:52.347316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b392-810f-40d9-95aa-adadcae95e54 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:52.480188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:52.481250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:52.481878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:52.482502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] PATH_INFO: `/v3/projects/8d6f31ddd2734877ac46792941645dd5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:52.485225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6f31ddd2734877ac46792941645dd5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:52.489204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:52.518618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:52.784217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6f31ddd2734877ac46792941645dd5', 'request_id': 'req-797176c7-0e8a-4280-b932-38c5c4c35021'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:52.808875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6f31ddd2734877ac46792941645dd5', 'request_id': 'req-797176c7-0e8a-4280-b932-38c5c4c35021'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:52.836653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6f31ddd2734877ac46792941645dd5', 'request_id': 'req-797176c7-0e8a-4280-b932-38c5c4c35021'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:53.054361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] The token cache is being invalidate because project 8d6f31ddd2734877ac46792941645dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:21:53.055724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:53.058661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-797176c7-0e8a-4280-b932-38c5c4c35021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:21:53.062924 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4254/8515] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:21:52 2022] DELETE /identity/v3/projects/8d6f31ddd2734877ac46792941645dd5 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:21:53.070953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:53.072822 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:53.073598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:53.136390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:53.144924 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:53.279832 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4262/8516] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:53.291806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:53.292511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:53.292623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:53.334737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:53.336772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:53.355993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4255/8517] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:53.359892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:53.382420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6be2-3257-4b07-8b7f-25aff6d15aba None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:53.384707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:53.385352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:53.385632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:53.385905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:53.386571 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:21:53.386873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:53.389126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:53.407040 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4263/8518] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:21:53.413479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:53.426570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c311-b307-4608-9294-ac055d9aea85 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:53.438903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:53.440849 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:53.441593 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:53.442140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:53.444356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:53.449231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:53.654616 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4256/8519] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:21:53 2022] POST /identity/v3/projects => generated 365 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:21:53.655672 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:53.686640 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768995-ac44-4d41-9327-fbe169863f6e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:53.913168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:53.913168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:53.913168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:53.913168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:53.915529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:53.920090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:54.081999 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4264/8520] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:21:53 2022] POST /identity/v3/users => generated 283 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:21:54.088621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:54.117407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565625b7-b109-4156-895b-a1be7bdd36a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:54.129068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:54.130179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:54.130776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:54.132392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:54.134053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:54.137469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:54.166752 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4257/8521] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:21:54.173291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:54.215490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92df10-3e99-4396-8afb-7c978520a516 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:54.227620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:54.233646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:54.233646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:54.233646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:54.233646 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:54.236017 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426752a4-90e8-4505-a0e0-20e13615e11d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:54.265301 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4265/8522] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:21:54.272245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:54.301345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0381cc9-86af-4f37-b2ed-24885f62c0f6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:54.318318 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:54.320004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:54.320497 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:54.320965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] PATH_INFO: `/v3/projects/a13d84934da549e5979682bd817fe7a1/users/90a68af4f00540c6bfafac660bbe07df/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:54.351898 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13d84934da549e5979682bd817fe7a1, user_id=90a68af4f00540c6bfafac660bbe07df, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:54.357646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:54.555897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4258/8523] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:21:54 2022] PUT /identity/v3/projects/a13d84934da549e5979682bd817fe7a1/users/90a68af4f00540c6bfafac660bbe07df/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:21:54.563975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605d2b-3c22-4154-8efc-f0779ff1fc1b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:54.564867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605d2b-3c22-4154-8efc-f0779ff1fc1b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:54.565616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605d2b-3c22-4154-8efc-f0779ff1fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:54.581986 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:54.619250 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-19605d2b-3c22-4154-8efc-f0779ff1fc1b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:21:54.622022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19605d2b-3c22-4154-8efc-f0779ff1fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:54.843715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4266/8524] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:21:54.853572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:21:54.855645 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:21:55.019817 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1bcb6-1333-4095-ae00-29a5031f5d46 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:21:55.030140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:21:55.032359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:21:55.033222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:21:55.033913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:21:55.055776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:21:55.059922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bcd8a-1590-4447-9920-614fc9a6da1c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:21:55.121315 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4259/8525] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:22:04.917217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=25 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:05.084215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:07.875337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639043-1dcc-4214-bc74-b494db496762 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:07.876079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639043-1dcc-4214-bc74-b494db496762 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:07.876330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9639043-1dcc-4214-bc74-b494db496762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:07.963361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b9639043-1dcc-4214-bc74-b494db496762 None None] MFA Rules not processed for user `9d9040fc0de14e1583a9f614c47096f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:22:07.965871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b9639043-1dcc-4214-bc74-b494db496762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:08.185409 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4267/8526] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:22:09.424020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:09.424851 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:09.425012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:22:09.439083 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:22:09.441007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:22:09.446741 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4260/8527] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:22:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:22:12.268519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:12.269382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:12.269892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:12.366758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] MFA Rules not processed for user `90a68af4f00540c6bfafac660bbe07df`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:22:12.370039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:12.641255 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4268/8528] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:22:12.652531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:12.654057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:12.667839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:12.737586 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1189a60-8c8a-42d6-8836-f6436e08a260 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:12.755311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:12.757760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:12.759716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:12.761921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:12.763558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7de22a-2ff7-4102-acb5-63bbfbc82500 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:12.764958 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:12.769623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:12.810483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:12.811763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:12.814921 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:12.816752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] PATH_INFO: `/v3/users/586e44616297471eaf68e3eee955f48a` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:12.822275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=586e44616297471eaf68e3eee955f48a)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:12.832753 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:12.985366 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4261/8529] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:22:12 2022] POST /identity/v3/users => generated 287 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:22:12.991941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:13.013569 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e830-8b8a-4177-a313-870a0dd87f3b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:13.036498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:13.038234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:13.038661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:13.042084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:13.043911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:13.051778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:13.086564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4262/8530] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:22:13.093800 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:13.117000 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806fa03-1669-4f95-8363-c1f9dc687c98 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:13.126655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:13.128478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:13.129298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:13.130047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] PATH_INFO: `/v3/system/users/6444126b33a34c248fb7de46236d1c1e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:13.172641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6444126b33a34c248fb7de46236d1c1e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:13.175123 n-d-852085-12 devstack@keystone.service[82439]: WARNING py.warnings [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 21:22:13.175123 n-d-852085-12 devstack@keystone.service[82439]: warnings.warn(msg) Oct 04 21:22:13.175123 n-d-852085-12 devstack@keystone.service[82439]: Oct 04 21:22:13.177805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca29f16-2927-474b-a030-ddc81edab83d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:13.196602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586e44616297471eaf68e3eee955f48a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:13.202489 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586e44616297471eaf68e3eee955f48a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:13.261759 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4263/8531] 10.222.0.78 () {60 vars in 1378 bytes} [Tue Oct 4 21:22:13 2022] PUT /identity/v3/system/users/6444126b33a34c248fb7de46236d1c1e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:22:13.281773 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:13.282235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:13.282938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:13.328781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586e44616297471eaf68e3eee955f48a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:13.337451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] MFA Rules not processed for user `6444126b33a34c248fb7de46236d1c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:22:13.342982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:13.356325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586e44616297471eaf68e3eee955f48a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:13.382787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586e44616297471eaf68e3eee955f48a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:13.385753 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4269/8532] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:22:12 2022] DELETE /identity/v3/users/586e44616297471eaf68e3eee955f48a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:13.551743 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4264/8533] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:22:13 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 21:22:13.555584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:13.577057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:14.001307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b5f0-e46d-4db7-8cb2-134aafea8a1b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:14.077601 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:14.081869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:14.242546 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6444126b33a34c248fb7de46236d1c1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:14.258833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:14.263746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:14.268393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] PATH_INFO: `/v3/services` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:14.270136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:14.277711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:14.300112 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4270/8534] 10.222.0.78 () {58 vars in 1110 bytes} [Tue Oct 4 21:22:13 2022] GET /identity/v3/services => generated 2191 bytes in 746 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:22:14.306823 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:14.368655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7567ab-82f7-413c-9e03-fc7c68ebd5c7 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:14.379208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:14.380402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:14.381358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:14.381939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] PATH_INFO: `/v3/projects/06b106a291b44599bb30d5040d82a3cb` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:14.384390 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b106a291b44599bb30d5040d82a3cb)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:14.391986 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:14.571202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:14.701767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adec1-134f-4946-bea9-ef2b9ff6b54d None tempest-ImageQuotaTest-292831684-system-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:14.731592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:14.794084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b106a291b44599bb30d5040d82a3cb', 'request_id': 'req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:14.812700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b106a291b44599bb30d5040d82a3cb', 'request_id': 'req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:14.827301 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b106a291b44599bb30d5040d82a3cb', 'request_id': 'req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:14.865166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6444126b33a34c248fb7de46236d1c1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:14.867331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:14.876232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:14.876232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] PATH_INFO: `/v3/limits` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:14.876232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:14.876232 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 04 21:22:15.058285 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 04 21:22:15.060024 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:22:15.061690 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4271/8535] 10.222.0.78 () {60 vars in 1126 bytes} [Tue Oct 4 21:22:14 2022] POST /identity/v3/limits => generated 124 bytes in 756 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 04 21:22:15.071299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:15.141509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] The token cache is being invalidate because project 06b106a291b44599bb30d5040d82a3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:22:15.175998 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:15.188777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:15.192122 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4265/8536] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:14 2022] DELETE /identity/v3/projects/06b106a291b44599bb30d5040d82a3cb => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:15.198604 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:15.209117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:15.556812 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7b2f6-d6a8-4de3-997e-50d0a9926ee9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:15.567312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:15.568372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:15.568785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:15.569259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] PATH_INFO: `/v3/users/2acccf7e8abc4831af1efef1b9631723` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:15.572396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acccf7e8abc4831af1efef1b9631723)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:15.577175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:15.716245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674f4fb-4e4f-4e4a-8352-a94ffbf85b3e None tempest-ImageQuotaTest-292831684-system-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:15.787412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:15.817070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6444126b33a34c248fb7de46236d1c1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:15.817426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:15.817764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:15.818883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:15.820227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:15.824531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:15.862660 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4272/8537] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 21:22:15 2022] GET /identity/v3/registered_limits => generated 129 bytes in 791 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:22:15.862922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:15.872660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:15.991340 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acccf7e8abc4831af1efef1b9631723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:16.139465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acccf7e8abc4831af1efef1b9631723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:16.184060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acccf7e8abc4831af1efef1b9631723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:16.262679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acccf7e8abc4831af1efef1b9631723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:16.272667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acccf7e8abc4831af1efef1b9631723'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:16.288540 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4266/8538] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:22:15 2022] DELETE /identity/v3/users/2acccf7e8abc4831af1efef1b9631723 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:16.440431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79ff2-5f0b-4ac5-b16a-63a8dc9a0f68 None tempest-ImageQuotaTest-292831684-system-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:16.648332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6444126b33a34c248fb7de46236d1c1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:16.657083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:16.657607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:16.660854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:16.662335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:16.710271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06dd1a-c3fa-49ce-84e5-31382a2f8807 None tempest-ImageQuotaTest-292831684-system-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:16.762367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4273/8539] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 4 21:22:15 2022] GET /identity/v3/registered_limits => generated 129 bytes in 901 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:22:17.003002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:17.005561 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:17.257328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:17.394271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705fd43-86d9-4225-9688-d92735a2d9c2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:17.423234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:17.427856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:17.427856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:17.427856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] PATH_INFO: `/v3/projects/6f35d354850f457d84b23ae003a92e9c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:17.429181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f35d354850f457d84b23ae003a92e9c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:17.433285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:17.914725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f35d354850f457d84b23ae003a92e9c', 'request_id': 'req-062ad921-e448-4562-b35a-dbb09607d2b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:17.934146 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f35d354850f457d84b23ae003a92e9c', 'request_id': 'req-062ad921-e448-4562-b35a-dbb09607d2b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:17.954784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f35d354850f457d84b23ae003a92e9c', 'request_id': 'req-062ad921-e448-4562-b35a-dbb09607d2b3'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:18.062581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] The token cache is being invalidate because project 6f35d354850f457d84b23ae003a92e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:22:18.063890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:18.066522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-062ad921-e448-4562-b35a-dbb09607d2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:18.071533 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4267/8540] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:17 2022] DELETE /identity/v3/projects/6f35d354850f457d84b23ae003a92e9c => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:26.721958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:26.775323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:26.775810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:26.776234 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:26.824156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] MFA Rules not processed for user `9d9040fc0de14e1583a9f614c47096f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:22:26.827203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:27.040424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4274/8541] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:22:27.129938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:27.131345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:27.131662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:27.221638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] MFA Rules not processed for user `426a3d7b9b2248b6b22051224a4baa17`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:22:27.221638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:27.371267 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4268/8542] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 4 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:22:27.373042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:27.406146 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384108-d76b-4b32-9277-f6bf1704b8b7 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:27.416474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:27.417905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:27.418320 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:27.419196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:27.422893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:27.583034 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:27.589367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed981c-a678-436c-ab8f-0280197a0cdf service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:27.591215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:27.594073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:27.637640 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4275/8543] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:22:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:22:27.764226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c668c-7c6a-4e7a-9ac3-f6a231cc9163 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:27.781059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:27.782491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:27.783002 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:27.783616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] PATH_INFO: `/v3/users/90a68af4f00540c6bfafac660bbe07df` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:27.786177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a68af4f00540c6bfafac660bbe07df)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:27.791203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:27.794993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:27.998475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:28.000458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:28.000957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:22:28.011807 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:22:28.017235 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:22:28.020440 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4276/8544] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:22:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:22:28.098756 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a68af4f00540c6bfafac660bbe07df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:28.205074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a68af4f00540c6bfafac660bbe07df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:28.221426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a68af4f00540c6bfafac660bbe07df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:28.250330 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a68af4f00540c6bfafac660bbe07df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:28.252296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a68af4f00540c6bfafac660bbe07df'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:28.270005 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4269/8545] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:22:27 2022] DELETE /identity/v3/users/90a68af4f00540c6bfafac660bbe07df => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:22:28.875536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:28.878341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:22:29.083759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6415-0f57-432a-8748-72ab24d2f58d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:29.113217 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:29.115297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:29.115756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:29.132471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] PATH_INFO: `/v3/projects/a13d84934da549e5979682bd817fe7a1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:29.132471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13d84934da549e5979682bd817fe7a1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:29.132471 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:29.171601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:29.405892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13d84934da549e5979682bd817fe7a1', 'request_id': 'req-d4f77b3e-44b9-448a-b837-e44422671c5b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:29.557048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13d84934da549e5979682bd817fe7a1', 'request_id': 'req-d4f77b3e-44b9-448a-b837-e44422671c5b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:29.575129 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13d84934da549e5979682bd817fe7a1', 'request_id': 'req-d4f77b3e-44b9-448a-b837-e44422671c5b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:29.620273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] The token cache is being invalidate because project a13d84934da549e5979682bd817fe7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:22:29.620809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:29.625137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:29.628948 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4277/8546] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:22:28 2022] DELETE /identity/v3/projects/a13d84934da549e5979682bd817fe7a1 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:29.635922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:22:29.659046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08ada-3015-4363-a3fb-a2f87c5562a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:22:29.801214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:22:29.802834 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:22:29.803175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:22:29.803679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] PATH_INFO: `/v3/users/6444126b33a34c248fb7de46236d1c1e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:22:29.807064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6444126b33a34c248fb7de46236d1c1e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:22:29.812706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:22:30.167981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6444126b33a34c248fb7de46236d1c1e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:30.302892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6444126b33a34c248fb7de46236d1c1e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:30.318341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6444126b33a34c248fb7de46236d1c1e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:30.343197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:30.356293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6444126b33a34c248fb7de46236d1c1e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:30.357784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-74a9d412-f18c-4a66-ad5d-5459e16cb605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6444126b33a34c248fb7de46236d1c1e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:22:30.369771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4270/8547] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:22:29 2022] DELETE /identity/v3/users/6444126b33a34c248fb7de46236d1c1e => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:22:39.610299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:40.521636 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:19.759043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:19.763388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:19.794263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77b3e-44b9-448a-b837-e44422671c5b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:19.943239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:19.944020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:19.944319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:19.944771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] PATH_INFO: `/v3/users/848cfcbbcf20496b9f53c8b360442ff2` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:19.946411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848cfcbbcf20496b9f53c8b360442ff2)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:19.948837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:20.238306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848cfcbbcf20496b9f53c8b360442ff2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:20.241048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848cfcbbcf20496b9f53c8b360442ff2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:20.337861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848cfcbbcf20496b9f53c8b360442ff2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:20.369309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848cfcbbcf20496b9f53c8b360442ff2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:20.391878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848cfcbbcf20496b9f53c8b360442ff2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:20.408543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4278/8548] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:23:19 2022] DELETE /identity/v3/users/848cfcbbcf20496b9f53c8b360442ff2 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:20.416166 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:20.417039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:20.417215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:20.455170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:20.458502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:20.604630 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4271/8549] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:23:20.621923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:20.624447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:20.785683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a5167-d2d4-4227-8338-bc009db41d02 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:20.801447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:20.803607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:20.804475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:20.805224 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:20.836488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:20.841813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:20.883599 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4279/8550] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:23:22.047556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:22.054953 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:22.108365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34430a-60de-46ff-95f9-65649cd5eeaf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:22.108365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:22.109853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:22.109853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:22.109853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] PATH_INFO: `/v3/projects/a8395ec0f4534f788ed56dca21bd9b2d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:22.114494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8395ec0f4534f788ed56dca21bd9b2d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:22.119345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:22.375686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8395ec0f4534f788ed56dca21bd9b2d', 'request_id': 'req-2f607e5e-e231-4679-a306-7490b8bdf319'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:22.392063 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8395ec0f4534f788ed56dca21bd9b2d', 'request_id': 'req-2f607e5e-e231-4679-a306-7490b8bdf319'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:22.409105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8395ec0f4534f788ed56dca21bd9b2d', 'request_id': 'req-2f607e5e-e231-4679-a306-7490b8bdf319'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:22.533378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] The token cache is being invalidate because project a8395ec0f4534f788ed56dca21bd9b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:23:22.533874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:22.535761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:22.543253 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4272/8551] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:22 2022] DELETE /identity/v3/projects/a8395ec0f4534f788ed56dca21bd9b2d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:22.545608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:22.559917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a396e-f83a-41ce-bc31-aae3342c7c9c service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:22.601595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:22.709786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:22.713392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:22.713392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:22.714715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] PATH_INFO: `/v3/users/7c26b24af5254671bfe3f66a351082fc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:22.717425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c26b24af5254671bfe3f66a351082fc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:22.721853 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:23.172910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c26b24af5254671bfe3f66a351082fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:23.174118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c26b24af5254671bfe3f66a351082fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:23.308312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c26b24af5254671bfe3f66a351082fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:23.338273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c26b24af5254671bfe3f66a351082fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:23.356073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-24f2d939-d055-447c-9f89-0933d91d1c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c26b24af5254671bfe3f66a351082fc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:23.386515 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4280/8552] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:23:22 2022] DELETE /identity/v3/users/7c26b24af5254671bfe3f66a351082fc => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:24.159944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:24.165668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:24.196337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607e5e-e231-4679-a306-7490b8bdf319 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:24.412948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:24.414672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:24.417110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:24.418047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] PATH_INFO: `/v3/projects/855118acb64644a6bb287c861cbc5f87` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:24.421323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855118acb64644a6bb287c861cbc5f87)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:24.425879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:24.650363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:24.704835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855118acb64644a6bb287c861cbc5f87', 'request_id': 'req-8805b326-cc73-415c-b61b-a292bfbf25e5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:24.717939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855118acb64644a6bb287c861cbc5f87', 'request_id': 'req-8805b326-cc73-415c-b61b-a292bfbf25e5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:24.731312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855118acb64644a6bb287c861cbc5f87', 'request_id': 'req-8805b326-cc73-415c-b61b-a292bfbf25e5'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:24.909439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] The token cache is being invalidate because project 855118acb64644a6bb287c861cbc5f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:23:24.909875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:24.911674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-8805b326-cc73-415c-b61b-a292bfbf25e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:24.914600 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4273/8553] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:24 2022] DELETE /identity/v3/projects/855118acb64644a6bb287c861cbc5f87 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:24.922670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:24.923767 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:24.924022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:24.961495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:24.963218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:25.093994 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4281/8554] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:25.106458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.109279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.110602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:25.150231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:25.152700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:25.167297 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4274/8555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:23:25.170847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:25.189280 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc17a2-559c-4e2b-b8c5-5c9006fe7a27 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:25.196052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:25.196958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.197345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.197697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:25.198542 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:23:25.198915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:25.201032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:25.227835 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4282/8556] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:23:25.232960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:25.250608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d82f2-eec9-4f0b-aba8-726d3d37899b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:25.278237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:25.279507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.280046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.280553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:25.281667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:25.286131 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:25.458496 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4275/8557] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:23:25 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:25.460618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:25.491421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce93ce5-b9d7-4c65-9eb8-2c5a813fbd37 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:25.572384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:25.702693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:25.703693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.704175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.704617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:25.705681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:25.709783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:25.891925 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4283/8558] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:23:25 2022] POST /identity/v3/users => generated 288 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:25.897147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:25.913481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d339e0b-6872-48fb-8def-05a01b832c7f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:25.921660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:25.924430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.924430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.924991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:25.927168 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:25.931059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:25.953202 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4276/8559] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:23:25.960604 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:25.985330 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841084-8e46-49e2-885f-913272572e97 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:25.996401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:25.998349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:25.998349 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:25.998866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:26.000123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:26.003300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c1c0-9d1b-430b-8918-4da41bab9b52 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:26.029754 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4284/8560] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:23:26.039669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:26.064690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb59ed-784c-4c9b-a136-ec527a652e01 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:26.073976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:26.075275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:26.076021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:26.076952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] PATH_INFO: `/v3/projects/76d5a01e84404443a736b381fb5ab927/users/5ba3ba0b206d4425bd85accc8a25f7b7/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:26.114027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d5a01e84404443a736b381fb5ab927, user_id=5ba3ba0b206d4425bd85accc8a25f7b7, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:26.119633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:26.274443 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4277/8561] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:23:26 2022] PUT /identity/v3/projects/76d5a01e84404443a736b381fb5ab927/users/5ba3ba0b206d4425bd85accc8a25f7b7/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:26.299795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:26.301255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:26.307582 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:26.359294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] MFA Rules not processed for user `5ba3ba0b206d4425bd85accc8a25f7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:26.361636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:26.494287 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4285/8562] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:26.496757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:26.645058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074df2-a1fe-405d-b03e-781b872316a3 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:26.659933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:26.661448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:26.662262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:26.663088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:26.664989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:26.670236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:26.865087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:26.866471 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4278/8563] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:26.884472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf48af7-d407-499b-926f-cff7ba493112 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:27.020031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:27.021707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.021707 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.023070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:27.025917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:27.030817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:27.214320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4286/8564] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:23:26 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:27.221320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:27.243005 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58397d-2500-4ac6-8e16-0eff78e85ca2 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:27.252202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:27.253357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.253860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.254375 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:27.255680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:27.259181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:27.283263 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4279/8565] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:23:27.290369 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:27.315331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e709b3a-e39b-4cae-af14-b63811169a90 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:27.325898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:27.327175 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.327858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.331456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] PATH_INFO: `/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c/users/5399bcccd6ae4ca489783e91c545249d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:27.364945 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a65e9dce744bca2ccf70c38c0c46c, user_id=5399bcccd6ae4ca489783e91c545249d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:27.370876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:27.569786 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4287/8566] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:23:27 2022] PUT /identity/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c/users/5399bcccd6ae4ca489783e91c545249d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:27.577550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:27.617074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac872-13a8-469f-af6d-ed1aa63e5972 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:27.688579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:27.780358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:27.781696 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.782450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.783024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:27.785017 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:27.793866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803048b-6f79-4d46-ba8d-8b706255b3bc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:27.822148 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4280/8567] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:23:27.843423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:27.858486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:27.869693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55032c4f-dfb0-4dd9-8e4a-47b795a895a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:27.903291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:27.904675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.905375 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.905917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] PATH_INFO: `/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c/users/5399bcccd6ae4ca489783e91c545249d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:27.913188 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a65e9dce744bca2ccf70c38c0c46c, user_id=5399bcccd6ae4ca489783e91c545249d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:27.919187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0643a-56b6-4481-920a-daa83dfe3e30 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:27.947734 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4288/8568] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:23:27 2022] PUT /identity/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c/users/5399bcccd6ae4ca489783e91c545249d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:23:27.970134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:27.970639 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:27.971234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:28.031656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] MFA Rules not processed for user `5399bcccd6ae4ca489783e91c545249d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:28.034306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:28.195623 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4281/8569] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:28.216827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:28.217737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:28.217999 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:28.259761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] MFA Rules not processed for user `a554eb26060549b48a431c579659ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:28.262354 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:28.381469 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4289/8570] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 4 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:28.392744 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:28.415286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8da9f-c3a8-4213-8103-5c653a33db09 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:28.421767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:28.422961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:28.423522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:28.424020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:28.555658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:28.559724 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:28.580648 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4282/8571] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:23:28.928690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:28.931521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:28.953260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f894fa-f2a9-4298-8bd9-23943b4d57f8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:28.961334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:28.962473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:28.963260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:28.963722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:28.967267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:29.123240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:29.126741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200b47-aff5-40f4-949b-7436839b5207 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:29.147378 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4290/8572] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:23:38.422700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:38.556075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:38.627254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f4ab1-dd75-4e07-a300-72cc438839fd service cinder] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:38.643824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:38.645799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:38.648091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:38.648719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] PATH_INFO: `/v3/users/5ba3ba0b206d4425bd85accc8a25f7b7` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:38.651279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba3ba0b206d4425bd85accc8a25f7b7)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:38.655485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:39.021568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba3ba0b206d4425bd85accc8a25f7b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:39.137982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:39.181790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba3ba0b206d4425bd85accc8a25f7b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:39.198844 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba3ba0b206d4425bd85accc8a25f7b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:39.228182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba3ba0b206d4425bd85accc8a25f7b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:39.229359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba3ba0b206d4425bd85accc8a25f7b7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:39.245560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4283/8573] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:23:38 2022] DELETE /identity/v3/users/5ba3ba0b206d4425bd85accc8a25f7b7 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:39.253438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:39.253910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:39.254885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:39.364631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:39.370507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:39.529878 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4291/8574] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:39.548762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:39.551549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:39.713138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c6d7-6ec5-43d6-9742-dfa1b856c349 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:39.719564 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:39.720550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:39.721050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:39.722833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:39.741585 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:39.744277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:39.763582 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4284/8575] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:23:40.716606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:40.719668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:40.747939 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aa597-2e20-411d-9903-76ca5e3357ce None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:40.779432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:40.780840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:40.781233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:40.781758 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] PATH_INFO: `/v3/projects/76d5a01e84404443a736b381fb5ab927` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:40.784750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d5a01e84404443a736b381fb5ab927)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:40.788970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:41.058042 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d5a01e84404443a736b381fb5ab927', 'request_id': 'req-b4f785f7-ebce-4e64-9d91-a48d7e70a939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.195347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d5a01e84404443a736b381fb5ab927', 'request_id': 'req-b4f785f7-ebce-4e64-9d91-a48d7e70a939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.211121 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d5a01e84404443a736b381fb5ab927', 'request_id': 'req-b4f785f7-ebce-4e64-9d91-a48d7e70a939'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.238341 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] The token cache is being invalidate because project 76d5a01e84404443a736b381fb5ab927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:23:41.239719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.241612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.251179 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4292/8576] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:40 2022] DELETE /identity/v3/projects/76d5a01e84404443a736b381fb5ab927 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:41.252925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:41.274892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42ba-b2e1-4ef9-80fb-dd47e45605df service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:41.427631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:41.428728 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:41.429260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:41.429743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] PATH_INFO: `/v3/users/5399bcccd6ae4ca489783e91c545249d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:41.432366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5399bcccd6ae4ca489783e91c545249d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:41.436488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:41.449453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:41.808097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5399bcccd6ae4ca489783e91c545249d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.929823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5399bcccd6ae4ca489783e91c545249d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.951321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5399bcccd6ae4ca489783e91c545249d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.991894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5399bcccd6ae4ca489783e91c545249d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:41.993171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-f57fa507-3d2e-4323-8d96-372c308fc770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5399bcccd6ae4ca489783e91c545249d'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:42.006254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4285/8577] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:23:41 2022] DELETE /identity/v3/users/5399bcccd6ae4ca489783e91c545249d => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:42.894962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:42.897736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:42.929628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f785f7-ebce-4e64-9d91-a48d7e70a939 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:43.110527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:43.112247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:43.112759 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:43.113260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] PATH_INFO: `/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:43.115794 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5a65e9dce744bca2ccf70c38c0c46c)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:43.119687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:43.317510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:43.350868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5a65e9dce744bca2ccf70c38c0c46c', 'request_id': 'req-f30d3920-6be4-4c07-9532-36c56271c606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:43.513781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5a65e9dce744bca2ccf70c38c0c46c', 'request_id': 'req-f30d3920-6be4-4c07-9532-36c56271c606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:43.524351 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5a65e9dce744bca2ccf70c38c0c46c', 'request_id': 'req-f30d3920-6be4-4c07-9532-36c56271c606'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:43.541005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] The token cache is being invalidate because project 9a5a65e9dce744bca2ccf70c38c0c46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:23:43.541421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:43.542472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f30d3920-6be4-4c07-9532-36c56271c606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:23:43.544513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4293/8578] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:23:42 2022] DELETE /identity/v3/projects/9a5a65e9dce744bca2ccf70c38c0c46c => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:23:43.557441 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:43.558252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:43.558252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:43.599043 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:43.601822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:43.742824 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4286/8579] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:43.757553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:43.758164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:43.758688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:43.796137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:43.798568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:43.815800 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4294/8580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:43.823718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:43.867349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fc9e-647a-4450-9688-5166280d07ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:43.891107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:43.893657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:43.893657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:43.894144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:43.895177 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:23:43.895801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:43.898425 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:43.925564 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4287/8581] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:23:43.933007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:43.963816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409be18c-6c18-4d30-9136-bd5bb73fdfc6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:43.988915 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:43.989743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:43.990178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:43.990663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:43.992532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:43.994814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:44.193038 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4295/8582] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:23:43 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:44.199867 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:44.218950 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964e62-9b1c-426e-ae41-598b102e4881 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:44.355811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:44.357109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:44.357698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:44.358470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:44.359815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:44.363776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:44.545683 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4288/8583] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:23:44 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:23:44.552715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:44.581750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc69-7779-4bbe-a731-d557846c0658 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:44.593808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:44.601577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:44.602195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:44.602683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:44.604307 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:44.607873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:44.626731 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4296/8584] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:23:44.634782 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:44.642471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:44.650485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a793f9-4654-426b-986b-e15535ad74cb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:44.656650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:44.657859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:44.658263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:44.659334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:44.660154 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:44.662009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c048d-167f-477b-b7e8-f9703b17e2ff admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:44.676746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4289/8585] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:23:44.682347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:44.705055 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1495e-f80d-4626-9a7f-19ea7d6eb858 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:44.714095 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:44.715573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:44.715976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:44.716475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] PATH_INFO: `/v3/projects/fa8bf2fa906e464a9dfdc703eb568ebf/users/83fc44141e434dfa8e9c28bcfc996f7b/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:44.749543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8bf2fa906e464a9dfdc703eb568ebf, user_id=83fc44141e434dfa8e9c28bcfc996f7b, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:44.753715 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:44.844872 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4297/8586] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:23:44 2022] PUT /identity/v3/projects/fa8bf2fa906e464a9dfdc703eb568ebf/users/83fc44141e434dfa8e9c28bcfc996f7b/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:23:44.871447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:44.871815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:44.872244 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:44.933673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] MFA Rules not processed for user `83fc44141e434dfa8e9c28bcfc996f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:23:44.935280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:45.066535 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4290/8587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:23:45.093802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:23:45.096001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:23:45.198120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1552-b32f-4404-bb97-54052ae9fb58 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:23:45.203411 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:23:45.204164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:23:45.204556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:23:45.204952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:23:45.218596 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:23:45.220438 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:23:45.237712 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4298/8588] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:23:55.061046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=36 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:55.228625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:22.678107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:22.681360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:22.884573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3ed86-d819-4a72-8a7b-4ec7f7066efc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:22.894236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:22.896280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:22.897054 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:22.898549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:22.903439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:23.130996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:23.134989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:23.171469 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4291/8589] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:24.478241 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:24.480806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:24.734855 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5a80-4f50-4c64-970e-07b5578f7f56 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:24.754371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:24.754371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:24.754371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:24.754371 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:24.755436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:24.790066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:24.794425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:24.840344 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4299/8590] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:24.854557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:24.858118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:24.896641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003177a-ad64-4602-87c0-0bb633fdbdd6 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:24.910106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:24.911661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:24.912842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:24.913522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] PATH_INFO: `/v3/users/9d9040fc0de14e1583a9f614c47096f6` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:24.916776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9040fc0de14e1583a9f614c47096f6)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:24.921320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:25.327312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9040fc0de14e1583a9f614c47096f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:25.434488 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9040fc0de14e1583a9f614c47096f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:25.452504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9040fc0de14e1583a9f614c47096f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:25.482453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9040fc0de14e1583a9f614c47096f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:25.484112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-367bc774-45fa-4f0e-af75-0aa7ec62ebc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9040fc0de14e1583a9f614c47096f6'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:25.498382 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4292/8591] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:24:24 2022] DELETE /identity/v3/users/9d9040fc0de14e1583a9f614c47096f6 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:26.003978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:26.057559 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe41fe-9352-43c1-a27f-de2755ffd885 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:26.201695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:26.202721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:26.203298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:26.203689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] PATH_INFO: `/v3/projects/407a5520d21e46e8bcaddabf536fadcd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:26.205558 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] RBAC: Authorizing `identity:delete_project(project_id=407a5520d21e46e8bcaddabf536fadcd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:26.208417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:26.509145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407a5520d21e46e8bcaddabf536fadcd', 'request_id': 'req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:26.645809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407a5520d21e46e8bcaddabf536fadcd', 'request_id': 'req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:26.666809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407a5520d21e46e8bcaddabf536fadcd', 'request_id': 'req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:26.709798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] The token cache is being invalidate because project 407a5520d21e46e8bcaddabf536fadcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:24:26.713321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:26.713321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-be5bb0e2-6869-4fca-91ef-16f4e1d5305b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:26.716787 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4300/8592] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:24:26 2022] DELETE /identity/v3/projects/407a5520d21e46e8bcaddabf536fadcd => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:26.726341 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:26.727278 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:26.727656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:26.775430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:26.777764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:26.832223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:26.950457 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4293/8593] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:26.966020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:26.967766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:26.973337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.014786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:27.017879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:27.044266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.053223 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4301/8594] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:27.066933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1fe2-3dc8-423d-b512-aa188cfa38db None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.074752 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.075833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.076371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.076880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.078172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:24:27.079525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.084014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.116277 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4294/8595] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:24:27.123955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.146908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4609e-c070-402d-a54b-24f0082e85fe None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.156695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.158662 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.158866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.159159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.160501 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.163666 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.188655 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:27.326512 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4302/8596] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:24:27 2022] POST /identity/v3/projects => generated 399 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:24:27.338213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.360508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ff62-cd08-48d8-90d8-3065c384ed34 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.488417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.489600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.490097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.490699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.492158 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.496276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.629017 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4295/8597] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:24:27 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:24:27.636740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.661378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e115-fb5b-496f-a4ab-ab1aef942e30 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.670533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.671851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.672370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.673039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.674463 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.677883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.702418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4303/8598] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:24:27.708312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.724143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c18b-7ab1-434a-b37d-4ba792c84b11 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.733232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.734410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.734939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.735407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.736703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.740038 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f1952-b35d-4f33-98e8-9c208ad9e3a0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.761898 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4296/8599] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:24:27.769788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:27.791726 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad858685-aa6c-420a-87d3-fb8edd9d0d45 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:27.802549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:27.804333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.804869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.805625 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] PATH_INFO: `/v3/projects/d36e2a55660c43e09bef049c28815e72/users/435114da213645f7b897104a9f501b60/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:27.837990 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36e2a55660c43e09bef049c28815e72, user_id=435114da213645f7b897104a9f501b60, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:27.843433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:27.947461 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4304/8600] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:24:27 2022] PUT /identity/v3/projects/d36e2a55660c43e09bef049c28815e72/users/435114da213645f7b897104a9f501b60/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:27.967099 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:27.967647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:27.968156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:28.029449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] MFA Rules not processed for user `435114da213645f7b897104a9f501b60`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:28.031977 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:28.184115 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4297/8601] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:28.203248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:28.208378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:28.340772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3a158-12b1-4da6-921c-bd89f0abaed4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:28.349053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:28.353024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:28.353460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:28.353865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:28.380421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:28.382243 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:28.395636 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4305/8602] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:35.908661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:35.912741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:36.020357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:36.322322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e1ab-7ec3-4bed-af2f-5c20bec8e6d8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:36.369647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:36.371266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:36.376907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:36.378853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:36.382707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:36.441185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:36.444801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14af430-82d9-4a69-8ea3-0a9bc5873cea service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:36.511183 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4298/8603] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:38.388402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:41.980453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:41.991336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:42.226455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d21e0e-2990-42ca-983f-8ad35f8ec719 service cinder] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:42.235870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:42.237282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:42.237880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:42.238548 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] PATH_INFO: `/v3/users/77c793eaa0c14d9886a6a8f2e721cf9e` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:42.241140 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c793eaa0c14d9886a6a8f2e721cf9e)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:42.245970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:42.693957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c793eaa0c14d9886a6a8f2e721cf9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:42.695305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c793eaa0c14d9886a6a8f2e721cf9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:42.845922 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c793eaa0c14d9886a6a8f2e721cf9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:42.879843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c793eaa0c14d9886a6a8f2e721cf9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:42.900274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c793eaa0c14d9886a6a8f2e721cf9e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:42.914242 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4306/8604] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:24:41 2022] DELETE /identity/v3/users/77c793eaa0c14d9886a6a8f2e721cf9e => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:42.923490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:42.924343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:42.928651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:42.970384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:42.972909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:43.124092 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4299/8605] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:43.142016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:43.144889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:43.281189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4536c-5635-41b6-8256-e3949b845fc7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:43.288531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:43.289617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:43.290366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:43.290873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:43.310865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:43.315212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fb657-88b2-450b-9578-24de646d0650 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:43.336481 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4307/8606] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:43.960945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:43.965988 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:43.996455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108b4a-1afb-47df-89fa-e7c6bc0be18b None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:44.006903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:44.021040 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:44.021594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:44.022209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] PATH_INFO: `/v3/projects/f1825a1177a04e78bd4d42c9ab83c051` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:44.025813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1825a1177a04e78bd4d42c9ab83c051)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:44.031019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:44.263317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1825a1177a04e78bd4d42c9ab83c051', 'request_id': 'req-54b5909e-2ca4-4008-9172-bc85128c16d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:44.277635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1825a1177a04e78bd4d42c9ab83c051', 'request_id': 'req-54b5909e-2ca4-4008-9172-bc85128c16d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:44.292012 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1825a1177a04e78bd4d42c9ab83c051', 'request_id': 'req-54b5909e-2ca4-4008-9172-bc85128c16d9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:44.576182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] The token cache is being invalidate because project f1825a1177a04e78bd4d42c9ab83c051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:24:44.576667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:44.578027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-54b5909e-2ca4-4008-9172-bc85128c16d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:44.581206 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4300/8607] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:24:43 2022] DELETE /identity/v3/projects/f1825a1177a04e78bd4d42c9ab83c051 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:44.589164 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:44.589992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:44.590158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:44.644374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:44.644374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:44.671499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:44.779291 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4308/8608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:24:44.972100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:44.972753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:44.973097 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.010935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:45.013266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:45.029477 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4301/8609] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:45.036594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.061482 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33e74-91db-4779-a028-90c3bd1e1f3b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.072877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.074067 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.074581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.075098 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.079253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:24:45.079253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.080626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:45.109126 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4309/8610] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:24:45.117484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.147457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523830-ace9-4f29-9455-dbd3472b5343 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.159078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.160260 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.161058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.162053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.163723 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.169591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:45.346833 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4302/8611] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:24:45 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:24:45.353530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.377746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015437-e6ea-467b-b27e-9988b8021b1a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.567007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.568287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.568785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.569291 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.570581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.574743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:45.701647 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4310/8612] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:24:45 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:24:45.704103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.717651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:45.729954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf68d78-e0af-4c10-8473-6d75ee6227e9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.743571 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.746741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.746741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.746741 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.747493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.752129 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:45.778490 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4303/8613] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:24:45.780338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.802288 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1701e5-3cad-48c8-b684-2bd99971af31 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.813594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.815338 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.816907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.817827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.819544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.823774 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b73bc4-b332-49ab-94a3-36f5bde1a6bd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:45.854550 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4311/8614] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:24:45.857792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:45.879830 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc90d-85f3-47fb-a4e8-0659b9c7e6b1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:45.891768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:45.892954 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:45.893507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:45.894148 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] PATH_INFO: `/v3/projects/74860681489a47bb9746ff0edf7adfed/users/d712dc735cfb4d4f816a293c774ea363/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:45.967587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=74860681489a47bb9746ff0edf7adfed, user_id=d712dc735cfb4d4f816a293c774ea363, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:45.975463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:46.122356 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4304/8615] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:24:45 2022] PUT /identity/v3/projects/74860681489a47bb9746ff0edf7adfed/users/d712dc735cfb4d4f816a293c774ea363/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:46.142861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:46.148458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:46.148458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:46.239057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] MFA Rules not processed for user `d712dc735cfb4d4f816a293c774ea363`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:46.239057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:46.402039 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4312/8616] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:46.456039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:46.456224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:46.603178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01352-1d23-488c-98a5-2aaf429656fe admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:46.614887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:46.616031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:46.616531 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:46.617033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:46.639892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:46.639892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd435e-e750-475b-9368-ae6c9a2c16df service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:46.666316 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4305/8617] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:48.754204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:48.757400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:48.808355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:48.932791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9b02-b6c3-46e5-a347-109a08803727 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:48.943752 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:48.944978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:48.945491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:48.945982 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] PATH_INFO: `/v3/users/435114da213645f7b897104a9f501b60` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:48.948764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=435114da213645f7b897104a9f501b60)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:48.953039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:49.223821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435114da213645f7b897104a9f501b60'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:49.226229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435114da213645f7b897104a9f501b60'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:49.319449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435114da213645f7b897104a9f501b60'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:49.348885 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435114da213645f7b897104a9f501b60'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:49.403297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435114da213645f7b897104a9f501b60'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:49.414376 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4313/8618] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:24:48 2022] DELETE /identity/v3/users/435114da213645f7b897104a9f501b60 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:49.424507 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:49.495505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:49.495505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:49.495505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:49.495505 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:49.633389 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4306/8619] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:49.641024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:49.643712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:49.786632 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e45d-9ead-47e2-93ce-45263f79c47c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:49.795203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:49.795203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:49.795923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:49.797268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:49.816290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:49.820169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faefba-96df-47f7-9687-8273272c5e58 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:49.845128 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4314/8620] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:24:50.726729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:50.732126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:50.802691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0a6aa-ed4f-41c0-b803-51394b389471 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:50.818360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:50.819625 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:50.820096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:50.821211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] PATH_INFO: `/v3/projects/d36e2a55660c43e09bef049c28815e72` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:50.825307 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36e2a55660c43e09bef049c28815e72)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:50.829853 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:51.063048 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36e2a55660c43e09bef049c28815e72', 'request_id': 'req-a5c230d3-77f5-4dfb-bdef-4162339afda7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:51.077621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36e2a55660c43e09bef049c28815e72', 'request_id': 'req-a5c230d3-77f5-4dfb-bdef-4162339afda7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:51.086251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36e2a55660c43e09bef049c28815e72', 'request_id': 'req-a5c230d3-77f5-4dfb-bdef-4162339afda7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:51.090436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:51.234935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] The token cache is being invalidate because project d36e2a55660c43e09bef049c28815e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:24:51.235687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:51.237273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a5c230d3-77f5-4dfb-bdef-4162339afda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:24:51.240199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4307/8621] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:24:50 2022] DELETE /identity/v3/projects/d36e2a55660c43e09bef049c28815e72 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:51.250700 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:51.251605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:51.251978 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:51.292502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:51.295292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:51.367343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:51.421399 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4315/8622] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:51.438467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:51.438979 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:51.439711 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:51.478408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:51.481030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:51.496761 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4308/8623] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:24:51.502719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:51.516985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d71d4-23f3-422b-be84-c2810ef866d4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:51.525785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:51.527195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:51.527736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:51.528370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:51.530119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:24:51.530659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:51.544865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:51.582055 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4316/8624] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:24:51.584667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:51.608511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1700d-0ab6-4ea9-b45e-a81a0968797f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:51.616025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:51.618587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:51.618587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:51.619031 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:51.620182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:51.624234 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:51.816692 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4309/8625] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:24:51 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:24:51.825031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:51.841103 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09641cae-e961-4b80-861e-3b5251768bc2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:51.951425 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:51.952430 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:51.953719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:51.954061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:51.955401 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:51.958268 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:52.141076 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4317/8626] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:24:51 2022] POST /identity/v3/users => generated 286 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:24:52.146620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:52.168020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de212be-9263-49ee-9d2c-5f5f97da1dfb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:52.178573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:52.179784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:52.180285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:52.180777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:52.182322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:52.185490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:52.210600 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4310/8627] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:24:52.216884 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:52.235948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f185-5592-4cd4-84d8-62db02ef60e1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:52.245267 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:52.246337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:52.246838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:52.247442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:52.249218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:52.253089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b459f1-e64f-441d-a1ab-7551fd19fcb7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:52.296542 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4318/8628] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:24:52.300899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:52.326320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ecf9-6eeb-4b9b-9ab8-4b9378803b9c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:52.349020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:52.349020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:52.349020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:52.349020 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] PATH_INFO: `/v3/projects/c1ea0b0d12fc499dad11f4c35209eb91/users/f4fc078c2ec240ae86abfe7c2882e900/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:52.375777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea0b0d12fc499dad11f4c35209eb91, user_id=f4fc078c2ec240ae86abfe7c2882e900, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:52.380117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:52.500902 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4311/8629] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:24:52 2022] PUT /identity/v3/projects/c1ea0b0d12fc499dad11f4c35209eb91/users/f4fc078c2ec240ae86abfe7c2882e900/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:24:52.507168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c95e-70f0-44e2-be33-08f9040c7c08 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:52.507638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c95e-70f0-44e2-be33-08f9040c7c08 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:52.507977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038c95e-70f0-44e2-be33-08f9040c7c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:52.536076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6038c95e-70f0-44e2-be33-08f9040c7c08 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:24:52.537736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6038c95e-70f0-44e2-be33-08f9040c7c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:52.664452 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4319/8630] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:24:52.681591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:24:52.684327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:24:52.812861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b441a5d-844c-408f-971d-f08bb0fbd76f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:24:52.820027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:24:52.820027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:24:52.820027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:24:52.821920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:24:52.839609 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:24:52.842530 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:24:52.864197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4312/8631] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:25:02.646962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:02.852663 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:04.117970 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:04.119618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:04.120705 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:04.251680 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] MFA Rules not processed for user `f4fc078c2ec240ae86abfe7c2882e900`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:04.257312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:04.535816 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4320/8632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:04.542389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:04.583665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83d08-5fd3-4b77-9c35-3fa39afe8008 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:04.599033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:04.600136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:04.600913 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:04.601321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:04.602220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:04.606397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:04.814129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4313/8633] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:25:04 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:25:04.818757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:04.868503 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1724d4-09e3-4c7c-846a-79b7f6afc5e6 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:05.159048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:05.160420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:05.161284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:05.161943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:05.163476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:05.168379 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:05.645148 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4321/8634] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:25:04 2022] POST /identity/v3/users => generated 292 bytes in 828 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:25:05.652777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:05.698858 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:05.702882 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:05.703605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d03040-8bf7-4032-a172-7b0db0b3551b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:05.723223 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:05.724917 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:05.725739 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:05.726537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:05.728137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:05.732292 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:05.764549 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4314/8635] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:25:05.773321 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:05.805001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88429e91-b9c7-4c86-ba51-feab9d20a91e admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:05.814634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:05.816655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:05.822384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:05.822384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] PATH_INFO: `/v3/projects/1ac5326204b94208b0d4e46022f385a5/users/52c40c5574a94ded89126b22356db356/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:05.854783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac5326204b94208b0d4e46022f385a5, user_id=52c40c5574a94ded89126b22356db356, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:05.862584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:05.922087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:05.942404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc54-ada5-4842-85b3-645f3b5b0ab2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:05.952879 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:05.954518 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:05.955060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:05.955639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:05.959362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:05.999808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4315/8636] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:25:05 2022] PUT /identity/v3/projects/1ac5326204b94208b0d4e46022f385a5/users/52c40c5574a94ded89126b22356db356/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:06.006133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:06.130364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:06.134109 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:06.153012 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4322/8637] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:25:06.181805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca94df-5e94-4664-8fa4-aad885f3fc43 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:06.201056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:06.201056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:06.201056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:06.201056 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:06.201884 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:06.204133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638abca-9419-4638-ab3f-c2c5daaced8d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:06.224944 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4316/8638] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:25:06.232246 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:06.255933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3d1bc-5265-49ee-b0ae-aa6127984cd6 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:06.265799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:06.267040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:06.267653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:06.268162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] PATH_INFO: `/v3/projects/1ac5326204b94208b0d4e46022f385a5/users/52c40c5574a94ded89126b22356db356/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:06.272484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac5326204b94208b0d4e46022f385a5, user_id=52c40c5574a94ded89126b22356db356, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:06.278402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:06.304714 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4323/8639] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:25:06 2022] PUT /identity/v3/projects/1ac5326204b94208b0d4e46022f385a5/users/52c40c5574a94ded89126b22356db356/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:16.215719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:16.292520 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:19.188874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f8e0-e1d3-4cc1-abfe-daace0c30b48 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:19.190629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f8e0-e1d3-4cc1-abfe-daace0c30b48 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:19.191486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f8e0-e1d3-4cc1-abfe-daace0c30b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:19.272039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b79f8e0-e1d3-4cc1-abfe-daace0c30b48 None None] MFA Rules not processed for user `52c40c5574a94ded89126b22356db356`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:19.275204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b79f8e0-e1d3-4cc1-abfe-daace0c30b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:19.524958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4317/8640] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:19.564601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:19.569701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:19.914865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcef0f-4e0c-4561-a1d3-49af8b004a9b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:19.927722 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:19.928798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:19.929388 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:19.930100 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:20.169227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:20.174441 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db023f-4809-47d2-bcb1-c573c0c3f286 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:20.209698 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4324/8641] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:25:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:25:26.340946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:26.342602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:26.343189 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:26.403263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] MFA Rules not processed for user `f4fc078c2ec240ae86abfe7c2882e900`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:26.405887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:26.421501 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4318/8642] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:27.211677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:27.212566 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:27.213130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:25:27.227667 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:25:27.229806 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:25:27.254702 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4325/8643] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:25:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:25:29.104415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:29.107120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:29.325549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b118-f9d6-4ac1-81f5-bb2e44227c82 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:29.338254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:29.339660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:29.340299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:29.340911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:29.346637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:29.381312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:29.384903 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:29.419232 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4319/8644] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:25:30.190637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=76 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:39.401313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=77 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:44.292648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:44.525594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8f4d-1e5c-4282-9ec4-5014f31f722f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:44.536305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:44.537350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:44.537839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:44.541366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] PATH_INFO: `/v3/users/f4fc078c2ec240ae86abfe7c2882e900` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:44.541366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fc078c2ec240ae86abfe7c2882e900)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:44.545091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:44.863864 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fc078c2ec240ae86abfe7c2882e900'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:44.865484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fc078c2ec240ae86abfe7c2882e900'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:44.970603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fc078c2ec240ae86abfe7c2882e900'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:45.027491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fc078c2ec240ae86abfe7c2882e900'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:45.054016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fc078c2ec240ae86abfe7c2882e900'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:45.095487 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4326/8645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:25:44 2022] DELETE /identity/v3/users/f4fc078c2ec240ae86abfe7c2882e900 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:45.710882 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:45.747458 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ad69-c1ee-482b-9b2c-8c7657619c4c service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:45.906140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:45.907423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:45.907984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:45.908495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] PATH_INFO: `/v3/projects/c1ea0b0d12fc499dad11f4c35209eb91` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:45.910961 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ea0b0d12fc499dad11f4c35209eb91)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:45.914364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:46.211180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ea0b0d12fc499dad11f4c35209eb91', 'request_id': 'req-70ae7006-7d8a-4d15-95a9-150389713bd7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.226787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ea0b0d12fc499dad11f4c35209eb91', 'request_id': 'req-70ae7006-7d8a-4d15-95a9-150389713bd7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.255259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ea0b0d12fc499dad11f4c35209eb91', 'request_id': 'req-70ae7006-7d8a-4d15-95a9-150389713bd7'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.351991 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] The token cache is being invalidate because project c1ea0b0d12fc499dad11f4c35209eb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:25:46.353990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.353990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.362205 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4320/8646] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:25:45 2022] DELETE /identity/v3/projects/c1ea0b0d12fc499dad11f4c35209eb91 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:46.364725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:46.368553 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:46.398436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65376f10-f19d-4a5f-b017-385a9fff690a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:46.540404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:46.541805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:46.542216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:46.542633 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] PATH_INFO: `/v3/users/52c40c5574a94ded89126b22356db356` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:46.546484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c40c5574a94ded89126b22356db356)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:46.550963 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:46.593708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:46.842769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c40c5574a94ded89126b22356db356'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.844331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c40c5574a94ded89126b22356db356'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:46.987323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c40c5574a94ded89126b22356db356'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:47.016032 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c40c5574a94ded89126b22356db356'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:47.032998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c40c5574a94ded89126b22356db356'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:47.046108 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4327/8647] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:25:46 2022] DELETE /identity/v3/users/52c40c5574a94ded89126b22356db356 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:25:47.545297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:47.548202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:47.580179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae7006-7d8a-4d15-95a9-150389713bd7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:47.943883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:47.945003 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:47.945469 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:47.945974 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] PATH_INFO: `/v3/projects/1ac5326204b94208b0d4e46022f385a5` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:47.948277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac5326204b94208b0d4e46022f385a5)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:47.952889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:48.132628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:48.159069 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac5326204b94208b0d4e46022f385a5', 'request_id': 'req-a22de6ec-6819-49d4-95ed-9141278a745c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:48.173631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac5326204b94208b0d4e46022f385a5', 'request_id': 'req-a22de6ec-6819-49d4-95ed-9141278a745c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:48.186536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac5326204b94208b0d4e46022f385a5', 'request_id': 'req-a22de6ec-6819-49d4-95ed-9141278a745c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:48.322547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] The token cache is being invalidate because project 1ac5326204b94208b0d4e46022f385a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:25:48.323051 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:48.324263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-a22de6ec-6819-49d4-95ed-9141278a745c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:48.326241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4321/8648] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:25:47 2022] DELETE /identity/v3/projects/1ac5326204b94208b0d4e46022f385a5 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:25:53.577154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:53.579658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:53.623043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc635d88-3908-49d2-a06f-9177864068fc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:53.795203 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:53.797011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:53.797830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:53.798579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] PATH_INFO: `/v3/users/83fc44141e434dfa8e9c28bcfc996f7b` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:53.801587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fc44141e434dfa8e9c28bcfc996f7b)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:53.806011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:54.166730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fc44141e434dfa8e9c28bcfc996f7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:54.167887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fc44141e434dfa8e9c28bcfc996f7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:54.411622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fc44141e434dfa8e9c28bcfc996f7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:54.440153 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fc44141e434dfa8e9c28bcfc996f7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:54.455475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fc44141e434dfa8e9c28bcfc996f7b'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:54.469366 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4328/8649] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:25:53 2022] DELETE /identity/v3/users/83fc44141e434dfa8e9c28bcfc996f7b => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:54.476921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:54.478105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:54.478105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:54.537831 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:54.540823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:54.698427 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4322/8650] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:54.714683 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:54.717813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:54.745607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:54.890182 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602be11-f18e-461e-85e6-089186114233 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:54.898154 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:54.900237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:54.900685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:54.901080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:54.919657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:54.922626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b7d7-29d1-4c37-a07a-33d0c658eeaa service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:54.942369 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4329/8651] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:25:55.852892 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:55.855837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:55.889785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a5a06-dfce-45d5-bf5b-98104f1fa720 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:55.901535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:55.902863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:55.903556 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:55.904361 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] PATH_INFO: `/v3/projects/fa8bf2fa906e464a9dfdc703eb568ebf` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:55.906735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8bf2fa906e464a9dfdc703eb568ebf)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:55.911513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:56.278767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8bf2fa906e464a9dfdc703eb568ebf', 'request_id': 'req-736f89dc-88f3-43fc-8363-3dc949f246ab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:56.293331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8bf2fa906e464a9dfdc703eb568ebf', 'request_id': 'req-736f89dc-88f3-43fc-8363-3dc949f246ab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:56.305994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8bf2fa906e464a9dfdc703eb568ebf', 'request_id': 'req-736f89dc-88f3-43fc-8363-3dc949f246ab'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:56.480960 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] The token cache is being invalidate because project fa8bf2fa906e464a9dfdc703eb568ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:25:56.481319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:56.483526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-736f89dc-88f3-43fc-8363-3dc949f246ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:25:56.486354 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4323/8652] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:25:55 2022] DELETE /identity/v3/projects/fa8bf2fa906e464a9dfdc703eb568ebf => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:56.495172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:56.496015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:56.496437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:56.601305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:56.603527 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:56.738894 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4330/8653] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:25:56.752814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:56.753314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:56.753824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:56.795384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:56.803328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:56.821550 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4324/8654] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:56.829005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:56.850417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a569-49df-4222-a511-a71ec8ed3469 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:56.860681 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:56.870433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:56.895125 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4331/8655] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:25:56.902774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:56.923518 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda03968-9d9c-405f-80f4-b1fb52d5db0d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:56.932713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:56.933824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:56.934322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:56.934868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:56.936156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:56.940086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:57.104931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:57.119773 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4325/8656] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:25:57.126889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:57.147887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffdb6-3fee-4ef4-8cea-0feb72e30443 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:57.280612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:57.281889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:57.282509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:57.283099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:57.285044 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:57.289264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:57.308694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:57.428523 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4332/8657] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:25:57 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:25:57.436060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:57.455024 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30ee8-e639-4b9b-b1e0-7c7c5a3da0bd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:57.464600 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:57.465847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:57.466396 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:57.466928 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:57.468181 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:57.471607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:57.493927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4326/8658] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:25:57.501340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:57.522381 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43d0d-84a5-440b-ae8b-19e213dcfa4b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:57.531270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:57.532370 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:57.532876 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:57.533535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:57.535046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:57.538358 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01a609-18ae-43d1-9451-ace2db54ca71 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:57.559385 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4333/8659] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:25:57.567197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:57.588163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137a93-e127-45a3-9b80-44e4d4168f61 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:57.596967 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:57.598140 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:57.598626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:57.603712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] PATH_INFO: `/v3/projects/3554296c0d504bf1afa4e5bb65dba76a/users/437f84236b164941b2899041c73917bc/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:57.630933 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3554296c0d504bf1afa4e5bb65dba76a, user_id=437f84236b164941b2899041c73917bc, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:57.636523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:57.792489 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4327/8660] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:25:57 2022] PUT /identity/v3/projects/3554296c0d504bf1afa4e5bb65dba76a/users/437f84236b164941b2899041c73917bc/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:25:57.814624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac685-db67-4e5e-8da1-95cab33e148a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:57.815251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac685-db67-4e5e-8da1-95cab33e148a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:57.815771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecac685-db67-4e5e-8da1-95cab33e148a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:57.880169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9ecac685-db67-4e5e-8da1-95cab33e148a None None] MFA Rules not processed for user `437f84236b164941b2899041c73917bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:25:57.885768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9ecac685-db67-4e5e-8da1-95cab33e148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:58.020539 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4334/8661] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:25:58.038533 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:25:58.041602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:25:58.161671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790552a-1b12-4e97-885b-56b84e0a41a6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:25:58.168211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a554eb26060549b48a431c579659ff93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:25:58.169147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:25:58.170248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:25:58.170637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:25:58.185455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:25:58.187983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431026d-d1bb-4805-abee-30d56cf268df service cinder] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:25:58.203606 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4328/8662] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:01.536505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:01.537312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:01.537515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:01.574523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] MFA Rules not processed for user `437f84236b164941b2899041c73917bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:01.577462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:01.591009 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4335/8663] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:03.398686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:03.399623 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:03.400312 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:03.452624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:03.456337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:03.484250 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:03.486323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:03.579630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843000f9-2e35-41b6-ba04-859e29664307 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:03.585465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:03.586652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:03.587355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:03.588089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:03.592130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:03.632544 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4329/8664] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:03.655269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:03.657866 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:03.691797 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a9a53-5f5c-4b59-8720-0389aec917d9 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:03.708806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:03.709694 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:03.710083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:03.710473 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:03.723840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:03.726412 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:03.742573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4330/8665] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:26:03.775286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:03.778345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:03.812713 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4336/8666] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:11.416456 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:11.419674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:11.442120 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b045-c3cf-4a06-988a-078f5d082cb6 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:11.448990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:11.450652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:11.451377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:11.451678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:11.455449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:11.478735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:11.482059 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:11.503777 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4331/8667] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:13.148644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:13.148644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:13.177424 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d060-c4a2-4a63-868d-f54ac0c73190 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:13.189144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:13.192806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:13.192806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:13.192806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:13.196820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:13.216995 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:13.231923 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:13.235324 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267b42-2a22-4945-aadb-ec9a0c90eedd service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:13.264565 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4337/8668] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:19.720546 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:19.753584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabaf80-73a2-4595-b3e1-d6885258bffe service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:19.765015 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:19.766133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:19.766635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:19.767269 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:19.770698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:19.801393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:19.804064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:19.825605 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4332/8669] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:23.402434 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:29.589789 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513950-eead-40ae-9d74-1eea92b84037 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:29.591562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513950-eead-40ae-9d74-1eea92b84037 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:29.591932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513950-eead-40ae-9d74-1eea92b84037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:29.630130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-87513950-eead-40ae-9d74-1eea92b84037 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:29.632543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-87513950-eead-40ae-9d74-1eea92b84037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:29.733705 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4338/8670] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:29.813233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:29.944893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:29.945416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:30.076106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616695-7615-4bb5-8e09-673aa0e6f734 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:30.086712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:30.087889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:30.088401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:30.088881 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:30.107295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:30.109175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:30.127703 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4333/8671] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:31.628423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37329bd2-53fd-4cc0-ac1f-dd1aa00f4024 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:31.629088 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37329bd2-53fd-4cc0-ac1f-dd1aa00f4024 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:31.629432 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37329bd2-53fd-4cc0-ac1f-dd1aa00f4024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:31.664725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-37329bd2-53fd-4cc0-ac1f-dd1aa00f4024 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:31.666997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-37329bd2-53fd-4cc0-ac1f-dd1aa00f4024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:31.681683 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4339/8672] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:31.702737 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:31.718490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e143-1e20-4696-81c0-3544938e8b95 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:31.727199 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:31.728394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:31.728990 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:31.729559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:31.747186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:31.749272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:31.760671 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4334/8673] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:33.148237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa578c-0372-4a8d-8eeb-e47964adc607 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:33.149128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa578c-0372-4a8d-8eeb-e47964adc607 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:33.149709 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa578c-0372-4a8d-8eeb-e47964adc607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:33.185953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-4afa578c-0372-4a8d-8eeb-e47964adc607 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:33.188385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4afa578c-0372-4a8d-8eeb-e47964adc607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:33.202267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4340/8674] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:33.220127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:33.237493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a3e3-94c0-457d-bdc0-49769d0ed00a service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:33.244169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:33.244872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:33.245271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:33.245594 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:33.263271 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:33.266373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:33.285163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4335/8675] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:26:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:34.484189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5d0c-bdc0-4ee5-84f5-b1423950bbae None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:34.485061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5d0c-bdc0-4ee5-84f5-b1423950bbae None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:34.485420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5d0c-bdc0-4ee5-84f5-b1423950bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:34.523092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e8dc5d0c-bdc0-4ee5-84f5-b1423950bbae None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:34.530574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e8dc5d0c-bdc0-4ee5-84f5-b1423950bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:34.546739 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4341/8676] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:34.575258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:34.597563 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e05b0-6fef-4568-885b-7219b970f3fb service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:34.607431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:34.608492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:34.608973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:34.609452 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:34.627423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:34.630527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:34.648199 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4336/8677] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:37.808617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:37.810099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:37.810706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:37.849957 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:37.852849 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:37.871806 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4342/8678] 10.222.0.85 () {58 vars in 1015 bytes} [Tue Oct 4 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:37.889243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:37.892128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:37.925502 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f9b05-03e8-4243-90dd-fb0aa0cfa446 service swift] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:37.936580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:37.937912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:37.938424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:37.938915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:37.957704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:37.960778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f284a02-9f73-416a-bcf5-8f55b6e4f3db service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:37.981694 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4337/8679] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:42.023196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:42.167290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8dbb-4a3f-4eba-af9d-b680b41663bc None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:42.180165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:42.181361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:42.181877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:42.182389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] PATH_INFO: `/v3/users/437f84236b164941b2899041c73917bc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:42.184831 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437f84236b164941b2899041c73917bc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:42.192599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:42.545422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437f84236b164941b2899041c73917bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:42.546654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437f84236b164941b2899041c73917bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:42.706449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437f84236b164941b2899041c73917bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:42.736294 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437f84236b164941b2899041c73917bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:42.755064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437f84236b164941b2899041c73917bc'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:42.758626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:42.775366 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4343/8680] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:26:42 2022] DELETE /identity/v3/users/437f84236b164941b2899041c73917bc => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:26:42.778671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:42.779651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:42.779651 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:42.814765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:42.817606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:42.966506 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4338/8681] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:42.979901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:42.983275 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:43.102904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3774c3-346f-415a-a615-7552e77c70e0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:43.111163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:43.113052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:43.113506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:43.114374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:43.134464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:43.137043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:43.155127 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4344/8682] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:26:43.692527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:43.697116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:43.722833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1904bdf-e853-4e82-b3fe-98e3e4a281bf None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:43.739427 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:43.740298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:43.740683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:43.741203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] PATH_INFO: `/v3/projects/3554296c0d504bf1afa4e5bb65dba76a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:43.743217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3554296c0d504bf1afa4e5bb65dba76a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:43.747008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:43.953068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:43.976501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3554296c0d504bf1afa4e5bb65dba76a', 'request_id': 'req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:43.990343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3554296c0d504bf1afa4e5bb65dba76a', 'request_id': 'req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:44.001434 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3554296c0d504bf1afa4e5bb65dba76a', 'request_id': 'req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:44.201156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] The token cache is being invalidate because project 3554296c0d504bf1afa4e5bb65dba76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:26:44.201665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:44.202919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5301a34d-41a0-44dc-a1de-d93a18a1fbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:44.205771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4339/8683] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:26:43 2022] DELETE /identity/v3/projects/3554296c0d504bf1afa4e5bb65dba76a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:26:44.677165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:44.680509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:44.708417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc0d3-5669-4c6a-8bc6-e486b6bc3052 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:44.822007 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:44.823108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:44.823511 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:44.823830 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] PATH_INFO: `/v3/users/d712dc735cfb4d4f816a293c774ea363` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:44.825302 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d712dc735cfb4d4f816a293c774ea363)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:44.828058 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:45.121485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd712dc735cfb4d4f816a293c774ea363'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:45.122733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd712dc735cfb4d4f816a293c774ea363'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:45.249431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd712dc735cfb4d4f816a293c774ea363'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:45.278174 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd712dc735cfb4d4f816a293c774ea363'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:45.293355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd712dc735cfb4d4f816a293c774ea363'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:45.305803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4345/8684] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:26:44 2022] DELETE /identity/v3/users/d712dc735cfb4d4f816a293c774ea363 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:26:45.312992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:45.313874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:45.313874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:45.349453 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:26:45.351052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:45.483631 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4340/8685] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:26:45.499703 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:45.502595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:45.551166 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:45.638737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c56923-427e-49a7-911b-a88df4a6f5b1 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:45.645475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:45.646818 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:45.647363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:45.647998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:45.662065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:45.666894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc54752-f46e-4bee-830e-4a725c61d3a0 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:45.681351 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4346/8686] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:26:46.447823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:26:46.450065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:26:46.472389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe696-0b06-433f-a7e9-dca30190bda6 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:26:46.479382 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:26:46.480894 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:26:46.481380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:26:46.481904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] PATH_INFO: `/v3/projects/74860681489a47bb9746ff0edf7adfed` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:26:46.484547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74860681489a47bb9746ff0edf7adfed)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:26:46.493691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:26:46.709579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74860681489a47bb9746ff0edf7adfed', 'request_id': 'req-7d1ad5f2-18ac-436e-89a5-ab07037595e4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:46.724808 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74860681489a47bb9746ff0edf7adfed', 'request_id': 'req-7d1ad5f2-18ac-436e-89a5-ab07037595e4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:46.738329 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74860681489a47bb9746ff0edf7adfed', 'request_id': 'req-7d1ad5f2-18ac-436e-89a5-ab07037595e4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:46.867336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] The token cache is being invalidate because project 74860681489a47bb9746ff0edf7adfed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:26:46.867878 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:46.869085 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7d1ad5f2-18ac-436e-89a5-ab07037595e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:26:46.872663 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4341/8687] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:26:46 2022] DELETE /identity/v3/projects/74860681489a47bb9746ff0edf7adfed => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:26:55.850066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=17 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:56.859605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=66,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:02.316562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:02.317318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:02.317659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:02.351536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:02.353741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:02.491930 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4347/8688] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:02.509041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:02.510174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:02.510174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:02.546552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:02.548672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:02.564767 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4342/8689] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:02.572816 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:02.590695 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8d49-9ea0-4b02-804c-784ff2c3d266 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:02.602866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:02.603935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:02.604892 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:02.605328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:02.606502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:27:02.607169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:02.610377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:02.636320 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4348/8690] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:27:02.655810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:02.674016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a5e2-39ab-4042-a8c4-3653e77e428f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:02.683257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:02.684462 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:02.684947 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:02.685395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:02.686602 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:02.692186 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:02.841766 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4343/8691] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:27:02 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:02.848810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:02.869102 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846391-5f9d-46bb-b5c8-5e215313de8d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:02.993592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:02.995439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:02.996149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:02.996658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:02.997874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:03.003037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:03.207231 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4349/8692] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:27:02 2022] POST /identity/v3/users => generated 296 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:03.213674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:03.234302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc81ed-3145-4663-9cfe-c479810611d7 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:03.243046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:03.244127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:03.244620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:03.245128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:03.246410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:03.249598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:03.271249 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4344/8693] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:03.278866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:03.300048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc67c8-46e3-488e-8971-32a8a61cfcbb admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:03.309173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:03.310310 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:03.310825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:03.311406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:03.312716 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:03.316156 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28767c9d-7faf-4aab-9103-3578164da382 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:03.331053 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4350/8694] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:03.346366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:03.359267 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e726-f6e7-4fdd-8356-aeb5a3170c8c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:03.365204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:03.366073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:03.366459 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:03.366969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] PATH_INFO: `/v3/projects/49486f6954e340efbf04c7b4ae8098fb/users/48eda3a284964e5785742149f90b2477/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:03.388423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=49486f6954e340efbf04c7b4ae8098fb, user_id=48eda3a284964e5785742149f90b2477, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:03.392298 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:03.503212 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4345/8695] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:27:03 2022] PUT /identity/v3/projects/49486f6954e340efbf04c7b4ae8098fb/users/48eda3a284964e5785742149f90b2477/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:27:03.527011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:03.527659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:03.528151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:03.582270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] MFA Rules not processed for user `48eda3a284964e5785742149f90b2477`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:03.584530 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:03.709750 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:03.730498 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4351/8696] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:27:03.738589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:03.876880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dcbe7-35e1-4742-a62a-2593c8aea9dd admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:03.886364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:03.887674 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:03.888172 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:03.888669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:03.889946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:03.894216 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.048347 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4346/8697] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:27:03 2022] POST /identity/v3/projects => generated 391 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:27:04.055827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:04.077933 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d09b-8659-481e-9d34-90f90a9b8f5d None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:04.206443 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:04.207556 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:04.208051 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:04.208547 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:04.209809 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:04.214299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.399263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4352/8698] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:27:04 2022] POST /identity/v3/users => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:04.405982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:04.427183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397ebe7-43c5-4441-895a-3a5e057752ce admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:04.436706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:04.464454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:04.464454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:04.464454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:04.464454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:04.464454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.467046 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4347/8699] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:04.476602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:04.497901 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ab46-32f3-42f7-af2c-c4ea1fd2cefc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:04.507465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:04.508651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:04.509131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:04.509624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] PATH_INFO: `/v3/projects/39d99c8623964f299bab3664296b77f9/users/0846761655a5458ab05dd995ae4a2e77/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:04.542205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d99c8623964f299bab3664296b77f9, user_id=0846761655a5458ab05dd995ae4a2e77, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:04.547674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.736736 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4353/8700] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:27:04 2022] PUT /identity/v3/projects/39d99c8623964f299bab3664296b77f9/users/0846761655a5458ab05dd995ae4a2e77/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:04.743644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:04.764457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b61c-0d61-42e0-b921-1689018e4c9a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:04.888058 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:04.889111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:04.889579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:04.890050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:04.891084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:04.894570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf852-30c2-4c7e-9ed9-2bbdaa07eb1c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.916686 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4348/8701] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:27:04.924447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:04.944167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695c59a-af93-413e-beab-9690c7403330 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:04.952896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:04.954010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:04.954491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:04.954956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] PATH_INFO: `/v3/projects/39d99c8623964f299bab3664296b77f9/users/0846761655a5458ab05dd995ae4a2e77/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:04.958718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d99c8623964f299bab3664296b77f9, user_id=0846761655a5458ab05dd995ae4a2e77, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:04.964775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d49c-841a-42b1-b208-7587b7e73b00 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:04.986715 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4354/8702] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:27:04 2022] PUT /identity/v3/projects/39d99c8623964f299bab3664296b77f9/users/0846761655a5458ab05dd995ae4a2e77/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:05.004261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:05.004655 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:05.005175 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:05.032442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:05.059490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] MFA Rules not processed for user `0846761655a5458ab05dd995ae4a2e77`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:05.061721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:05.215787 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4349/8703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:05.242311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea585e-e4f1-40cb-be92-8e1dca85548e None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:05.242799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea585e-e4f1-40cb-be92-8e1dca85548e None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:05.243402 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea585e-e4f1-40cb-be92-8e1dca85548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:05.286996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-3eea585e-e4f1-40cb-be92-8e1dca85548e None None] MFA Rules not processed for user `48eda3a284964e5785742149f90b2477`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:05.286996 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-3eea585e-e4f1-40cb-be92-8e1dca85548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:05.411182 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4355/8704] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:05.437025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:05.439590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:05.601220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd24c-5052-4a6e-8d17-31f46f4301c3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:05.611801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:05.612975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:05.613479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:05.613982 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:05.631734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:05.635041 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7e67-3d06-4f18-9aeb-ed464237bdf6 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:05.655361 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4350/8705] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:06.563628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:06.565048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:06.565524 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:06.608712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:06.611113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:06.720137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:06.754951 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4356/8706] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:06.779498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501dc3f-4ef8-4eb2-9d6a-8ed8aa764385 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:06.780182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501dc3f-4ef8-4eb2-9d6a-8ed8aa764385 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:06.780467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501dc3f-4ef8-4eb2-9d6a-8ed8aa764385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:06.819372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-b501dc3f-4ef8-4eb2-9d6a-8ed8aa764385 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:06.821707 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b501dc3f-4ef8-4eb2-9d6a-8ed8aa764385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:06.839445 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4351/8707] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:06.851090 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:06.872690 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f2484-478a-4af3-ac89-f29ca4964679 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:06.882665 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:06.883867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:06.884419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:06.884909 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:06.903286 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:06.906787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:06.929424 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4357/8708] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:09.236535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:09.237397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:09.237397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:09.275190 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:09.277997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:09.294806 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4352/8709] 10.222.0.83 () {58 vars in 1015 bytes} [Tue Oct 4 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:09.314282 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:09.317015 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:09.351186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b63f-90bc-4092-941c-98dcc3cd5e38 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:09.360591 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:09.361749 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:09.362296 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:09.362800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:09.381201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:09.384467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d786805-d4ef-42c9-827f-f53c887fd7e8 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:09.405803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4358/8710] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:19.266424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=71 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:19.396776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=17 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:24.684678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:24.687092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:24.712243 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c27252-be18-4810-abeb-f1c881a23595 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:24.719551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:24.720360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:24.720883 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:24.721270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:24.732956 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:24.735079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:24.751584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4353/8711] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:27:24.770107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b027-9a10-4e1a-bbf7-17ec328447c7 None None] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:24.771020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b027-9a10-4e1a-bbf7-17ec328447c7 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:24.771020 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961b027-9a10-4e1a-bbf7-17ec328447c7 None None] PATH_INFO: `/` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:24.772707 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4359/8712] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 21:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 21:27:24.783583 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] Authenticating service token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 21:27:24.808895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:24.822526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582333-daeb-40c7-8153-0d38ffaf60e8 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:24.828320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0846761655a5458ab05dd995ae4a2e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39d99c8623964f299bab3664296b77f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:24.829115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:24.829394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:24.829760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] PATH_INFO: `/v3/projects/39d99c8623964f299bab3664296b77f9` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:24.831127 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: Authorizing `identity:get_project(project_id=39d99c8623964f299bab3664296b77f9)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:24.833365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26266-45ee-4fc6-9e0f-51b3cb5b70bd tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:24.835892 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4354/8713] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 21:27:24 2022] GET /identity/v3/projects/39d99c8623964f299bab3664296b77f9 => generated 391 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:27:25.257724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:25.258185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:25.258607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:27:25.270526 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:25.272821 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:27:25.275873 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4360/8714] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:27:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:27:25.623906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d313c-8f84-4924-97fe-255651e550f8 None None] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:25.624397 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d313c-8f84-4924-97fe-255651e550f8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:25.624889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d313c-8f84-4924-97fe-255651e550f8 None None] PATH_INFO: `/` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:25.627605 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4355/8715] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 4 21:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 21:27:25.639710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] Authenticating service token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 04 21:27:25.674306 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:25.693756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e723c-d5ca-4322-97ff-dfd8b7a3469a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:25.701289 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0846761655a5458ab05dd995ae4a2e77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39d99c8623964f299bab3664296b77f9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:25.702114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:25.702644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:25.703052 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] PATH_INFO: `/v3/projects/39d99c8623964f299bab3664296b77f9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:25.704795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: Authorizing `identity:get_project(project_id=39d99c8623964f299bab3664296b77f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:25.707229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:25.709513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4361/8716] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 4 21:27:25 2022] GET /identity/v3/projects/39d99c8623964f299bab3664296b77f9 => generated 391 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:27:26.109407 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:26.110302 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:26.110490 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:27:26.123742 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:26.132007 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:27:26.134270 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4356/8717] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:27:26 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:27:28.461659 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:28.465455 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:28.581339 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b986e6-e771-4f0a-8439-0cb8b37d7dd1 tempest-ServersAdminNegativeTestJSON-898749961 tempest-ServersAdminNegativeTestJSON-898749961-project-admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:28.587036 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:28.588477 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:28.589010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:28.589500 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:28.592529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:28.619327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:28.622158 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69245-da3a-4718-9e64-4979b01141e5 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:28.652087 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4362/8718] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:32.365929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:32.459620 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d568-1207-4ebc-abb3-7820fadbf21f None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:32.468150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:32.469293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:32.469792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:32.470289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] PATH_INFO: `/v3/users/48eda3a284964e5785742149f90b2477` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:32.472710 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48eda3a284964e5785742149f90b2477)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:32.476666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:32.814857 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48eda3a284964e5785742149f90b2477'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:32.932323 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48eda3a284964e5785742149f90b2477'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:32.948659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48eda3a284964e5785742149f90b2477'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:32.974141 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48eda3a284964e5785742149f90b2477'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:32.978450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48eda3a284964e5785742149f90b2477'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:32.990451 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4357/8719] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:27:32 2022] DELETE /identity/v3/users/48eda3a284964e5785742149f90b2477 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:32.998772 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:32.999704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:32.999913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:33.032078 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:33.033912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:33.127418 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4363/8720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:33.141906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:33.144491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:33.240787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456c7b6-d40d-4462-97f1-be79c7036d49 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:33.247975 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:33.249047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:33.249557 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:33.250065 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:33.269359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:33.272445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:33.284008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:33.295410 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4358/8721] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:33.752448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:33.754290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:33.778361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa55c8-7fc9-477f-be28-7a3edfe23fa8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:33.787721 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:33.788877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:33.793502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:33.793502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] PATH_INFO: `/v3/projects/49486f6954e340efbf04c7b4ae8098fb` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:33.793502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49486f6954e340efbf04c7b4ae8098fb)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:33.796487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:33.999483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49486f6954e340efbf04c7b4ae8098fb', 'request_id': 'req-819b26a0-af76-4a72-b22a-67b9c81e0e45'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.086673 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49486f6954e340efbf04c7b4ae8098fb', 'request_id': 'req-819b26a0-af76-4a72-b22a-67b9c81e0e45'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.101913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49486f6954e340efbf04c7b4ae8098fb', 'request_id': 'req-819b26a0-af76-4a72-b22a-67b9c81e0e45'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.124895 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] The token cache is being invalidate because project 49486f6954e340efbf04c7b4ae8098fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:27:34.125473 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.126484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.128267 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4364/8722] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:27:33 2022] DELETE /identity/v3/projects/49486f6954e340efbf04c7b4ae8098fb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:27:34.133544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:34.154180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6f5b-1fd0-4296-b9eb-83984a63dfe7 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:34.277813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:34.278862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:34.279410 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:34.279904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] PATH_INFO: `/v3/users/0846761655a5458ab05dd995ae4a2e77` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:34.282368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0846761655a5458ab05dd995ae4a2e77)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:34.286675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:34.582311 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0846761655a5458ab05dd995ae4a2e77'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.684392 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0846761655a5458ab05dd995ae4a2e77'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.702796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0846761655a5458ab05dd995ae4a2e77'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.736431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0846761655a5458ab05dd995ae4a2e77'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.737749 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-1009c077-0dc0-4fd5-9bbd-365ec89b29de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0846761655a5458ab05dd995ae4a2e77'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:34.754287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4359/8723] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:27:34 2022] DELETE /identity/v3/users/0846761655a5458ab05dd995ae4a2e77 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:35.466101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:35.468775 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:35.499453 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b26a0-af76-4a72-b22a-67b9c81e0e45 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:35.529308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:35.630484 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:35.631832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:35.632660 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:35.634336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] PATH_INFO: `/v3/projects/39d99c8623964f299bab3664296b77f9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:35.637844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d99c8623964f299bab3664296b77f9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:35.642313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:35.882587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d99c8623964f299bab3664296b77f9', 'request_id': 'req-2456c0a3-ab38-421f-b8d9-8d990ff8a597'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:36.023764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d99c8623964f299bab3664296b77f9', 'request_id': 'req-2456c0a3-ab38-421f-b8d9-8d990ff8a597'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:36.038930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d99c8623964f299bab3664296b77f9', 'request_id': 'req-2456c0a3-ab38-421f-b8d9-8d990ff8a597'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:36.058568 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] The token cache is being invalidate because project 39d99c8623964f299bab3664296b77f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:27:36.058930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:36.060070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-2456c0a3-ab38-421f-b8d9-8d990ff8a597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:36.061968 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4365/8724] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:27:35 2022] DELETE /identity/v3/projects/39d99c8623964f299bab3664296b77f9 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:36.072905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.073785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.073785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.112139 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:36.114092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:36.200181 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4360/8725] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:36.209392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.209839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.210304 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.246651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:36.248340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:36.263225 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4366/8726] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:27:36.270415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.289610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7130c-1c2b-4dba-bc45-d5ba89eb349e None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.298188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.299096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.299580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.299989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.300836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:27:36.301272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.303296 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:36.318408 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4361/8727] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:27:36.324168 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.335172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812119fd-a485-42c4-80a9-bd0646c4a070 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.341708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.342408 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.342783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.343110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.343886 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.346003 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:36.453743 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4367/8728] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:36.458889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.473336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f4ad-f46b-467f-8d50-d31870446fef admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.478682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:36.581985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.583098 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.583634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.584119 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.585371 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.589393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:36.734175 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4362/8729] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:27:36 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:36.741449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.763233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62dc4-71cf-4123-8a3b-1f10b70fabce admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.771534 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.772653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.773126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.773628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.774846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.778346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:36.802273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4368/8730] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:36.808541 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.829733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0881b-a54b-490b-a370-4e9c91374113 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.839178 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.840295 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.840821 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.841289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.842550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.845926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb129d-91f8-4c4c-9431-62a702f16318 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:36.870254 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4363/8731] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:36.878111 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:36.898557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b86424-a1e0-41c0-bae9-d5961f160587 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:36.907173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:36.908405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:36.908998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:36.909513 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] PATH_INFO: `/v3/projects/53e157aea13344d7b3d229a8438e5017/users/5f06190cae314128ae2f6626c3afac07/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:36.942040 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e157aea13344d7b3d229a8438e5017, user_id=5f06190cae314128ae2f6626c3afac07, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:36.947668 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:37.110091 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4369/8732] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:27:36 2022] PUT /identity/v3/projects/53e157aea13344d7b3d229a8438e5017/users/5f06190cae314128ae2f6626c3afac07/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:27:37.119909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd378-0c96-4e65-9a3a-c81360891470 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:37.120753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd378-0c96-4e65-9a3a-c81360891470 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:37.121115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd378-0c96-4e65-9a3a-c81360891470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:37.158460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-996cd378-0c96-4e65-9a3a-c81360891470 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:37.161037 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-996cd378-0c96-4e65-9a3a-c81360891470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:37.288643 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4364/8733] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:37.306540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:37.309529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:37.408181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:37.432047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef14ded-81a1-423d-9536-fa3f9ca6726d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:37.439776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:37.441386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:37.442669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:37.443575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:37.463832 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:37.467110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043017bb-c50a-4b20-82da-5423ddf31dee service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:37.488985 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4370/8734] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:47.238994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:47.239745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:47.240053 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:47.312287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] MFA Rules not processed for user `5f06190cae314128ae2f6626c3afac07`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:47.314579 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:47.483483 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4365/8735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:47.500783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1a59-2c28-49c2-b49c-3dfc775bede2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:47.500783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1a59-2c28-49c2-b49c-3dfc775bede2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:47.500783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb1a59-2c28-49c2-b49c-3dfc775bede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:47.544941 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b2eb1a59-2c28-49c2-b49c-3dfc775bede2 None None] MFA Rules not processed for user `5f06190cae314128ae2f6626c3afac07`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:47.547047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b2eb1a59-2c28-49c2-b49c-3dfc775bede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:47.563635 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4371/8736] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:27:47.579413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:47.582613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:47.616445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:47.727646 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33ed1e-bb3c-4e2b-acbc-461eaab08b75 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:47.739227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:47.740678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:47.741344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:47.741957 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:47.761920 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:47.766144 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:47.781427 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4366/8737] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:48.215952 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:48.216619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:48.217035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:27:48.231592 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:27:48.233140 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:27:48.234970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4372/8738] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:27:48 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:27:54.620514 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:54.622597 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:54.769029 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1d0-0e47-4815-b859-84a72c2e74cd service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:54.778806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:54.780128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:54.780693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:54.781192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:54.785277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:54.813654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:54.826039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:54.833246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:54.844984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cd72d-ccfc-45fc-b68e-433121fc06e2 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:54.858059 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:54.859172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:54.859670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:54.860005 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] PATH_INFO: `/v3/users/5f06190cae314128ae2f6626c3afac07` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:54.862053 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4367/8739] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:27:54.862325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f06190cae314128ae2f6626c3afac07)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:54.866405 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:55.211336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f06190cae314128ae2f6626c3afac07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:55.212846 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f06190cae314128ae2f6626c3afac07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:55.325844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f06190cae314128ae2f6626c3afac07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:55.354498 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f06190cae314128ae2f6626c3afac07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:55.371863 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-497633bf-ec44-44a9-af54-f78c0abb78a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f06190cae314128ae2f6626c3afac07'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:55.385562 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4373/8740] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:27:54 2022] DELETE /identity/v3/users/5f06190cae314128ae2f6626c3afac07 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:55.989615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:56.014101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a9c9-dcf2-44ba-9d61-4520fa365136 service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:56.150660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:56.151891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:56.152344 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:56.152813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] PATH_INFO: `/v3/projects/53e157aea13344d7b3d229a8438e5017` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:56.155293 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e157aea13344d7b3d229a8438e5017)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:56.159359 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:56.310050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:56.336628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e157aea13344d7b3d229a8438e5017', 'request_id': 'req-e92b0f4f-4384-4459-8f92-8de35399e15e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:56.352788 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e157aea13344d7b3d229a8438e5017', 'request_id': 'req-e92b0f4f-4384-4459-8f92-8de35399e15e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:56.365624 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e157aea13344d7b3d229a8438e5017', 'request_id': 'req-e92b0f4f-4384-4459-8f92-8de35399e15e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:56.566279 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] The token cache is being invalidate because project 53e157aea13344d7b3d229a8438e5017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:27:56.566676 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:56.568074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e92b0f4f-4384-4459-8f92-8de35399e15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:27:56.570706 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4368/8741] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:27:55 2022] DELETE /identity/v3/projects/53e157aea13344d7b3d229a8438e5017 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:56.579451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:56.580233 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:56.580512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:56.618784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:56.621157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:56.746911 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4374/8742] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:56.761614 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:56.762161 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:56.762661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:56.799443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:56.801786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:56.816737 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4369/8743] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:56.824080 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:56.844639 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e4053-c397-443f-886d-a78f7c0d4f10 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:56.855731 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:56.856869 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:56.857361 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:56.857850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:56.859099 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:27:56.859652 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:56.862919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:56.890220 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4375/8744] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:27:56.897818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:56.918334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305ff9-f535-4470-9916-fe2e6a2035c3 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:56.927424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:56.928553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:56.928989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:56.929448 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:56.930774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:56.934734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:57.103982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4370/8745] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:27:56 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:27:57.111713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:57.133028 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8eb3-b1c8-4cca-9804-89969f25da35 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:57.217947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:57.252449 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:57.253515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:57.253994 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:57.254521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:57.255638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:57.259708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:57.480566 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4376/8746] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:27:57 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:27:57.487641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:57.506580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffc5f0-f142-4b0b-927e-3215ae2b6875 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:57.515687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:57.516717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:57.517213 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:57.517836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:57.518873 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:57.521498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:57.543341 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4371/8747] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:57.550956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:57.573810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc3a9-064a-4182-954f-f3b7fd4b8563 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:57.582512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:57.583651 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:57.584178 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:57.584674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:57.586008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:57.589442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53260d53-79a6-4e71-bbc6-6ed73bd649d9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:57.612081 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4377/8748] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:27:57.620117 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:57.640588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3d65-93a0-47e1-b8bd-fa260f883136 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:57.649377 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:57.650627 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:57.651125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:57.651673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] PATH_INFO: `/v3/projects/fcaad48dd9a24394a948efc94496ef1a/users/225c41ce531d4478a5aa43c7fa6ea7f6/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:57.685079 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcaad48dd9a24394a948efc94496ef1a, user_id=225c41ce531d4478a5aa43c7fa6ea7f6, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:57.691096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:57.869802 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4372/8749] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:27:57 2022] PUT /identity/v3/projects/fcaad48dd9a24394a948efc94496ef1a/users/225c41ce531d4478a5aa43c7fa6ea7f6/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:27:57.878200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6756-d146-475c-a440-9c66e7ad0fc9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:57.878678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6756-d146-475c-a440-9c66e7ad0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:57.879181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6756-d146-475c-a440-9c66e7ad0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:57.916393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e68c6756-d146-475c-a440-9c66e7ad0fc9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:27:57.918804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e68c6756-d146-475c-a440-9c66e7ad0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:58.043189 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4378/8750] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:27:58.059925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:27:58.062491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:27:58.161599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b303-c2e4-4b5b-90b2-0886d8d927b6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:27:58.169150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:27:58.170349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:27:58.170843 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:27:58.171374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:27:58.190837 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:27:58.193784 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfef7-73ab-4490-8fea-e5db7af351e5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:27:58.213808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4373/8751] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:28:07.749506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:07.750634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:07.751213 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:07.819867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] MFA Rules not processed for user `225c41ce531d4478a5aa43c7fa6ea7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:07.822325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:07.983338 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4379/8752] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:08.011526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934550-e804-46e7-a0da-2598af603269 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:08.012215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934550-e804-46e7-a0da-2598af603269 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:08.012748 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08934550-e804-46e7-a0da-2598af603269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:08.049411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-08934550-e804-46e7-a0da-2598af603269 None None] MFA Rules not processed for user `225c41ce531d4478a5aa43c7fa6ea7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:08.051796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-08934550-e804-46e7-a0da-2598af603269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:08.064982 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4374/8753] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:08.088616 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:08.091389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:08.198900 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:08.256675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eeb9c-c55c-4778-9f2c-61b692bd2923 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:08.268253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:08.270054 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:08.270481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:08.270936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:08.288363 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:08.291856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d32a-edc9-4d03-9313-94902cab62a1 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:08.311080 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4380/8754] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:08.800890 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:08.801383 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:08.801859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-c8eeb44c-8e18-4f26-b18d-71dee2b16ab0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:28:08.814764 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:08.815846 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:28:08.816897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4375/8755] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:28:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:28:08.851437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:08.852284 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:08.852456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:08.884208 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] MFA Rules not processed for user `225c41ce531d4478a5aa43c7fa6ea7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:08.886070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:08.898156 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4381/8756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:09.405887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:09.406732 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:09.406902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:28:09.420837 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:09.422483 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:28:09.424289 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4376/8757] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:28:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:28:16.493480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:16.538861 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f500c-18c0-4c6f-b9f8-037657042cf1 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:16.547317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:16.548536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:16.549039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:16.549526 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] PATH_INFO: `/v3/users/225c41ce531d4478a5aa43c7fa6ea7f6` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:16.552266 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225c41ce531d4478a5aa43c7fa6ea7f6)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:16.556229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:17.419325 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225c41ce531d4478a5aa43c7fa6ea7f6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:17.420533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225c41ce531d4478a5aa43c7fa6ea7f6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:17.585810 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225c41ce531d4478a5aa43c7fa6ea7f6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:17.614694 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225c41ce531d4478a5aa43c7fa6ea7f6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:17.630714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-94d5b23e-ebdd-4955-8cb9-1897ba2fc4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225c41ce531d4478a5aa43c7fa6ea7f6'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:17.644421 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4382/8758] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:28:16 2022] DELETE /identity/v3/users/225c41ce531d4478a5aa43c7fa6ea7f6 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:28:18.040275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=68,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:18.098941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:18.103025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:18.245743 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c22e1-fb74-4c19-b928-0eaead0dc37c None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:18.254402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:18.255465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:18.255942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:18.256386 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] PATH_INFO: `/v3/projects/fcaad48dd9a24394a948efc94496ef1a` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:18.259252 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcaad48dd9a24394a948efc94496ef1a)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:18.263081 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:18.427076 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcaad48dd9a24394a948efc94496ef1a', 'request_id': 'req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:18.440091 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcaad48dd9a24394a948efc94496ef1a', 'request_id': 'req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:18.453112 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcaad48dd9a24394a948efc94496ef1a', 'request_id': 'req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:18.547760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] The token cache is being invalidate because project fcaad48dd9a24394a948efc94496ef1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:28:18.548350 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:18.549619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7bd7d94e-56d1-41bf-ac6f-6b56f37c3789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:18.552450 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4377/8759] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:28:18 2022] DELETE /identity/v3/projects/fcaad48dd9a24394a948efc94496ef1a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:28:18.562382 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:18.565532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:18.565532 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:18.601787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:18.604022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:18.735662 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4383/8760] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:28:18.751086 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:18.751449 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:18.751809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:18.788132 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:18.791241 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:18.807780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4378/8761] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:18.815474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:18.835299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e634e-c109-49ee-988f-73fc6a1835c9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:18.844768 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:18.845766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:18.846480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:18.846988 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:18.848426 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:28:18.848943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:18.852725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:18.879779 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4384/8762] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:28:18.887481 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:18.906687 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2cbf-0e9a-4736-bc69-69d1ebad9d7d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:18.917021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:18.918247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:18.918758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:18.919246 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:18.925940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:18.925940 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:19.062193 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4379/8763] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:28:19.070456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:19.090806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efca2-b11e-446b-b7a8-c104a1d43499 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:19.120386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:19.218657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:19.219796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.220322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.220835 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:19.221972 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:19.226119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:19.325423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4385/8764] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:28:19 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:28:19.332508 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:19.352891 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d4bc-3677-42d7-b501-446f47fbe482 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:19.361578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:19.362765 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.363336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.363869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:19.365071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:19.368254 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:19.389704 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4380/8765] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:28:19.396819 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:19.419057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958c14-ac06-415b-b359-8e067f3be3a6 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:19.428654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:19.430980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.430980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.430980 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:19.432122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:19.435257 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68ca3-cf32-40e9-989e-71d2b0f8674b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:19.457238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4386/8766] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:28:19.465094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:19.484995 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fc90-6fa8-48d9-8f5b-e6f6d1ed3ab8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:19.493346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:19.494613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.495122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.495671 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] PATH_INFO: `/v3/projects/b6ed030efed04e42bb7298166990f4a4/users/c91a3baba3474707a2bc7e731e8da458/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:19.529657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed030efed04e42bb7298166990f4a4, user_id=c91a3baba3474707a2bc7e731e8da458, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:19.535780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:19.641126 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4381/8767] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:28:19 2022] PUT /identity/v3/projects/b6ed030efed04e42bb7298166990f4a4/users/c91a3baba3474707a2bc7e731e8da458/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:28:19.649870 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbe42-513b-40da-957b-b939e13d7c58 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.651465 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbe42-513b-40da-957b-b939e13d7c58 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.651627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbe42-513b-40da-957b-b939e13d7c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:19.688309 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a13bbe42-513b-40da-957b-b939e13d7c58 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:19.690737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a13bbe42-513b-40da-957b-b939e13d7c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:19.820759 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4387/8768] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:19.838355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:19.841506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:19.904304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:19.978001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca019a-2958-4331-b0b9-1daa5c37940a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:19.984805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:19.985922 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:19.986414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:19.986887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:20.006060 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:20.009549 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:20.031251 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4382/8769] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:28:29.549264 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdce0c-2b97-4b3c-9619-c4fe98e16daf None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:29.550131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdce0c-2b97-4b3c-9619-c4fe98e16daf None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:29.550428 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdce0c-2b97-4b3c-9619-c4fe98e16daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:29.608644 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-6ccdce0c-2b97-4b3c-9619-c4fe98e16daf None None] MFA Rules not processed for user `c91a3baba3474707a2bc7e731e8da458`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:29.610903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6ccdce0c-2b97-4b3c-9619-c4fe98e16daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:29.759502 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4388/8770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:29.786349 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:29.790342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:29.957289 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba3bad-38da-4b0f-be68-ac251b51b037 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:29.967654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:29.968690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:29.969134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:29.969616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:29.989951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:29.992690 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31a3bd-52b9-4d4e-9bd8-ea783f348e49 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:30.010325 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4383/8771] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:35.468326 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:35.469723 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:35.470464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:35.510433 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] MFA Rules not processed for user `c91a3baba3474707a2bc7e731e8da458`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:35.513057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:35.527543 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4389/8772] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:36.238283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:36.239072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:36.239661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:28:36.253529 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:36.255353 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:28:36.258038 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4384/8773] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:28:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:28:40.002607 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=52 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:44.953992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:44.976689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e0a3a-9db2-437d-90ac-916523fbb278 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:44.986962 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:44.987910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:44.988400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:44.988910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] PATH_INFO: `/v3/users/c91a3baba3474707a2bc7e731e8da458` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:44.992143 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91a3baba3474707a2bc7e731e8da458)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:44.996461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:45.025976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:45.436817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91a3baba3474707a2bc7e731e8da458'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:45.438101 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91a3baba3474707a2bc7e731e8da458'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:45.765062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91a3baba3474707a2bc7e731e8da458'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:45.792692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91a3baba3474707a2bc7e731e8da458'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:45.808475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-206779d5-8ce2-492d-bdd8-8553b3b9439d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91a3baba3474707a2bc7e731e8da458'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:45.821442 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4390/8774] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:28:44 2022] DELETE /identity/v3/users/c91a3baba3474707a2bc7e731e8da458 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:28:46.325380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:46.328642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:46.496288 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbf0ed-834b-43c1-9c14-208ef31e65d2 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:46.504369 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:46.505511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:46.506009 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:46.506506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] PATH_INFO: `/v3/projects/b6ed030efed04e42bb7298166990f4a4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:46.509042 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ed030efed04e42bb7298166990f4a4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:46.514114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:46.728443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ed030efed04e42bb7298166990f4a4', 'request_id': 'req-7f2b8dd2-440e-42b1-967c-f24167582d4c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:46.743864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ed030efed04e42bb7298166990f4a4', 'request_id': 'req-7f2b8dd2-440e-42b1-967c-f24167582d4c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:46.757401 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ed030efed04e42bb7298166990f4a4', 'request_id': 'req-7f2b8dd2-440e-42b1-967c-f24167582d4c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:46.874762 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] The token cache is being invalidate because project b6ed030efed04e42bb7298166990f4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:28:46.875276 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:46.876334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-7f2b8dd2-440e-42b1-967c-f24167582d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:28:46.878208 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4385/8775] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:28:46 2022] DELETE /identity/v3/projects/b6ed030efed04e42bb7298166990f4a4 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:28:46.909510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:46.910829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:46.910984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:46.950619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:46.953254 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:47.085438 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4391/8776] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:47.103495 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.104061 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.104588 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.144354 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:47.147378 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:47.162927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4386/8777] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:47.170162 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.189670 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52831a-9804-4baa-bbcf-57374176a035 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.198824 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.199989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.200497 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.201107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.202474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:28:47.203014 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:47.206380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:47.232989 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4392/8778] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:28:47.241429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.263976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0494-76b4-4023-8b0d-06476928fcc4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.272581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.275772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.275772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.275772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.275772 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:47.279870 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:47.482997 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4387/8779] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:28:47.490637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.512706 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a48e8-29ae-4bc4-ad6c-4aeb361793ea admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.645883 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.646993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.648201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.648598 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.649960 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:47.654117 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:47.812896 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4393/8780] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:28:47 2022] POST /identity/v3/users => generated 292 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:28:47.819874 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.840446 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07581bad-4573-4aa9-8a48-6ef30a884541 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.849183 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.850304 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.851363 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.851859 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.853110 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:47.856348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:47.879869 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4388/8781] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:28:47.887919 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.911935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa28ca-3c93-4500-8dfa-936ce78dedd7 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.923201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.924451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.924913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.925461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:47.926747 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:47.930376 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca12fbf-093e-4e98-a6d5-0a3532939176 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:47.935961 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:47.957138 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4394/8782] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:28:47.965171 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:47.985532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b32a-2b6f-42f7-a7a7-ba1d3c9ed09a admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:47.994471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:47.995697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:47.996310 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:47.996805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] PATH_INFO: `/v3/projects/d4834e96ebfd4a33ac33e7d3e81637ac/users/6433c1be19ca4644b48a5968d083e119/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:48.030475 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4834e96ebfd4a33ac33e7d3e81637ac, user_id=6433c1be19ca4644b48a5968d083e119, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:48.036385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:48.155745 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4389/8783] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:28:47 2022] PUT /identity/v3/projects/d4834e96ebfd4a33ac33e7d3e81637ac/users/6433c1be19ca4644b48a5968d083e119/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:28:48.165263 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f718a-2498-4d23-80a8-355df8ba58e1 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:48.165762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f718a-2498-4d23-80a8-355df8ba58e1 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:48.166283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f718a-2498-4d23-80a8-355df8ba58e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:48.202698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-719f718a-2498-4d23-80a8-355df8ba58e1 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:48.205062 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-719f718a-2498-4d23-80a8-355df8ba58e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:48.336954 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4395/8784] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:48.353754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:48.357214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:48.429224 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:48.486764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6278e-6b0a-4034-ad0d-081ff6382d2c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:48.496251 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:48.497493 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:48.497996 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:48.498470 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:48.519942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:48.522886 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29361c-4fc5-4d61-ae2d-f9e75d0ea5df service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:48.543686 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4390/8785] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:58.319958 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=28 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:58.529124 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919bce-5c4f-4ce7-af43-bd458b013b4b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:58.529650 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919bce-5c4f-4ce7-af43-bd458b013b4b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:58.530151 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919bce-5c4f-4ce7-af43-bd458b013b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:58.585066 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-2f919bce-5c4f-4ce7-af43-bd458b013b4b None None] MFA Rules not processed for user `6433c1be19ca4644b48a5968d083e119`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:58.587618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2f919bce-5c4f-4ce7-af43-bd458b013b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:58.707758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=14 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:58.713949 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4396/8786] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:58.741551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:58.742164 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:58.742801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:58.777836 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] MFA Rules not processed for user `6433c1be19ca4644b48a5968d083e119`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:58.780106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:58.793911 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4391/8787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:58.814713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd99a-3ef2-42b2-895e-95c4505b7660 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:58.823202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd99a-3ef2-42b2-895e-95c4505b7660 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:58.823202 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd99a-3ef2-42b2-895e-95c4505b7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:58.896149 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-d7fdd99a-3ef2-42b2-895e-95c4505b7660 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:58.898043 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-d7fdd99a-3ef2-42b2-895e-95c4505b7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:59.034704 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4397/8788] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:59.047587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:59.071408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925d54-f905-4bd0-bbf9-efd919cfbee4 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:59.081858 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:59.082718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:59.083226 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:59.083664 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:59.100872 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:59.104007 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:59.122438 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4392/8789] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:59.172239 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1b88-d55b-47f4-a5f6-88a21b49f8f9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:59.172729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1b88-d55b-47f4-a5f6-88a21b49f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:59.173216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1b88-d55b-47f4-a5f6-88a21b49f8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:59.217046 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-feab1b88-d55b-47f4-a5f6-88a21b49f8f9 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:28:59.219828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-feab1b88-d55b-47f4-a5f6-88a21b49f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:59.239206 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4398/8790] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:28:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:28:59.262889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:28:59.265525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:28:59.451863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b601-1654-45f0-81c7-5cf078109bdc service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:28:59.457018 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:28:59.458107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:59.458590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:59.459072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:59.480869 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:28:59.483989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:28:59.502416 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4393/8791] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:28:59.941762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:28:59.942586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:28:59.942586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:28:59.957631 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:28:59.959047 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:28:59.967058 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4399/8792] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:28:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:29:07.128404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:07.153437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b32a8-e763-46d1-87ac-c3780c662880 service glance] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:07.162130 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:07.163496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:07.163993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:07.164370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] PATH_INFO: `/v3/users/6433c1be19ca4644b48a5968d083e119` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:07.166780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6433c1be19ca4644b48a5968d083e119)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:07.170399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:07.566856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6433c1be19ca4644b48a5968d083e119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:07.689969 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6433c1be19ca4644b48a5968d083e119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:07.707551 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6433c1be19ca4644b48a5968d083e119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:07.735766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6433c1be19ca4644b48a5968d083e119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:07.737087 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-47c0d71b-31ae-4cf8-bfb0-70f2e78cbeed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6433c1be19ca4644b48a5968d083e119'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:07.749560 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4394/8793] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:29:07 2022] DELETE /identity/v3/users/6433c1be19ca4644b48a5968d083e119 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:08.180744 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:08.184364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:08.308574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:08.337092 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae0fd0-acd6-4bfd-b25a-c6805f8c84f3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:08.345948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:08.347048 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:08.347593 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:08.350581 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] PATH_INFO: `/v3/projects/d4834e96ebfd4a33ac33e7d3e81637ac` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:08.352458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4834e96ebfd4a33ac33e7d3e81637ac)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:08.356661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:08.535878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4834e96ebfd4a33ac33e7d3e81637ac', 'request_id': 'req-5cfc90a5-a212-426a-a697-cb60c68ab35a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:08.697624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4834e96ebfd4a33ac33e7d3e81637ac', 'request_id': 'req-5cfc90a5-a212-426a-a697-cb60c68ab35a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:08.716724 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4834e96ebfd4a33ac33e7d3e81637ac', 'request_id': 'req-5cfc90a5-a212-426a-a697-cb60c68ab35a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:08.746086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] The token cache is being invalidate because project d4834e96ebfd4a33ac33e7d3e81637ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:29:08.746677 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:08.747935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-5cfc90a5-a212-426a-a697-cb60c68ab35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:08.750659 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4400/8794] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:29:08 2022] DELETE /identity/v3/projects/d4834e96ebfd4a33ac33e7d3e81637ac => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:08.769946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:08.770838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:08.771014 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:08.811955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:08.811955 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:08.875751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:08.935976 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4395/8795] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:29:08.951834 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:08.952273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:08.952688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:08.992793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:08.994887 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:09.010377 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4401/8796] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:09.017408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.039766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a82f4b-139e-439a-8633-1a834b6c8bef None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.049496 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.050536 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.050997 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.051472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.052708 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:29:09.053823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.056828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.080406 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4396/8797] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:29:09.087737 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.106204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148b12e-004c-4452-b30c-bae1462099e9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.114533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.116386 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.116843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.117301 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.118488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.122256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.257300 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4402/8798] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:29:09 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:09.264934 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.286672 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d966b-4a93-4584-90f9-7a13ccfc3999 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.411827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.412770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.413218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.413673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.414827 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.418841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.605742 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4397/8799] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:29:09 2022] POST /identity/v3/users => generated 285 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:09.613488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.635393 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04974-42b5-48b9-a185-cc402b98590c admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.644389 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.645521 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.646029 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.646597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.648160 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.651333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.675270 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4403/8800] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:29:09.682989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.703008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0cc5a-5ff5-4919-ba02-e068e2ad1709 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.712596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.713682 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.714209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.714685 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.715911 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.719320 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42b5d-147c-42b9-b502-eaf5e27d48f9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.744796 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4398/8801] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:29:09.752875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:09.774223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b6f9e-0e52-4c81-9fdf-489a9bdaeacf admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:09.782481 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:09.783711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.784204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.784688 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] PATH_INFO: `/v3/projects/84a07d6a273a43c9a10a494100c6cc91/users/a3ed13a2ee4641498bb528f33ce4e590/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.815976 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a07d6a273a43c9a10a494100c6cc91, user_id=a3ed13a2ee4641498bb528f33ce4e590, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:09.820698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:09.902252 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4404/8802] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:29:09 2022] PUT /identity/v3/projects/84a07d6a273a43c9a10a494100c6cc91/users/a3ed13a2ee4641498bb528f33ce4e590/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:09.919763 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:09.920648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:09.920648 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:09.972025 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] MFA Rules not processed for user `a3ed13a2ee4641498bb528f33ce4e590`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:09.974225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:10.117940 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4399/8803] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:10.136704 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:10.139905 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:10.266954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e180b-73ce-4e33-96f9-a71f6c1cbe9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:10.273113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:10.274214 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:10.274671 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:10.275173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:10.294328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:10.297584 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f9dbb-ad4a-4400-a0b0-3a84285ee82a service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:10.318109 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4405/8804] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:29:20.111755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:20.308781 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:39.293929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:39.456742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad5ccc-28e8-440b-a50b-10a846fc2eac None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:39.472806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:39.474170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:39.475327 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:39.475880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] PATH_INFO: `/v3/users/a3ed13a2ee4641498bb528f33ce4e590` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:39.478030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ed13a2ee4641498bb528f33ce4e590)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:39.482370 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:39.795783 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ed13a2ee4641498bb528f33ce4e590'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:39.906791 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ed13a2ee4641498bb528f33ce4e590'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:39.923581 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ed13a2ee4641498bb528f33ce4e590'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:39.950376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ed13a2ee4641498bb528f33ce4e590'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:39.951686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ed13a2ee4641498bb528f33ce4e590'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:39.964004 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4400/8805] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:29:39 2022] DELETE /identity/v3/users/a3ed13a2ee4641498bb528f33ce4e590 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:39.971785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:39.972661 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:39.972841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:40.010163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:40.012474 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:40.132381 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4406/8806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:40.144257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:40.147182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:40.270109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c817-7549-40ad-ae60-c5e3500328b6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:40.276610 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:40.277688 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:40.278174 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:40.278608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:40.295816 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:40.298592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2055ec2-c910-4ec5-b20b-1e905de70623 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:40.319037 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4401/8807] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:29:40.811840 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:40.817865 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:40.841949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a92d1-297f-4cd0-9de1-6a94d39c88d8 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:40.850627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:40.851906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:40.852567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:40.853383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] PATH_INFO: `/v3/projects/84a07d6a273a43c9a10a494100c6cc91` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:40.856693 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a07d6a273a43c9a10a494100c6cc91)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:40.863839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:41.125739 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a07d6a273a43c9a10a494100c6cc91', 'request_id': 'req-3b6aa08e-8703-45f0-a427-075ba063014e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:41.278134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a07d6a273a43c9a10a494100c6cc91', 'request_id': 'req-3b6aa08e-8703-45f0-a427-075ba063014e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:41.292741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a07d6a273a43c9a10a494100c6cc91', 'request_id': 'req-3b6aa08e-8703-45f0-a427-075ba063014e'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:41.316608 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] The token cache is being invalidate because project 84a07d6a273a43c9a10a494100c6cc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:29:41.317136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:41.318437 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3b6aa08e-8703-45f0-a427-075ba063014e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:41.321374 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4407/8808] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:29:40 2022] DELETE /identity/v3/projects/84a07d6a273a43c9a10a494100c6cc91 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:41.330796 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:41.331642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:41.331896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:41.369946 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:41.372444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:41.409170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:41.503331 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4402/8809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:41.517631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:41.518126 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:41.518627 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:41.556255 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:41.558519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:41.573238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4408/8810] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:41.580261 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:41.600194 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738cd75-8113-4db0-b918-3d8527ac35fc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:41.609036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:41.610115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:41.610619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:41.611170 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:41.612421 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:29:41.612994 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:41.616835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:41.641523 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4403/8811] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 21:29:41.649825 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:41.667862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d87654-d464-4eff-9d72-2373c0d3d2bd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:41.676083 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:41.677273 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:41.677740 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:41.678212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:41.679442 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:41.683380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:41.843238 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4409/8812] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:29:41 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:41.850941 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:41.872626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3c3b-8478-4a82-af27-562b802150d8 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:42.001705 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:42.002681 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.003235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.003778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.005467 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:42.009457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:42.160130 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4404/8813] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:29:41 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:42.168247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:42.188167 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f066ae5-1917-413e-ac86-6b1a3d4ba035 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:42.197713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:42.198821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.199741 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.199935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.201226 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:42.204123 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:42.230633 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4410/8814] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:29:42.237415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:42.270847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e46fc-84da-47b3-b180-0808afd5d2d4 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:42.270847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:42.270847 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.271411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.271567 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.272832 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:42.276343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaa62d-de3c-4528-be47-05e3142d39f4 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:42.298870 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4405/8815] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:29:42.304610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:42.321420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dd11b-e8fe-41d5-b876-6658c92c16bd admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:42.330557 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:42.332064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.332697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.333812 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] PATH_INFO: `/v3/projects/e892831ccc994cc2b1d7c4cc62b2b424/users/fccea18bc55a40c1b596ee6efdd294e4/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.368422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e892831ccc994cc2b1d7c4cc62b2b424, user_id=fccea18bc55a40c1b596ee6efdd294e4, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:42.373711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:42.499825 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4411/8816] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:29:42 2022] PUT /identity/v3/projects/e892831ccc994cc2b1d7c4cc62b2b424/users/fccea18bc55a40c1b596ee6efdd294e4/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:42.518209 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.519416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.519416 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.570477 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] MFA Rules not processed for user `fccea18bc55a40c1b596ee6efdd294e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:42.572698 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:42.708160 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4406/8817] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:42.720821 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:42.724081 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:42.760145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:42.830122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812671f1-38c6-4a84-bcda-318fe6933bd0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:42.835763 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:42.836533 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:42.836875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:42.837215 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:42.849899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:42.852013 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:42.870781 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4412/8818] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:29:52.705414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:53.018270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:53.021484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:53.031817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=17 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:53.245387 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d81ad1-41d6-425f-89ea-990653af07ac None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:53.260046 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:53.261136 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:53.261943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:53.262454 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:53.266380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:53.316445 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:53.320314 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c542-1eb6-4ae6-815f-3f72751cddfb service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:53.355934 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4407/8819] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:29:53.936998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:54.081236 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f740e-6838-4cf0-9dce-536ccd710c36 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:54.090984 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:54.092279 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:54.093507 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:54.094057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] PATH_INFO: `/v3/users/fccea18bc55a40c1b596ee6efdd294e4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:54.096687 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccea18bc55a40c1b596ee6efdd294e4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:54.101663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:54.379229 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccea18bc55a40c1b596ee6efdd294e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:54.380545 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccea18bc55a40c1b596ee6efdd294e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:54.493163 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccea18bc55a40c1b596ee6efdd294e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:54.521588 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccea18bc55a40c1b596ee6efdd294e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:54.538456 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccea18bc55a40c1b596ee6efdd294e4'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:54.551970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4413/8820] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:29:53 2022] DELETE /identity/v3/users/fccea18bc55a40c1b596ee6efdd294e4 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:54.559877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:54.560770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:54.561308 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:54.599554 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:54.601908 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:54.736071 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4408/8821] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:54.754002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:54.757328 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:54.882953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0b24-5053-4b55-8112-63f5c9311400 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:54.889917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:54.891060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:54.891623 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:54.892159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:54.915713 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:54.918804 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d9953-111b-46b5-929d-26889108c5b2 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:54.940167 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4414/8822] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:29:55.392587 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:55.395417 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:55.422479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db502-b768-4686-8b0e-5a20a3a70125 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:55.433901 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:55.435083 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:55.435628 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:55.436283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] PATH_INFO: `/v3/projects/e892831ccc994cc2b1d7c4cc62b2b424` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:55.438760 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e892831ccc994cc2b1d7c4cc62b2b424)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:55.443283 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:55.626297 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e892831ccc994cc2b1d7c4cc62b2b424', 'request_id': 'req-ca04bc45-7744-4950-860e-8cffc6822165'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:55.644306 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e892831ccc994cc2b1d7c4cc62b2b424', 'request_id': 'req-ca04bc45-7744-4950-860e-8cffc6822165'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:55.659004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e892831ccc994cc2b1d7c4cc62b2b424', 'request_id': 'req-ca04bc45-7744-4950-860e-8cffc6822165'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:55.665047 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:55.872895 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] The token cache is being invalidate because project e892831ccc994cc2b1d7c4cc62b2b424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:29:55.873381 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:55.874637 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-ca04bc45-7744-4950-860e-8cffc6822165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:29:55.877845 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4409/8823] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:29:55 2022] DELETE /identity/v3/projects/e892831ccc994cc2b1d7c4cc62b2b424 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:55.887549 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:55.888457 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:55.888637 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:55.930682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:55.933951 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:55.977602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:56.073278 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4415/8824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:56.096379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.096862 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.097365 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.134414 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:56.137116 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:56.153986 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4410/8825] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:56.162523 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:56.186538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226c532-1c1e-407d-a734-523c027890e3 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:56.191890 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:56.193045 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.193586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.194069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.195403 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:29:56.196022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:56.199322 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:56.226721 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4416/8826] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:29:56.234545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:56.253094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63a6d0-b3d9-40a4-be2a-323aa8e7284d None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:56.262539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:56.263907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.264428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.264931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.266118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:56.270704 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:56.411956 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4411/8827] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:29:56 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:56.417756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:56.439039 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8a4d-a268-4440-8950-1fb9a0d87213 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:56.565648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:56.567404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.567913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.568419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.569728 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:56.573977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:56.863927 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4417/8828] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:29:56 2022] POST /identity/v3/users => generated 293 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:29:56.871080 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:56.892044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4dae-adfc-4e11-9bb2-a315ca505cb0 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:56.900984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:56.901785 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.902070 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.902426 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.903657 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:56.906399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:56.926779 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4412/8829] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:29:56.934061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:56.955510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e444-0256-479f-b6a4-464669e5d567 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:56.964802 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:56.967305 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:56.967850 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:56.968331 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:56.969561 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:56.973216 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b4c4-4d73-40bd-bed6-90c3c67fc3ff admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:56.996555 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4418/8830] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:29:57.004115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:57.026388 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6ec7-02d7-4228-8766-729f8ac1d0fb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:57.035942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:57.037686 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:57.038215 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:57.038775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] PATH_INFO: `/v3/projects/85b7ddd272374c81b094a377fde7a3e1/users/b83b49ea9a8c4f5fa6016e823ba673e9/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:57.073185 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b7ddd272374c81b094a377fde7a3e1, user_id=b83b49ea9a8c4f5fa6016e823ba673e9, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:57.079066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:57.220197 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4413/8831] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:29:57 2022] PUT /identity/v3/projects/85b7ddd272374c81b094a377fde7a3e1/users/b83b49ea9a8c4f5fa6016e823ba673e9/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:29:57.230218 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b15d4-ee59-4f7d-abff-75d3f9ae3bf5 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:57.230711 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b15d4-ee59-4f7d-abff-75d3f9ae3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:57.231270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b15d4-ee59-4f7d-abff-75d3f9ae3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:57.269613 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-c16b15d4-ee59-4f7d-abff-75d3f9ae3bf5 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:29:57.272108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-c16b15d4-ee59-4f7d-abff-75d3f9ae3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:57.378423 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4419/8832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:29:57.397050 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:29:57.400356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:29:57.519487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7893-fa70-408d-9f67-0f4d2a2d9a04 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:29:57.526972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:29:57.528095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:29:57.528599 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:29:57.529101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:29:57.549506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:29:57.552775 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:29:57.574728 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4414/8833] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:30:07.365271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:07.564395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:07.849867 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:07.850751 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:07.851648 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:07.915965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] MFA Rules not processed for user `b83b49ea9a8c4f5fa6016e823ba673e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:07.918258 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:08.065148 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4420/8834] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:08.073169 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:08.093524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c07ca-450a-47a4-98d6-095901139ad5 service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:08.103750 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:08.105287 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:08.105786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:08.106285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:08.107864 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:08.111825 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:08.219690 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4415/8835] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:30:08 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:30:08.227298 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:08.249983 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3ea31-e3f3-4587-92e1-0d634ecd8354 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:08.412866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:08.414676 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:08.415247 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:08.415799 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:08.417122 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:08.421000 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:08.546315 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4421/8836] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:30:08 2022] POST /identity/v3/users => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:30:08.554411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:08.577022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de966140-d5fc-4a49-820a-fbb3edb01129 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:08.587270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:08.588638 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:08.589192 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:08.589613 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:08.590861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:08.594134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:08.618578 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4416/8837] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:08.625400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:08.645198 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e6c5-0977-4665-b853-9c2e9dfd3407 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:08.653769 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:08.654907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:08.655436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:08.655916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] PATH_INFO: `/v3/projects/08eca1a2cac64d2c9203d1190a5f4736/users/4257ec8eac3e4bc8b7c754f27f4e7f5d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:08.689283 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eca1a2cac64d2c9203d1190a5f4736, user_id=4257ec8eac3e4bc8b7c754f27f4e7f5d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:08.695265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:08.811260 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4422/8838] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:30:08 2022] PUT /identity/v3/projects/08eca1a2cac64d2c9203d1190a5f4736/users/4257ec8eac3e4bc8b7c754f27f4e7f5d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:08.818721 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:08.838584 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35f28-f7e1-4fa4-b90d-b41832e3afd9 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:08.959893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:08.961001 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:08.961494 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:08.961951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:08.963195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:08.966408 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6fcd-992c-4e09-b4f6-a8c54a8a1bfd admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:08.987712 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4417/8839] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:08.995038 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:09.014317 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1424371-0a16-4858-8b8f-0dfc82387d1e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:09.023956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:09.025491 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:09.026022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:09.026599 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] PATH_INFO: `/v3/projects/08eca1a2cac64d2c9203d1190a5f4736/users/4257ec8eac3e4bc8b7c754f27f4e7f5d/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:09.030733 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eca1a2cac64d2c9203d1190a5f4736, user_id=4257ec8eac3e4bc8b7c754f27f4e7f5d, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:09.037373 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fe6a9-418c-4cb3-b2ea-40fb335cbd58 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:09.060741 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4423/8840] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:30:08 2022] PUT /identity/v3/projects/08eca1a2cac64d2c9203d1190a5f4736/users/4257ec8eac3e4bc8b7c754f27f4e7f5d/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:18.748680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:18.749591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:18.749591 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:18.792618 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] MFA Rules not processed for user `4257ec8eac3e4bc8b7c754f27f4e7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:18.794509 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:18.915570 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4418/8841] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:18.948464 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33535-6ca5-4eb6-bcaf-797849e84052 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:18.949327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33535-6ca5-4eb6-bcaf-797849e84052 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:18.949519 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33535-6ca5-4eb6-bcaf-797849e84052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:18.985299 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-1fb33535-6ca5-4eb6-bcaf-797849e84052 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:18.988180 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1fb33535-6ca5-4eb6-bcaf-797849e84052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:19.116654 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:19.174247 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4424/8842] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 4 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:19.185137 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:19.218942 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986e65-cca7-4291-9efd-c0aae698a578 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:19.236316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:19.237394 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:19.237905 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:19.238376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:19.366423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:19.392985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:19.396868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d6b8-10c5-4005-a438-5d308bac68ff service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:19.427965 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4419/8843] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:30:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:30:19.621460 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507f13-bb12-4d41-9a8e-46dcc0e53f98 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:19.622493 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507f13-bb12-4d41-9a8e-46dcc0e53f98 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:19.622927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79507f13-bb12-4d41-9a8e-46dcc0e53f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:19.654587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-79507f13-bb12-4d41-9a8e-46dcc0e53f98 None None] MFA Rules not processed for user `b83b49ea9a8c4f5fa6016e823ba673e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:19.657011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-79507f13-bb12-4d41-9a8e-46dcc0e53f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:19.669083 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4425/8844] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:20.191608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8c77-8596-45de-bfe8-30189a7577fa None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:20.192485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8c77-8596-45de-bfe8-30189a7577fa None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:20.192670 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8c77-8596-45de-bfe8-30189a7577fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b8cb8c77-8596-45de-bfe8-30189a7577fa None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:30:20.203867 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:20.205509 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:30:20.208019 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4420/8845] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:30:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:30:20.558938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:20.559795 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:20.559977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:20.596472 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] MFA Rules not processed for user `b83b49ea9a8c4f5fa6016e823ba673e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:20.598771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:20.612970 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4426/8846] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:20.657993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397c47-d0fd-483d-b0a1-6a765fb03844 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:20.658725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397c47-d0fd-483d-b0a1-6a765fb03844 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:20.659337 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2397c47-d0fd-483d-b0a1-6a765fb03844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:20.697204 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d2397c47-d0fd-483d-b0a1-6a765fb03844 None None] MFA Rules not processed for user `a0e5fa628b98463594d6066befb76468`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:20.699247 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d2397c47-d0fd-483d-b0a1-6a765fb03844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:20.714808 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4421/8847] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:30:20.736787 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:20.740018 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:20.856878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87120f-49ea-45cb-894e-d48f856e1b87 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:20.864487 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:20.865486 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:20.865979 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:20.866461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:20.885975 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:20.888977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660723b5-d7d0-4a4e-80d5-53a2f3888d40 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:20.916084 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4427/8848] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:30:21.403727 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:21.404650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:21.405074 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-8ee94892-ef18-4784-8b4a-5fc2d94d1d59 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:30:21.419834 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:21.426592 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:30:21.428937 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4422/8849] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:30:21 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:30:21.809312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12271a3-fe69-4fb6-a523-696a0043e293 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:21.813319 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12271a3-fe69-4fb6-a523-696a0043e293 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:21.813913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12271a3-fe69-4fb6-a523-696a0043e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:21.857107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-f12271a3-fe69-4fb6-a523-696a0043e293 None None] MFA Rules not processed for user `b83b49ea9a8c4f5fa6016e823ba673e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:21.859943 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f12271a3-fe69-4fb6-a523-696a0043e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:21.874929 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4428/8850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:22.291182 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:22.291811 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:22.292877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:30:22.306132 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:30:22.308050 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:30:22.310031 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4423/8851] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:30:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:30:28.986515 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764021-9325-4ad8-9120-96bee0969156 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:28.987429 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764021-9325-4ad8-9120-96bee0969156 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:28.991311 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764021-9325-4ad8-9120-96bee0969156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:29.013813 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-85764021-9325-4ad8-9120-96bee0969156 None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:29.015755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-85764021-9325-4ad8-9120-96bee0969156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:29.109900 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4429/8852] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:29.125666 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:29.128262 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:29.150768 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698402d-e824-4a7f-8086-d40609a22edc None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:29.157981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:29.159629 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:29.160147 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:29.160660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:29.183896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:29.183896 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:29.204481 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4424/8853] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:30:36.311576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764021-9325-4ad8-9120-96bee0969156 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:36.435904 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:36.459172 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764021-9325-4ad8-9120-96bee0969156 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:36.468144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:36.469512 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:36.470195 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:36.470806 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] PATH_INFO: `/v3/users/b83b49ea9a8c4f5fa6016e823ba673e9` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:36.474360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83b49ea9a8c4f5fa6016e823ba673e9)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:36.478367 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:36.800540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83b49ea9a8c4f5fa6016e823ba673e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:36.804012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83b49ea9a8c4f5fa6016e823ba673e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:36.945910 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83b49ea9a8c4f5fa6016e823ba673e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:36.974634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83b49ea9a8c4f5fa6016e823ba673e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:36.991334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83b49ea9a8c4f5fa6016e823ba673e9'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.005263 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4430/8854] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:30:36 2022] DELETE /identity/v3/users/b83b49ea9a8c4f5fa6016e823ba673e9 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:37.444693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:37.467088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa30fc-9be5-43b3-bb6f-ca02252efd1a service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:37.593923 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:37.595214 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:37.595669 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:37.596200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] PATH_INFO: `/v3/projects/85b7ddd272374c81b094a377fde7a3e1` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:37.598580 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b7ddd272374c81b094a377fde7a3e1)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:37.602615 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:37.758570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b7ddd272374c81b094a377fde7a3e1', 'request_id': 'req-c00ac554-3328-44d6-8116-bd5b35610c2c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.772605 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b7ddd272374c81b094a377fde7a3e1', 'request_id': 'req-c00ac554-3328-44d6-8116-bd5b35610c2c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.784972 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b7ddd272374c81b094a377fde7a3e1', 'request_id': 'req-c00ac554-3328-44d6-8116-bd5b35610c2c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.888506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] The token cache is being invalidate because project 85b7ddd272374c81b094a377fde7a3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:30:37.889019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.890362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:37.893725 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4425/8855] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:30:37 2022] DELETE /identity/v3/projects/85b7ddd272374c81b094a377fde7a3e1 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:37.900760 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:37.903396 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:37.929929 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415caec5-5866-4ab0-b31c-36a1ffb3d821 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:38.055597 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:38.056587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:38.057079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:38.057573 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] PATH_INFO: `/v3/users/4257ec8eac3e4bc8b7c754f27f4e7f5d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:38.059971 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4257ec8eac3e4bc8b7c754f27f4e7f5d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:38.063685 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:38.387315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4257ec8eac3e4bc8b7c754f27f4e7f5d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:38.388522 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4257ec8eac3e4bc8b7c754f27f4e7f5d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:38.477543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4257ec8eac3e4bc8b7c754f27f4e7f5d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:38.506271 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4257ec8eac3e4bc8b7c754f27f4e7f5d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:38.511248 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:38.524315 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-6d8198a4-c876-49a4-b54d-296fb60e4b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4257ec8eac3e4bc8b7c754f27f4e7f5d'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:38.538475 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4431/8856] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:30:37 2022] DELETE /identity/v3/users/4257ec8eac3e4bc8b7c754f27f4e7f5d => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:38.925989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:38.928877 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:38.956589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ac554-3328-44d6-8116-bd5b35610c2c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:39.073634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:39.084915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:39.086249 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:39.086725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:39.087245 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] PATH_INFO: `/v3/projects/08eca1a2cac64d2c9203d1190a5f4736` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:39.091455 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08eca1a2cac64d2c9203d1190a5f4736)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:39.093819 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:39.270652 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eca1a2cac64d2c9203d1190a5f4736', 'request_id': 'req-27d9fd61-5078-4393-95ab-993bd6198f62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:39.280761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eca1a2cac64d2c9203d1190a5f4736', 'request_id': 'req-27d9fd61-5078-4393-95ab-993bd6198f62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:39.289203 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eca1a2cac64d2c9203d1190a5f4736', 'request_id': 'req-27d9fd61-5078-4393-95ab-993bd6198f62'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:39.396902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] The token cache is being invalidate because project 08eca1a2cac64d2c9203d1190a5f4736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:30:39.397430 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:39.398612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-27d9fd61-5078-4393-95ab-993bd6198f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:30:39.401268 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4426/8857] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:30:38 2022] DELETE /identity/v3/projects/08eca1a2cac64d2c9203d1190a5f4736 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:30:39.409459 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:39.410165 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:39.410461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:39.450200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:39.453008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:39.583718 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4432/8858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:39.595338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:39.595809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:39.596842 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:39.632865 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:39.635322 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:39.648380 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4427/8859] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:39.656237 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:39.675948 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd41bb-57cc-4144-8162-765bbde9c312 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:39.684808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:39.686190 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:39.686374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:39.686757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:39.688037 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:30:39.688490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:39.691205 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:39.714874 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4433/8860] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:30:39.722861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:39.741156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4a6f-124c-4087-a009-9d90e0fbe372 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:39.750021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:39.751115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:39.751633 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:39.752114 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:39.753948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:39.757786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:39.909507 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4428/8861] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:30:39 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:30:39.916502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:39.941911 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbb8c5-9e02-43e4-ae80-2524d7994af0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:40.056719 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:40.057954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.058488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.059016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.060343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:40.065335 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:40.266319 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4434/8862] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:30:39 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:30:40.274742 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:40.295818 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9c05e-3b83-4fb8-9963-58813e47f680 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:40.304429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:40.305478 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.305936 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.306399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.307828 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:40.310841 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:40.332043 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4429/8863] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:40.339238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:40.359798 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192fa0-3153-4efc-a5ba-fe4fb0792fd9 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:40.368564 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:40.369729 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.370253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.370762 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.372057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:40.375413 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201f8f1-0588-422d-a762-00198d4e3241 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:40.399794 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4435/8864] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:40.406767 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:40.423358 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0643b-a9d7-4d5c-a00c-ccdc768bb330 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:40.430899 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:40.439568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.439568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.439568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] PATH_INFO: `/v3/projects/bb447ffc303348ce826e0d5bbb56f7f2/users/0feaeaa5e2da4e15bccb37fd42695ef1/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.464094 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb447ffc303348ce826e0d5bbb56f7f2, user_id=0feaeaa5e2da4e15bccb37fd42695ef1, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:40.468348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:40.556992 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4430/8865] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:30:40 2022] PUT /identity/v3/projects/bb447ffc303348ce826e0d5bbb56f7f2/users/0feaeaa5e2da4e15bccb37fd42695ef1/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:30:40.568541 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb37f-8a13-4bb3-bbdc-90899be09c86 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.569240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb37f-8a13-4bb3-bbdc-90899be09c86 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.569385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb37f-8a13-4bb3-bbdc-90899be09c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.602385 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-664fb37f-8a13-4bb3-bbdc-90899be09c86 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:40.603997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-664fb37f-8a13-4bb3-bbdc-90899be09c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:40.708374 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:40.726000 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4436/8866] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:40.744222 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:40.747814 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:40.867778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95f40-5cc7-4aeb-b5b5-fd12b04f5e17 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:40.876325 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:40.877266 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:40.877729 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:40.878188 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:40.895437 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:40.897802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:40.912660 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4431/8867] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:30:50.259212 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:50.267630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:50.267630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:50.313439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] MFA Rules not processed for user `0feaeaa5e2da4e15bccb37fd42695ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:30:50.315854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:30:50.438757 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4437/8868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:30:50.445641 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:50.461291 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76cb57-08fd-4b0b-b689-bf00673c172a service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:50.468952 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:50.470197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:50.470949 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:50.471423 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:50.472725 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:50.476039 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:50.697163 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4432/8869] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:30:50 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:30:50.702989 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:50.722261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4963b93-ca6e-42dd-a3cb-7c9abb0d5c1f None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:50.823047 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:50.824221 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:50.824748 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:50.825327 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:50.826669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:50.830782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:50.971513 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4438/8870] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:30:50 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:30:50.973485 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:50.989970 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:50.999360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cbcca-108f-4d5b-a6eb-b07991b2ab27 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:51.006592 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:51.007286 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:51.007575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:51.007856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:51.008537 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:51.010471 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:51.027041 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4433/8871] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:51.032595 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:51.050592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e361-a104-4d7d-9ed0-85d4fc241079 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:51.058820 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:51.059907 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:51.060297 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:51.060697 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] PATH_INFO: `/v3/projects/c69689cf3f6242dab6ed3222a08acb0e/users/39fdf0edbb3f43739a844df847c20fdd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:51.086422 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69689cf3f6242dab6ed3222a08acb0e, user_id=39fdf0edbb3f43739a844df847c20fdd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:51.089624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:51.179372 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4439/8872] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:30:51 2022] PUT /identity/v3/projects/c69689cf3f6242dab6ed3222a08acb0e/users/39fdf0edbb3f43739a844df847c20fdd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:30:51.186004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:51.206272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c462f8-c086-4bb4-a5c7-af233cc19802 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:51.349019 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:51.350277 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:51.350822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:51.351384 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:51.352675 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:51.356126 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e507-8713-41c9-98b4-ba4edbb39307 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:51.381584 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4434/8873] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:30:51.385837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:30:51.407444 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa491f41-4a22-47ee-87f5-21b47af71a2e admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:30:51.419658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:30:51.423974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:30:51.423974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:30:51.423974 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] PATH_INFO: `/v3/projects/c69689cf3f6242dab6ed3222a08acb0e/users/39fdf0edbb3f43739a844df847c20fdd/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:30:51.425894 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69689cf3f6242dab6ed3222a08acb0e, user_id=39fdf0edbb3f43739a844df847c20fdd, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:30:51.431314 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:30:51.450201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4440/8874] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:30:51 2022] PUT /identity/v3/projects/c69689cf3f6242dab6ed3222a08acb0e/users/39fdf0edbb3f43739a844df847c20fdd/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:00.873855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e06b-a0d6-4ca8-818f-83a36b9ecdbc None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:00.874632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e06b-a0d6-4ca8-818f-83a36b9ecdbc None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:00.877027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e06b-a0d6-4ca8-818f-83a36b9ecdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:00.974691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-d8e5e06b-a0d6-4ca8-818f-83a36b9ecdbc None None] MFA Rules not processed for user `39fdf0edbb3f43739a844df847c20fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:00.977145 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-d8e5e06b-a0d6-4ca8-818f-83a36b9ecdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:01.129473 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4435/8875] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:01.175352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:01.178552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:01.273506 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:01.298016 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0398-96ec-4086-8edb-299b9368d6e8 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:01.303610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:01.304575 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:01.305115 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:01.305603 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:01.425877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:01.428808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:01.448555 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4441/8876] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:31:01.872565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b9a-3828-4ad7-b513-f12f3192d02a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:01.872565 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b9a-3828-4ad7-b513-f12f3192d02a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:01.873150 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b9a-3828-4ad7-b513-f12f3192d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:01.993348 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-00da0b9a-3828-4ad7-b513-f12f3192d02a None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:01.996879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-00da0b9a-3828-4ad7-b513-f12f3192d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:02.100451 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=100 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:02.137489 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4436/8877] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:02.326303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:02.333024 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:02.509238 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347dfea-0841-423d-ac82-22b90d5998a9 service glance] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:02.522342 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:02.523525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:02.524069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:02.524630 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:02.543061 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:02.546880 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24772ae-af4d-48a4-b5c0-c3083a4deb80 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:02.565030 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4442/8878] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:12.154833 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=6 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:12.557390 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=67 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:18.835679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881decbf-66c4-400f-922e-920b9723d35d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:18.836654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881decbf-66c4-400f-922e-920b9723d35d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:18.836654 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881decbf-66c4-400f-922e-920b9723d35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:18.874380 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-881decbf-66c4-400f-922e-920b9723d35d None None] MFA Rules not processed for user `0feaeaa5e2da4e15bccb37fd42695ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:18.877227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-881decbf-66c4-400f-922e-920b9723d35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:18.890465 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4437/8879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:19.390808 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:19.391761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:19.391947 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:31:19.404845 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:31:19.454766 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:31:19.462358 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4443/8880] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:31:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:31:19.622575 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca25247-87fa-44fa-87c0-9d4109f985af None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:19.623100 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca25247-87fa-44fa-87c0-9d4109f985af None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:19.623647 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca25247-87fa-44fa-87c0-9d4109f985af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:19.660057 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-5ca25247-87fa-44fa-87c0-9d4109f985af None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:19.672066 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-5ca25247-87fa-44fa-87c0-9d4109f985af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:19.677904 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4438/8881] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:31:19.699833 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:19.726313 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedde5-183e-4087-9849-5f07f602877c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:19.736902 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:19.738001 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:19.738562 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:19.739107 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:19.757251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:19.760782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:19.778129 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4444/8882] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:21.921331 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59b15-362f-40b6-9cc3-18878d3447c5 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:21.921976 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59b15-362f-40b6-9cc3-18878d3447c5 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:21.922280 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59b15-362f-40b6-9cc3-18878d3447c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:21.948935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2fa59b15-362f-40b6-9cc3-18878d3447c5 None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:21.950368 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2fa59b15-362f-40b6-9cc3-18878d3447c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:21.959931 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4439/8883] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:21.975253 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:21.991064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c136b1-ff47-4106-85ef-2ba63ea382e6 service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:22.000272 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:22.001417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:22.001917 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:22.002415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:22.019333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:22.022567 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7250f-5a9b-44ff-a30a-384e6820efc5 service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:22.041256 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4445/8884] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:31:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:31.942432 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=9 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:32.033479 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=12 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.438792 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ffbb8-a37f-440d-a458-fb5f5a55c064 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:37.445552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ffbb8-a37f-440d-a458-fb5f5a55c064 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:37.445552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ffbb8-a37f-440d-a458-fb5f5a55c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:37.477523 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-0c4ffbb8-a37f-440d-a458-fb5f5a55c064 None None] MFA Rules not processed for user `0feaeaa5e2da4e15bccb37fd42695ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:37.479978 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0c4ffbb8-a37f-440d-a458-fb5f5a55c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:37.493441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4440/8885] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:38.018091 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:38.018928 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:38.019094 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:31:38.033804 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:31:38.035399 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:31:38.036669 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4446/8886] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:31:38.264107 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:38.264603 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:38.265153 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:38.304105 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] MFA Rules not processed for user `92b7edc1a506407db3cd691bfabf169c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:38.306457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:38.321465 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4441/8887] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:31:38.343899 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:38.372663 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01766e-705b-4a6f-85e6-7749233a9f1b None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:38.383012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18d4e38ee31a4ab3a21e998803226465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:38.384159 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:38.384657 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:38.385144 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:38.403609 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:38.407321 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:38.425447 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4447/8888] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 4 21:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:41.823769 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:41.827722 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:41.993860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f60be8-546b-4fa2-a9f8-6409b4c8a9cb None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:42.004179 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:42.005598 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:42.006106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:42.006632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:42.011433 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:42.036357 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:42.040064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:42.062720 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4442/8889] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:31:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:31:48.417636 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:52.053103 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=38 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:53.527874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:53.658447 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257858-d9d4-44e5-a2f1-3c8aa0262d5c service swift] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:53.667362 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:53.674022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:53.674022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:53.674022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] PATH_INFO: `/v3/users/0feaeaa5e2da4e15bccb37fd42695ef1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:53.674022 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feaeaa5e2da4e15bccb37fd42695ef1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:53.676607 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:53.931696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feaeaa5e2da4e15bccb37fd42695ef1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:53.932875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feaeaa5e2da4e15bccb37fd42695ef1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.030360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feaeaa5e2da4e15bccb37fd42695ef1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.060930 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feaeaa5e2da4e15bccb37fd42695ef1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.076708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feaeaa5e2da4e15bccb37fd42695ef1'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.088273 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4448/8890] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:31:53 2022] DELETE /identity/v3/users/0feaeaa5e2da4e15bccb37fd42695ef1 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:54.551935 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:54.571718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08157e10-0db9-4c35-ac0c-b56f743cbace service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:54.708239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:54.709402 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:54.709937 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:54.710393 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] PATH_INFO: `/v3/projects/bb447ffc303348ce826e0d5bbb56f7f2` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:54.712631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb447ffc303348ce826e0d5bbb56f7f2)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:54.716658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:54.936761 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb447ffc303348ce826e0d5bbb56f7f2', 'request_id': 'req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.951346 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb447ffc303348ce826e0d5bbb56f7f2', 'request_id': 'req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:54.964220 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb447ffc303348ce826e0d5bbb56f7f2', 'request_id': 'req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.096259 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] The token cache is being invalidate because project bb447ffc303348ce826e0d5bbb56f7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:31:55.096764 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.097985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.100673 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4443/8891] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:31:54 2022] DELETE /identity/v3/projects/bb447ffc303348ce826e0d5bbb56f7f2 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:55.107383 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:55.110414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:55.136086 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75c6e-3c5f-4413-8649-36fdef224d36 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:55.258889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:55.260104 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:55.260606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:55.261106 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] PATH_INFO: `/v3/users/39fdf0edbb3f43739a844df847c20fdd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:55.263611 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fdf0edbb3f43739a844df847c20fdd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:55.267776 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:55.317419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:55.573638 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fdf0edbb3f43739a844df847c20fdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.574829 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fdf0edbb3f43739a844df847c20fdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.704130 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fdf0edbb3f43739a844df847c20fdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.730847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fdf0edbb3f43739a844df847c20fdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.746727 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-824f9fd1-ce44-497f-8e1d-40b9b097eb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fdf0edbb3f43739a844df847c20fdd'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:55.758821 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4449/8892] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:31:55 2022] DELETE /identity/v3/users/39fdf0edbb3f43739a844df847c20fdd => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:56.227253 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:56.229938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:56.257813 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5d5e-884e-449c-8a0e-dfc3485b9238 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:56.400328 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:56.401482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:56.401984 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:56.402482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] PATH_INFO: `/v3/projects/c69689cf3f6242dab6ed3222a08acb0e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:56.404888 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69689cf3f6242dab6ed3222a08acb0e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:56.408856 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:56.671196 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:56.699373 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69689cf3f6242dab6ed3222a08acb0e', 'request_id': 'req-c0019eaf-df43-498f-954c-9cfc8450e295'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:56.712754 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69689cf3f6242dab6ed3222a08acb0e', 'request_id': 'req-c0019eaf-df43-498f-954c-9cfc8450e295'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:56.724570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69689cf3f6242dab6ed3222a08acb0e', 'request_id': 'req-c0019eaf-df43-498f-954c-9cfc8450e295'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:56.872078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] The token cache is being invalidate because project c69689cf3f6242dab6ed3222a08acb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:31:56.872616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:56.874008 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-c0019eaf-df43-498f-954c-9cfc8450e295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:31:56.877573 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4444/8893] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:31:56 2022] DELETE /identity/v3/projects/c69689cf3f6242dab6ed3222a08acb0e => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:31:56.885602 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:56.886461 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:56.886678 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:56.918868 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:56.920590 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:57.050971 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4450/8894] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:57.067706 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.068217 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.068735 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.108515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:57.111539 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:57.128101 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4445/8895] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:57.135287 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.154874 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0076de-ef90-4a43-b5c4-738f0ece3b1a None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.160954 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.161771 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.162108 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.162742 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.163626 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:31:57.164119 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.166293 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.182930 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4451/8896] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:31:57.190815 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.209667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0739-2821-451f-92e8-c887bf6488a8 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.218272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.219411 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.219921 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.220413 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.221608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.225642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.353294 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4446/8897] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:31:57 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:31:57.361200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.380800 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892370f7-25b8-4097-9105-38bff5ee4e4b admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.497406 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.498517 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.499035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.500223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.501462 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.505495 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.616755 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4452/8898] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:31:57 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 21:31:57.623095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.642658 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7d1b3-b5b2-4ea9-a720-5ab0de429584 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.651904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.653143 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.653691 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.654399 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.655755 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.658926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.681990 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4447/8899] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:31:57.688675 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.708073 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb01db-e27c-46cb-832c-b0471f595178 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.717579 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.718647 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.719170 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.719791 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.721384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.724991 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245221-76a9-49ad-a7eb-0c8391d68579 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.749427 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4453/8900] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:31:57.755929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:57.776712 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5799e-b5af-4688-a70a-cd30427739db admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:57.786210 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:57.787835 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.788319 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.788824 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] PATH_INFO: `/v3/projects/6fc5c72665164a0c8d9e7e476c283e98/users/7b1f3277f1cd436ba2d864142da13dce/roles/85251621622246e79e839f870f6d411d` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.821472 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc5c72665164a0c8d9e7e476c283e98, user_id=7b1f3277f1cd436ba2d864142da13dce, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:57.827366 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:57.950646 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4448/8901] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:31:57 2022] PUT /identity/v3/projects/6fc5c72665164a0c8d9e7e476c283e98/users/7b1f3277f1cd436ba2d864142da13dce/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:57.969601 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:57.970452 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:57.970896 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:57.986488 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:58.031414 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:58.033783 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:58.169484 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4454/8902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:58.176697 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:58.294095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1589e6-4bec-43f7-a190-5b36e06eec30 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:58.300570 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:58.301239 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:58.301524 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:58.301801 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:58.302482 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:58.304568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:58.441144 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4449/8903] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:31:58 2022] POST /identity/v3/projects => generated 393 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:31:58.447634 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:58.469187 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215416ec-0fa5-4d9e-b98b-91588bea76f4 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:58.572838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:58.573631 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:58.574011 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:58.574394 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] PATH_INFO: `/v3/users` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:58.575368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:58.577692 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:58.703979 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4455/8904] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:31:58 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:31:58.710101 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:58.729343 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89169b-3e10-40ad-8a82-7a3a108ecfd1 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:58.738450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:58.741753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:58.741753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:58.741753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:58.741753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:58.744630 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:58.757958 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4450/8905] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:31:58.763431 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:58.775682 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75603d-dbca-4a6a-a01f-8282a1b91812 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:58.781696 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:58.782435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:58.782717 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:58.782997 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] PATH_INFO: `/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496/users/b7892d70b0824d6c92d64eef7eb6a76c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:58.805419 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa3eb265504a669f5ca3b7b0ce0496, user_id=b7892d70b0824d6c92d64eef7eb6a76c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:58.811303 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:58.922917 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4456/8906] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:31:58 2022] PUT /identity/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496/users/b7892d70b0824d6c92d64eef7eb6a76c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:58.929999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:58.948550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64632d28-4fe8-4d11-8864-9c9cfcb2a27d admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:59.008156 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:59.059809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:59.060839 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:59.061202 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:59.061522 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:59.062273 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:59.064106 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca325c9d-acbd-447d-a989-f26fec7112df admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:59.082599 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4451/8907] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:31:59.089714 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:59.110674 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cc66-86ad-49ad-8a5c-0d7bc872d184 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:59.119736 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:59.120936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:59.121448 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:59.121936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] PATH_INFO: `/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496/users/b7892d70b0824d6c92d64eef7eb6a76c/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:59.125866 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa3eb265504a669f5ca3b7b0ce0496, user_id=b7892d70b0824d6c92d64eef7eb6a76c, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:59.131445 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:59.153311 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4457/8908] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:31:59 2022] PUT /identity/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496/users/b7892d70b0824d6c92d64eef7eb6a76c/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:31:59.174902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899d9-d446-4f69-825a-623db660b466 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:59.175534 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899d9-d446-4f69-825a-623db660b466 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:59.176072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394899d9-d446-4f69-825a-623db660b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:59.234225 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-394899d9-d446-4f69-825a-623db660b466 None None] MFA Rules not processed for user `b7892d70b0824d6c92d64eef7eb6a76c`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:31:59.236766 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-394899d9-d446-4f69-825a-623db660b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:59.383168 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4452/8909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:31:59.411600 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:31:59.414932 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:31:59.532334 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:59.586938 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04440-eb95-4806-8011-251cf34fc0a0 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:31:59.598196 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:31:59.599502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:31:59.600010 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:31:59.600509 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:31:59.727622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:31:59.731012 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821a22-de49-4cc2-83fe-d756ccdcc4e9 service nova] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:31:59.751810 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4458/8910] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:32:08.666128 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394899d9-d446-4f69-825a-623db660b466 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:32:08.668887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-394899d9-d446-4f69-825a-623db660b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:32:08.806033 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394899d9-d446-4f69-825a-623db660b466 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:32:08.814180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:32:08.815257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:08.815931 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:08.816626 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:08.837718 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:32:08.840661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e01127-1d7a-43ba-927d-e2b0f5a4164f service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:32:08.861897 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4453/8911] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:32:09.742131 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=35 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:14.713209 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:14.714251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:14.714251 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:14.767343 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:32:14.770223 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:32:14.785343 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4459/8912] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:32:15.419944 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866013-38e2-42fc-84a5-bad9d7467f0d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:15.420661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866013-38e2-42fc-84a5-bad9d7467f0d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:15.421123 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb866013-38e2-42fc-84a5-bad9d7467f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-bb866013-38e2-42fc-84a5-bad9d7467f0d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:32:15.440699 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:32:15.442409 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:32:15.469058 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4454/8913] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:32:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:32:18.851915 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=75 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:24.754710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:34.123708 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:32:34.127427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:32:34.409068 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89843eb-2553-4d9b-a7bb-b264b4183c97 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:32:34.438312 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:32:34.440110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:34.440618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:34.441114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:34.449355 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:32:34.474112 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:32:34.477949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e4df9-14ee-4abe-91f7-6425f6ebdb39 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:32:34.501245 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4460/8914] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:32:38.706236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2c44-57b3-42a2-8a27-3bc0a049494d None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:38.707096 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2c44-57b3-42a2-8a27-3bc0a049494d None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:38.707313 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2c44-57b3-42a2-8a27-3bc0a049494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:38.744632 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-056f2c44-57b3-42a2-8a27-3bc0a049494d None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:32:38.746989 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-056f2c44-57b3-42a2-8a27-3bc0a049494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:32:38.759825 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4455/8915] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:32:39.375851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145378-8816-4e86-b4a9-e05d528ebd87 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:32:39.376725 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145378-8816-4e86-b4a9-e05d528ebd87 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:32:39.376888 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145378-8816-4e86-b4a9-e05d528ebd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1f145378-8816-4e86-b4a9-e05d528ebd87 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:32:39.391128 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:32:39.392885 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:32:39.397474 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4461/8916] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:32:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:32:44.491499 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=32 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:48.736447 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:01.433689 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b73ca-30f9-4214-a5f5-dff862bcbac0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:01.435163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b73ca-30f9-4214-a5f5-dff862bcbac0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:01.435163 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b73ca-30f9-4214-a5f5-dff862bcbac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:01.473428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-6f9b73ca-30f9-4214-a5f5-dff862bcbac0 None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:01.475810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f9b73ca-30f9-4214-a5f5-dff862bcbac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:01.494173 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4456/8917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:02.253732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197eb14-b81b-461d-9e23-29f302506ae0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:02.255574 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197eb14-b81b-461d-9e23-29f302506ae0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:02.256380 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197eb14-b81b-461d-9e23-29f302506ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-9197eb14-b81b-461d-9e23-29f302506ae0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:33:02.273116 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:02.274881 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:33:02.294132 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4462/8918] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:33:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:33:11.464108 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:24.243299 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d7f8-d83b-4598-b11a-9daf00222e5a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:24.244404 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d7f8-d83b-4598-b11a-9daf00222e5a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:24.244786 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667d7f8-d83b-4598-b11a-9daf00222e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:24.284027 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2667d7f8-d83b-4598-b11a-9daf00222e5a None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:24.286237 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2667d7f8-d83b-4598-b11a-9daf00222e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:24.299378 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4457/8919] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:24.902912 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d231d-9533-4424-8f82-6c38e7ebef73 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:24.903612 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d231d-9533-4424-8f82-6c38e7ebef73 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:24.903959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d231d-9533-4424-8f82-6c38e7ebef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-543d231d-9533-4424-8f82-6c38e7ebef73 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:33:24.916889 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:24.919334 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:33:24.921897 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4463/8920] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:33:24 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:33:34.275389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:46.848122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:46.850072 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:46.850552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:46.888515 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] MFA Rules not processed for user `7b1f3277f1cd436ba2d864142da13dce`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:46.891547 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:46.905762 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4458/8921] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:47.622544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092647-a297-41fd-91b7-b2fb88e15d53 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:47.624161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092647-a297-41fd-91b7-b2fb88e15d53 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:47.624756 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092647-a297-41fd-91b7-b2fb88e15d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-bd092647-a297-41fd-91b7-b2fb88e15d53 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:33:47.636014 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:33:47.637392 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:33:47.641277 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4464/8922] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:33:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:33:54.854138 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:54.962559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33b872-5ce7-4ff3-b25a-f2f56e95ee7a None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:54.967753 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:54.968678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:54.969071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:54.969517 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] PATH_INFO: `/v3/users/7b1f3277f1cd436ba2d864142da13dce` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:54.971553 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1f3277f1cd436ba2d864142da13dce)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:54.974861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:55.263635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1f3277f1cd436ba2d864142da13dce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:55.416506 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1f3277f1cd436ba2d864142da13dce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:55.432281 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1f3277f1cd436ba2d864142da13dce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:55.457932 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1f3277f1cd436ba2d864142da13dce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:55.459115 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1f3277f1cd436ba2d864142da13dce'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:55.471287 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4459/8923] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:33:54 2022] DELETE /identity/v3/users/7b1f3277f1cd436ba2d864142da13dce => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:33:55.479793 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:55.480720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:55.480916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:55.518436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:55.520352 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:55.642557 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4465/8924] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:33:55.660088 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:55.662823 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:55.789550 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134ee4e-2bf0-4b4c-af33-015f65f60724 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:55.796667 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:55.801364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:55.801364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:55.801364 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:55.816906 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:55.819985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:55.841329 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4460/8925] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:33:56.332720 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:56.335615 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:56.362065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5f9e-fc4e-4193-9025-055bc53baafd None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:56.371827 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:56.372936 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:56.373427 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:56.373913 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] PATH_INFO: `/v3/projects/6fc5c72665164a0c8d9e7e476c283e98` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:56.377071 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc5c72665164a0c8d9e7e476c283e98)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:56.380998 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:56.550653 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc5c72665164a0c8d9e7e476c283e98', 'request_id': 'req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:56.668053 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc5c72665164a0c8d9e7e476c283e98', 'request_id': 'req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:56.680350 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc5c72665164a0c8d9e7e476c283e98', 'request_id': 'req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:56.702368 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] The token cache is being invalidate because project 6fc5c72665164a0c8d9e7e476c283e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:33:56.702893 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:56.704181 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:56.706984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4466/8926] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:33:56 2022] DELETE /identity/v3/projects/6fc5c72665164a0c8d9e7e476c283e98 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:33:56.713109 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:56.726619 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e73176-94e9-448a-945b-ea7011a5328c service neutron] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:56.742673 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:56.825317 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:56.826263 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:56.826656 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:56.827068 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] PATH_INFO: `/v3/users/b7892d70b0824d6c92d64eef7eb6a76c` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:56.829004 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7892d70b0824d6c92d64eef7eb6a76c)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:56.832255 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:57.078904 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7892d70b0824d6c92d64eef7eb6a76c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:57.203806 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7892d70b0824d6c92d64eef7eb6a76c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:57.219964 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7892d70b0824d6c92d64eef7eb6a76c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:57.242578 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7892d70b0824d6c92d64eef7eb6a76c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:57.243965 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e02bcf1c-7565-4711-ad00-1cf1c4e81b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7892d70b0824d6c92d64eef7eb6a76c'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:57.255366 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4461/8927] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:33:56 2022] DELETE /identity/v3/users/b7892d70b0824d6c92d64eef7eb6a76c => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:33:57.966261 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:57.969009 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:57.993838 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5ded-9ccc-49bf-bbf7-f7c6849e16aa admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:58.111185 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:58.112332 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:58.112841 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:58.113347 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] PATH_INFO: `/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:58.115856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa3eb265504a669f5ca3b7b0ce0496)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:58.119531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:58.265628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:58.298031 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa3eb265504a669f5ca3b7b0ce0496', 'request_id': 'req-3692132d-f71e-4c5b-942d-76e992ef74ef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:58.405525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa3eb265504a669f5ca3b7b0ce0496', 'request_id': 'req-3692132d-f71e-4c5b-942d-76e992ef74ef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:58.420114 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa3eb265504a669f5ca3b7b0ce0496', 'request_id': 'req-3692132d-f71e-4c5b-942d-76e992ef74ef'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:58.443881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] The token cache is being invalidate because project 33fa3eb265504a669f5ca3b7b0ce0496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:33:58.445056 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:58.447222 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-3692132d-f71e-4c5b-942d-76e992ef74ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:33:58.451044 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4467/8928] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:33:57 2022] DELETE /identity/v3/projects/33fa3eb265504a669f5ca3b7b0ce0496 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:33:58.460165 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:58.464879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:58.464879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:58.497498 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:58.499943 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:58.630379 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4462/8929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:58.646560 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:58.647084 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:58.647698 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:58.687935 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:58.689510 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:58.705499 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4468/8930] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:58.712805 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:58.733535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126485-4f92-4992-88ab-1d4eb213bf23 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:58.742389 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:58.743532 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:58.744044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:58.748415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:58.748415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:33:58.748415 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:58.750316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:58.776771 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4463/8931] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:33:58.784544 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:58.804755 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7f2f-4d41-4517-bcdb-30109bbf842c None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:58.813757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:58.814746 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:58.815201 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:58.815628 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:58.816782 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:58.820805 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:58.997516 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4469/8932] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:33:58 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:33:59.004232 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:59.023589 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbe602-06fc-46c0-97da-7c1c05bc977c admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:59.065353 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:59.148379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:59.149683 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.150235 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.150716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.152545 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:59.156596 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:59.263920 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4464/8933] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:33:59 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:33:59.270346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:59.290555 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec82f3-3fef-46a0-8080-a46d0dbd7fc4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:59.299926 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:59.300977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.301483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.302008 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.303451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:59.306851 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:59.329190 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4470/8934] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:33:59.336838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:59.356064 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26754db-695d-48fd-86bf-90554e61cddb admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:59.363948 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:59.365044 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.365525 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.366006 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.367501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:59.371479 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774126f-d5bd-4cc1-be0b-7081b4ea9e17 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:59.395698 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4465/8935] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 21:33:59.402345 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:59.420784 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcf86-0844-4713-9f6c-b7eb9ab18fbc admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:59.428605 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:59.429606 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.430070 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.430366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] PATH_INFO: `/v3/projects/6a14a0b665fd4c4d98138e39f75314bc/users/570063e6ff0b4ef383149d832a7768c0/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.461852 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a14a0b665fd4c4d98138e39f75314bc, user_id=570063e6ff0b4ef383149d832a7768c0, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:59.467225 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:33:59.634180 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4471/8936] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:33:59 2022] PUT /identity/v3/projects/6a14a0b665fd4c4d98138e39f75314bc/users/570063e6ff0b4ef383149d832a7768c0/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:33:59.642616 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a36ac-47f9-49d7-b441-b0b48e49b329 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.643457 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a36ac-47f9-49d7-b441-b0b48e49b329 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.643845 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a36ac-47f9-49d7-b441-b0b48e49b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.679902 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-f55a36ac-47f9-49d7-b441-b0b48e49b329 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:33:59.683092 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-f55a36ac-47f9-49d7-b441-b0b48e49b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:59.815515 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4466/8937] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:33:59.833391 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:33:59.836360 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:33:59.959480 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae9201-d428-40b7-a042-1fb07fbf0492 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:33:59.965981 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:33:59.967110 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:33:59.967730 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:33:59.968227 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:33:59.986200 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:33:59.988862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:00.006598 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4472/8938] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:08.784804 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:08.786095 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:08.786582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:08.846333 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] MFA Rules not processed for user `570063e6ff0b4ef383149d832a7768c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:34:08.848802 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:08.999241 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4467/8939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:34:09.006256 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:09.024969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f8ec8-16d9-4d6f-95c4-edaa396de813 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:09.034340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:09.035828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:09.036340 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:09.036817 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:09.038145 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:09.042502 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:09.158585 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4473/8940] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:34:09 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:34:09.163678 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:09.185653 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805488-1e62-4fea-9b62-177e3ceb4bfe None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:09.249680 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:09.315511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:09.317022 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:09.317745 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:09.318218 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:09.319460 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:09.323606 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:09.600927 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4468/8941] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:34:09 2022] POST /identity/v3/users => generated 292 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:34:09.607927 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:09.627245 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86275375-5396-41fa-a384-715a57d96d18 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:09.636417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:09.637619 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:09.638120 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:09.638624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:09.639889 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:09.643060 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:09.673652 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4474/8942] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:34:09.680513 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:09.702036 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae419f-346b-44cc-a5e6-6ea1aa6fc5dc admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:09.711442 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:09.712925 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:09.713985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:09.714484 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] PATH_INFO: `/v3/projects/9820fa9db69f467db2a6e7837484b3a1/users/b97d25976e864f318ab923848c4f0ed4/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:09.747635 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9820fa9db69f467db2a6e7837484b3a1, user_id=b97d25976e864f318ab923848c4f0ed4, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:09.753662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:09.863441 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4469/8943] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:34:09 2022] PUT /identity/v3/projects/9820fa9db69f467db2a6e7837484b3a1/users/b97d25976e864f318ab923848c4f0ed4/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:34:09.871412 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:09.892536 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1913-84a3-4030-8f0b-1dae68ccb2e4 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:09.930873 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:10.031415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:10.032451 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:10.032844 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:10.033585 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:10.034977 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:10.038199 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab559f9-debc-4326-9f2e-c78557009097 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:10.061727 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4475/8944] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:34:10.068461 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:10.093568 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f1827-4e37-401c-aaef-6a2cd6587ecf admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:10.101379 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:10.102861 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:10.103032 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:10.103326 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] PATH_INFO: `/v3/projects/9820fa9db69f467db2a6e7837484b3a1/users/b97d25976e864f318ab923848c4f0ed4/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:10.107111 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9820fa9db69f467db2a6e7837484b3a1, user_id=b97d25976e864f318ab923848c4f0ed4, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:10.112863 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:10.137858 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4470/8945] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:34:10 2022] PUT /identity/v3/projects/9820fa9db69f467db2a6e7837484b3a1/users/b97d25976e864f318ab923848c4f0ed4/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:34:20.055323 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=20 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:20.127777 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=30,keystone:INSERT=5 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:20.212745 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e499-1d5a-42cd-b12d-ab7aaa13ac41 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:20.213847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e499-1d5a-42cd-b12d-ab7aaa13ac41 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:20.214281 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e499-1d5a-42cd-b12d-ab7aaa13ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:20.266529 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-0128e499-1d5a-42cd-b12d-ab7aaa13ac41 None None] MFA Rules not processed for user `b97d25976e864f318ab923848c4f0ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:34:20.268089 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-0128e499-1d5a-42cd-b12d-ab7aaa13ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:20.405197 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4476/8946] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:34:20.432999 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:20.444395 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:20.573716 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1dcc-aa45-4f91-a73b-f6719d74c175 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:20.582789 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:20.583945 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:20.584428 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:20.584973 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:20.716270 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:20.720889 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:20.740748 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4471/8947] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:34:24.825420 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589152-6833-4119-b9e7-a20b8249dc79 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:24.826278 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589152-6833-4119-b9e7-a20b8249dc79 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:24.826580 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589152-6833-4119-b9e7-a20b8249dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:24.865770 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-a2589152-6833-4119-b9e7-a20b8249dc79 None None] MFA Rules not processed for user `570063e6ff0b4ef383149d832a7768c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:34:24.867906 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-a2589152-6833-4119-b9e7-a20b8249dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:24.885201 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4477/8948] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:34:24.949285 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:34:24.954608 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:25.092424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00a41c-038c-41de-b475-31bbb0c9ca29 service nova] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:34:25.100590 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '426a3d7b9b2248b6b22051224a4baa17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:34:25.101776 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:25.102544 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:25.104211 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:25.112799 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:25.136316 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:34:25.138195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48cdfd-d287-45b1-a3e8-09669751f193 service glance] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:34:25.156321 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4472/8949] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:34:25.631862 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:25.632378 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:25.632881 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-a1a9c2bb-b258-4544-b6fb-4f77a90da9d0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:34:25.646782 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:34:25.648120 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:34:25.649834 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4478/8950] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:34:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:34:30.487424 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:34:30.488275 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:34:30.488436 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:34:30.527200 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] MFA Rules not processed for user `570063e6ff0b4ef383149d832a7768c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:34:30.529504 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:34:30.543336 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4473/8951] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:34:34.854570 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=37 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:40.517794 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=92 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:04.473157 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:04.474137 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:04.474316 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:35:04.489027 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:35:04.490940 n-d-852085-12 devstack@keystone.service[82440]: ERROR keystone.server.flask.application Oct 04 21:35:04.493524 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4479/8952] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:35:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 04 21:35:18.277355 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:18.430829 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0d94e-5b0d-45c2-ace2-79abcb4c2864 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:18.439463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:18.440487 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:18.442180 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:18.442738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] PATH_INFO: `/v3/users/570063e6ff0b4ef383149d832a7768c0` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:18.445733 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570063e6ff0b4ef383149d832a7768c0)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:18.449631 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:18.680272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570063e6ff0b4ef383149d832a7768c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:18.815122 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570063e6ff0b4ef383149d832a7768c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:18.831661 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570063e6ff0b4ef383149d832a7768c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:18.859582 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570063e6ff0b4ef383149d832a7768c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:18.860879 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570063e6ff0b4ef383149d832a7768c0'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:18.872014 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4474/8953] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:35:18 2022] DELETE /identity/v3/users/570063e6ff0b4ef383149d832a7768c0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:19.308189 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:19.311485 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:19.494565 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b3c4-3db7-4baf-88e0-91cdf87982ba None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:19.503337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:19.504525 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:19.505035 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:19.505543 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] PATH_INFO: `/v3/projects/6a14a0b665fd4c4d98138e39f75314bc` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:19.508594 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a14a0b665fd4c4d98138e39f75314bc)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:19.512400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:19.780552 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a14a0b665fd4c4d98138e39f75314bc', 'request_id': 'req-f8313089-ea62-4a26-a33b-beeb2acbb776'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:19.866076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a14a0b665fd4c4d98138e39f75314bc', 'request_id': 'req-f8313089-ea62-4a26-a33b-beeb2acbb776'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:19.880274 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a14a0b665fd4c4d98138e39f75314bc', 'request_id': 'req-f8313089-ea62-4a26-a33b-beeb2acbb776'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:19.903908 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] The token cache is being invalidate because project 6a14a0b665fd4c4d98138e39f75314bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:35:19.904531 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:19.905898 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:19.908796 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4480/8954] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:35:19 2022] DELETE /identity/v3/projects/6a14a0b665fd4c4d98138e39f75314bc => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:19.916662 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:19.971193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ccd80-3c74-48ae-8e3a-a2ae35893c46 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:20.084693 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:20.097491 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:20.098758 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:20.099338 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:20.099855 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] PATH_INFO: `/v3/users/b97d25976e864f318ab923848c4f0ed4` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:20.102770 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97d25976e864f318ab923848c4f0ed4)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:20.106644 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:20.357875 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97d25976e864f318ab923848c4f0ed4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:20.512231 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97d25976e864f318ab923848c4f0ed4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:20.528887 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97d25976e864f318ab923848c4f0ed4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:20.556535 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97d25976e864f318ab923848c4f0ed4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:20.557916 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-9d12aae2-b4f6-4f26-b211-8801462bef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97d25976e864f318ab923848c4f0ed4'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:20.569710 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4475/8955] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:35:19 2022] DELETE /identity/v3/users/b97d25976e864f318ab923848c4f0ed4 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:21.016875 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:21.019993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:21.090618 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313089-ea62-4a26-a33b-beeb2acbb776 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:21.192085 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:21.209006 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:21.209955 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:21.210366 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:21.210766 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] PATH_INFO: `/v3/projects/9820fa9db69f467db2a6e7837484b3a1` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:21.212949 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9820fa9db69f467db2a6e7837484b3a1)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:21.216183 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:21.420569 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9820fa9db69f467db2a6e7837484b3a1', 'request_id': 'req-46751a32-34e2-43b3-a53d-73363ee86c2a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:21.580392 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9820fa9db69f467db2a6e7837484b3a1', 'request_id': 'req-46751a32-34e2-43b3-a53d-73363ee86c2a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:21.596147 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9820fa9db69f467db2a6e7837484b3a1', 'request_id': 'req-46751a32-34e2-43b3-a53d-73363ee86c2a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:21.629336 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] The token cache is being invalidate because project 9820fa9db69f467db2a6e7837484b3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:35:21.629859 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:21.631065 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-46751a32-34e2-43b3-a53d-73363ee86c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:35:21.633815 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4481/8956] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:35:21 2022] DELETE /identity/v3/projects/9820fa9db69f467db2a6e7837484b3a1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:21.642486 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:21.646258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:21.646258 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:21.682909 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:21.685193 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:21.815407 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4476/8957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:35:21.830242 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:21.830814 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:21.831259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:21.871796 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:21.874136 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:21.889230 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4482/8958] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:35:21.896227 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:21.916272 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78503abb-1af7-4821-a285-715892cf01b0 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:21.924860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:21.925939 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:21.926429 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:21.927078 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:21.928159 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 21:35:21.928463 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:21.931719 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:21.955780 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4477/8959] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 4 21:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 21:35:21.963458 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:21.980399 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e338a4-e4af-4fc2-8ae2-f4a54409eb53 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:21.988847 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:21.989764 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:21.990211 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:21.990658 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:21.991903 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:21.995260 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:22.114290 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4483/8960] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:35:21 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:35:22.120540 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:22.138376 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee6e7-b25f-4802-9f76-e07b3c2d87c6 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:22.244133 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:22.245360 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.245860 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.246362 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.247665 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:22.251780 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:22.268118 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:22.396746 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4478/8961] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:35:22 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:35:22.403292 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:22.419937 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df0987-03a7-4c27-ac14-8b7e4500e8f2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:22.427732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:22.427732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.427732 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.428384 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.428743 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:22.430785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:22.445525 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4484/8962] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:35:22.450983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:22.470184 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721b8c-172f-42ad-a22a-4ddb24f69732 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:22.478778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:22.479907 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.480372 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.480702 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] PATH_INFO: `/v3/roles` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.481520 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:22.483679 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1538-0ade-4f22-8079-67f69c38f665 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:22.504993 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4479/8963] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:35:22.512300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:22.531057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dc123-b44f-4c8e-bcb0-558da287a455 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:22.540761 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:22.541920 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] REQUEST_METHOD: `PUT` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.542423 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.542925 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] PATH_INFO: `/v3/projects/ff8c73de4bee4a1a86546a72ba04b0f4/users/55e9386df0044a1eb9651d4a46570fa8/roles/85251621622246e79e839f870f6d411d` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.574586 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8c73de4bee4a1a86546a72ba04b0f4, user_id=55e9386df0044a1eb9651d4a46570fa8, role_id=85251621622246e79e839f870f6d411d)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:22.580664 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:22.659803 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4485/8964] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:35:22 2022] PUT /identity/v3/projects/ff8c73de4bee4a1a86546a72ba04b0f4/users/55e9386df0044a1eb9651d4a46570fa8/roles/85251621622246e79e839f870f6d411d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:22.668559 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2e6d9-0359-4b17-b1b6-55e450811b88 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.669385 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2e6d9-0359-4b17-b1b6-55e450811b88 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.669552 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2e6d9-0359-4b17-b1b6-55e450811b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.704374 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-4cb2e6d9-0359-4b17-b1b6-55e450811b88 None None] MFA Rules not processed for user `555d4df795a04beda46e1d2e3837f96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:22.705929 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-4cb2e6d9-0359-4b17-b1b6-55e450811b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:22.805718 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4480/8965] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:35:22.817290 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:22.819801 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:22.956643 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4e61-ed8d-41b2-af0f-172b17dc1618 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:22.964828 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67b4e16c695421890649a036fada64c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:22.965916 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:22.966712 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:22.967087 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:22.986308 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:22.989265 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:23.010092 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4486/8966] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:35:32.257345 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:32.258195 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:32.258342 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:32.302476 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] MFA Rules not processed for user `55e9386df0044a1eb9651d4a46570fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:32.305197 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:32.441881 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4481/8967] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:35:32.449417 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:32.462505 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a23-d98a-4592-87d2-12b59c108789 service neutron] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:32.470790 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:32.471346 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:32.471710 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:32.472186 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:32.473134 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:32.475777 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:32.481934 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:32.591400 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4487/8968] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 4 21:35:32 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:35:32.593912 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:32.620016 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519550f3-1023-4eb4-91fe-029e58fb5111 None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:32.774790 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:32.775993 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:32.776492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:32.776980 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] PATH_INFO: `/v3/users` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:32.778257 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:32.782208 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:32.880650 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:32.892373 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4482/8969] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 4 21:35:32 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 21:35:32.904689 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:32.926854 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307e6e-b6c9-4b23-a41c-e685945e6b8d admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:32.943400 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:32.943856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:32.944587 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:32.945064 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:32.946576 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:32.950220 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:32.980984 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4488/8970] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:35:32.988612 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:33.008659 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ed82-fe29-4686-97a1-2880a5a9b43f admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:33.017450 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:33.018700 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:33.019236 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:33.019731 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] PATH_INFO: `/v3/projects/4f3c10f3d10d482598605343174a91bd/users/cb9181b86f8d4a89ace5ba31816a607e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:33.045642 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3c10f3d10d482598605343174a91bd, user_id=cb9181b86f8d4a89ace5ba31816a607e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:33.049757 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:33.175064 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4483/8971] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:35:32 2022] PUT /identity/v3/projects/4f3c10f3d10d482598605343174a91bd/users/cb9181b86f8d4a89ace5ba31816a607e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:35:33.182467 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:33.205699 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd9368-6c0b-48e4-adf5-1d62f343e4b2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:33.306113 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:33.307240 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:33.307669 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:33.308128 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] PATH_INFO: `/v3/roles` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:33.309252 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:33.312270 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c30310-3482-47c9-90c6-c182badb0527 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:33.327587 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4489/8972] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 4 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 21:35:33.333868 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:33.347073 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94ec7e-bb52-4e1d-8851-210e1c2e717b admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:33.353734 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:33.354511 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:33.354840 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:33.355233 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] PATH_INFO: `/v3/projects/4f3c10f3d10d482598605343174a91bd/users/cb9181b86f8d4a89ace5ba31816a607e/roles/752f2c38dc7242cca4d4703d29369911` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:33.357880 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3c10f3d10d482598605343174a91bd, user_id=cb9181b86f8d4a89ace5ba31816a607e, role_id=752f2c38dc7242cca4d4703d29369911)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:33.361751 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:33.381456 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4484/8973] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 4 21:35:33 2022] PUT /identity/v3/projects/4f3c10f3d10d482598605343174a91bd/users/cb9181b86f8d4a89ace5ba31816a607e/roles/752f2c38dc7242cca4d4703d29369911 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:35:43.321161 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:43.374492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=15,keystone:INSERT=2 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:43.560069 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481021a3-a5a3-4399-8855-3b384366b6d3 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:43.560535 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481021a3-a5a3-4399-8855-3b384366b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:43.560959 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481021a3-a5a3-4399-8855-3b384366b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:43.620514 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-481021a3-a5a3-4399-8855-3b384366b6d3 None None] MFA Rules not processed for user `cb9181b86f8d4a89ace5ba31816a607e`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:43.622860 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-481021a3-a5a3-4399-8855-3b384366b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:43.763110 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4490/8974] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:35:43.788492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:43.791084 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:43.960713 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd7ab-af30-4f2a-969d-6c7d04c5c6ec admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:43.972052 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e5fa628b98463594d6066befb76468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:43.972959 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:43.973248 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:43.973528 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:44.064926 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:44.068134 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e01d7-44c2-4c06-92eb-a3f929b27a4d service nova] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:44.083602 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4485/8975] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:35:48.277475 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] REQUEST_METHOD: `POST` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:48.278353 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:48.278538 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:48.307837 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.auth.core [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] MFA Rules not processed for user `55e9386df0044a1eb9651d4a46570fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:35:48.309785 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:48.322621 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4491/8976] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 4 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 21:35:48.912634 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1816f0-83e2-4070-8ca2-24dd8c457e17 None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:48.921703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1816f0-83e2-4070-8ca2-24dd8c457e17 None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:48.921703 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1816f0-83e2-4070-8ca2-24dd8c457e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application [None req-7b1816f0-83e2-4070-8ca2-24dd8c457e17 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 21:35:48.929165 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 04 21:35:48.931289 n-d-852085-12 devstack@keystone.service[82439]: ERROR keystone.server.flask.application Oct 04 21:35:48.933249 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4486/8977] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 4 21:35:48 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 04 21:35:54.077983 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=61 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:56.120436 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:35:56.123204 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:56.280300 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f977774-39cd-4edb-bed4-417cac9a7cb9 None None] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:35:56.289843 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:35:56.290987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:35:56.291622 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:35:56.291987 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:35:56.295435 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:35:56.321439 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:35:56.337173 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:35:56.344236 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4492/8978] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:35:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:36:05.167075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] REQUEST_METHOD: `POST` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:05.167075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:05.167075 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:05.275526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.auth.core [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] MFA Rules not processed for user `618992172e2c4fc89d9f0be304dfe510`. Rule list: `[]` (Enabled: `True`). {{(pid=82439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 21:36:05.277822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:36:05.296124 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4487/8979] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 4 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 21:36:05.316757 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:05.336421 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0bd1b-dae7-48b3-81fd-41afa334ca72 service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:05.346169 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:05.347277 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:05.347807 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:05.348259 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:05.365985 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:05.369839 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:05.397723 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4493/8980] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:36:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:36:05.416157 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:05.581336 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8f5a1-e114-44c8-b5ba-c051a8b618ed None None] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:05.590621 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:05.591822 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:05.592334 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:05.592781 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] PATH_INFO: `/v3/users/55e9386df0044a1eb9651d4a46570fa8` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:05.594787 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e9386df0044a1eb9651d4a46570fa8)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:05.598738 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:05.958660 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e9386df0044a1eb9651d4a46570fa8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:06.077021 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e9386df0044a1eb9651d4a46570fa8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:06.092981 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e9386df0044a1eb9651d4a46570fa8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:06.120439 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e9386df0044a1eb9651d4a46570fa8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:06.121649 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e9386df0044a1eb9651d4a46570fa8'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:06.134478 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4488/8981] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:36:05 2022] DELETE /identity/v3/users/55e9386df0044a1eb9651d4a46570fa8 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:36:06.595318 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:06.616023 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00c32-2c31-46c6-b127-5b68e2a32fcb service placement] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:06.733577 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=100 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:06.746965 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:06.755540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:06.755540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:06.755540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] PATH_INFO: `/v3/projects/ff8c73de4bee4a1a86546a72ba04b0f4` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:06.755540 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8c73de4bee4a1a86546a72ba04b0f4)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:06.757356 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:06.944377 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8c73de4bee4a1a86546a72ba04b0f4', 'request_id': 'req-dac5f809-2d9f-4391-b7c3-2252504b8c9a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.116993 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8c73de4bee4a1a86546a72ba04b0f4', 'request_id': 'req-dac5f809-2d9f-4391-b7c3-2252504b8c9a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.132871 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8c73de4bee4a1a86546a72ba04b0f4', 'request_id': 'req-dac5f809-2d9f-4391-b7c3-2252504b8c9a'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.158076 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] The token cache is being invalidate because project ff8c73de4bee4a1a86546a72ba04b0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:36:07.158617 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.159969 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.162789 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4494/8982] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:36:06 2022] DELETE /identity/v3/projects/ff8c73de4bee4a1a86546a72ba04b0f4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:36:07.170264 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:07.172893 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:36:07.205778 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2436b8-592a-4f31-b492-a3a330de0219 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:07.299668 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:07.333573 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:07.334717 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:07.335444 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:07.335968 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] PATH_INFO: `/v3/users/cb9181b86f8d4a89ace5ba31816a607e` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:07.338356 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9181b86f8d4a89ace5ba31816a607e)` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:07.342730 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:07.685992 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9181b86f8d4a89ace5ba31816a607e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.831465 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9181b86f8d4a89ace5ba31816a607e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.853071 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9181b86f8d4a89ace5ba31816a607e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.880810 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9181b86f8d4a89ace5ba31816a607e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.882030 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.notifications [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9181b86f8d4a89ace5ba31816a607e'} {{(pid=82439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:07.894280 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4489/8983] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 4 21:36:07 2022] DELETE /identity/v3/users/cb9181b86f8d4a89ace5ba31816a607e => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 21:36:08.399490 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:08.403027 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:36:08.430337 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f809-2d9f-4391-b7c3-2252504b8c9a admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:08.556701 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555d4df795a04beda46e1d2e3837f96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39207e776fb342b89ba6688e4c9f0eb3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:08.557856 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:08.558364 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:08.558877 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] PATH_INFO: `/v3/projects/4f3c10f3d10d482598605343174a91bd` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:08.561333 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3c10f3d10d482598605343174a91bd)` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:08.565404 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:08.733002 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3c10f3d10d482598605343174a91bd', 'request_id': 'req-60e06210-5bb9-446a-ad5d-ded53215ead2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:08.842057 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3c10f3d10d482598605343174a91bd', 'request_id': 'req-60e06210-5bb9-446a-ad5d-ded53215ead2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:08.856878 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3c10f3d10d482598605343174a91bd', 'request_id': 'req-60e06210-5bb9-446a-ad5d-ded53215ead2'} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:08.879992 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] The token cache is being invalidate because project 4f3c10f3d10d482598605343174a91bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 21:36:08.880610 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:08.881788 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.notifications [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 21:36:08.884367 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4495/8984] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 4 21:36:08 2022] DELETE /identity/v3/projects/4f3c10f3d10d482598605343174a91bd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 21:36:17.886919 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:18.874415 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:48.797501 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:36:48.799809 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:36:48.942443 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dc3c-0c4e-4637-9ef8-6348ad472b33 admin admin] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:36:49.053543 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:36:49.054212 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:36:49.054492 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:36:49.054774 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:36:49.057023 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.fernet_utils [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:36:49.071431 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:36:49.073526 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:36:49.087764 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4490/8985] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 21:36:59.081527 n-d-852085-12 devstack@keystone.service[82439]: DEBUG dbcounter [-] [82439] Writing DB stats keystone:SELECT=58 {{(pid=82439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:41.034592 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Authenticating user token {{(pid=82440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:37:41.036956 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:37:41.064953 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06210-5bb9-446a-ad5d-ded53215ead2 admin admin] Validating token access rules against request {{(pid=82440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:37:41.074483 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:37:41.075624 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] REQUEST_METHOD: `GET` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:37:41.076118 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] SCRIPT_NAME: `/identity` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:37:41.076620 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:37:41.080079 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.fernet_utils [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 21:37:41.103718 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:37:41.106786 n-d-852085-12 devstack@keystone.service[82440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602a84b-8e28-458b-8327-a28445ce7fa6 service placement] RBAC: Authorization granted {{(pid=82440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:37:41.128889 n-d-852085-12 devstack@keystone.service[82440]: [pid: 82440|app: 0|req: 4496/8986] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 21:37:51.119476 n-d-852085-12 devstack@keystone.service[82440]: DEBUG dbcounter [-] [82440] Writing DB stats keystone:SELECT=6 {{(pid=82440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:54.811985 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] Authenticating user token {{(pid=82439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 21:41:54.839699 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35cc42-f6a2-4bfe-bf6b-25fa1a1e096a service placement] Validating token access rules against request {{(pid=82439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 21:41:54.846838 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '618992172e2c4fc89d9f0be304dfe510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e548a82d7ba413bb8f774858cfcd2b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 21:41:54.847771 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] REQUEST_METHOD: `GET` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 21:41:54.848125 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] SCRIPT_NAME: `/identity` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 21:41:54.848572 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 21:41:54.860938 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 21:41:54.862951 n-d-852085-12 devstack@keystone.service[82439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f8448-ed4e-4066-8c50-cf0c1e60aee0 service placement] RBAC: Authorization granted {{(pid=82439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 21:41:54.877129 n-d-852085-12 devstack@keystone.service[82439]: [pid: 82439|app: 0|req: 4491/8987] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 4 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)